[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog  Archive

Name
Email
Subject
REC
STOP
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options

Allowed file types:jpg, jpeg, gif, png, webp,webm, mp4, mov, swf, pdf
Max filesize is16 MB.
Max image dimensions are15000 x15000.
You may upload5 per post.


This board will be deleted next Wednesday. I am moving to a General on 8chan.moe /t/. This board is archived at 8chan.moe /hydrus/!

YouTube embed. Click thumbnail to play.

46605e No.14743 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v412.tar.gz

I had a great week catching up on smaller jobs, improving search speeds, and adding a 'lite' 407->408 update mode for HDD users who sync with the PTR. There are also a couple of new applications for the Client API.

Update this week will take a few seconds to a few minutes as new database indices are created.

sibling and search speeds

Thanks to feedback from some PTR-syncing HDD users, the new siblings update code, most importantly in step 407->408, takes way too long for them - perhaps more than 24 hours. I have written a little yes/no dialog popup into the update step that talks about this and optionally activates a 'lite' mode that does not apply siblings. This still requires some Post too long. Click here to view the full text.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

69fa4c No.14744

As always, thanks for the update.

It seems to have some problem though. On the Linux version, I'm getting this error for the url downloader, for apparently any website I try:

TypeError

PendURLs() got an unexpected keyword argument 'filterable_tags'

File "hydrus/hydrus/client/gui/ClientGUICommon.py", line 1794, in eventFilter

File "hydrus/hydrus/core/HydrusData.py", line 1542, in call

File "hydrus/hydrus/client/gui/ClientGUIControls.py", line 732, in EnterText

File "hydrus/hydrus/client/gui/ClientGUIManagement.py", line 3780, in _PendURLs

Also I think hydrus companion doesn't work alright, but I haven't found a good error to copy for that yet.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8088cd No.14752

>>14744

Hey, I am sorry for the trouble. I messed something up here at the last minute last week and I did not catch it in testing. Top priority this week is to write a better test suite for the downloader pages and the client api so this does not happen again.

I have made a new hotfix today and replaced the files the download links above point to. Please download again and let me know if you have any more trouble.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

69fa4c No.14757

File: 22c5cc7c2d343a6⋯.jpg (322.32 KB,1400x1376,175:172,22c5cc7c2d343a6700e71154b8….jpg)

>>14752

That fixed it. Thanks for the effort!

> Top priority this week is to write a better test suite for the downloader pages and the client api so this does not happen again.

Sounds like a great idea.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8088cd No.14762

I had an ok week. I mostly fixed bugs, aiming for a nice 'clean' release before I go for the parents database cache.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

f9a318 No.14714 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v411.tar.gz

I had a good week. The siblings work is complete.

siblings

The last areas that used the old siblings systems are now migrated to the new fast cache. The 'loading tag siblings' step of client boot, which for PTR users could be several seconds of work, is no longer needed!

These last parts are all user-facing UI code. Mostly tag autocomplete behaviour and the 'will display as' labels you see in tag edit contexts. Everything now goes through the database, and all in a nice asynchronous way, so (fingers crossed) it will not add noticeable lag.

As I unified code here and moved to nicer logic, I was able to clean up some behaviour. Matching siblings baPost too long. Click here to view the full text.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4c6717 No.14738

I had a great week. I was able to catch up on smaller work, optimised a variety of db functions, including the new sometimes-slow tag and wildcard queries, and added a 'lite' mode for the big 407->408 update so PTR-syncing users on HDDs can update in less time.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2cac8d No.14741

Just updated from v374, I made a backup just in case but it went smoothly. Thanks dev!

Also finally polished off the last of my duplicates just before the update, my high watermark was in the high 70ks, so I think I sorted out at least 200k duplicates overall since whenever I started using Hydrus, probably late 2015 or sometime 2016?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4c6717 No.14742

>>14741

That is pretty killer mate, well done. I am confident a big update to dupes is coming in 2021, including filter workflow and beginning of filter automation, so if you have thougthts on the current system's strengths and weaknesses, I would be really interested to know.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2cac8d No.14749

>>14742

I went over 8k characters and notepad++ doesn't count spaces but 8ch does, so rather than try and figure out where to split it I just pastebinned

https://pastebin.com/mBZLa7tk

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: b28babaa13b7dbf⋯.png (765.02 KB,1278x720,71:40,b28babaa13b7dbfb92d271ee0a….png)

2f807c No.12641 [Open thread][Last50 Posts]

Here you can ask questions so that the board is not clogged with small threads.

Old thread >>9327

746 posts and 114 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2 No.14726

>>14700

Do you have help->advanced mode turned on? I think I hide some of those clever commands behind that.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2 No.14727

>>14702

Ah, do you mean for 'export folders'? I experimented with this with manual export (I think you need help->advanced mode turned on), and I did have a plan to try this out for export folders. I'll bump this up and take a proper look.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2 No.14728

>>14703

It is not a pipe dream, but it is such a big job that it'll have to win a 'big job' poll. I expect to get through three or four big jobs a year once I am back to normal schedule, and the next poll should be up by Christmas. Let's see how it does there, and we'll see when we can expect it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2 No.14729

>>14709

>>14712

>>14713

I plan to have nice support for traditional zip/cbz/cbr files in future. It is sufficiently popular that I expect it to win a 'big job' poll pretty soon. I'll have proper thumbs, browsing of internal pages, and support for conversion back and forth between individual files and compiled 'chapters' or 'volumes' or whatever. This will be a part of my attempt to solve the problem of handling awkward 'page' tags.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2 No.14730

>>14715

>>14721

Thank you for this information. I will attempt to detect WAL and networking gubbins in future. I generally do not recommend running the db itself across a network share due to latency issues, but I hope I can at least detect the situation and throw up a warning, and ideally recover and set WAL off.

NEW THREAD

>>14731

>>14731

>>14731

>>14731

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
Post last edited at



File: 5734ceedfcc53a4⋯.png (219.04 KB,373x323,373:323,Tzs0oi5.png)

51fa6a No.10443 [Open thread]

Make my day showing me your boners, lads.

I hope i'm not a degenerate by this board's standards.

19 posts and 17 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fbd825 No.12879

>>12874

You dont. You just hope that the techno-jew doesnt care about whatever it is you're hoarding.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

1b4a70 No.12892

>>12872

>60 bucks per year

It's not expensive, but it's still 60 dollars more than my current backup expenses.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

51fa6a No.12898

>>12874

I don't give a fuck that some NSA employee can look at my patreon content.

>>12872

I like knowing that all my kino tiddies are saved somewhere in Buttfuc, Tennessee.

It's 3h of my job for a year of peace of mind.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

1b4a70 No.12908

File: 57e2c6b71dc3d74⋯.png (225.39 KB,376x394,188:197,ClipboardImage.png)

Finally reached 7% in regards to filesize by sorting the bigger files first.

There's still shit to import, but freeing 20GB up is pretty nice.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8de9b4 No.14717

File: ac4be9f8729f6b6⋯.png (479.1 KB,559x790,559:790,Bone.png)

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

cda3a0 No.14699 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v410/Hydrus.Network.410.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v410/Hydrus.Network.410.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v410/Hydrus.Network.410.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v410/Hydrus.Network.410.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v410.tar.gz

I had an ok week. I wasn't as productive as I hoped, but I am happy with the mostly optimisation work.

optimisations

After some more profiling in IRL situations, and with more helpful info from users, I have done another round of profiling for the new sibling cache, and more besides. A database technique I use for many purposes is now more reliable (fewer lag spikes), and has less CPU overhead. If you found some systems (like the 'related tags' suggestions in manage tags dialog) sometimes took a few seconds to work in the past couple of weeks, they should now be fast again. And you should find many types of file search, particularly those with multiple search predicates, and general tag processing, should be faster than before.

Post too long. Click here to view the full text.
____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0e34a8 No.14706

>>14699

Got an error when trying to search by time imported

DBException
OperationalError: no such column: timestamp
Traceback (most recent call last):
File "hydrus\core\HydrusThreading.py", line 382, in run
callable( *args, **kwargs )
File "hydrus\client\gui\ClientGUIManagement.py", line 4932, in THREADDoQuery
query_hash_ids = controller.Read( 'file_query_ids', search_context, job_key = query_job_key, limit_sort_by = sort_by )
File "hydrus\core\HydrusController.py", line 615, in Read
return self._Read( action, *args, **kwargs )
File "hydrus\core\HydrusController.py", line 194, in _Read
result = self.db.Read( action, *args, **kwargs )
File "hydrus\core\HydrusDB.py", line 1028, in Read
return job.GetResult()
File "hydrus\core\HydrusData.py", line 1755, in GetResult
raise e
hydrus.core.HydrusExceptions.DBException: OperationalError: no such column: timestamp
Database Traceback (most recent call last):
File "hydrus\core\HydrusDB.py", line 629, in _ProcessJob
result = self._Read( action, *args, **kwargs )
File "hydrus\client\ClientDB.py", line 12868, in _Read
elif action == 'file_query_ids': result = self._GetHashIdsFromQuery( *args, **kwargs )
File "hydrus\client\ClientDB.py", line 7215, in _GetHashIdsFromQuery
files_info_hash_ids = self._STI( self._c.execute( select ) )
sqlite3.OperationalError: no such column: timestamp


Database Traceback (most recent call last):
File "hydrus\core\HydrusDB.py", line 629, in _ProcessJob
result = self._Read( action, *args, **kwargs )
File "hydrus\client\ClientDB.py", line 12868, in _Read
elif action == 'file_query_ids': result = self._GetHashIdsFromQuery( *args, **kwargs )
File "hydrus\client\ClientDB.py", line 7215, in _GetHashIdsFromQuery
files_in
Post too long. Click here to view the full text.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6b5b94 No.14707

Hey dev, I'm having some trouble with the Twitter subscriptions. I just tried to set one up and it says to put in the username but whether I put the handle in with or without an @ it always says this subscription appears to be dead when it tries to update. I've tried this with multiple different accounts. Any idea what could be causing that?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ef2013 No.14708

I had a good week. I fixed some recent search bugs and I capped off the new siblings work. Everything siblings is now running off the new cache, so the slow 'loading tag siblings' step of boot no longer occurs!

The release should be as normal tomorrow.

>>14706

Thank you for this report, I am sorry for the trouble. I believe this happens when the 'time imported' search is mixed with certain other search predicates, either tags or some more unusual system preds. It should be fixed tomorrow, but let me know if you have any more issues.

>>14707

I am not sure. This is on the new nitter downloader? Can you give an example username, so I can try my end?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0e34a8 No.14711

>>14707

are you using "nitter media lookup"? I have my subs for media and retweets split up so the "media and retweets" one might not have worked.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

110ffa No.14669 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v409/Hydrus.Network.409.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v409/Hydrus.Network.409.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v409/Hydrus.Network.409.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v409/Hydrus.Network.409.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v409.tar.gz

I had a great week fixing some bugs and optimising the new tag siblings cache. The new code works much faster now.

siblings

I am very happy that there do not seem to have been any obvious errors with the new sibling database cache. Unfortunately, a couple of areas were working inefficiently, which IRL testing helped to diagnose. I put a lot of time into this this week and was very successful - some sections take 10% less time, some 90%, and one critical query now takes 99% less time. It depends on many factors, but many things are faster overall. In particular, tag processing speed, which took a real hit, is back up to good speed, and setting new tag sibling application rules now only needs to regenerate for changed siblings, so if you add (or remove) your Post too long. Click here to view the full text.

3 posts omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8d94cb No.14692

Currently updating many more versions at once than recommended. 384 to 407 went really fast, but not it's taking forever on "generating combined tag display cache 2/2". After about half an hour it now reached 56/41,805, so will probably take about 17.4 days at this pace. DB is on a NAS using HDDs, while Hydrus is set to use a 2 GB DB cache. Can I expect it to speed up, or should I revert to my 384 backup and only update to version 407 for now?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

110ffa No.14696

>>14687

I believe you can force the App to look to a new location with this:

open -n -a "Hydrus Network.app" --args -d="/path/to/db"

Basically you are doing the same -d parameter, but you have to do it slightly odd for the App. More general info here:

https://hydrusnetwork.github.io/hydrus/help/database_migration.html

Worth doing a test on an empty location to make sure it works before doing the real thing, and always have a backup.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

110ffa No.14697

>>14692

That 408 update >>14654 involved a lot a big db work, I am afraid. It should accelerate, as the early numbers are the heavy ones, but it may just not be feasible on an HDD, especially in a high latency situation. The PTR is mostly SSD-only now.

If it is still chugging along, you should be able to cancel and just install 406. In tomorrow's release, the code that does this works faster. The speed-up will be retroactive to that update step, if you want to try again with v410.

If you have not cancelled it already, and it has accelerated, it is probably worth just letting it finish. That combined part, though heavy, should be the last step.

There will be another heavy update for v412, but not as big.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

110ffa No.14698

I had an ok week. I wasn't as productive as I hoped, but I fixed some bugs and made great progress in optimising the new sibling code, and older code too. The various lag spikes in systems like 'related tags' should be smoothed out, many file searches are snappier, and tag processing should be faster than it was in v407.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

854cd8 No.14705

>>14696

Circling back this worked perfectly. Using absolute paths it was easy enough to create a quick batch file and chmod it +x.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

8654cc No.14620 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v407/Hydrus.Network.407.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v407/Hydrus.Network.407.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v407/Hydrus.Network.407.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v407/Hydrus.Network.407.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v407.tar.gz

I had an ok week. I did some prep work for siblings, and fixed some bugs.

misc

The right-click menu off a normal taglist now provides a whole bunch of different copy options, depending on whether you want all or selected, tags or subtags, and with or without counts.

I fixed a bunch of weird hover window issues in the media viewer. On a thin media viewer, the top-right window now squeezes into the smaller space better, and if it can't fit, it bumps down so you can still use it. The center-right duplicates window also positions correct on a thin window. And now moving your mouse off a clicked hover window will immediately restore focus to the main media window, which should eliminate some annoying click focuPost too long. Click here to view the full text.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8654cc No.14633

Hey, I messed up the siblings dialog in 407, it won't ok correctly. I'll fix it all up in the bigger siblings work in 408.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

43e5e4 No.14641

>I fixed a bunch of weird hover window issues in the media viewer

This caused an annoying bug. When you have the manage tags window open in the media viewer, and you move the mouse pointer outside its window it loses focus and that then makes the left tag list pop up over it when you move the mouse pointer back over the window. Quite annoying.

Previous workflow would be having the tag window in focus all the time and with the mouse over media viewer use scroll wheel to go previous/next image. Can't do it now because the tag window loses focus so I have to click on it again to edit the tags but then the annoying tag list covers it when I try to click it. Please restore previous behavior.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8654cc No.14646

I had a good week getting into the meat of the tag siblings database work. There is a lot to do, but I have a plan I am happy with, it is going well, and I am confident I will have a good first version ready for next week, Wednesday the 19th.

So, no release tomorrow!

>>14641

Thank you for this report. It is driving me nuts as well, I know what is going on and will fix it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2e92dc No.14653

I had a great couple of weeks moving tag siblings forward. The client now handles siblings more quickly and accurately using a new database cache. They are easier to undo going forward, and you can also choose where siblings apply on a per-service basis (e.g. turning off the PTR's default siblings and using your own instead).

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

07510e No.14670

File: 7c0fa834d670640⋯.jpg (1.47 MB,4115x5836,4115:5836,7c0fa834d67064051f2b8d9fb0….jpg)

Hey dev, did something changed about the client API system? I can't use Hydrus-Companion right now and getting this message when starting Hydrus:

>Twited failed to import, so could not start the local booru/client api!

I'm running from the source.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

317ffb No.14654 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v408/Hydrus.Network.408.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v408/Hydrus.Network.408.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v408/Hydrus.Network.408.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v408/Hydrus.Network.408.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v408.tar.gz

I had a great couple of weeks moving tag siblings forward. The update this week will take some time as a new cache is generated. On an SSD with the PTR synced, about 10 to 20 minutes, depending on how many files you have. Some of the new tag sibling application rules may have 5-10 minute delays on edit as well. If you have a large/PTR client and are on an HDD, or you would rather just wait for the kinks to be ironed out, you might like to wait a week or two for me to further optimise this new code.

siblings

tl;dr: Siblings are faster and better now, you don't have to do anything. Some parents will not appear with new downloads - don't worry about it, they will all fill back in nicely soon.

Post too long. Click here to view the full text.
____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5c8e42 No.14666

I had a great week fixing some bugs and making the slowest parts of the new sibling cache code work much faster and more efficiently. The lag that was introduced last week should be reduced, I hope, by about 4-10 times, making it much less noticeable. The UI feedback on longer jobs is also improved.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: ccbc600bb546807⋯.png (799 KB,1089x612,121:68,group_f2861da0fd889d168bf9….png)

cf5ec8 No.14665 [Open thread]

I would like to set up a locally hosted booru for my (rather large) image collection. Having used hydrus before, I would like to use it in conjunction with hyve (https://github.com/imtbl/hyve) as a Web UI accessible by many devices, instead of relying on a danbooru instance, for example.

Some things that I'm thinking about are:

- I mostly use Docker images on a Debian-based headless system. hyve provides a Docker image for hydrus server to use so I think my plan will be to use the server version as host, use the client to manage the database, and use hyve's web UI to access the database on the Android devices which don't have the client.

- I'm not very knowledgeable so I'm mostly relying on using others prebuilt images.

- I'll probably want to test this out on a smaller imageset first as I'm well aware of how long it will take to set up a database of 50,000+ images.

I posted this here because I'm curious:

1. Does anyone else have a similar set-up to this and if they do, do they have any comments on how it's working?

2. Is there a better solution than hyve that would suit my purposes?

3. Would it make sense to find (or try to build) an up-to-date Docker image of the client to run on the host?

Thanks in advance for any replies, even if you just want to call me a fag.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

8da398 No.14597 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v406/Hydrus.Network.406.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v406/Hydrus.Network.406.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v406/Hydrus.Network.406.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v406/Hydrus.Network.406.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v406.tar.gz

I had a good week. It is now easy to deduplicate queries in subscriptions.

subscriptions

Managing multiple subscriptions can get complicated. Figuring out which queries are in which sub, whether and where you have duplicates, is tedious. A recent bug with query pasting also could have introduced some duplicates within the same sub. This week should make it simple to manage.

The main manage subscriptions dialog now has a 'deduplicate' button. It lights up any time your subs of a particular downloader have the same query, whether that includes dupes within the same sub or across different subs. Click it, and it launches a thorough process to determine what you want to do:

Post too long. Click here to view the full text.
____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

1dd9ca No.14600

>>14597

Got a small issue. For a few versions now, when the schedule maintenance on client exit is for vacuuming, it gives the "is now a good time for maintenance y/n?" dialog, but when I click "yes" the vacuum never actually runs. Client just exits as normal. All other maintenance seems to work, just the vacuums don't (external mappings, master, etc.)

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d82b71 No.14604

>>14600

Hmm, thank you for this report. I'll double-check how those tests work. Generally the issue here is that vacuums take a while, so it tries to go 'hey, the user doesn't want shutdown work to be longer than x minutes, can you do a vacuum in <=x?'. If the dialog's test is passing, but the test on the actual vacuum is failing, it'll quit out immediately, thinking there isn't enough time.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

1dd9ca No.14613

>>14604

I've still got it set to the default 30 minutes. My DB is fairly small, so usually the vacuums don't take longer than 10-15 minutes for the whole thing (maintenance -> vacuum)

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d82b71 No.14618

I had an ok week. Some of the work I did (siblings improvements) is not ready to be turned on yet, so tomorrow's release mostly just has bug fixes, including several related to the media viewer's hover windows positioning and behaviour.

The release should be as normal tomorrow.

>>14613

Hmm, thanks.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

24c888 No.14576 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v405/Hydrus.Network.405.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v405/Hydrus.Network.405.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v405/Hydrus.Network.405.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v405/Hydrus.Network.405.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v405.tar.gz

I had a good week. 'system:number of tags' now supports namespace filtering.

number of tags

The 'system:number of tags' predicate now lets you attach a namespace, so you can search for 'files with two character tags' or 'files with more than one creator', or any other combination you can think of. Also, all 'number of tags' queries have been optimised, and are now typically much faster, particularly when mixed with other tags. They are also quickly cancellable, so if you do enter a very slow one, it should respond fairly quickly if you hit the 'stop search' button that appears after a delay.

I updated a bunch of the database code here to support new types of search. With the namespace searching, you can enPost too long. Click here to view the full text.

2 posts omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

737633 No.14582

>>14577

At the moment, if you add 'series:metroid' to 'character:samus aran', then anything with samus will actually get the tag metroid added. This applies retroactively to existing files.

The problem with this is when some lad adds a bad sibling/parent/whatever that adds 'shadow the hedgehog' to every file with 'shadow'. Then that damn hedgehog appears all over the place, and undoing the operation is tricky. Same deal if they have some private, local tag parents that leak over onto the PTR or similar.

So, with virtual parents, the actual tag tables will not store 'metroid'. There will be a second, mirrored table that applies metroid to all the samus stuff, but it will be a 'virtual' tag, implied by the parent relationship but not actually on the tag service when you open up manage tags. It'll have some entry, a bit like how siblings say 'samus_aran (will display as character:samus aran)', just so you know it will show, but it won't be hard-baked.

Then, if the relationship is bad, or needs to be remapped or whatever, then the virtual tag table can be recalculated and the base tag store is not affected. Parents become nicely undoable.

This 'presentation' tag cache will be useful for pre-computing siblings as well (which are currently mostly virtual, but computed expensively on the fly), and some other things like tag filtering so I can hide all the 'title' tags if you want without spending CPU on it for every request. I can also search that pre-computed table efficiently, and reduce/eliminate the inaccurate (5-9) tag counts you sometimes see. It'll also allow cheap namespace-to-namespace siblings, so you can rename creator to artist or whatever.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

737633 No.14583

>>14581

That's an interesting thought. I enjoyed working on the local booru, but I never had time to make it nice. I don't think I'll work properly on it again, instead focusing on the client api so others can do it better.

I actually think what you would like here is sort of doable with the client api right now. That can query the current session, and all the files in each page. If you wanted to map it to a nice URL structure, you'd have to host your own web server that talked to the client api, and it would obviously be a bunch of work to implement this all, but doable.

The lads who are working on different front-end browsers for the client api are coming along, by the way. I expect to announce at least one in the next 4-8 weeks. Should be an Android APK or something, let's you search by tags and view thumbs/files and everything.

I expect to keep working on the client api every now and then to keep adding tools.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a8cee0 No.14591

Thank you based dev

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

737633 No.14595

I had a good week. Along with some simpler code cleanup, I fixed some bugs, added some quality of life, and made it easy to detect and remove duplicate subscription queries, even across different subscriptions.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

f012c7 No.14598

>>14583

I look forward to seeing what the community can do with the client API! The idea of an Android browser sounds great, and I already get a lot of use out of Hydrus Companion.

I think Flask could get pretty close to what I was thinking, since custom URL's can be added to specific app functions.

I'm a beginner when it comes to this stuff, but I think it could be fun to play with the API, especially if there are a few code samples floating around that I could learn from as well.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

f486ba No.14537 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v403/Hydrus.Network.403.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v403/Hydrus.Network.403.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v403/Hydrus.Network.403.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v403/Hydrus.Network.403.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v403.tar.gz

Despite losing a couple days to sickness, I had a great two weeks doing small jobs.

shortcuts

I reworked some of the behind the scenes of shortcut commands, most importantly cleaning up a bad decision I made when I first moved to the new system. There are about 120 'simple' commands in the system, and now all of them are defined in a neater way that allows me to change and expand things more easily in future.

Every shortcut now has a nicer 'label' when you select it in the edit shortcuts UI (and anywhere else the command is shown). Rather than the old 'focus_media_viewer', you'll get something like 'keyboard focus: to the media viewer'. Rating shortcuts will also display their service's rating as it undersPost too long. Click here to view the full text.

2 posts omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5df9c6 No.14544

>>14540

I have a master job to migrate the old wx-based colours in options->colours to Qt qss stylesheets, so everything is unified there, but I don't think I have power over the colour of the title bar. I think it is entirely OS-based, so I don't actually render any of it, nor have control over it other than basic flags like 'show a minimise button'.

I saw some other users talking about this recently. Under Win10 'personalize' options, where you set the colours, you can force the title bar to shade with your chosen colour with a checkbox, but it might be brash, and of course it is system wide, so it may look bad with your other programs.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5df9c6 No.14545

>>14543

Is this for launching a known url? I think if there are multiple urls, it opens a list asking you which one to open, right?

What would you like to be the option/discriminator here? I assume URL Class would be correct, so I could add an edit panel for the 'open known url' command that let you select like 'gelbooru file page', and it would target that.

If you mean to open the 'edit known urls' dialog, I think this is available under the 'media' shortcut set, called 'manage file urls'.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0a4cd0 No.14551

Thanks dev

We've made it to the Forbidden version and I've finally made it under 30k dupes

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a7e7c1 No.14552

I had a good, full week that was almost entirely focused on migrating all the multi-column lists in the program to a unified options system. All lists in the program now remember their columns' widths, and those that typically sort now also restore their last sort.

This is a neat change, and it means it will be easier to add column selection and rearrangement in future, but that's basically it for the week. If you aren't interested in columns, feel free to skip!

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

c86f68 No.14592

>>14545

Oh, I meant in the system tags, where you have to select "known url", then paste what you want into the field. It would be nice to have a shortcut to get to that field, or maybe the option to just search for URLs directly.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 63f74807f69788d⋯.png (5.5 KB,217x323,217:323,Screenshot_825_.png)

6dd46f No.14555 [Open thread]

But there are a few improvement suggestions I'd like to make, if that's ok? They're pretty small (except for the last one) but I have no idea how to code anything so maybe it's harder than I think… but regardless, here they are:

-It would be very convenient for editing tags if the selection for editing tags was not inside any arrow side menus. So if you right click, the option for "Edit Tags" would just be at the top of the menu, instead of having to hover over "Manage". The attached picture to this post will show my personal ideal right click menu.

-I have a LOT of alternate pictures. Instead of having to go through the right click menus to check if there are any alternates, could there be an icon that tells you whether a picture has alternates or not on the thumbnail? Similar to the Notes icon that was added not long ago.

-In addition to the previous one and like the first request, could the alternate grouping option be put in a more convenient spot in the menu instead of having to go through "manage > file relationships > set relationships > set alternate"? Maybe I'm the only one that has a lot of alternates (I get a lot of art from pixiv and artists love to have multiple images per post with slight variations between them)? But imo this is a very tedious way of setting images as alternates. It would be awesome if the button was just there when the menu is opened, instead of having to hover and guide the mouse cursor over a bunch of side menus.

-To add a new page, could there be a "+" button, similar to adding a new tab in an internet browser?

-And my biggest and most difficult request: having a sort of "folder" system. This would allow folders or archive files of manga to be added to the database. You could make it so that you add all the pages normally, but then you can add a grouping that turns it into a folder of sorts. Maybe when you decide to view the 'folder', it opens a new tab with all the pages? This would be extremely cool, as I like to collect digital manga as well as pictures, and as of now, I cannot sort my manga beyond making folders in Windows Explorer. Which isn't a very good way to sort mangaPost too long. Click here to view the full text.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6dd46f No.14556

Aww no, I made a mistake!

I typed this in notepad and when copying it to here, I accidentally missed the first two paragraphs. I'm very sorry about that.

Here it is:

Hey there, I apologize if making a new thread isn't warranted for this but it's not really a simple Q&A question, so…

I use Hydrus Client for sorting through my massive image collection every day and this program really is amazing. Never before have I been able to find my favorite images so fast.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6dd46f No.14557

One more thing actually: if you think these ideas aren't good or you don't have the time to implement them, then is it hard for a complete noob in programming to go into the source code and find the menu code and change it to suit my needs? Making the menu have easier access to alternates and slightly easier access to editing tags would be wonderful for me, but maybe it wouldn't be for other people.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

bc550e No.14580

Dev has said he wants right click menus to be entirely customizable, but that is probably not a very high priority feature so don't expect it anytime soon.

Meanwhile I suggest you learn the keyboard shortcuts. F3 is manage tags, F9 is new page etc. Change or set them up yourself in File > Shortcuts menu. I have "set alternates" as shift+a, for example.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

c57bbe No.14553 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v404/Hydrus.Network.404.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v404/Hydrus.Network.404.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v404/Hydrus.Network.404.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v404/Hydrus.Network.404.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v404.tar.gz

I had a good week working almost entirely on the client's multi-column lists. They now remember their column widths and sort.

multi-column lists

All the tables across the program are now plugged into a unified options structure. This remembers the lists' columns' widths, so if you resize the manage subscriptions list a little tighter, then the next time you load that dialog, it should come back the same. The lists across the program that automatically start and maintain a sort (e.g. manage subs, or the query list in a downloader page), also remember if you change the sort.

This sounds simple, but it involved rewriting critical sections for every list, and there are about 66 different ones! I am happy with Post too long. Click here to view the full text.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

70fc92 No.14554

Thanks dev!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6a079c No.14567

Not a single 404 not found joke, I'm disappointment.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

338247 No.14570

>>14567

You could not find any joke? :^)

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

338247 No.14573

I had a good week. As well as misc cleanup and bug fixes, I added a namespace filter to 'system:number of tags', so you can now search for files with 2 series tags, more than four character tags, or any combination you can think of. Most 'number of tags' searches are faster, as well.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

7016c8 No.14492 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v402/Hydrus.Network.402.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v402/Hydrus.Network.402.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v402/Hydrus.Network.402.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v402/Hydrus.Network.402.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v402.tar.gz

I had a great week just doing cleanup and other small work.

all misc this week

Most of the pages in the client now have special status bar text for when they have no files. If your search results in no files, instead of the old '0 files', you'll get 'no results for this search', and 'search cancelled!' if the search was cancelled, and so on. It just adds a bit of quick feedback to some actionslike highlighting a gallery query with no new fileswhere the new blank page may just be replacing another blank page.

I added 'copy_xxx_hash' shortcuts to the media shortcut set, for 'md5', 'sha1', and 'sha512'. All the hash-copying code is neated up as well, so if hashes can't be found for Post too long. Click here to view the full text.

6 posts omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

99975c No.14513

I am pretty sick, so I will delay 403 a week to July 8th. Covid positivity is about 9% here, so it probably isn't that, but I am knocked about a bit.

Thanks everyone. I hope to be back on Saturday for messages as usual.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8c6f7c No.14516

>>14513

Oh I'm sorry that you are sick.

Get well soon,Dev!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8dae35 No.14517

File: c0e8c469ebf9f1f⋯.png (14.36 MB,4292x3804,1073:951,c0e8c469ebf9f1f6b22f9dae72….png)

Get well dev! Hope it's not serious!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

99975c No.14518

Thanks lads, back in business. Just knocked me out a couple days.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

99975c No.14532

I was knocked out for a couple days from illness, but I otherwise had a great couple of weeks doing small work. Shortcuts are nicer to work with, a bunch of UI is cleaned up and fixed, and tag import options now supports an explicit whitelist for requiring tags for file import.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



Delete Post [ ]
[]
[1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]
| Catalog | Nerve Center | Random
[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]