/hydrus/ - Version 413

Name
Options
Subject
Message	Max message length: 12000
Files	Drag files here to upload or click here to select them 0.00 / 50.00 MB Max file size: 32.00 MB Total max file size: 50.00 MB Max files: 5 Supported file types: GIF, JPG, PNG, WebM, OGG, and more

E-mail
Password	(used to delete files and posts)
Misc

Version 413 Anonymous 09/23/2020 (Wed) 21:38:28 Id: 21fc98 No. 14763

https://www.youtube.com/watch?v=neSjixsTTjY windows zip: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.Windows.-.Extract.only.zip exe: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.Windows.-.Installer.exe macOS app: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.macOS.-.App.dmg linux tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.Linux.-.Executable.tar.gz source tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v413.tar.gz I had an ok week. I mostly fixed bugs to make a 'clean' release before I go for the tag parents database cache. It is all misc work this week, no highlights. full list - added 'sort by number of files in collection' file sort type. it obviously only does anything interesting if you are collecting by something - when you enter a tag from a manage tags suggested tags column with a double-click, the tag input box is now immediately focused. entering it with a keyboard action does not move the focus - wrote a new routine for the 'check and repair' database menu that scans for and fixes invalid tags. this might be some system:tag that snuck in, superfluous unicode whitespace, or some weird website encoding that results in null characters, or any other old tag that has since become invalid. tag translations are written to the log - added an experimental 'post_index' CONTEXT VARIABLE to subsidiary page parsers–whenever a non-vetoed post has pursuable URLs, this value is incremented by one. this is an attempt to generate a # 0,1,2,3 series. feedback on this would be appreciated, so I can formalise and document it - added 'no_proxy' option for the options->connection page. it uses comma-separated host/domains, just like for curl or the NO_PROXY environment variable. it defaults to 127.0.0.1. in future, options will be added to auto-inherit proxy info from environment variables - fixed an error when subscriptions try to publish to a page name when a 'page of pages' already has that name - activated some old 'clean url' parsing tech I wrote but never plugged in that helps parsing urls from source fields on sites that start with non-url gubbins - fixed the v411->v412 update step to account for a tags table that has duplicate entries (this shouldn't ever happen, but it seems some legacy bug or storage conversion indicent may have caused this for some users). if a unique constraint error is raised, the update step now gives a little message box and does dedupe work - fixed an issue where the 'will display as' tag was rendering without namespace when 'hide namespace in normal views' was on - fixed a recent character encoding routine that was supposed to filter out null characters - fixed some UPnP error reporting - _may_ have fixed an odd and seemingly rare 'paintevent' issue when expanding the popup toaster from collapsed state–it may also have been a qt bug, and fixed in the new qt: - updated qt to 5.15.1 for windows and linux builds. it fixes a couple of odd issues like 'unclicking' to select a menu item (issue #296) - added session save to holistic ui test suite - misc code cleanup - . - client api: - wrote a client test for the help menu so I can test some basic functions holistically, hoping to stop some recent typo bugs from happening again - did a couple of hotfixes for v412 to deal with some client api url pending bugs. the links in the 412 release now point to new fixed builds - fixed an issue setting additional tags via the client api when the respective service's tag import options are not set to get anything - fixed a 500 error with /add_tags/add_tags when a tags parameter is an empty list - fixed the /manage_pages/get_page_info client api help to show the 'page_info' key in the example response next week I am now going to write the tag parents database cache. This will basically be the same as I just did for tag siblings, making parents applicable cross-service and completely virtual. I will also improve how the application works, making it pause/resumable in non-interrupting parts in the background, like how repository tag processing works now. I expect this to take two weeks, possibly three, so please do not expect a release next week. I'll make an update on Tuesday evening as normal.

Anonymous Board Owner 09/23/2020 (Wed) 22:15:11 Id: 21fc98 No. 14764

The 'no_proxy' setting may not work quite right, btw. Seems to be some odd IP/domain behaviour. Me and a user are looking at it. If you use a proxy and have any trouble, disable it in settings to go back to old behaviour. If you don't use a proxy in options->connection, nothing has changed, you don't have to do anything.

Parents Cache Update 1 Anonymous Board Owner 09/29/2020 (Tue) 22:30:55 Id: a22d76 No. 14781

I had an ok week. I got stuck into the parents cache and related maintenance updates. I have a plan and I am grinding away at it. There is still a lot to do, but current expectation is 414 will be out on October the 14th.

Anonymous 10/02/2020 (Fri) 16:16:18 Id: fba445 No. 14787

As always, thank you based dev.

Anonymous 10/04/2020 (Sun) 21:21:47 Id: d88811 No. 14800

Speaking of proxy. It would be great having the ability to configure a proxy per website/downloader. There are a couple of sites on tor and i2p I would like to scrape. Manually setting the proxy every time is annoying and blocks other downloaders.

Anonymous Board Owner 10/07/2020 (Wed) 00:56:43 Id: a22d76 No. 14809

>>14800 Thanks. Yeah, I agree. When I next do big work on the network engine, I will be making some UI for the 'domain manager', and more per-domain tools, so the system will be better able to detect 'ah, this site is down' and not affect the whole system. When I have that up, I could migrate the proxy options to that new system and UI and change depending on domain. The new 'no_proxy' setting, btw, seems to be ignored due to a bug with the networking library I use (requests), so with luck that should be fixed soon, which may make things easier in the meantime. If there is any way you can set up a system-wide TOR proxy, that hydrus can inherit with no proxy settings or a careful 'no_proxy', it might be possible to figure out multiple proxies for certain sites more quickly than waiting for me to develop it. This might only be reasonable to do on Linux, though, where there is better support for mapping this sort of thing.

Parents Cache Update 2 Anonymous Board Owner 10/07/2020 (Wed) 00:57:49 Id: a22d76 No. 14810

I had another ok week. I am not working as fast as hoped, but the new maintenance system works. The very long wait times to recalculate siblings is gone–it now all happens in the background over time. I am now working on converting parents to the new system. I am less confident I can get 414 ready and good for October the 14th, but we'll see how it goes.

Parents Cache Update 3 Anonymous Board Owner 10/14/2020 (Wed) 00:05:37 Id: 39f86f No. 14824

I had a great week. The siblings and parents database code is mostly in place, and I was successful in unifying their application method to a simpler algebra that should result in faster siblings/parents work across the board. I now have to tie up many database loose ends, cleanse the old UI-side parents system, and polish. About 150 small things and 3 big things left. I think I can be ready for October 21st!

Release Tomorrow! Anonymous Board Owner 10/21/2020 (Wed) 06:56:58 Id: ae7751 No. 14836

I had a good four weeks migrating tag parents to the new database cache. Like siblings, parents are now applicable across services and completely undo-able. Furthermore, the large CPU requirements we experienced after the siblings cache are gone–a new maintenance routine cuts all parents and siblings work into pieces and figures it all out quietly in the background. The release should be as normal tomorrow. It should only take a few seconds to update!

Quick Reply


Sage Bypass Check