Topic: Downloading Favorites in Mass

Posted under General

With E6AI shutting down soon I wanted to save my favorites to my computer, but with 36 pages of favorites that would take awhile to do manually.

Does anyone know of a way to bulk download images? I know there are tools that work for E621, but they don't seem to work for this site.

I've been using Hydrus Network with it's browser extension Hydrus Companion. Works very well, but Hydrus has a fairly steep learning curve.

Fixxor

Member

I always use gallery-dl, since it can handle e621 and FA too

Linux example:

gallery-dl -a browser --cookies-from-browser firefox --destination ./ --write-metadata --write-info-json --download-archive ./archive.sqlite 'https://e6ai.net/posts?tags=fav%3Aexample'

I find that Hydrus' downloader can be a bit slow particularly for larger imports, so I've been using gallery-dl configured to also pull metadata to JSON. Between that and downloading the posts+pools databases from https://e6ai.net/db_exports should effectively be enough to get any needed info for later import into the local Hydrus client.

Also, as it turns out, the search page/endpoint appears to cap out at around 56k posts returned for any given search, and with the final post ID here now being permanently locked at 193896, one could, in theory scrape the whole site in four queries using the

id:x..y

special search operator. Hypothetically, with a decent connection, this could be accomplished in around 48 hours and change without tripping rate limits.