Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

[EchoesOfTheDeep]

Three questions:

1) I am having no issues downloading. Everything is working smoothly. There is one JPG4U album I want to download that is password protected but I cant figure out how to make it work. Any ideas?

2) Is the command window supposed to close automatically everytime? Would love it if it stayed open.

3) Can we donate? Would love to send a little bit of $$$ your way as a thank you. This is such a life saver for me.

 

[slitchampion]

Please, Log in or Register to view quotes

1) Password protected albums are not downloadable by CDL.

2) CDL will stop running once all runs complete or you choose to exit. The command-line/terminal window should stay open throughout.

3)

Please, Log in or Register to see links and images

 

[captainboo69]

1.Is it possible to have filename match the coomer/kemono album name?

2. Do these folder name setting work with coomer/kemono?
--include-album-id-in-folder-name
--include-thread-id-in-folder-name

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

You can do so through CDL's sorting

Please, Log in or Register to see links and images

include_album_id_in_folder_name does.

 

[Recordking]

Cyberdrop is amazing one small problem downloading from Coomer with the newest version this program is downloading files at like 200kbps it peaks at 400kbps

With Coomer-DL newest version there is a bug it is stuck on Crawls older versions I could download from Coomer at like 1.5mbps to 3mbps

Coomer site is not slow it is Cyberdrop I know because I can download a lot faster with Coomer-DL

I have a 1Gbit connection with Usenet I can download at real speed 90mbps to 108mbps

 

[Aurora Borealis]

Have an issue that started this morning

Spoiler: code

Please, Log in or Register to view spoilers

It looks like it wiped the .yaml files in Configs folder, it's just blank spaces now..?

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

This can happen occasionally when the program is improperly exited.

Have to delete them and start them again

edit: no guarantees, but this shouldn't happen anymore with 5.2.56

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

It is coomer being slow.

As well as continuous timeouts from coomers end.

Compounded by the fact that CDL makes two requests: a head request to check site validity and get the content size (to reference against history, and existing files), and the actual download. It has always been this way

Doubled: actually try opening the files on coomer, it's slow as fuck.

 

[EchoesOfTheDeep]

I've been using Cyberdrop for about a week now and have a few notes I wanted to mention. Firstly, I wanted to thank the Developer once again for this app. You have NO idea how much time and work it has saved me. I wish I would be able to use it on some vBulletin forums I frequent, haha, but I am more than happy with what we have here. I want to confirm that I used this on Windows and am now using it on Linux Mint and it is working flawlessly on both OS's. Was a pain to install on Linux (but that is me being an idiot) and quite easy on Windows. A couple of things I noticed:

1) Is *Blacklisted site*.tv still supported? Scraper doesn’t work on my end for this site, on both Windows and Linux.

2) Is Version 5.0.124 the most current version? I get a message in the downloader saying that it’s not but this is what I downloaded from the link provided in the first post of the thread. Still works fine from what I see.

3) The biggest issue I found was GoFile. When Cyberdrop is downloading the links it scraped, if it finds a GoFile link and the link is now a dead link (the album was deleted), Cybderdrop will hang up on this link. Sometimes the other links in the queue will download, sometimes they won’t. This has been a common issue that I have seen.

4) Coomer is slow on Cyberdrop, as discussed. But its slower on JDownloader, so I prefer the scraper over JDownloader for Coomer. Thats a +!

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

I'll comment on this as it relates to the rest of your issues. It's not the latest. 5.2.57 is currently the latest. You need to be using python 3.11 or newer for it to update beyond 5.0.124.

On windows, uninstall the python you have (and delete the venv folder where you're running cyberdrop-dl) and install the newer version, then try again.

Should be similar on linux, just make sure your current version of python isn't required by the system like on some distros.

 

[lemonl]

Fantastic work!
I wanna suggest implementing a dl throttle/bandwidth limiter as well.
Where you can set the value yourself. Would be neat if you could also select and choose which dl process you want to throttle.

Or if anyone knows of a bandwidth limiter that works with cyberdrop-dl. i can't get trickle to work, and any limiter that gets enabled on the NIC won't work for me (since i'm also transfering files via smb/lan).

cheers!

 

[Recordking]

Please, Log in or Register to view quotes

The how is Coom-DL able to download files from the at the site at a min of 1.5mbps and Cyberdrop only downloads files at like 200k to 400k.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Different servers, different speeds. But I am getting the same speeds on both applications. But also, coom-dl doesn't show speed. It shows total downloaded.

 

[EightyThree]

Please, Log in or Register to view quotes

Have you looked into the rate limiting options?

Please, Log in or Register to see links and images

 

[EchoesOfTheDeep]

Please, Log in or Register to view quotes

Thanks for the help, On Linux, I am running a virtual environment under Python 3.11. I deleted and re-installed the .SH file in the same Virtual Environment. The downloader still says V5.0.124. It's working, but its just not the latest version. Thanks for the support!

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

I would verify that virtual environment then, as it is likely 3.10 not 3.11.

To clarify some confusion here (likely), the latest round of start scripts create their own virtual environments for python, using the system default. That's the venv folder that is created upon starting. You can delete that one and create one yourself that is 3.11, and just make it named the same, in the same location. Or you can specify a python executable in the sh file itself.

 

[EchoesOfTheDeep]

Please, Log in or Register to view quotes

Deleting the pre-installed venv and putting in my own with the latest python solved it for me. Currently on the latest python with the latest cyberdrop. Smooth like butter! Thanks!

 

[mka123]

Has anyone else experienced using this tool uses 99% of their RAM? Nothing has changed for me with this tool but when I use it now, it just EATS my RAM. Like, all of it. And then even after I stop the process and close the command prompt, task manager has my RAM pegged at 99% used. This only happens when using this tool.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

You should very much look deeper into this (meaning elsewhere), CDL really doesn't use almost any ram.

 

[SasukeUchiha49]

Hey I've been having an issue where videos finish downloading but it doesn't stop and keeps downloading it seems to eventually stop but usually once it hits 100% its done and moves on to the next file was wondering if anyone had any theories on what's causing this

Please, Log in or Register to see links and images