Tools Ways to rip entire TikTok profile?

[Oiser]

I am curious to know if there are any software tools, apps or browser add-ons that allow downloading an entire Kwai profile. I have been searching for such a solution for quite some time now, but only came across outdated or dysfunctional programs, or ones that only permit individual downloads. I would highly appreciate it if someone could share any information on this matter.

 

[blarg0192]

Any solutions for somebody too dumb for python?

 

[jasonjemodah]

Please, Log in or Register to view quotes

This is no longer working for me. When I run this, I get the error "[tiktok:user] Downloading page 1
ERROR: JSON.parse: unexpected end of data at line 1 column 1 of the JSON data"
Anyone else have the same issue?

Downloading a video from the video url works fine, so I suppose the second method in your post still works.

 

[neolith]

Please, Log in or Register to view quotes

full profile scraping with yt-dlp and its hacked fork is always problematic. i always recommend just gathering all the video ids, and then downloading them all.
regardless, i'd direct everyone to post #71 for that solution.

 

[Hans Landa]

Please, Log in or Register to view quotes

Well it usually works flawlessly but right now i have a problem with playwright and thats the following: When i try to scrape a new profile it constantly Retrys playwright and after the 10th try it just stops.

Other profiles i have downloaded before still works normally.

edit: ok tried to download new videos from an older profile i already scraped and it seems that this doesn't work either anymore.

 

[Beakwood]

I suspect it has something to do with how playwright scrapes. Because, as neolith stated regarding grabbing links individually and downloading them with yt-dlp using bulk function works. But, if you're trying using only the account url only tiktok.com/@/ you will run into the json error. The same goes for using the script from richard2480

 

[neolith]

Please, Log in or Register to view quotes

this right here. atm. tiktok has changed how they verify connections, and so it broke the captcha bypass for both yt-dlp and the script here. for consistent results, i recommend just following my guide and grabbing all video urls.

 

[Oiser]

Please, Log in or Register to view quotes

I can execute the script, but it doesn`t copy the links to my clipboard.
Profile tested:

Please, Log in or Register to see links and images

 

[Hans Landa]

Please, Log in or Register to view quotes

does it download the videos with the watermark or without? cuz im specifically looking for a non watermarked option.

 

[jasonjemodah]

Please, Log in or Register to view quotes

yt-dlp downloads without watermark

 

[Alucard92]

Alright running into problems again, I thought I had it going but it came back with this

Please, Log in or Register to view codes content!

What am I doing wrong?

 

[neolith]

Please, Log in or Register to view quotes

theres been some changes to tiktoks backend, and OP of the original python script hasn't publicly posted the new code yet

 

[Alucard92]

Please, Log in or Register to view quotes

Crap, thanks I was going crazy trying to figure out what I was doing wrong.

Is there any other way to rip an entire profile that works?

 

[neolith]

Please, Log in or Register to view quotes

my original method, is somewhere in this thread, i forget the post #, but it is linked on my profile. basically, the most we can do, is use a userscript to copy all video links to your clipboard, and then give that to a text file, and then have yt-dlp, scrape all links in the file. basically programmatically scraping profiles through yt-dlp is broken, but it should still support individual tiktoks

 

[DevilDevine]

Please, Log in or Register to view quotes

I ended up using a bookmarklet. Copies all the video URLs from the user page (just scroll down beforehand) that have the same main URL as their page in them (to avoid it grabbing useless URLs). Copies to your clipboard, post it in a txt file yt-dlp reads from, then run it, and you're sorted.

Spoiler: Bookmarklet

Please, Log in or Register to view spoilers

 

[DevilDevine]

Please, Log in or Register to view quotes

This still works. It's the way the frontend now loads on the website.

If you go to a user directly from a URL (for example:

Please, Log in or Register to see links and images

): it won't give the individual URLs for all their videos on their page.
You can see by hovering over the videos it will link to just

Please, Log in or Register to see links and images

(so the bookmarklet doesn't scrape it as it doesn't match the user's page/main URL)

Now, if you go to their page through a video URL (/https://www.tiktok.com/@nickiminaj/video/7251030516940557611/) by clicking on their profile from the video, it does load all the other video URLs and the bookmarklet works as intended.

Personally, I favourite/like a video from an account I want to scrape. Go to my own tiktok profile, use the liked/favourite tab, open said video in another tab, and it's always good to go that way.

A bit convoluted, but hope that helps

 

[Zogbot9001]

FULL DISCLOSURE, I DID NOT MAKE THIS TOOL
​

I found this browser extension on 4Chan that downloads (almost all) TikToks from a user's profile, with the click of a button. I'm sharing it because it's a bit more idiot proof that the youtube-dlp methods in this existing thread.

Installation

1. Download the .zip file
2. Unzip the file
3. Do the following depending on your browser (I recommend using Firefox):

Google Chrome:
• Open the extension menu(type chrome://extensions/ in the address bar)
• Turn on developer mode
• Click "Load unpacked" and upload the root folder
• Upload the "connect-ext" folder as a second extension(a bit of a crutch to make an MV3 extension to work properly:

Please, Log in or Register to see links and images

)

Firefox:
• Open firefox extension menu(type about:addons in the address bar)
• Click on gear icon and choose "Install Add-on From File"
• Upload firefox-ext.xpi

Now, whenever you go to a Tik Tok user's profile it will look like this:

By default, the extension will spit out all downloaded files into your Downloads folder, which you probably do not want.

Click on the extension's icon in your browser and surround the name of your desired folder in forward slashes in the download folder field.

This will put all downloaded videos into a folder in your Downloads folders called SusuArchive.

Everything else from here on is fairly straightforward.

TO DO​

As of now, the extension DOES NOT download all videos from a user, but it does get the vast majority of them. I do not have the background necessary to figure what is going wrong and how to fix it, so if anyone wants to contribute, please do.

DOWNLOAD
Version 2023_05_10:

Please, Log in or Register to see links and images

​

 

[pogggersx]

Please, Log in or Register to view quotes

I installed this extension on Firefox and it was working fine but now when I click download button nothing happens. It is showing the following error in the log.
[X] JSON.parse: unexpected end of data at line 1 column 1 of the JSON data (1/2): Retrying... [X] JSON.parse: unexpected end of data at line 1 column 1 of the JSON data (2/2): Retrying... [X] JSON.parse: unexpected end of data at line 1 column 1 of the JSON data [X] JSON.parse: unexpected end of data at line 1 column 1 of the JSON data

 

[pushitplayit]

my download method for dummies (python illiterate)

Get Jdownloader2 and open it

Please, Log in or Register to see links and images

Goto tiktok profile and scroll to the end or as far as you want.
Click the Link Grabber addon. On the filter box type "video"
Click the Copy button.
JD2 will fetch all the video links and you can start downloading.

 

[JuicyLucy666]

Please, Log in or Register to view quotes

This is the best way imo, I load up the profile I wanna rip, then scroll all the way down to load all the video thumbnails, open link grabber and filter by "video" keyword, then copy all links and save into a text file, then use your downloader of choice to download (for me I use yt-dlp)