MMO P&S LinkedIn Data Collector

SelfDev

SelfDev

Active member
Joined
Oct 12, 2020
Messages
215
I tried to gather data from LinkedIn for a test, but after a little while, my requests stopped working. I think it’s because of a captcha or something similar. When I logged in using a spare LinkedIn account, I got a message about using a bot. But I know lots of people still collect data from LinkedIn.

How do they do it?
 
I made it pretty easy. Logged in with my own info, searched for what I wanted, clicked on each profile, and grabbed the stuff I needed. I used tools like Selenium and Scrapy to help.
 
SelfDev said:
I made it pretty easy. Logged in with my own info, searched for what I wanted, clicked on each profile, and grabbed the stuff I needed. I used tools like Selenium and Scrapy to help.
Click to expand...

Websites can spot Selenium pretty fast now because it’s kinda outdated.
 
You could check out Playwright. I’ve been using it to do stuff on Google, and so far it’s working really nice.
 
You must log in or register to reply here.
Back
Top Bottom