MMO P&S LinkedIn Data Collector

SelfDev

Active member
Joined
Oct 12, 2020
Messages
215
I tried to gather data from LinkedIn for a test, but after a little while, my requests stopped working. I think it’s because of a captcha or something similar. When I logged in using a spare LinkedIn account, I got a message about using a bot. But I know lots of people still collect data from LinkedIn.

How do they do it?
 
I made it pretty easy. Logged in with my own info, searched for what I wanted, clicked on each profile, and grabbed the stuff I needed. I used tools like Selenium and Scrapy to help.
 
I made it pretty easy. Logged in with my own info, searched for what I wanted, clicked on each profile, and grabbed the stuff I needed. I used tools like Selenium and Scrapy to help.

Websites can spot Selenium pretty fast now because it’s kinda outdated.
 
You could check out Playwright. I’ve been using it to do stuff on Google, and so far it’s working really nice.
 
Back
Top Bottom