MMO P&S LinkedIn Data Collector

[SelfDev]

I tried to gather data from LinkedIn for a test, but after a little while, my requests stopped working. I think it’s because of a captcha or something similar. When I logged in using a spare LinkedIn account, I got a message about using a bot. But I know lots of people still collect data from LinkedIn.

How do they do it?

 

[Chonessah]

How’d you gather stuff from LinkedIn?

 

[SelfDev]

I made it pretty easy. Logged in with my own info, searched for what I wanted, clicked on each profile, and grabbed the stuff I needed. I used tools like Selenium and Scrapy to help.

 

[Chonessah]

I made it pretty easy. Logged in with my own info, searched for what I wanted, clicked on each profile, and grabbed the stuff I needed. I used tools like Selenium and Scrapy to help.

Websites can spot Selenium pretty fast now because it’s kinda outdated.

 

[SelfDev]

Websites can spot Selenium pretty fast now because it’s kinda outdated.

What else should I try? How can I stay hidden so websites don’t notice me?

 

[Chonessah]

You could check out Playwright. I’ve been using it to do stuff on Google, and so far it’s working really nice.