Linkedin Tips for scraping LinkedIn public data at scale?

[Opscertag]

Is there any advice available on efficiently scraping public profiles on LinkedIn?

I can successfully obtain all the profile URLs from Google, but the LinkedIn authentication wall activates swiftly, even with my entirely clean residential IP. Although I can automatically handle bot verification, it rarely triggers, mainly presenting the authentication wall.

I've explored various approaches, such as attempting to retrieve profiles from search engine caches (unsuccessful due to no-archive tags) and posing as Google with a Google bot user agent and forwarding headers with a Google crawler IP. Additionally, I've experimented with rotating user agents and cookies, among other methods.

Considering my options, it seems creating hundreds of profiles, utilizing rotating 4G proxies, and scraping while logged in might be the most effective strategy.

Any insights or tips on scraping LinkedIn would be greatly appreciated.

By the way, do you have an interest in free tools? I'm offering complimentary access to my suite of SEO/IM tools. Check the details below.

 

[Bugco]

Considering my options, it seems creating hundreds of profiles, utilizing rotating 4G proxies, and scraping while logged in might be the most effective strategy.

You have the option to utilize the mentioned solution or employ Sales Nav for scraping, using your research criteria to achieve this.