Introduction

Web scraping is a common task in data science projects and I recently wanted data on job listings on LinkedIn. This was part of a larger NLP project, so I wanted the text descriptions of each posting. In this write up I show how you could create a Python class to web scrape job postings on LinkedIn. The end of this write up will include the LinkedInBot class and a script demonstrating it’s use.

If you just want the code — here is the GitHub repository with a LinkedInBot class and a DBCommunicator class that uses sqlite3 to store the…

Matan Freedman

Data Scientist | Developer | Engineer

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store