A19 Test data as‐a‐code configuration ‐ Linkedin Scraping - dcasota/m365-scripts GitHub Wiki

On the internet you will find a ton of tools to scrape data e.g. from Linkedin.

A easy-to-use tool is Axiom.ai.

Prerequisites

Prerequisites are:

  • Windows
  • Google Chrome
  • Axiom.ai login account (start with a free user account)
  • Axiom.ai Google Chrome Extension
  • Axiom.ai Desktop agent
  • A Google Chrome Spreadsheet shared to contribute publicly.

Once all prerequisites are installed, in Chrome you find the extension window.

Configuration of the project

Proceed with a login.

image

The sample project 'Scrape Page to Google Sheet' is a jumpstart project. This template easily scrapes the data from Linkedin and saves it to a Google spreadsheet.

The template consists of two steps.

image

Step1: get data from an URL

This steps consists of several input fields.

Specifiy the Linkedin url which is capable to list all employees as pageable list-

https://www.linkedin.com/search/results/people/?heroEntityKey=urn%3Ali%3Aorganization<identification>&keywords=<company>%20group&origin=CLUSTER_EXPANSION&sid=%3B8K

image

image

In 'Click 'Select' to choose the data you wish to scrape.', specify e.g. name, title, location and picture of Linkedin list objects. In the Axiom.ai extension you have to select click on two object so that the column is specified. In case of a different type of data e.g. image, it has to be specified on the data field.

image

In 'Find pager (if any)', specify the pager button on the bottom of the Linkedin list. image

image

For max results, start with a small sample amount e.g. of 20 entries.

image

In the output preview, analyze if the data scraped matches with your needs.

image

Step2: Write data to a Google Sheet

In Step2, specify the shared Google spreadsheet, sheet name, DATA, write options and write method.

image

Project run

Save the project. Press 'run w/ desktop app'.

image

After the run, you should find the data in your Google spreadsheet.

image

Run reports

In run reports, you can see the amount of time it took per project and the remaining time accordingly to your subscription.

In addition, you easily can modify an existing project.

image

Be aware, do not delete projects in the free account subscription. It might delete a cascade of projects as well.

⚠️ **GitHub.com Fallback** ⚠️