Scrape Any Website's Data into Airtable using ParseHub

May 1, 2022Rosie Threlfall

In this guide, we'll scrape website data into Airtable using ParseHub. We'll use the Data Fetcher Airtable app to connect to ParseHub and import selected fields of the website data. We'll scrape event information from timeout.com, but you can use this method to scrape any website's data into Airtable.

ParseHub is a tool for extracting data from websites. You can download it here and sign up for a free account. You can also find ParseHub tutorials here for any help getting started. 

Install Data Fetcher

Install Data Fetcher from the Airtable app marketplace. After the app launches, sign up for a free Data Fetcher account by entering a password and clicking 'Sign up for free'.

Group 1Data Fetcher Sign Up .png

Scrape Website Data into Airtable

On the home screen of the Data Fetcher app, click 'Create your first request'. Requests in Data Fetcher are how you import data to or send data from your Airtable base.

click-create-your-first-request.png

On the create request screen in Data Fetcher, for Application, select 'ParseHub'.

application-parsehub.png

Copy and paste your personal API key from your ParseHub account into Data Fetcher below the label Authorization. Your API key authorizes Data Fetcher to read from your ParseHub account. You can find your ParseHub API key here.

Parsehub-authorization.png

For Endpoint, select 'Import data from a project's latest run'.

parsehub-endpoint.png

You can also add a Name for your request, e.g. 'Import Website Data'. 

Click 'Save & Continue'.

Parsehub import to Airtable

On the next screen, select the ParseHub Project you want to fetch your data from.

Select the Output Table & View you want to import the data into.

output-table-1.png

Click 'Save & Run'.

Parsehub Project Output

This request will run, and the Response Field Mapping window will open. This is where you set which fields from the ParseHub project will map to which fields in the output table in Airtable.

You can easily find the fields you want to import using the 'Find field' search bar.

For this example we will import all of our fields. 

You can choose whether to add these to existing Airtable fields or to create new ones. You can also choose the type of any new field (ie. Single line text, Multi line text, Email etc). 

Click 'Save & Run'.

Parsehub-response-field-mapping.png

Data Fetcher will create any fields that need to be created in the output table, then run the request and import the scraped website data from ParseHub to Airtable. You can now choose to view the output table.

ParseHub-output-table.png

Scrape Website Data into Airtable Automatically

Instead of manually running a request every time you want to update data from a particular project in ParseHub, you can use Data Fetcher's scheduled requests feature to automatically import data every 15 minutes/ hour/ day etc.

To enable scheduling, you'll need both a paid Data Fetcher account and a paid ParseHub account.

In Data Fetcher, scroll to Schedule and click 'Upgrade'.

table-1-schedule-upgrade-button.png

A new tab will open where you can select a plan and enter your payment details to upgrade.

data fetcher upgrade pricing plans.png

Return to the Data Fetcher app and click 'I've done this'.

table-1-schedule-ive-done-this-button.png

Under Schedule click '+ Authorize'.

Schedule Data Fetcher

A new window will now open for you to authorize the Airtable bases you need Data Fetcher to access.

It's recommended to select 'All current and future bases in all current and future workspaces' to avoid issues with unauthorized bases in the future.

Click 'Grant access'.

schedule-authorize-bases.jpg

In the Data Fetcher interface Schedule this request is now toggled on.

Select how often you want the request to run, e.g. 'Every 15 mins'. Click 'Save' and the request will now run on the schedule and sync any new scraped website data automatically.

Group 11(2).png

Related Posts

How to Import Public Company Data from LinkedIn to Airtable

How to Import Public Company Data from LinkedIn to Airtable

Oct 15, 2023

Rosie Threlfall

LinkedInWeb Scraping
How to Import LinkedIn Profile Info into Airtable

How to Import LinkedIn Profile Info into Airtable

Jul 11, 2023

Rosie Threlfall

Web ScrapingLinkedIn
How to Create an Airtable Web Scraper with No-Code

How to Create an Airtable Web Scraper with No-Code

May 11, 2023

Rosie Threlfall

Web Scraping