🔥 Google Sheets integration is live! Learn more

Scrape Any Website's Data into Airtable using ParseHub

May 1, 2022Rosie Threlfall

In this guide, we'll scrape website data into Airtable using ParseHub. We'll use the Data Fetcher Airtable app to connect to ParseHub and import selected fields of the website data. We'll scrape event information from timeout.com, but you can use this method to scrape any website's data into Airtable.

ParseHub is a tool for extracting data from websites. You can download it here and sign up for a free account. You can also find ParseHub tutorials here for any help getting started. 

Install Data Fetcher

Install Data Fetcher from the Airtable app marketplace. After the app launches, sign up for a free Data Fetcher account by entering a password and clicking 'Sign up for free'.

Group 1Data Fetcher Sign Up .png

Scrape Website Data into Airtable

On the home screen of the Data Fetcher app, click 'Create your first request'. Requests in Data Fetcher are how you import data to or send data from your Airtable base.

click-create-your-first-request.png

On the create request screen in Data Fetcher, for Application, select 'ParseHub'.

application-parsehub.png

Copy and paste your personal API key from your ParseHub account into Data Fetcher below the label Authorization. Your API key authorizes Data Fetcher to read from your ParseHub account. You can find your ParseHub API key here.

Parsehub-authorization.png

For Endpoint, select 'Import data from a project's latest run'.

parsehub-endpoint.png

You can also add a Name for your request, e.g. 'Import Website Data'. 

Click 'Save & Continue'.

Parsehub import to Airtable

On the next screen, select the ParseHub Project you want to fetch your data from.

Select the Output Table & View you want to import the data into.

output-table-1.png

Click 'Save & Run'.

Parsehub Project Output

This request will run, and the Response Field Mapping window will open. This is where you set which fields from the ParseHub project will map to which fields in the output table in Airtable.

You can easily find the fields you want to import using the 'Find field' search bar.

For this example we will import all of our fields. 

You can choose whether to add these to existing Airtable fields or to create new ones. You can also choose the type of any new field (ie. Single line text, Multi line text, Email etc). 

Click 'Save & Run'.

Parsehub-response-field-mapping.png

Data Fetcher will create any fields that need to be created in the output table, then run the request and import the scraped website data from ParseHub to Airtable. You can now choose to view the output table.

ParseHub-output-table.png

Scrape Website Data into Airtable Automatically

Instead of manually running a request every time you want to update data from a particular project in ParseHub, you can use Data Fetcher's scheduled requests feature to automatically import data every 15 minutes/ hour/ day etc.

To enable scheduling, you'll need both a paid Data Fetcher account and a paid ParseHub account.

In Data Fetcher, scroll to Schedule and click 'Upgrade'.

table-1-schedule-upgrade-button.png

A new tab will open where you can select a plan and enter your payment details to upgrade.

Screenshot 2021-12-29 at 10.25.19.png

Return to the Data Fetcher app and click 'I've done this'.

table-1-schedule-ive-done-this-button.png

Click 'Add API key' in order to add your Airtable API key. You can find your Airtable API key here.

Group 11(1).png

Enter your Airtable API key and click 'Save'.

save-airtable-api-key.png

Enable Schedule this request.

schedule-data-fetcher-request.png

Select how often you want the request to run, e.g. 'Every 15 mins'. Click 'Save' and the request will now run on the schedule and sync any new scraped website data automatically.

Group 11(2).png

Other Recent Posts

How to Import Google Calendar Events to Airtable

How to Import Google Calendar Events to Airtable

Sep 26, 2022

Rosie Threlfall

Google Calendar
The Journey Bootstrapping a SaaS to $10k MRR

The Journey Bootstrapping a SaaS to $10k MRR

Sep 12, 2022

Andy Cloke

BootstrappingData Fetcher
How to Import Zoho CRM Data to Airtable

How to Import Zoho CRM Data to Airtable

Sep 8, 2022

Rosie Threlfall