How to Scrape Amazon Product Data into Airtable

Mar 16, 2023ā€¢Rosie Threlfall

If you need to extract data from Amazon and import it into Airtable, this can be easily achieved using the Apify API and the free Data Fetcher extension.Ā 

This is often referred to as data scraping (or web scraping) and describes the process of importing data from websites into files or spreadsheets. For this example, we are scraping data from Amazon into Airtable.Ā 

Follow this step-by-step tutorial to find out how to use the Apify Airtable integration, which can also be used to scrape data from other websites. You can read our guide onĀ how to scrape Airbnb data into AirtableĀ here.Ā 

What is Apify?

Apify is a web scraping tool that enables you to collect data from any website. Apify has inbuilt tools to help you easily extract data such Instagram profile info or extract data from TikTok videos such as hashtags and users.

Create an Apify Account

Sign up for a free Apify account here using your email address, Google or Github profile.

apify1.png

You'll need to Verify your email address and complete the requested onboarding info.

apify2.png

Use the Store search bar to locate and select the Amazon Product Scraper.

Apify-Amazon1.png

At the bottom of the next screen, select 'Start 14 days trial'.

Apify-Amazon8.png

Next, copy and paste the URL of the Amazon product (or product category) you want to scrape data from.

Apify-Amazon3.png

You have the option to select a maximum number of items to scrape (which may apply if you were scraping a whole Amazon category.) For this example, we are using a single product, so ignore this step.

Apify-Amazon4.png

Then select 'Save as new task'. This creates what Apify refers to as an 'Actor Task'.

Apify-Amazon9.png

Click 'Start', and Apify will start scraping the product data from your chosen Amazon product.

Apify-Amazon10.png

Install Data Fetcher

Next, set up a new Airtable base and install Data Fetcher via the Airtable marketplace. Sign up for a Data Fetcher account by entering a password and clicking 'Sign up for free'. Alternatively, you can use your Google login to create a new account. If you already have a Data Fetcher account use the 'Have an account?' text in the bottom left of the screen to log in.

Data Fetcher is a powerful Airtable extension that can be used to import different types of data from APIs or websites into Airtable.

Data Fetcher Sign Up

Scrape Amazon Product Data into Airtable with Apify

Data Fetcher requests are used to import and export data. You can create multiple requests within one installation of Data Fetcher in an Airtable base.

Click on 'Create your first request' from the Data Fetcher home screen.

Create your first request in Data Fetcher

On the create request screen, select 'Apify' for Application to use the Apify Airtable integration.

apify7.png

Click here to get your Personal API token from Apify and copy this to your clipboard using the copy button.

apify8.png

Paste this API key here.

apify9.png

For Endpoint select 'Import results from an actor task's latest run'.

apify10.png

For Actor task choose your Amazon Crawler task.

Apify-Amazon5.png

Give your request a name such as 'Scrape Amazon Product Info' and click 'Save & Run'.

Apify-Amazon6.png

TheĀ Response field mappingĀ modal will open, where you choose which fields to import from your chosen Amazon product(s) and how they will map to your output table.Ā 

Click Filter all to remove any pre-selected fields, then use theĀ Find fieldĀ search bar to easily locate the fields you want to import.

For this example, we are going to import the following fields:

'Url', 'Title', 'Brand', 'Description', 'Stars'.

These will automatically be set to map to new fields that will be created in the output table.

Click 'Save & Run'.

Apify-Amazon12.png

The Apify Airtable integration will run and you'll now see the data in your output table related to your Amazon product (or the products in an Amazon category.)

Scrape Amazon Data into Airtable Automatically

Currently, you'd need to manually click 'Run' in Data Fetcher to import any updates to the Amazon product data. It's also possible to set the Apify Airtable integration to run at regular intervals.

There are two steps to automate this process, using both the Apify scheduling feature and the Data Fetcher's scheduling feature.

In Apify, navigate to the Saved Tasks menu on the left and select your 'Amazon Scraper Task'.

Then choose Schedule from the menu on the top right of the screen.

Apify-Amazon15.png

You can enter a new name for My Schedule 1 if you wish.

By default the schedule is set to every day, but you can also choose hourly, weekly, yearly or choose your own schedule.

Click 'Activate'.

Apify-Amazon16.png

Next, you'll need to set up Data Fetcher's scheduling feature. You'll need to upgrade your account as this is a paid Data Fetcher feature. In Data Fetcher, scroll to Schedule and click 'Upgrade'.

schedule-requests.png

Choose a plan from the different options depending on your needs and enter your payment details.

data fetcher upgrade pricing plans.png

Back in Data Fetcher, click 'I've done this'.

schedule-upgrade.png

UnderĀ Schedule click '+ Authorize'.

Schedule Data Fetcher

A new window will now open and prompt you to authorize the Airtable bases you need Data Fetcher to access.

By selecting 'All current and future bases in all current and future workspaces' you should avoid issues with unauthorized bases in the future.

Click 'Grant access'.

schedule-authorize-bases.jpg

Back in Data Fetcher, you'll see Schedule this request is now toggled on.

Select a schedule for the Apify Airtable integration based on intervals of 'Minutes', 'Hours', 'Days' or 'Months'. Click 'Save', and changes to the data will automatically scrape product data from Amazon, then import into your Airtable base on your chosen schedule.

Schedule this request

Related Posts

How to Create an Airtable Web Scraper with No-Code

How to Create an Airtable Web Scraper with No-Code

May 11, 2023

ā€¢

Rosie Threlfall

ā€¢Web Scraping
How to Scrape Airbnb Data into Airtable with Apify

How to Scrape Airbnb Data into Airtable with Apify

Sep 2, 2022

ā€¢

Rosie Threlfall

ā€¢Web Scraping
Scrape Any Website's Data into Airtable using ParseHub

Scrape Any Website's Data into Airtable using ParseHub

May 1, 2022

ā€¢

Rosie Threlfall

ā€¢ParseHubWeb Scraping