How To Scrape And Import Google News Data To Google Sheets

Reading Time: 5 minutes

Google News is a news aggregator service that provides comprehensive, up-to-date news coverage, aggregated from sources all over the world. Google News helps us stay updated so that we never miss any important updates.

In this article, we will learn how to scrape Google News articles and import Google News data to Google Sheets using Amigo, a data integration and automation tool. With Amigo, we can import all sorts of data to Google Sheets without any hassle and without coding. We can also automatically update the data at regular intervals. Just set it up once and let Amigo do the job.

Below is a snippet of articles scraped from Google Sheets and imported into Google Sheets using Google News API.

Scrape Google News with Google Sheets

To scrape Google News articles to Google Sheets, we will follow the steps below:

Scrape and import Google News data to Google Sheets

Here’s the step-by-step guide to scraping Google News articles and importing Google News data to Google Sheets with Google News API.

Install the Amigo extension

Install the Amigo Google Sheets add-on from the Google Workspace Marketplace to scrape Google News data.

Install Amigo scrape Google News articles

Alternatively, you can get it from Google Sheets.

  • Open a new sheet
  • Go to Extensions→Add-ons→Get add-ons
  • Search for Amigo and install

Generate the API key

We’ll use a Google News API on RapidAPI, an API marketplace.

Sign up or log in to RapidAPI.

After logging in, search for Google News API from the RapidAPI hub and select the Google News API from the results. Get more information on the Google News API documentation.

Google New API in RapidAPI

Choose a subscription plan from the Pricing menu to use the Google News API. We’ll choose the Basic plan, for now–you can always upgrade later.

Subscribe to the Google News API

On subscribing to the Google News API, an API key will be generated which will allow us to scrape Google News articles.

Click on Endpoints to go back to the Google News API documentation and scroll down a bit. You will find your API key under the Header Parameters.

API key

Get the data endpoint

We can use the Get articles endpoint to scrape Google News articles for specific keywords for any period in multiple languages.

Google News API endpoint to get articles

In the Required Parameters section, add your language preference. This way one can filter articles on the basis of language. For example, we will use EN code to scrape Google News articles in the English language.

Language parameter in Google News API

In the q field under Optional Parameters, enter the search keyword for which you want to scrape articles from Google Sheets.

To filter the search result, one can enter the search query, from (start date) and to (end-date) parameters. For example, “stock” as the search query will fetch financial news articles related to the stock market.

Search keyword

Then (optionally) fill in the other parameters such as date, limit, properties, and so on to filter the results.

Click the Test Endpoint option to run the Google News API query.

Running the query in Google News API

The success message indicates that the API is functioning correctly.

The Google News API is functional

The Google News API endpoint URL as well as the API headers are found under Code Snippets.

Change the language from (Node.js) Axios to Shell->cURL using the dropdown menu.

Select cURL from the dropdown menu

Copy the URL excluding the apostrophes and also note the headers. This is the endpoint URL for the keyword we want to scrape Google News articles and import the data to Google Sheets.

Endpoint URL and headers

Import the data to Google Sheets

Go back to Google Sheets and launch the Amigo extension to import the Google News data to Google Sheets.

Launch Amigo to import Google News data to Google Sheets

Select Custom API from the list of sources.

Selecting the source in Amigo Data

Enter the Google News API endpoint URL in the API URL field.

Entering the Google News API endpoint URL

Expand the Details tab and enter the following as headers (as given in the Code Snippets):

Name: X-RapidAPI-Host, Value:

Name: X-RapidAPI-Key, Value: your_key

Replace your_key with your RapidAPI key.

Google News API headers and values

Click the PREVIEW button to retrieve the Google News articles and preview them before import.

Flatten the nested datasets and then click IMPORT.

Click to preview, flatten and import

The Google News articles will be scraped and imported into Google Sheets in a moment. A snippet of the imported data is shown below.

Snippet of imported data

We have learned how to import Google News data to Google Sheets. After the data have been imported, we can set a refresh schedule and the data will be updated automatically at regular intervals–weekly, daily, hourly, or on specific days. And, if we so wish, set an alert so the news is sent to us via email and/or Slack. Learn how to set a refresh schedule. This way you can track the development of a story from Google Sheets or keep track of certain keywords.

Amigo Data can connect Google Sheets to multiple sources and allows to import data automatically. It’s a convenient and versatile tool for importing and exporting data to Google Sheets. It can save a lot of time and effort. To learn more about other various kinds of data that can be imported to Google Sheets, visit our blog.

How do I scrape news headlines?

Can I scrape Google News automatically?

Can I scrape Google Search results?

Some related articles you may be interested in:

Import AirDNA Data To Google Sheets

Import Realtor Data To Google Sheets

Import Zillow data to Google Sheets

Leave a Reply