Google BigQuery

The BigQuery extractor loads data from BigQuery and brings it into Keboola Connection (KBC).

To work with Google BigQuery, create an account and enable billing. Then create a Google Storage Bucket as a temporary storage for off-loading the data from BigQuery.

Create Bucket

To create a Google Storage Bucket, go to the Google Cloud Platform console and select Storage.

Screenshot - Google Cloud Platform

Create a new bucket:

Screenshot - Google Cloud Storage

Enter the bucket’s name and Storage Class:

Screenshot - Create Bucket

Create New Configuration

Find Google Analytics in the list of extractors. Create a new configuration and name it.

Screenshot - Big Query Authorization

Then authorize the account.

Select one of the two authorization methods:

  • Instant – Use this if you have access to a Google account; the authorization will be done immediately.
  • External – If you need to authorize access to the service from someone who does not have an account in KBC, you can generate an external link, which will guide them through this process.

Screenshot - Big Query Authorization

Name the authorization, and follow the on-screen instructions.

Configure Extraction

Start by clicking the green Configure button.

Screenshot - Big Query Bucket Configured

Select your Google Project and the bucket you created at the beginning.

Screenshot - Big Query Configuration Detail

Then configure the actual extraction queries by clicking the New Query button.

Screenshot - Query Configuration

Name the query, and specify your requirements in the SQL query field. Save the query configuration.

Screenshot - Finished Configuration

Now run the configuration to bring the data to KBC.

Screenshot - Query Configuration

Running the extractor creates a background job that

  • executes the queries in Google BigQuery.
  • saves the results to Google Cloud Storage.
  • exports the results from Google Cloud Storage and stores them in specified tables in Keboola Connection Storage.
  • removes the results from Google Cloud Storage.

Note: Using Google BigQuery extractor is also described in our Getting Started Tutorial.