Keboola Connection Storage

This extractor loads single or multiple tables from a Keboola Connection project and stores them in a bucket in your current project. The component can be used in situations where Shared Buckets cannot, e.g. when moving data between two different organizations or regions.

Create New Configuration

Find the Keboola Connection Storage extractor in the list of extractors and create a new configuration. Name it.

Screenshot - Create configuration

Prepare API Token

The extractor requires an API Token with read-only access to a single bucket. This limits the potential risks of token misuse.

To create such a token, go to Users & Settings in the source project and create a new token. Use a name that will help you identify the token later, and set the read access to the desired bucket.

Screenshot - Create API Token

After creating the token, copy it somewhere safe as you won’t be able to see it again. If you lose the token, you can refresh it – the current token will be deactivated and a new token will be issued.

If you want to extract from multiple buckets, you’ll have to create multiple tokens and multiple configurations.

Specify Source Project

Select the region of the source project, and paste the token you generated in the source project.

Screenshot - Source Project

Add Tables

Screenshot - Create table

To create a new table, click the New Table button and assign a name. It will be used to create the source table name in Storage and can be modified.

List Tables

Screenshot - List tables

The configuration can extract as many tables as you wish. The list is fully searchable, and you can delete or disable each table. In addition, you can explicitly run an extraction of only one table. The extraction order of the tables can be changed.

Modify Table

Each table has different settings but they are all extracted from the same project and bucket.

Screenshot - List tables

Source

  • Table Name specifies the table name in the source project within the bucket the token has access to. As the token has access to a single bucket only, you do not need to specify the bucket.
  • Changed In Last allows you to extract only a recent part of the data.

Save Settings

  • Incremental – enables incremental loading in the current project. If the Primary Key is not set, the data is appended, otherwise the rows with an existing primary key are updated.
  • Primary Key – sets the primary key of the table in the current project. The primary key does not have to be the same as in the source project.