Loading Data

There are multiple ways to load data into Keboola Connection. When you are starting with a project or doing any kind of POC, it is usually fastest to load data manually. If everything goes well and the project goes to production, you will later switch to automatic data loading using extractors; in our tutorial, you can load data with the GoogleDrive and Database extractors.

Manually Loading Data

In this part of our tutorial, you will load four tables into Keboola Connection Storage. The tables represent business opportunities, their associated users and accounts. Additionally, company levels for each user are specified. For our tutorial, we have prepared the tables as CSV files:

Download the files to your computer (they are very small) and start loading data.

Important: All characters appearing in this data are fictitious. Any resemblance to real persons, living or dead or undead or unborn or otherwise semi-existent is purely coincidental.

To manually load data, go to the Components – Extractors section and use the search box to find CSV Import:

Screenshot -- Extractors

Click on the CSV Import tile to see more details. Here you can store predefined import configurations. Each Keboola Connection extractor can have multiple configurations. This concept allows you to extract data from multiple sources of the same type. Each configuration of CSV Import will point to a different table and will allow you to reuse it quickly later.

Screenshot -- CSV Import Intro

Click on New Configuration to continue.

Screenshot -- CSV New Configuration

You will be creating configuration for each table, so let’s name the first one Opportunity and click on Create Configuration. Each created configuration is filled with defaults; for example, the CSV format and the destination name of the table in KBC Storage. For this tutorial, change only the Destination setting by clicking the pen icon.

Screenshot -- CSV Import Configuration

Now change the Destination field to in.c-csv-import.opportunity and click Save.

Screenshot -- Change upload settings

Now you can start uploading. Select the downloaded opportunity.csv file from your computer and hit the Upload button.

Screenshot -- Upload CSV file

Once the upload is finished (you will get a notification), go back to the CSV import (you can use navigation on the top) and repeat the process for the other three tables (create a configuration, change the destination, upload the requested file).

Screenshot -- Upload CSV file progress

That’s it. You should now have four tables with sample data stored in your Keboola Connection project:

  • in.c-csv-import.opportunity
  • in.c-csv-import.account
  • in.c-csv-import.user
  • in.c-csv-import.level

To verify that you have loaded all the tables and to peek at the data, go to Storage. All database tables stored in your project are listed in the Tables tab. They are grouped together into Buckets, and the newly loaded tables can be found in the in.c-csv-import bucket. To see all tables in a bucket, click the bucket title. Click individual table names to see the table details, including Data Sample.

Screenshot -- Storage preview

You can now take