Loading Data

There are multiple ways to load data into KBC. When you are starting with a project or doing any kind of POC, it is usually fastest to load data manually. If everything goes well and the project goes to production, you will later switch to automatic data loading using extractors; in our tutorial, you can load data with the GoogleDrive and Database extractors.

Manually Loading Data

In this part of our tutorial, you will load four tables into KBC Storage. The tables represent business opportunities, their associated users and accounts. Additionally, company levels for each user are specified. For our tutorial, we have prepared the tables as CSV files:

Download the files to your computer (they are very small) and start loading data.

Important: All characters appearing in this data are fictitious. Any resemblance to real persons, living or dead or undead or unborn or otherwise semi-existent is purely coincidental.

To manually load data, go to the Extractors section and use the search box to find CSV Import:

Screenshot -- Extractors

Click on the More button to see CSV Import details. Here you can store predefined import configurations. Each KBC extractor can have multiple configurations. This concept allows you to extract data from multiple sources of the same type. Each configuration of CSV Import will point to a different table and will allow you to reuse it quickly later.

Screenshot -- CSV Import Intro

Click on New Configuration to continue.

Screenshot -- CSV New Configuration

You will be creating configuration for each table, so let’s name the first one Opportunity and click on Create Configuration. Each created configuration is filled with defaults; for example, CSV format and destination name of the table in KBC Storage. For this tutorial, change only the Destination setting by clicking on pen icon.

Screenshot -- CSV Import Configuration

Now change the Destination field to in.c-csv-import.opportunity and click on Save.

Screenshot -- Change upload settings

Now you can start uploading. Select the downloaded opportunity.csv file from your computer and hit the Upload button.

Screenshot -- Upload CSV file

Once the upload is finished (you will get a notification), go back to the CSV import (you can use navigation on the top) and repeat the process for the other three tables (create configuration, change destination, upload file).

Screenshot -- Upload CSV file progress

That’s it. You should now have four tables with sample data stored in your KBC project:

  • in.c-csv-import.opportunity
  • in.c-csv-import.account
  • in.c-csv-import.user
  • in.c-csv-import.level

To verify that you have loaded all the tables and to peek at the data, go to Storage Console. All database tables stored in your project are listed in the Tables tab. They are grouped together into Buckets, and the newly loaded tables can be found in the in.c-csv-import bucket. To see all tables in a bucket, click the arrow next to its name. Click a table name to see table details including Data Sample.

Screenshot -- Storage preview

You can now take