Loading Data with Database Extractor

So far, you have learned to load data into KBC manually and via a GoogleDrive extractor. Let’s now load data from an external database with the help of the Snowflake Database extractor (the procedure is same for all our database extractors.

We will use our own sample Snowflake database, so do not worry about having to get database credentials from anyone.

Configure Snowflake Extractor

Start by going into the Extractors section of KBC and create a new extractor.

Screenshot - Create a new Extractor

Find Snowflake. You can use the search feature to find it quickly.

Screenshot - Create a new Database Extractor

Similarly to the GoogleDrive extractor, the Snowflake extractor can have multiple configurations. As each configuration represents a single database connection, we only need one configuration. Continue with New Configuration.

Screenshot - New Database Extractor Configuration

Name the configuration.

Screenshot - Create a new Database Extractor Configuration

Now, set up credentials to the source database. Set

  • Host to kebooladev.snowflakecomputing.com,
  • Port to 443, and
  • Username, Password, Database and Schema to HELP_TUTORIAL.
  • Warehouse to DEV.

Test the credentials and save them.

Screenshot - Database Extractor Credentials

Now select the tables to import from the dropdown. Each selected table corresponds to a single table in Storage.

Screenshot - Quickstart

Select the ACCOUNTS, USER, and OPPORTUNITY tables and press “Create”.

Screenshot - Database Tables Selected

You will get the following configurations. Now let’s click on Run Extraction to load the data from the database into your tables in Storage.

Screenshot - Run the extraction

Running the extractor creates a background job that

  • connects to the database,
  • executes the queries, and
  • stores results in the specified tables in Storage.

When a job is running, a small orange circle appears under Last runs, along with RunId and other info on the job. Green is for success, red for failure. Click on the indicator, or the info next to it, for more details. Once the job is finished, click on the names of the tables to inspect their contents.

Now when you know how to use a database extractor, continue with the rest of the tutorial.