ThoughtSpot

This writer sends data to a ThoughtSpot platform.

Create New Configuration

Find the ThoughtSpot writer in the list of writers and create a new configuration. Name it.

Screenshot - Create configuration

The first step is to Set Up Credentials:

Screenshot - Main page

You need to provide a host name, user name, password, database name, schema and SSH user and SSH password. The writer uses the TSLOAD CLI tool and TQL commands to load that data. These commands are executed on the server through an SSH connection. Therefore the SSH credentials are needed to connect to the server instance.

Screenshot - Credentials

Table Configuration

The next step is to configure the tables you want to write. Click the Add New Table button:

Screenshot - Add Table

Select an existing table from Storage:

Screenshot - Select Table

The next step is to specify table configuration. Click the Edit Columns button to configure the table columns:

Screenshot - Configure Table

Use the preview icon to peek at the column contents.

Screenshot - Table Columns

For each column you can specify its

  • name in the destination database; you can also use the select box in the table header to bulk convert the case of all names.
  • data type (one of supported data types); you can also use the select box in the table header to bulk set the type for all columns. Setting the data type to IGNORE means that the column will not be present in the destination table.

When done configuring the columns, don’t forget to Save the settings.

Load Options

At the top of the page, you can specify the target table type and name additional load options. The table type is one of STANDARD, FACT, and DIMENSION. See an explanatory article about schema design or the official guide for more details on designing the data schema.

Screenshot - Table Type

There are two main options how the writer can write data to tables — Full Load mode and Incremental Load mode.

Screenshot - Table Options

In the Incremental Load mode, the data are bulk inserted into the destination table and the table structure must match (including the data types). That means the structure of the target table will not be modified. If the target table doesn’t exist, it will be created. If a primary key is defined on the table, the data is upserted. If no primary key is defined, the data is inserted.

In the Full Load mode, the table is completely overwritten including the table structure. The table is removed using the DROP command and recreated.

Additionally, you can specify a Ppimary key of the table, a simple column data filter, and a filter for incremental processing.