This writer sends data to a Google BigQuery dataset.
Find the BigQuery writer in the list of writers and create a new configuration. Name it.
To access and write to your BigQuery dataset, you need to set up a Google Service Account.
Keboola Connection BigQuery Writer)
BigQuery Data Editorand
BigQuery Job Userroles.
Important: The private key is stored in an encrypted form and only the non-sensitive parts are visible in the UI for your verification. The key can be deleted or replaced by a new one at any time.
There is one more thing left to do before you can start adding tables. Specify the Google BigQuery Dataset and save it. All tables in this configuration will be written to this dataset. If the dataset does not exist, the roles assigned to the Google Service Account will allow the writer to create it.
To add a new table to the writer, click + Add Table and select the table. The table name will be used to create the destination table name in BigQuery and can be modified.
The configuration can write as many tables as you wish. The list is fully searchable, and you can delete or disable each table. In addition, you can explicitly run only one table. The writing order of the tables can be changed.
You can specify the table name in BigQuery and set the load type to
Full Load or
Incremental load type does not use a primary key to modify existing records, new records will be always appended to the table.
You can rename the destination column in BigQuery and specify the used data type. The little eye icon on the right will show you a preview of the values so you don’t have to guess the data type.
Note: You have to define a data type on at least one column for the configuration to work.