Pigeon Importer allows you to import data from e-mail attachments to KBC. It extracts data from systems generating exports only as CSV files attached to an email, and can also be used instead of repeated manual imports of CSV files.
Tables only get imported with the extractor running. The import is not triggered by an email being sent or received. When running, the extractor will import all emails received since its previous run. Therefore it is a good idea to set up Pigeon Importer in a scheduled orchestration.
Find Pigeon Importer in the Extractors section and create a new configuration. As each configuration can import multiple tables, there is no need to create more than one unless you want to better organize your data. Let’s say one configuration would load your daily data, and another one your yearly reports.
Choose a meaningful name for your configuration.
Email Import defines the link between an email and a table in Storage. It imports a single table into Storage.
Select an existing table from Storage, or create a new table ID: a bucket and table name. Specify the primary key and CSV options if needed.
Send an e-mail with a data attachment to the generated email address. Use the following sample table:
With the email message content being completely arbitrary, all that matters is the attached CSV file. It must always adhere to the format specified in Email Import. It can also be gzipped.
Click Run email import and confirm.
When running the import job, follow the UI instructions to check the processed data in the imported table. There may be a delay between the time the email is sent, received, and picked up by the importer.