Customer IO

The Customer IO data source connector uses the Customer IO Beta API to extract customers, campaigns, segments, and activities from your Customer.io account.

Get API Key

To use this connector, you need a bearer token, known as an App API Key from Customer.io. You can generate a key with a defined scope in your account settings. Learn more about bearer authorization in Customer.io.

Configuration

Create a new configuration of the Customer IO connector.

Then insert the API key you obtained from Customer.io.

API Key

Continue configuring other parameters. Once finished, don’t forget to save everything.

Load Type

Select one of the following two load types:

  • Incremental Update – updates the result tables based on the primary key consisting of all selected dimensions.
  • Full Load – overwrites the destination table each time, with no primary keys.

Note: When set to incremental updates, the primary key is set automatically based on the selected dimensions. If the dimension list is changed in an existing configuration, the existing result table might need to be dropped, or the primary key changed before the load, since its structure will be different. If set to Full Load, no primary key is set.

Load type

Continue by selecting what data you want to download.

Campaigns

A campaign is a workflow that people in an audience trigger and traverse. Note that the JSON and Array objects in the actions and tags columns are represented as text.

Columns:

column example
actions [{‘id’: 3, ‘type’: ‘email’}, {‘id’: 7, ‘type’: ‘email’}]
active FALSE
created 1591294006
created_by Leos
customer_id 123x
date_attribute  
deduplicate_id 123123:29:00
first_started 0
frequency  
id 1
name Onboarding Campaign
start_hour  
start_minutes  
state draft
tags [‘Sample’]
timezone  

Segments

Segments are groups of people, subsets of your audience. You get information about segments and the customers contained by a segment.

Example output:

deduplicate_id description id name progress state tags type
26521567:45:00 Includes all people 1 Signed up   finished   dynamic
26582936:15:00 Anyone associated with active customer account. 13 Active Customers   finished   dynamic

Next, select the messages, customers, and/or activities that you wish to download.

Messages

This table contains metadata about messages. You may filter the messages by their type: email, webhook, twilio, urban_airship, slack, push.

Learn more.

You can select the Continue since last run option. When checked, only those messages that appeared since the last run will be downloaded.

To backfill without changing this attribute, click the Reset State button.

Load type

Customers

When downloading customers, you can filter them using JSON. You can also select only the attributes you want to see.

Filter

An additional filter condition in JSON format. The filter language is defined here. If left empty, all users are downloaded.

Example values:

  • Find the first 2 customers in segment 7 and segment 5 =>: {"and":[{"segment":{"id":7}},{"segment":{"id":5}}]}
  • Find the first 10 unsubscribed customers =>: {"attribute":{"field":"unsubscribed","operator":"eq","value":"true"}}}

Attributes

A comma-separated list of required customer attributes. Each customer may have a different set of columns. This is to limit only to attributes you need. All attributes are downloaded if left empty.

Note: It is possible that there are some custom attributes with the same name. E.g., Name and name or Last name and last_name are considered the same after conversion to a supported Storage format. You may use appropriate processors to deal with this situation.

Activities

Activities are cards in campaigns, broadcasts, etc. They might be messages, webhooks, attribute changes, etc. You can select the activity types you are interested in. Also, there are two modes of result parsing available to choose from. When done, remember to save your configuration before you run it.

Result parsing

Each activity type may have different columns and table structure. For this reason, the data source connector allows fetching data in two modes: PARSED_DATA and SINGLE_TABLE.

1) PARSED_DATA will generate structured table for each activity type. E.g., the type event will generate the table activity_event:

customer_id data_description data_project data_start id name timestamp type
David   test   1234d inactive project 1609808524 event
Tom   test2 2020-10-19T11:18:55Z 3467g enroll 1603120800 event
Carl desc TS_Test   667676h credit grant 1616382356 event

2) SINGLE_TABLE will populate single activities_all table with data unparsed as column. The data will be present in a data folder as a JSON string.

Example:

customer_id data delivery_id delivery_type id timestamp type
David {‘daysofinactivity’: 76, ‘lastactivitydate’: ‘2020-10-21’, ‘project’: ‘test’, ‘projecturl’: ‘example.com’}     1234d 1609808524 event
Tom {‘project’: ‘test2’, ‘start’: ‘2020-10-19T11:18:55Z’}     01EN0Q4 1603120800 event