With this end-to-end flow you can extract your updated data from your CRM tool (Salesforce, PipeDrive) and bring it into Keboola Connection. After all the necessary tasks are performed on the data, you can transform the results into visualizations in any BI tool of your choice. By using our CRM template, you will get an overview about your customers, activities, and opportunities for potential sales across the pipeline.
The flow, in a nutshell:
First, the CRM source component (extractor) will collect data from your account (companies, deals, activities, lists, owners, contacts, and pipelines).
We then add NULL values if any columns are missing, and create an output CRM data model (a set of output tables).
The data will be written into a Snowflake database via the Snowflake destination component (writer).
Finally, you will schedule and run the entire flow (i.e., the sequence of all the prepared, above mentioned steps, in the correct order). The CRM source component, all data manipulations, and the Snowflake destination component, will be processed.
An entity-relationship diagram is a specialized graphic that illustrates the relationships between entities in a data destination.
|ACTIVITY||data about activities of employees|
|COMPANY||list of companies and their websites|
|CONTACT||list of contacts|
|EMPLOYEE||list of employees associated with the deal|
|OPPORTUNITY||data about companies and employees associated with the deal|
|OPPORTUNITY CONTACT||combined data about opportunities and contacts|
|OPPORTUNITY SNAPSHOT||history of the opportunity table and its changes|
These data sources are available in Public Beta:
These data destinations are available in Public Beta:
The process is simple. We will guide you through it, and, when needed, ask you to provide your credentials and authorize the destination component.
First decide which data source and which data destination you want to use. Then select the corresponding template from the Templates tab in your Keboola Connection project. When you are done, click + Use Template.
This page contains information about the template. Click + Use Template again.
You’ll be asked to write a name for the template instance you are about to create. You can use the template as many times as you want and still keep everything organized.
After clicking Next Step, you will see the template builder. Fill in all needed credentials and perform the required OAuth authorizations.
Important: Make sure to follow all the steps very carefully to prevent the newly created flow from failing because of any user authorization problems. If you are struggling with this part, go to the section Authorizing Data Destinations below.
Follow the steps one by one and authorize at least one data source from the list. Finally, the destination must be authorized as well.
When you are finished, click Save in the top right corner. The template builder will create your new configuration, and when it is done, you will see the newly created flow.
Click Run Template and start building your visualizations a few minutes later.
To use a selected data source component, you must first authorize the data source.
Fill in your Salesforce login name, password, and security token.
Fill in your company domain and the API token. You can find it in Settings > Personal preferences > API.
To create a working flow, you must select at least one data destination.
To configure the destination component, you need to set up a Google Service Account and create a new JSON key.
A detailed guide is available here.
Authorize your Google account.
Duplicate the sheet into your Google Drive and paste the file ID back to Keboola Connection. It is needed for correct mapping in your duplicated Google sheet.
If you do not have your own data warehouse, follow the instructions and we will create a database for you:
Everything is set up.
If you want to use your own Snowflake database, you must provide the host name (account name), user name, password, database name, schema, and a warehouse.
We highly recommend that you create a dedicated user for the destination component in your Snowflake database. Then you must provide the user with access to the Snowflake Warehouse.
Warning: Keep in mind that Snowflake is case sensitive and if identifiers are not quoted, they are converted to upper case. So if you run, for example, a query CREATE SCHEMA john.doe;, you must enter the schema name as DOE in the destination component configuration.
More info here.
Before turning to the Keboola support team for help, make sure your error is not a common problem that can be solved without our help.
If you see the error pictured below, you have probably forgotten to set up the Snowflake database.
Click on the highlighted text under Configuration in the top left corner. This will redirect you to the Snowflake Database component. Now follow the Snowflake Database provided by Keboola on the page Authorizations/destinations.
Then go to the Jobs tab and Run the flow again.