Looker offers a solution to export your Looks through different Deliveries such as email, SFTP or a Webhook. Those Deliveries can be either "One-shot" or "Recurring". Let's see how to use it to synchronize your Looker data with Pigment.
⚠️ Important
Looker has a row limit of 5,000 rows for data delivery. Even if your Look returns fewer than 5,000 rows, data will not be delivered unless a row limit is explicitly set within Looker.
To optimize data transfers, consider performing an initial bulk load of historical data. After this, update the dataset periodically by delivering only new or modified rows from the Look. This approach helps mitigate Looker’s row limit while maintaining up-to-date data.
Create an import configuration
Download as CSV the Look you wish to export to Pigment. For more information on how to generate an import configuration ID, see How to generate an import configuration ID in Pigment.
Get an API key
The Pigment Api Key is used to authenticate Looker calls to Pigment.
You need to generate an Import API Key from the API Keys management page. For more information, see Manage API key documentation.
Create a Webhook Delivery in Looker
To allow Looker to push data from a Look directly to Pigment, you must create a Webhook Delivery.
Pigment has a dedicated POST API for Looker Webhook Delivery:
https://pigment.app/api/import/push/looker?configurationId={CONFIGURATION_ID}&api_key={API_KEY}
Replace {CONFIGURATION_ID} and {API_KEY} by IDs retrieved in the previous steps.
ℹ️ Note
Your final URL should look like this example:
To create a Webhook Delivery:
Create a Delivery.
Select the webhook in Where your data should go.
Input the following Webhook URL:
https://pigment.app/api/import/push/looker?configurationId={CONFIGURATION_ID}&api_key={API_KEY}Replace the {CONFIGURATION_ID} and {API_KEY} with the one you generated in the previous two steps.
Select CSV in Format data.
For more information, see the Looker Documentation.
Looker offers you a large range of scheduling options to trigger this Delivery on daily, weekly, or monthly basis.
ℹ️ Note
Once you have set up a recurring delivery of your Look, Looker displays that schedule on the Schedules page. This option is only visible if your Looker admin has given you permission to schedule dashboards and Looks. For more information please consult Looker Documentation.
Once configuration is done, check that the integration is working correctly and importing successful on the Pigment side using the update history panel. Check the standard API documentation for more details.