How to Manually Run Imports

Prev Next

This article explains how to create and review import configurations and use them to run imports in Pigment Blocks.

Access and Permissions

The permission you need depends on the action you want to perform:

  • To create, edit, duplicate, rename, or delete an import configuration or copy its configuration ID, you need the Configure Imports permission.

  • To run an existing saved import configuration, you need the Run Imports permission.

These permissions are independent. You must also have the relevant access rights for the data involved.

What import methods are available in Pigment?

You can import data into Pigment by uploading a CSV file, using a connector configured in the Integrations section under Settings, or importing data directly from another Pigment Block.

For more information about the available import methods, see the following:

Test your CSV format

To transfer data into Pigment, first export your data into a CSV format. Ensure that the data structure matches the format required for import, including consistent headers and the same CSV delimiter. You will need to manually import this data into Pigment once in order to define how Pigment should read the file and the appropriate mappings.

⚠️ Important

When you import using a CSV file, you’re prompted to select a CSV file. Ensure that the file settings are consistent with the required format. If there are mismatched settings, this can cause errors.

Import Data with a CSV in Pigment

⚠️ Important

Setting up a new CSV import, including a one-off import, requires the Configure Imports permission. For full instructions, see How to Import Data Manually into Lists.

The following steps are an overview of the manual Pigment import process:

  1. Open the Block where you want to import the data.
    This can be a Transaction List, Dimension List or Metric.

  2. Select Import Data.

  3. In Step 1, configure your CSV file format to ensure Pigment reads it correctly.
    This includes setting encoding, delimiters, data layout (flat or pivoted), and optional settings like load date and constant values.
    For more information, see Step 1: Define the CSV file format.

  4. In Step 2, map each column in your CSV file to the corresponding Pigment properties.
    This includes setting formats for numbers and dates, customizing data definitions, and verifying each column’s alignment for accurate data import. For more information, see Step 2: Map the Data.

  5. When the Import Summary appears, select Save beside the new import configuration.
    Give it a clear name and description to easily locate it for future imports.

Review an existing configuration

⚠️ Important

You need the Configure Imports permission to edit, duplicate, rename, or delete an import configuration or to copy its configuration ID.

You can review an existing configuration to adjust its settings or confirm that it matches a new file.

  1. Open the Block containing the configuration you want to review.

  2. Select Import Data, then open the three-dot menu next to the configuration.

  3. Do one of the following:

    • Edit the configuration.

    • Copy the configuration ID.

    • Create a new configuration based on this configuration.

    • View the previous import summary.

    • Rename or delete the import configuration.

      ℹ️ Note

      You can also access these settings by opening the Block settings and selecting Import configurations.

You can also review an Integration configuration to inspect its setup and how its data is mapped and parsed.

Run the import

⚠️ Important

You need the Run Imports permission to run an existing saved import configuration.

CSV

To run a saved CSV import configuration, select Import Data, select the configuration and upload your CSV file. The file settings and headers must match those specified in the saved configuration.

Integration

To run an existing import configuration for an integration, select Run. After the import completes, you can select Generate File to create a CSV output of the integration pipeline.

ℹ️ Note

For all Transaction List imports with unique Properties, delete any existing data before running your setup to prevent duplicate entries. To do this, select Edit List, select all Items, and delete them. After clearing the List, you can proceed with your import.