Set Up List-to-List Import

Prev Next

Use List-to-List imports to transfer data directly between Lists in Pigment. This article explains how to configure, run and schedule a List-to-List import.

Before you begin

A List-to-List import is a type of Block-to-Block import that uses one List as the source and another as the target. Transaction Lists and Dimension Lists can both be used as source or target Lists.

To control how Pigment transfers the data, map source and target Properties with compatible data types. You can also filter the source data using the filtering options available in Views.

The source List can be in the same Application as the target List, in a shared Block, or in a Snapshot or Recovered Application. After you save the import configuration, you can run it manually, trigger it from a Board using an Action widget, or schedule it.

Access and Permissions

You must have the Configure Imports permission to set up a new List-to-List import and the Run Imports permission to trigger an existing saved configuration. Scheduling a saved import requires both permissions. These permissions are independent.

When a Member sets up or runs a List-to-List import:

  • Their Read access rights apply to the source List.

  • Their Write access rights apply to the mapped Properties in the target List.

  • They need the Add Items permission to create new Items in the target List.

  • They need the Delete Items permission if Clear Items prior to import is turned on.

Set up a List-to-List Import

When setting up a List-to-List import:

  • The target List is the List that will receive the imported data.

  • The source List is the List from which the data will be pulled.

⚠️ Important

You need the Configure Imports permission and Read access rights on the source List to set up a List-to-List import. The preview and initial import include only the source data you can access.

To set up the List-to-List import:

  1. Open the target List.

  2. Select Import Data.

  3. Select Pigment List.

  4. Select a List from the source List drop-down menu.

  5. (Optional) Select Use a List from a Snapshot or Recovered Application, then select a Snapshot or Recovered Application from the source list drop-down menu.

  6. Select Set up import.

Step 1: Filter the Source List

You can configure and preview the data to be imported at this stage of the import. Data can be filtered or enriched using constant values.

By default, no filters are applied, so all Items from the source List are included in the import.

ℹ️ Note

When the source is a Snapshot or a Recovered Application, only Lists with the same structure as the target, including matching Properties and data types, are available.

Step 1 of the List to List import configuration

Add a filter

To filter the source data for import:

  1. Go to Filter Data, then select + Add a filter.

  2. Select the Property you want to filter on.

  3. Choose a filter operator. The available operators will vary depending on the Property type.

List of available operators:

Operator

Data Type

Is blank / Is not blank

All

Is in / Is not in

Dimension

Contains / Does not contain

Text

= , ≠

Text, Boolean, Date, Number and Integer

> , < , ≥ , ≤

Date, Number and Integer

Range (Min < N < Max), etc.

Date, Number and Integer

  1. Select + Add filter and repeat steps 1 - 3 to add multiple filters. When you apply multiple filters, you can combine them using the AND or OR logical operator. The preview panel on the left updates automatically to show the data that will be imported.

    1. ⚠️ Important

      When you configure the import, Pigment applies your Read access rights to the source List. The preview and initial import include only the source data you can access. When a Member triggers a saved configuration, Pigment applies that Member’s Read access rights to determine which source data is imported.

  2. When your data is filtered, select Map Data.

Add a constant value

You can enrich imported data with constant values. Once configured, constant values are available in Step 2: Map Data for Import and can be mapped like any other source field.

To add a constant value:

  1. Go to Enrich data.

  2. Select + Add a constant value and configure the following options:

    • Source name. The name of the constant value. The name must not conflict with an existing Property name in the source list.

    • Data type. Select the data type. A constant value can only be mapped to Properties with the same data type.  

    • Value. The value that is imported once the data is mapped.

  3. When your data is filtered, select Map Data.

⚠️ Important

If a constant value is configured but not mapped in Step 2: Map Data for Import, that constant value is automatically cleared.

Step 2: Map Data for import

Map the Properties from the source List to the corresponding Properties in the target List to define how the data will be imported. Only Properties with compatible data types can be mapped.

Step 2 in list-to-list import is to map the data.

Properties mapping

For each Property in the target List, select the corresponding Property from the source List to import data from.

  • Only Properties with the same data type can be mapped (e.g., an Integer Property can only be mapped to another Integer Property).

  • Autogenerated or formula-based target Properties cannot be mapped.

  • Any target Property left unmapped will not be updated during the import.

  • A single source Property can be mapped to multiple target Properties.

ℹ️ Note

To optimize property mapping, select Autofill source fields to automatically link Properties that have identical names and matching data types.

Error handling

For List-to-List imports, you can define what happens if a Member doesn’t have Write access rights or the required permissions to write to the target List.

To import data to a target List, you must have the following access depending on the operation:

  • To update existing Items. You must have Write access rights on all mapped Properties.

  • To create new Items. You must have Write access rights on all mapped Properties and the Add Items permission on the target List.

  • To delete Items. You must have the Delete Items permission on the target List. This option is available when Clear Items prior to import is turned on.

Two options are available if access rights or permissions are missing:

  • Fail import. The entire import is canceled if the Member triggering it lacks the required access rights or permissions. This ensures an all-or-nothing import: no Items are imported if the Member has insufficient access.

  • Reject rows. Only the affected rows will be skipped. The rest of the data will be imported, which may result in a partial import.

Additional options

⚠️ Important

Clear Items prior to import is available only when the target List is a Transaction List. For more information, see Clear Items prior to import in Transaction Lists.

In Transaction Lists, use Clear Items prior to import to remove existing Items before importing new data. You can remove every Item in the target List or limit the removal to Items within a defined scope.

When this setting is enabled, you can use the following options to define how Items are deleted from the List:

  • Delete the entire List

  • Define a specific set of Items to be deleted

To use Clear Items prior to import:

  1. Select Additional options, then turn on Clear Items prior to import.

  2. Select All items to delete every Item in the target List, or select Limited scope to delete a defined subset.

  3. For Limited scope, select one or more Properties with a Dimension data type. Pigment uses the values found in the imported data for those Properties to determine which Items are deleted and replaced.

  4. If you select multiple Properties, choose Any combination or Exact matches as the combination method.

  5. Select Import.

⚠️ Important

When you select Import while setting up a new import, you need the Configure Imports permission. This also applies if you don’t save the configuration. You need the Run Imports permission to trigger an existing saved configuration.

Import summary

When the import is complete, a report will display the number of Items created, updated, or deleted in the target List.

The report also highlights any rows that were skipped, such as those the user didn’t have permission or access rights to modify, or rows that existed in the source data but not in the target List.

Save a configuration

⚠️ Important

You need the Configure Imports permission to save or edit an import configuration.

If you plan to run the import multiple times, select Save as new to save the configuration. You can save it in Step 2: Map Data for Import before running the import or from the Import Summary after the import finishes.

To reopen a saved configuration, select Edit in the first step of the import process. This restores the settings from Step 1: Filter the Source List and Step 2: Map Data for Import.

After saving the configuration, you can:

  • Run it manually or trigger it from a Board using an Action widget. This requires the Run Imports permission.

  • Schedule it from the import scheduling page. This requires both the Configure Imports and Run Imports permissions.