Deduplication

The deduplicate function allows you to limit the number of relationships in a selection with exactly the same data. In other words, based on (a combination of) fields with the same value, you can exclude records.

Drag a deduplication block to the selection screen and connect an input (selection) block to the deduplication block.


Double-click on the deduplication block to open its settings.


Source/ Entity

Select the source in which the deduplication is to take place.

More details: Source/ Entity/ Key.

Maximum number of relations

Then define the ‘Maximum number of relations’. This defines the number of relationships that must remain after executing the deduplication. In other words, by entering the maximum number of relations it is determined how often a relation per deduplication attribute may occur after the deduplication.

The relations to retain are selected at random.

Search/Select Entities

This part of the screen shows the different entities that are available to search and select. You can search for entities by scrolling through the list, expanding the entity tree or via the search box.

More details: Search/Select Entities.

Define Selection/ Deduplication Criteria

In this window you can define the condition(s) on which the deduplicate will occur.


Limit

Indicate in every deduplicate block whether the number of records should be limited or not by using the ‘Limit’ function.

First, select ‘Off’, ‘Absolute’ or ‘Percentage’.
Then provide the absolute number or percentage per segment.

More details: Limiet.

Block template

More details: Block template.

Description

More details: Description.

Apply/Cancel/Save/Calculate

The deduplicate block is saved and executed immediately after clicking the "Calculate" button.


Example

Double a selection based on the same e-mail address and the maximum number of relations is one. If there are three relations in the selection with the email address info@ternair.com, the selection result will be limited to one relation with the email address info@ternair.com.

Video



Copyright © 2025 Ternair.