Skip to content
Back to Site

Configure Data Filter

Build entity-level filters with supported Field, Operator, and Value rules, including the operator syntax available for direct expressions.

Data Filter controls which records of a selected entity remain in the migration. Each visual rule uses Field -> Operator -> Value, and multiple rules inside one Entity Filter can be combined with AND or OR.

  1. Expand Data Filter.
  2. Select an entity and click Add Filter.
  3. Select the data Field belonging to that entity.
  4. Select the Operator that should evaluate the field.
  5. Enter the comparison Value required by that operator.
  6. Click Add Rule to add another condition to the same Entity Filter, then use AND or OR to define how the conditions relate.
  7. Repeat for other entities when additional record-level scope is required.

To migrate only Manufacturers whose names start with US_, configure:

SettingValue
EntityManufacturers
FieldName
OperatorStarts with
ValueUS_

The generated expression is:

(name starts_with "US_")

To narrow the same Entity Filter further, add another rule with AND:

SettingValue
FieldCreated Time
OperatorIs after
Value09/11/2001

For 9 November 2001, the combined expression is:

(name starts_with "US_" AND created_at after "2001-11-09")

The filter keeps only Manufacturers whose names start with US_ and whose creation time is after the example date.

Expression is generated automatically from the visual rules. Direct editing is available when a supported condition is easier to express manually.

When direct editing begins, the visual rule controls are hidden and the editor shows:

The visual rules are hidden because this expression is being edited directly.

Label is the customer-facing operator name displayed in the dropdown UI. Operator Identifier is the underlying syntax used when manually writing or editing expressions.

LabelOperator identifier
Equalsequals
Does not equalnot_equal
Starts withstarts_with
Does not start withnot_starts_with
Ends withends_with
Does not end withnot_ends_with
Containscontains
Does not containnot_contains
Is inin
Is not innot_in
Is emptyempty
Is not emptynot_empty
LabelOperator identifier
Equalsequals
Does not equalnot_equal
Is less thanless_than
Is greater thangreater_than
Is less than or equal toless_than_or_equal
Is greater than or equal togreater_than_or_equal
Is inin
Is not innot_in
Is emptyempty
Is not emptynot_empty
Is zerozero
Is not zeronot_zero
LabelOperator identifier
Equalsequals
Does not equalnot_equal
Is betweenbetween
Is not betweennot_between
Is beforebefore
Is afterafter
Is emptyempty
Is not emptynot_empty
LabelOperator identifier
Equalsequals
Does not equalnot_equal
Is betweenbetween
Is not betweennot_between
Is beforebefore
Is afterafter
Is emptyempty
Is not emptynot_empty
LabelOperator identifier
Is trueis_true
Is falseis_false

Start with the Field choices actually available for the selected entity in the active migration. A business requirement is suitable for Standard Data Filter only when those fields and the supported operators can express the requirement without changing its meaning.

RequirementStandard Data Filter is suitable whenDo not approximate the requirement with
Only active ProductsAn available Product field represents the exact active or saleable state required by the project.A different visibility, stock, or publication field whose meaning has not been confirmed as equivalent.
Only recent OrdersAn available Order creation date/time field can be evaluated with Is after or Is between using the agreed boundary.An update timestamp when the requirement is based on when the Order was created.
Products from selected Categories onlyAn available Product condition represents the required Product-to-Category membership.Product name, SKU, Category selection, or another field that does not prove Category membership.
Customers who placed at least one OrderAn available Customer condition represents the required Customer-to-Order relationship or the approved equivalent.Customer creation time, status, or another unrelated Customer field.
Products that are in stockThe project defines what in stock means and the available Product fields can express that exact rule, such as the required stock state, quantity rule, or location-aware condition.A generic status rule when stock depends on quantity, stock management, or location.
Valid or unused CouponsThe project defines valid and unused, and available Coupon fields can represent every required condition, such as status, effective dates, or usage boundaries.A single status or date field unless it fully represents the approved business rule.
Blog Posts published after a dateAn available Blog Post field represents the actual publication time required by the project.Created Time or Updated Time when the requirement is specifically based on publication time.

Before continuing, read the generated expression from left to right and confirm that the selected Field, Operator, Value, and AND / OR logic describe the intended record scope. After a Demo or Full Migration, validate representative records on both sides of the boundary: records that should migrate and records that should be excluded.

If the migrated scope is broader or narrower than intended, review the field type, operator, comparison value, and rule combination before running the filter again. For a directly edited expression, also check the operator identifiers and grouping syntax. Requirements that cannot be represented safely with the supported operators should be reviewed for Custom Service rather than approximated with a different condition.

Rules inside an Entity Filter are evaluated from top to bottom. AND / OR controls how the rules in that filter are combined.

  • Click x to remove an individual rule.
  • Use the remove control for the Entity Filter to delete the entire filter group.

If Data Transformation is included, configure it next. Otherwise continue to the next Add-on shown in Add-ons, preserving the required processing sequence.