Skip to main content

​
Tables and Columns

​
Parent and Child Tables

​
Results

​
Options

The Options panel on the right side of the Edit Source Structure dialog contains settings that control how the connector processes records. These settings are available alongside the table designer and apply to the entire query.

  • Only process new or changed records: Enables incremental processing so that the connector only selects rows that are new or changed since the last run.
  • Update [column] with [value] when rows are processed: Updates a column with a specified value after each row is processed.

You can also preview the output structure or view the underlying XML configuration by toggling Preview XML or Code View at the top of the Edit Source Structure dialog.

​
Joined Tables

This produces a query equivalent to:
To join more than two tables, click Add Join to add another join row. Each additional row joins a new table to the result of the previous join. When you are done configuring the join, click Apply.

​
Results

After you click Apply, a Results node appears in the results structure. To configure the columns and filters for your join output, click the ellipsis (...) on the Results node and choose Results Settings.

The Edit Results Settings dialog opens with two tabs: Columns and Filters.

Edit Results Settings dialog showing the Columns tab with source table tags

In the Columns tab, all columns from all joined tables are listed. Each column displays a tag indicating its source table. By default, all columns are selected. Uncheck a column to exclude it from the query output.

When two joined tables share a column name, the connector automatically prefixes the duplicate column with its table name to avoid collisions.

At the bottom of the Columns tab, use the Order by field to sort the output by a column, and choose ASC (ascending) or DESC (descending) order.

The Filters tab lets you add filters to limit the rows the connector selects. See Filters for more information.

​
Options

The Options panel on the right side of the Edit Source Structure dialog contains settings that control how the connector processes records. These settings are available alongside the JOIN designer and apply to the entire join query.

  • Use column [x] for processing new or changed records: Enables incremental processing so that the connector only selects rows that are new or changed since the last run. In a Joined Tables configuration, this column must come from the base (leftmost) table. Columns from joined tables are not available for this setting.
  • Update [column] with [value] when rows are processed: Updates a column with a specified value after each row is processed.

You can also preview the output structure or view the underlying XML configuration by toggling Preview XML or Code View at the top of the Edit Source Structure dialog.

​
Filters

You can optionally add filters to limit the data the connector selects. Click the Filters tab in the settings dialog to configure filters. The connector translates your filters into query syntax.

You do not need to apply a filter to your data if it does not suit your use case.

​
Creating a Filter

To create a filter, follow these steps:

  1. Click Add Filter.
  2. In the column dropdown, choose the column that you want to filter.
  3. In the condition dropdown, choose the filtering condition. The available conditions depend on the data type of the column you selected. For example, a numeric column has the condition Less Than or Equal To, whereas a string column has Contains.
  4. Enter a value in the value field. If the condition does not require a value (for example, Is Null), the value field is not shown.

The image below shows an example of a filter on a column named Vendor. With this filter in place, the connector only selects rows where the Vendor column contains CData.

Filter configured on the Vendor column with Contains CData condition

​
Filter Groups

You can apply multiple filters by clicking Add Filter and creating more filters. All filters belong to the same group by default. Click Add Group to create a nested group and separate filters by different logic.

Each group has the following options at the top:

  • NOT toggle: Inverts the logic of the entire group. For example, toggling NOT on a group that contains Amount Less Than or Equal To 5000 instructs the connector to select only rows where the amount is greater than 5000.
  • And / Or toggle: Determines how this group relates to adjacent filters or groups.
    • If you select And, this group's condition must be true in addition to adjacent conditions.
    • If you select Or, this group's condition is an alternative to adjacent conditions.

The screenshot below shows an example with multiple filter groups.

Multiple filter groups showing AND and OR logic

In this example, the filter condition is met when all of the following are true:

  • The Vendor column contains CData
  • The Status column equals Active or Pending
  • The Amount column is not less than or equal to 5000 (that is, Amount is greater than 5000)

If this filter condition is met, the connector selects the matching data and passes it down the flow.

​
Example Arc Flow