Data Filtering is the process of choosing a smaller part of a Data Set and using that subset for viewing or analysis.

Filtering may be used to:-

• Look at results for a particular period of time.
• Calculate results for particular groups of interest.
• Exclude erroneous or “bad” observations from an analysis.
• Train and validate statistical models.

Filtering requires a specific a rule or logic to identify the cases you want to included or excluded in the analysis. Data Filtering can also be referred to as Data “subsetting” or a Data “drill-down”.

Data Sorting is the process that involves rearranging the Data into some meaningful order to make it easier to understand, analyze or visualize.

When working with Data, sorting is a common method used for visualizing it in a form that makes it easier to comprehend the story the Data is telling.

Data Filtering and Sorting

Indigo DQM's Data Management Engine (DME) features advanced filtering and sorting that can be applied to Data Execution Plans.

Select the Results tab for the Data Execution Plan and check the option to 'Enable Data Filtering'.

Enabling Data Filtering and Sorting

A Data Filter can be applied to the Data Execution Plan to return even more specific results. To enable Data Filtering check the option and either add member(s) to the Data Filter manually or use the Data Filter Designer.

For example, if a Select Filter is applied for Name = 'Cool Doc Fee' then only the Fees with this criteria will be returned. Also, additional sorting can be applied to the Data Execution Plan to sort results by specific Data Column(s).

The results can be limited to a maximum number of Data Rows by setting the Row Limit.

Data Distinct Values

Data Distinct Values and Data Function determines how Data is summarized in a Data Table.

Functions for summarising Data include Sum, Average, Count, Max, Min, First, Last and Exists.

Enable Distinct Values and choose the relevant Data Column(s) and function for the Data Table according to how the Data needs to be summarised or presented.

Data Filter Designer

The Data Filter Designer is a powerful tool to help with the design and application of Data Filters and Data Sorting on Data Columns.

Select the Data Columns to filter and / or sort from the drop-down lists.

Click the 'Execute' button to apply the Data Filter and view the filtered Data. Click OK to apply the Data Filter to the Data Execution Plan.