Data Filtering is the process of choosing a smaller part of a Data Set and using that subset for viewing or analysis.
Filtering may be used to:-
- Look at results for a particular period of time.
- Calculate results for particular groups of interest.
- Exclude erroneous or bad observations from an analysis.
- Train and validate statistical models.
Filtering requires a specific a rule or logic to identify the cases you want to included or excluded in the analysis. Filtering can also be referred to as subsetting data, or a data drill-down.
Data Sorting is the process that involves rearranging the Data into some meaningful order to make it easier to understand, analyze or visualize.
When working with Data, sorting is a common method used for visualizing data in a form that makes it easier to comprehend the story the Data is telling.
Data Filtering and Sorting
Indigo DQM Data Management Engine Data Execution Plans Data can be Filtered using Data Filtering.
Enabling Data Filtering and Sorting
A Data Filter can be applied to the Data Execution Plan to return even more specific results. To Enable Data Filtering check the option and either Add member(s) to the Data Filter manually or use the Filter Designer.
For example, in the above Test Data if a Select Filter is applied for Name = 'Cool Doc Fee' then only the Fees with this Name will be returned. Also, additional sorting can be applied to the Data Execution Plan to sort results by specific Data Columns.
The results can be limited to a maximum number of Data Rows by setting the Row Limit.
Data Filter Designer
The Data Filter Designer can be used to design Data Filters and Sorting on Data Columns.
Select the Data Columns to Filter and / or Sort from the Dropdown lists in the Column Headers.
Click Run Filter to apply the Data Filter and view the Filtered Data. Click OK to apply the Filter to the Data Execution Plan.