How to Split a Sample

This article describes how to create a filter for splitting your sample. This feature has multiple use cases, such as splitting the sample for predictive modeling such as regression; for creating a training, validation, and testing sample based on a filter; or for removing a proportion of a sample. 

This article explains the required steps to generate each of the below three filter examples. 

Requirements

• A Displayr document containing a data set.

Please note this requires the Data Stories module or a Displayr license.

Method - creating a training and testing filter

1. Go to the Anything icon menu, and select Filtering > Model Checking > Filters for Train-Test Split.
2. When prompted input the percentage of the data sources that should be used as the training set. By default, this is set to 70%. Select OK. 
3. Displayr will create a Train test split variable usable as a filter. 

Method - creating a training, validation, and testing filter

1. Go to the Anything menu, and select Filtering > Model Checking > Filters for Train-Validation-Test Split.
2. When prompted input the percentage of the data sources that should be used as the training set. By default, this is set to 50%. Select OK. 
3. In the second prompt, input the percentage of the data sources that should be used as the validation set. By default, this is set to 25%. Select OK. 
4. Displayr will create a Train validate test split variable usable as a filter. 

Method - removing a proportion of a sample 

1. Go to the Anything icon , and select Filtering > Model Checking > Filters for Train-Test Split.
2. When prompted input the percentage of the data sources that you wish to keep. By default, this is set to 70%. Select OK. 
3. Displayr will create a Train test split variable usable as a filter.
4. To remove the respondents from the data set, select the name of your data set from the Data Sources tree.
5. Go to the object inspector > General > GENERAL > Unique identifier and select a variable with unique values, or select [Use case number]. CAUTION: Displayr will use the ordering of the data set to identify observations. If your data might change, you should not choose "use case number" unless new observations will always be added to the end of the data set.
6. Select any variables in your Data Sources tree that you wish to view as raw data, and right-click > View in Data Editor.
7. Select your filter variable in the Filter drop-down so that all the rows selected by the filter will appear in green. Here, we have applied our Testing Sample filter while showing our Location data:
8. Now right-click the row header of any row matching the filter and select Delete Row(s) Matching Filter to delete these cases from your data set.
9. OPTIONAL: You can return deleted cases to your data set by going back to the Data Editor and right-clicking any row header > Undelete All Rows or clicking on the data set name in the Data Sources tree and clicking Restore deleted cases from the object inspector.

See Also

How to Remove Cases From Raw Data Using a Filter

How to Create a Simple Filter

How to Tag a Variable as a Filter

How to Apply a Filter