UPCOMING WEBINAR: Run Research Your Way With AI Skills Quantum is an analytics software that has been around for a long time. Many customers and their clients who want to transition to more modern software may want to exactly replicate the significance testing for legacy analyses.
Method - Configure Stat Testing in Displayr
- Select a table and go to the object inspector
.
- Go to Appearance > Appearance > Significance > Advanced.
- Make the following changes in Statistical Assumptions settings:
- Change Show significance to Compare columns.
- Change both Multiple comparison correction settings in Exception Tests and Column Comparisons to None.
- Set the Minimal sample size for testing on the Significance Levels tab to its level in Quantum (which defaults to 30).
- Change the Test Type > Proportions test setting to Quantum.
- Change the Test Type > Means test setting to Quantum.
- Change Significance Levels > Weights and significance to Kish's approximation.
- Uncheck Column Comparisons > Recycle column letters.
- Replace the No test symbol with **.
- In the Significance levels and appearance grid, copy the one uppercase Column letters fields (i.e., A,B,C,...,) and paste it over the top of each of the lowercase fields (i.e., a,b,c,...,). Note that this will remove Displayr's default of using uppercase and lowercase to denote different levels of significance. However, it will not precisely replicate Quantum's use of column letters, as Displayr assigns a letter to NET fields but Quantum does not. Two ways of resolving this are to:
- Remove the NET categories from within Spans.
- Manually change the contents of Column letters to exactly replace Quantum if so required, but this will need to be redone for each question used in the columns of tables.
- Where a Binary - Multi question is in the columns of a table or analyzing a Numeric - Grid, Binary - Multi Grid or Nominal - Multi SUMMARY tables set Overlaps to Dependent.
Method - To Look into Differences in Results
- Move the NET categories to be at the beginning top/left of the tables (and sections within a table where Spans are used).
- Ensure that the base used in statistical comparisons is equivalent (e.g., on a Binary - Multi Grid, Quantum's base is the total number of responses, whereas Displayr's is the total number of respondents.
- Ensure that the rounding is being computed in a way consistent with Displayr (Displayr rounds up; by default, Quantum rounds to even).
- Check that the percentages and means being compared in the statistical tests are the same. Where they differ this likely relates to the base. Sometimes Filters can be used to get Displayr to replicate Quantum's percentages (however, keep in mind that this is something that is only done to aid in comparison rather than being a desirable approach to compute percentages).
- Ensure that any filters are equivalent (including Quantum's Interview Filter settings).