The Progressive Matrix question type allows you to organize groups of items that can be answered on the same answer scale in a grid, with either a single choice (radio button) or multi-choice (checkbox) used for selection.
Progressive Matrix focuses respondents' attention on one column or one row at a time — a process called progressive flow. After selections are made for this manageable cluster of answer options, respondents can move on to the next column or row and choose among the same answer choices for the next item on the list.
Want to learn more about our question types? Enroll in our Question Types Overview course in the Lighthouse Academy!
Building a Progressive Matrix Question
- In the Survey Editor, click the Progressive Matrix icon in the question menu, or drag the icon into place.
- Type or paste your question into the Question field.
- Type entities for respondents to evaluate into the Matrix Sub-Question fields and click the + icon to add additional options (up to 10). Use copy/paste to automatically populate answer options.
- Type or paste up to 12 Matrix answer options into the Matrix Answer Option fields, including an N/A option if desired.
- Hover over a number and click the X to delete a Matrix Sub-Question or Matrix Answer Option.
- Activate the Randomize checkbox to shuffle the Sub-Question or Matrix Answer order for each respondent.
- Click the anchor icon to the right of an entity to lock the option in place on the list, despite randomization.
Customizing a Question
- Click the Answers in columns dropdown to toggle whether respondents see answers in rows or columns.
- Click the Single Choices dropdown to choose whether respondents must select only one answer per row/column or if they can choose multiple.
- Activate the PC and Smartphone checkboxes to split Sub-Questions into separate pages.
💡 Tip: Split by pages is the default setting for Smartphones and is recommended for the best possible respondent experience.
Using Progressive Flow
When Multiple Choices is selected, additional options appear:
- Click the Progressive Flow dropdown and select Off to allow respondents to answer Sub-Questions in any order.
- Check the N/A checkbox to enable an exclusive option.
- Click the Min Required dropdown to select a minimum number of answers per Sub-Question.
- Click the Max Allowed dropdown to apply a maximum number of selections per Sub-Question.
Using Exclusive Logic
Plus, Max, and Enterprise users can use aytm Logic to prohibit respondents from selecting certain answer options together in a Multiple Choices Progressive Matrix. Learn more about Exclusive Logic.
- When Multiple choices is selected and Sub-Questions and answer options are programmed, click into the answer option field.
- Type [exclusive and enter the reference(s) of the answer(s) you'd like to restrict when a respondent has chosen that answer, including the sub-question number.
- Close the logic with a ].
- Preview the question to make sure the logic is working as intended.
Analyzing Progressive Matrix Results
On the Results page, the default view (Stacked 100%) shows answer percentages stacked in color-coded columns, with expandable data on the sub-question level displayed below.
- Hover over a bar to see the percentage and number of respondents who selected each answer option.
- Click the Stacked 100% dropdown to choose another visualization:
- Stacked Counts — shows the actual number of respondents for each answer along the y-axis. If all sub-questions have the same base size, this view won't differ much from Stacked 100%.
- Means — shows averages for each sub-question compared side by side, with drill-down statistics for each.
- Box Scores — shows calculations for Top 1 box, Top 2 box, Top 3 box, Top weighted, Bottom 1 box, Bottom 2 box, Bottom 3 box, and Bottom-weighted.
- Click the chart icon in the upper right corner of the question results to toggle to a horizontal chart.
- Click on a Sub-Question header to view a different breakdown for that particular question.
💡 Tip: Click the help bubble next to a Box Score selection to see how it is calculated. The "top" recognized by the system is always Answer Option 1, and the "bottom" is always the last answer option programmed.
Take a test drive on real-world results for this question type! Explore a live demo report.
