The Results page shows a heatmap, shelf statistics, and product metrics for each Shelf Test question.
Learn more about Shelf Test in our Lighthouse Academy course!
Viewing the Heatmap
- Click the Shelf Metrics dropdown to toggle the shelf view:
- Shelf Heatmap — the aggregate click data overlaid on the originally programmed shelf.
- Product Heatmap — visualizes total product clicks with a color scale ranging from the minimum (green) to the maximum (red) quantity.
- Clicks — precise coordinates where respondents clicked a shelf.
- Shelf view — a view of the originally programmed shelf, without respondent data.
- Click the hamburger menu to download any image as a PNG, PDF, or EPS file.
⚠️ Note: If an item is marked as unpurchasable via the checkbox within the product card, clicks will populate on the heatmap, but no other results will be available for that product within the Reports page since the product could not be added to a cart. If Randomization was enabled, respondents may have seen a different shelf layout, but the Results display the image as originally programmed.
Analyzing Shelf Summary Statistics
When analyzing the results of a Shelf Test, the geometric mean is often used as a way to account for outliers in the data. Unlike the standard arithmetic mean, the geometric mean does a better job at not being influenced by extreme outliers.
In the case of the Shelf Test — because there could be so much behavioral variation where some respondents might fill up their carts — rather than removing them as outliers altogether, the geometric mean acknowledges this could be real-life behavior but does not let it skew the results. For example, average cart size is calculated using the geometric mean because it is a more robust metric that avoids the extreme influence of outliers.
Summary statistics for the shelf are displayed below the shelf visualization:
- Average cart spend — the average sum (arithmetic mean) of money spent by each respondent.
- Average cart size — the average number (arithmetic mean) of products purchased by each respondent.
- Average number of unique products in cart — the average number (arithmetic mean) of unique products purchased by each respondent.
- Total products purchased — the count of products purchased by all respondents in the shelf exercise.
- Total products picked up — the total number of products picked up on the shelf across all respondents.
- Total product spend — the sum of money spent on products purchased by all respondents in the shelf exercise.
- Average time at shelf — the average time (geometric mean) spent by each respondent from entering the exercise to exiting.
- Average time to first click — the average time (geometric mean) each respondent took from entering the exercise to clicking on a product to examine it closer for the first time.
- Average attention span per product — the average (arithmetic mean) of the average amount of time each product's details were viewed by respondents, calculated using the geometric mean within respondent.
⚠️ Note: Average cart spend was previously calculated using the geometric mean. If you need to compute the geometric mean of the amounts spent by respondents, use the Excel formula
=GEOMEAN. If you have any questions, reach out to support@aytm.com.
Analyzing Product Metrics
- Click the Product Metrics dropdown below the shelf summary statistics to toggle between results:
- Purchase selection — represents the proportion of individuals who bought a product.
- Purchase quantity — the average number (arithmetic mean) of a product purchased among those who purchased that product.
- Purchase amount — the average spend (arithmetic mean) on a product among those who purchased that product.
- Purchased, picked up only — shows the percentages of individuals who purchased the product, those who solely picked it up, and those who did neither. Picked up only shows those who picked up the product but did not buy it. Total products picked up shows those who picked up the product and bought it.
- Attention span — the average time (geometric mean) spent viewing a product's detail view, among those who clicked on the product.
- Time to cart — the average time (geometric mean) between starting the task and adding a product to cart among those who added that product at any point in the exercise.
- Time to first click — the average time (geometric mean) between entering the exercise and clicking on a product to examine it closer for the first time.
- Hover over bars to get a further breakdown of data per product. When Purchase selection is visualized, hovering will also show live significance testing.
⚠️ Note: Purchase amount was previously calculated using the geometric mean. If you need to compute the geometric mean of the purchase amounts, use the Excel formula
=GEOMEAN. If you have any questions, reach out to support@aytm.com.
Exporting the Results
- Click the Export icon in the left-hand navigation.
- Select Raw CSV or Excel to yield a report that shows only purchase intent.
- Select Excel with coded map or JMP to yield a report that shows additional metrics. In Excel with coded map, each Shelf Test question added will yield its own sheet of data.