The Qualcha Library is a tool developed as part of aytm’s Data Quality initiatives. It provides a curated set of pre-built survey questions designed to detect low-quality responses and ensure data integrity.

A failure on any single question in the library should not be interpreted as an automatic disqualification. These items are designed to act as data quality indicators and should be considered alongside other checks and metrics when evaluating respondent quality.

Navigating the Qualcha Library

The Qualcha Library includes 11 different themes, each with an intuitive title to help you quickly identify the type of data quality check it performs. Before placing a Data Quality Check question, ensure you have reviewed the guidelines of use. You can find these annotated within each Qualcha element as you select it for placement in your survey.

1. Click the Question Library icon in the Collaboration Tools menu on the right side of the Survey Editor to access the Qualcha Library.
2. Click on a snippet for a brief description, including its purpose, format, and guidelines for use.
3. Use the Add dropdown menu or drag and drop the item into your survey.

⚠️ Note: Logic is programmed into each Qualcha Library question. Do not modify this logic, as it ensures our team can detect low-quality responses and maintain data integrity.

Examples of Snippets and Their Rules

Video Comprehension Snippet 

This snippet includes two linked questions:

• Question 1: A video the respondent must watch.
• Question 2: A follow-up question asking which character appeared in the video.

Rule: These questions must be used together and in the specified order.

Heat Map Questions 

This snippet includes two versions of a heat map question to accommodate different devices:

• PC Version
• Mobile Version

Rule: Only one version will be shown to the respondent based on their device. Both PC and Mobile versions must be included in the survey.

Answer Consistency Check

This snippet includes two similar questions designed to detect inconsistencies:

• Question 1: Appears at the beginning of the survey.
• Question 2: Should be placed toward the end.

Rule: These questions must not appear next to each other. Although they are inserted together, it's the user's responsibility to move the second question to the appropriate location.

Typical Cost Check

This snippet includes one slider question with the following rules.

⚠️ Note: You only need to edit this snippet if fielding outside the US.

The default is set for US currency:

• Sum/Units field = 100
• Logic is set to flag at $20 and above: [attentioncheck = 1 if Q1SQ1Rv>20]

Mandatory edits for non-US surveys:

• Update the Sum/Unit field to an acceptable range and cost of coffee in the local region.
• Adjust the logic to reflect a realistic maximum price in that region and currency.

Example: If fielding to Thailand, a cup of coffee can range from 30–145 Thai Baht (THB). You would:

1. Update the Sum/Units field to give a wider range (e.g. 800).
2. Update the logic to flag at 200 rather than 20: [attentioncheck = 1 if Q1SQ1rv>200]

Using Qualcha Questions for Filtering and Virtual Questions

Qualcha Library questions are primarily intended for aytm's panel operations team to detect low-quality responses and ensure data integrity. However, all users can access this information for filtering and Virtual Question (VQ) purposes.

To filter by Qualcha questions:

1. Click the filter icon in the left toolbar of the Stats page.
2. Scroll to Filter by Variables.
3. Select the Attention Check dropdown and check the box.
4. Click Apply Filters.

To create a Virtual Question using Qualcha questions:

1. Drag and drop a Virtual Question from the Data Lab into the Stats page.
2. Select Attention Check from the Optional Presets dropdown.
3. Click Generate Visualization.

Multilingual Surveys with Qualchas

When creating a multilingual or multi-country survey with the Qualcha Library, each question includes a banner image labeled: "This question is for quality assurance purposes only." If your survey is being fielded in a language other than English, all Qualcha content will need to be translated and localized with the rest of your survey. At this time, we do not offer baked-in, translated Qualcha libraries in languages other than English. 

Frequently Asked Questions

• How many Qualcha snippets should I include per survey? For surveys lasting 10 minutes or less, use only one Qualcha. For surveys 15 minutes or longer, you may include up to two. We do not recommend more than two, as this may impact respondent engagement.
• When is one Qualcha snippet recommended over another? Qualcha questions are versatile and effective across a wide range of research topics. Choose the question that best aligns with the tone, audience, and subject matter of your study. Refer to the annotations within the Qualcha snippet to understand any groups we do not recommend using that specific Qualcha type for.
• Can I still use my own red herring questions? Yes, but aytm strongly recommends selecting from the Qualcha Library, as these questions have been developed by research experts and have undergone extensive testing to ensure quality and reliability.

⚠️ Note: We will continue to enhance the library with additional features and content in future updates. We encourage you to explore the available snippets, adhere to the usage guidelines, and support our shared commitment to maintaining the highest standards of data integrity.

If you have any questions, reach out to support@aytm.com or click Chat with us at the top of the page.