--- title: Unmoderated Online vs. Moderated Onsite Studies description: This article breaks down the pros and cons of choosing whether to opt in for unmoderated online vs. moderated onsite studies. image: https://info.keylimeinteractive.com/hubfs/remote_moderation.png --- [![Key Lime Logo](https://info.keylimeinteractive.com/hs-fs/hubfs/Key%20Lime%20Logo.png?width=200&height=39&name=Key%20Lime%20Logo.png "Key Lime Logo")](https://keylimeinteractive.com/) - SERVICES - [All Services](https://keylimeinteractive.com/services) - [UX Strategy](https://keylimeinteractive.com/ux-strategy-design/) - [User Research](https://keylimeinteractive.com/user-research/) - [UX/UI Design](https://keylimeinteractive.com/ux-design-strategy/) - [EmTech Strategy](https://keylimeinteractive.com/emerging-technology/) - OUR WORK - [Our Approach](https://dev.keylimeinteractive.com/our-approach/) - [Enterprise Clients](https://keylimeinteractive.com/work/) - [Public Sector](https://keylimeinteractive.com/public-sector-gsa-schedule/) - [ABOUT US](https://keylimeinteractive.com/about-us/) - [Who We Are](https://keylimeinteractive.com/about-us/) - [People](https://keylimeinteractive.com/our-team/) - [Careers](https://workforcenow.adp.com/mascsr/default/mdf/recruitment/recruitment.html?cid=1eb079d3-bb50-438a-a731-eaa18a982193&ccId=19000101_000001&lang=en_US) - INSIGHTS - [CX Blog](https://info.keylimeinteractive.com) - [Events](https://keylimeinteractive.com/upcoming-events/) - [Competitive Indexes](https://keylimeinteractive.com/reports/#rankings) - [White Papers](https://keylimeinteractive.com/reports/) - [CONTACT US](https://keylimeinteractive.com/contact/) [![](https://keylimeinteractive.com/wp-content/uploads/2024/02/key-lime-interactive.svg)](https://info.keylimeinteractive.com/) - [What We Do](https://keylimeinteractive.com/ux-research-services/) - [Proven Process](https://keylimeinteractive.com/proven-process/) - [About Us](https://keylimeinteractive.com/about-us/) - [Meet Our Team](https://keylimeinteractive.com/our-team/) - [Careers](https://keylimeinteractive.com/careers/) - [News](https://keylimeinteractive.com/news/) - [Blog](https://info.keylimeinteractive.com/) - Resources - [Case Studies](https://keylimeinteractive.com/case-studies/) - [Events](https://info.keylimeinteractive.com/events) - [What We Do](https://keylimeinteractive.com/ux-research-services/) - [Proven Process](https://keylimeinteractive.com/proven-process/) - [About Us](https://keylimeinteractive.com/about-us/) - [Meet Our Team](https://keylimeinteractive.com/our-team/) - [Careers](https://keylimeinteractive.com/careers/) - [News](https://keylimeinteractive.com/news/) - [Blog](https://info.keylimeinteractive.com/) - Resources - [Case Studies](https://keylimeinteractive.com/case-studies/) - [Events](https://info.keylimeinteractive.com/events) [Contact us](https://info.keylimeinteractive.com/contact) [![](https://keylimeinteractive.com/wp-content/uploads/2024/02/key-lime-interactive.svg)](https://info.keylimeinteractive.com/) - [What We Do](https://keylimeinteractive.com/ux-research-services/) - [Proven Process](https://keylimeinteractive.com/proven-process/) - [About Us](https://keylimeinteractive.com/about-us/) - [Meet Our Team](https://keylimeinteractive.com/our-team/) - [Careers](https://keylimeinteractive.com/careers/) - [News](https://keylimeinteractive.com/news/) - [Blog](https://info.keylimeinteractive.com/) - Resources - [Case Studies](https://keylimeinteractive.com/case-studies/) - [Events](https://info.keylimeinteractive.com/events) - [What We Do](https://keylimeinteractive.com/ux-research-services/) - [Proven Process](https://keylimeinteractive.com/proven-process/) - [About Us](https://keylimeinteractive.com/about-us/) - [Meet Our Team](https://keylimeinteractive.com/our-team/) - [Careers](https://keylimeinteractive.com/careers/) - [News](https://keylimeinteractive.com/news/) - [Blog](https://info.keylimeinteractive.com/) - Resources - [Case Studies](https://keylimeinteractive.com/case-studies/) - [Events](https://info.keylimeinteractive.com/events) [Contact us](https://info.keylimeinteractive.com/contact) - - - # Unmoderated Online vs. Moderated Onsite Studies [By Key Lime Interactive](https://info.keylimeinteractive.com/author/key-lime-interactive) October 06, 2016 [Research Methods](https://info.keylimeinteractive.com/topic/research-methods), [UX Strategy](https://info.keylimeinteractive.com/topic/ux-strategy), [Remote Testing](https://info.keylimeinteractive.com/topic/remote-testing) - [Tweet](https://twitter.com/share) ![](https://info.keylimeinteractive.com/hubfs/remote_moderation.png) ###  **When you have a hammer, everything looks like a nail. But is that hammer the right tool for the job?**       Several third-party remote usability testing suites specialize in hosting unmoderated studies, and all promise powerful insights delivered at a low-cost. The companies can quickly recruit users, then run them through usability scenarios, establish benchmarks, conduct large-scale user research and more. But just because you have such a tool at your disposal, does that mean it’s the right tool for your project? When would you want to opt for an unmoderated online test instead of moderated sessions?       To answer that question of whether to choose unmoderated online vs. moderated onsite studies, define your goals and decide what you hope to learn. The more specific and better defined your goals are, the easier it is to quantify potential answers, and the more likely a remote unmoderated tool may be useful. Examples of research questions where unmoderated studies work well: - What common problems do users have trying to purchase a product on our website? - Is it easier for users to find this control if we put it at the top left of the screen or the top right? - In what order do users expect to find our product categories?       The key words here are **specific** and **defined**. Online unmoderated studies excel at evaluating clearly-defined computer-related tasks that participants can perform without guidance. The tools can recruit and execute study sessions much faster since they can run in parallel instead of serial scheduling at a research facility.  The flip side of the faster execution time is that it’s much harder to make changes mid-stream to adapt to unforeseen circumstances or stakeholder requests. Online unmoderated studies also require reasonably tech-savvy participants who are comfortable and able to use their computer or mobile phone to perform the activities. They may not be as well-suited for specialized user groups, such as certain patient populations, lower-literary adults, or children, where they might be harder to recruit, or more likely to need assistance, or both.       The lack of researcher-participant interaction means that an individual session is a closed system with a rigid structure. The only instructions the participant sees, the only questions they can answer, are what has already been scripted. Studies where the participant might need additional guidance during a session (i.e. testing a partially functional prototype with an incomplete, buggy interface) aren’t good candidates for unmoderated studies because there is a higher risk the participants might quit in frustration, or be unable to continue without a moderator to steer the session back on task. Participants struggling to complete tasks provide critical insights into the flaws of a product, and the greatest weakness of an unmoderated study is the inability to ask additional targeted questions during the session. Probing for more information about why something happened is crucial for assessing the root cause of an issue.      That is where moderated studies excel; their primary virtue is their dynamic nature. Studies requiring flexibility, close observation, the ability to provide guidance or probe for additional information, are best executed in a research facility with a moderator. Examples of research questions where moderated studies are the best fit: - Before we design the interface, what do people actually want to do with our hypothetical finance app? - How well does what our finance app allows people to do match up with what they actually want do, and why or why not? - How easy or difficult is it for people to use this handheld vacuum for a quick clean-up, and why?        As powerful as the dashboards and exported spreadsheets of remote study tools are, a trained user researcher still needs to review the sessions and analyze the findings. This requires a fair amount of secondary work, coding and organizing the data to tell a meaningful story. Also, while many remote study tools enable the quick and easy sharing of video clips from individual sessions, currently none provide ways to anonymize video footage – a valid concern in a field where protection of the participant is paramount.      The ultimate value of the data gathered by these studies, remote and unmoderated or onsite and moderated, is determined by the skill and training of the individuals designing them and analyzing the results. The first challenge is to determine the best method to answer the research questions at hand. That is where the UX consultants at Key Lime Interactive come in – to help your team choose the right tool for the job. ![pros and cons table of unmoderated vs moderated studies](https://info.keylimeinteractive.com/hs-fs/hubfs/prosconstableunmoderatedvmoderated-1.jpg?width=707&name=prosconstableunmoderatedvmoderated-1.jpg "pros and cons table of unmoderated vs moderated studies")   **READ MORE:** [Task Analysis: What It Is And Why It Matters](https://info.keylimeinteractive.com/task-analysis-what-it-is-and-why-it-matters), [5 Tips to Recruit and Onboard Participants for Remote Usability Studies ](https://info.keylimeinteractive.com/5-steps-to-recruit-and-onboard-participants-for-remote-usability-testing), [Outstanding UX Research Naturally Leads Us to UX Design](https://info.keylimeinteractive.com/an-8-year-evolution-outstanding-ux-research-naturally-leads-us-to-ux-design), [ROI of User Research](https://info.keylimeinteractive.com/infographic-rio-of-user-research), [Strengths and Weaknesses of a True Intent Study](https://info.keylimeinteractive.com/strengths-and-weaknesses-of-a-true-intent-study) ###### More by this Author [Key Lime Interactive](https://info.keylimeinteractive.com/author/key-lime-interactive) ##### You might also like ![Facilitate Better UXR by Fine-Tuning Soft Skills](https://info.keylimeinteractive.com/hubfs/dylan-gillis-KdeqA3aTnBY-unsplash.jpg) [Facilitate Better UXR by Fine-Tuning Soft Skills](https://info.keylimeinteractive.com/facilitate-better-uxr-by-fine-tuning-soft-skills) October 06, 2016 ![Empathy in UX Research: Why Does it Matter?](https://info.keylimeinteractive.com/hubfs/Canva%20images/white%20paper%20img.png) [Empathy in UX Research: Why Does it Matter?](https://info.keylimeinteractive.com/empathy-in-ux-research-why-does-it-matter) October 06, 2016 ![The Best Career Advice I've Received as a Junior Researcher](https://info.keylimeinteractive.com/hubfs/undefined-1.png) [The Best Career Advice I've Received as a Junior Researcher](https://info.keylimeinteractive.com/the-best-career-advice-ive-received-as-a-junior-researcher) October 06, 2016 #### Comments [Add Comment](https://info.keylimeinteractive.com/unmoderated-online-vs.-moderated-onsite-studies#comment-form) ABOUT KLI [Key Lime Interactive](https://keylimeinteractive.com/about-us)is a user experience research and service design agency, with a sweet spot for emerging technology. As UX experts, our goal is to make your life easier, optimize user experiences, and make the world a better place. - [Recent](https://info.keylimeinteractive.com/unmoderated-online-vs.-moderated-onsite-studies#tabs-0) - [Popular](https://info.keylimeinteractive.com/unmoderated-online-vs.-moderated-onsite-studies#tabs-1) ![Upsell with Purpose: Fueling SaaS Growth Through User Insight](https://info.keylimeinteractive.com/hubfs/Multiethnic%20group%20of%20young%20people%20sitting%20in%20conference%20room%20and%20brainstorming%20on%20business%20meeting.jpeg) [Upsell with Purpose: Fueling SaaS Growth Through User Insight](https://info.keylimeinteractive.com/upselling-in-a-saas-environment-with-a-user-centric-approach) Mar 17, 2020 ![5 Ways to Get the Most Out of Working with a UX Research Consultant](https://info.keylimeinteractive.com/hubfs/Attractive%20businessman%20speaking%20with%20fellow%20coworkers.jpeg) [5 Ways to Get the Most Out of Working with a UX Research Consultant](https://info.keylimeinteractive.com/5-ways-to-get-the-most-out-of-working-with-a-ux-research-consultant) Mar 17, 2020 ![Designing Engagement Through Micro-Interactions](https://info.keylimeinteractive.com/hubfs/AI-Generated%20Media/Images/A%20closeup%20shot%20of%20a%20finger%20gently%20tapping%20a%20digital%20button%20on%20a%20sleek%2c%20modern%20interface.jpeg) [Designing Engagement Through Micro-Interactions](https://info.keylimeinteractive.com/the-significance-of-micro-interactions-in-shaping-user-engagement-and-experience) Mar 17, 2020 ![What is the Keystroke-Level Model?](https://info.keylimeinteractive.com/hubfs/Keystroke.jpg) [What is the Keystroke-Level Model?](https://info.keylimeinteractive.com/what-is-the-keystroke-level-model) Mar 17, 2020 ![Current-State vs. Future-State Journey Mapping](https://info.keylimeinteractive.com/hubfs/destination-2386255_1280.jpg) [Current-State vs. Future-State Journey Mapping](https://info.keylimeinteractive.com/current-state-vs.-future-state-journey-mapping) Mar 17, 2020 ![A History of Voice Technology](https://info.keylimeinteractive.com/hubfs/Screen%20Shot%202020-08-11%20at%2012.18.34%20PM.png) [A History of Voice Technology](https://info.keylimeinteractive.com/history-of-voice-technology) Mar 17, 2020 Create a UX Strategy [![key-lime-interactive-ux](https://info.keylimeinteractive.com/hs-fs/hubfs/key-lime-interactive-ux.png?width=635&height=634&name=key-lime-interactive-ux.png)](https://keylimeinteractive.com/ux-strategy-design) ### Post By Topics - [Research Methods](https://info.keylimeinteractive.com/topic/research-methods) - [UX Strategy](https://info.keylimeinteractive.com/topic/ux-strategy) - [Events & News](https://info.keylimeinteractive.com/topic/events-news) - [UX Research](https://info.keylimeinteractive.com/topic/ux-research) - [User Experience](https://info.keylimeinteractive.com/topic/user-experience) - [User Interface](https://info.keylimeinteractive.com/topic/user-interface) - [UX](https://info.keylimeinteractive.com/topic/ux) - [News](https://info.keylimeinteractive.com/topic/news) - [Mobile UX](https://info.keylimeinteractive.com/topic/mobile-ux) - [Usability Testing](https://info.keylimeinteractive.com/topic/usability-testing) - [Competitive Research](https://info.keylimeinteractive.com/topic/competitive-research) - [UX Design](https://info.keylimeinteractive.com/topic/ux-design) - [Eye tracking & Biometrics](https://info.keylimeinteractive.com/topic/eye-tracking-biometrics) - [Qualitative Research](https://info.keylimeinteractive.com/topic/qualitative-research) - [Customer Experience](https://info.keylimeinteractive.com/topic/customer-experience) - [Journey Mapping](https://info.keylimeinteractive.com/topic/journey-mapping) - [DEI](https://info.keylimeinteractive.com/topic/dei) - [Remote Testing](https://info.keylimeinteractive.com/topic/remote-testing) - [User Experience Consultant](https://info.keylimeinteractive.com/topic/user-experience-consultant) - [VR](https://info.keylimeinteractive.com/topic/vr) - [XR](https://info.keylimeinteractive.com/topic/xr) - [Multicultural UX](https://info.keylimeinteractive.com/topic/multicultural-ux) - [Mobile Banking](https://info.keylimeinteractive.com/topic/mobile-banking) - [Quantitative Research](https://info.keylimeinteractive.com/topic/quantitative-research) - [App Development](https://info.keylimeinteractive.com/topic/app-development) - [User Experience Research Studies](https://info.keylimeinteractive.com/topic/user-experience-research-studies) - [Diversity Equity Inclusion](https://info.keylimeinteractive.com/topic/diversity-equity-inclusion) - [UI](https://info.keylimeinteractive.com/topic/ui) - [Voice Technology](https://info.keylimeinteractive.com/topic/voice-technology) - [Accessibility](https://info.keylimeinteractive.com/topic/accessibility) - [Behavioral Personas](https://info.keylimeinteractive.com/topic/behavioral-personas) - [Diary Study & Ethnography](https://info.keylimeinteractive.com/topic/diary-study-ethnography) - [Global Research](https://info.keylimeinteractive.com/topic/global-research) - [Inclusivity Index](https://info.keylimeinteractive.com/topic/inclusivity-index) - [User Testing](https://info.keylimeinteractive.com/topic/user-testing) - [Card Sort & Tree Test](https://info.keylimeinteractive.com/topic/card-sort-tree-test) - [Human-first Approach](https://info.keylimeinteractive.com/topic/human-first-approach) - [Personalization](https://info.keylimeinteractive.com/topic/personalization) - [CX](https://info.keylimeinteractive.com/topic/cx) - [Diary Study](https://info.keylimeinteractive.com/topic/diary-study) - [In-Depth Interviews](https://info.keylimeinteractive.com/topic/in-depth-interviews) - [Inclusivity](https://info.keylimeinteractive.com/topic/inclusivity) - [A/B Testing](https://info.keylimeinteractive.com/topic/a-b-testing) - [CX Research](https://info.keylimeinteractive.com/topic/cx-research) - [IDIs](https://info.keylimeinteractive.com/topic/idis) - [Bias](https://info.keylimeinteractive.com/topic/bias) - [Personas](https://info.keylimeinteractive.com/topic/personas) - [Research Participant Recruitment](https://info.keylimeinteractive.com/topic/research-participant-recruitment) - [Usability](https://info.keylimeinteractive.com/topic/usability) - [Women in UX](https://info.keylimeinteractive.com/topic/women-in-ux) - [Workshops](https://info.keylimeinteractive.com/topic/workshops) - [Customer Journey Mapping](https://info.keylimeinteractive.com/topic/customer-journey-mapping) - [Remote Research](https://info.keylimeinteractive.com/topic/remote-research) - [Research Analysis](https://info.keylimeinteractive.com/topic/research-analysis) - [UX Methods](https://info.keylimeinteractive.com/topic/ux-methods) - [Webinars](https://info.keylimeinteractive.com/topic/webinars) - [Anthropology](https://info.keylimeinteractive.com/topic/anthropology) - [Competitive Benchmarking](https://info.keylimeinteractive.com/topic/competitive-benchmarking) - [Competitive Insights](https://info.keylimeinteractive.com/topic/competitive-insights) - [Competitive Intelligence](https://info.keylimeinteractive.com/topic/competitive-intelligence) - [Confirmation Bias](https://info.keylimeinteractive.com/topic/confirmation-bias) - [Ethnography](https://info.keylimeinteractive.com/topic/ethnography) - [Gaming](https://info.keylimeinteractive.com/topic/gaming) - [Healthcare CX Design](https://info.keylimeinteractive.com/topic/healthcare-cx-design) - [Healthcare Customer Experience Design](https://info.keylimeinteractive.com/topic/healthcare-customer-experience-design) - [Heuristics](https://info.keylimeinteractive.com/topic/heuristics) - [Unmoderated](https://info.keylimeinteractive.com/topic/unmoderated) - [sample size calculation](https://info.keylimeinteractive.com/topic/sample-size-calculation) - [AI development](https://info.keylimeinteractive.com/topic/ai-development) - [Biometrics](https://info.keylimeinteractive.com/topic/biometrics) - [Communication](https://info.keylimeinteractive.com/topic/communication) - [Competitive Intelligence Analysis](https://info.keylimeinteractive.com/topic/competitive-intelligence-analysis) - [Concept Testing](https://info.keylimeinteractive.com/topic/concept-testing) - [Consultant](https://info.keylimeinteractive.com/topic/consultant) - [Custom Projects](https://info.keylimeinteractive.com/topic/custom-projects) - [Dedicated Services](https://info.keylimeinteractive.com/topic/dedicated-services) - [Digital Divide](https://info.keylimeinteractive.com/topic/digital-divide) - [Impact](https://info.keylimeinteractive.com/topic/impact) - [Keystroke Level Model](https://info.keylimeinteractive.com/topic/keystroke-level-model) - [Literature Review](https://info.keylimeinteractive.com/topic/literature-review) - [Negotiation in UX](https://info.keylimeinteractive.com/topic/negotiation-in-ux) - [Nonprofit UX](https://info.keylimeinteractive.com/topic/nonprofit-ux) - [Presentation](https://info.keylimeinteractive.com/topic/presentation) - [Rapid Research](https://info.keylimeinteractive.com/topic/rapid-research) - [Report](https://info.keylimeinteractive.com/topic/report) - [SaaS](https://info.keylimeinteractive.com/topic/saas) - [UX Templates](https://info.keylimeinteractive.com/topic/ux-templates) - [World Usability Day](https://info.keylimeinteractive.com/topic/world-usability-day) - [digital design](https://info.keylimeinteractive.com/topic/digital-design) - [persona](https://info.keylimeinteractive.com/topic/persona) - [user engagement](https://info.keylimeinteractive.com/topic/user-engagement) ![ ](https://keylimeinteractive.com/wp-content/uploads/2024/05/aicpa-soc-certified.png) ![Logo of the National Minority Supplier Development Council with colorful abstract shapes and text.](https://keylimeinteractive.com/wp-content/uploads/2024/05/NMSDC-Logo-NATIONAL-1024x716.jpg) ![Logo with the text "Insights Association" and colorful squares forming a pattern above the text.](https://keylimeinteractive.com/wp-content/uploads/2024/02/insights-association-logo-v2.png) ![](https://keylimeinteractive.com/wp-content/uploads/2024/02/key-lime-interactive.svg) Your Trusted Partner for UX Research Key Lime Interactive - [What We Do](https://keylimeinteractive.com/ux-research-services/) - [Proven Process](https://keylimeinteractive.com/proven-process/) Resources - [Case Studies](https://info.keylimeinteractive.com/case-studies) - [Events + Workshops](https://info.keylimeinteractive.com/events) - [Blog](https://info.keylimeinteractive.com/) Company - [About Us](https://keylimeinteractive.com/about-us/) - [Meet Our Team](https://keylimeinteractive.com/our-team/) - [Careers](https://keylimeinteractive.com/careers/) - [News](https://keylimeinteractive.com/news/) - [Security & Compliance](https://app.vanta.com/keylimeinteractive.com/trust/cylnxu23wx6pzvej7bloh9) - [Public Sector GSA](https://keylimeinteractive.com/public-sector-gsa-schedule/) Get in touch - [Contact Us](https://keylimeinteractive.com/contact) © 2025 All Rights Reserved. - [Privacy Policy](https://keylimeinteractive.com/privacy-policy/) - [Terms of Use](https://keylimeinteractive.com/terms/)