Success Rate Analysis

Success rate analysis measures how often users successfully complete a defined task or reach a desired outcome in a research session or within a live product. It's one of the most direct indicators of whether a design is actually working for the people using it.

The mechanics: define the task clearly, establish criteria for what counts as success, run the study, and track outcomes. The success rate is the percentage of participants who achieve the goal on their first attempt, without assistance or significant workarounds. Partial completions of users who eventually succeeded after errors or backtracking are typically tracked separately to give a fuller picture of where the difficulty lies.

Overall rates matter, but disaggregation is where the real insight lives. A 68% overall success rate might look acceptable until you break it down by segment: 91% for experienced users, 39% for first-timers. That gap tells you something precise about where the problem lives and who it's affecting most, which is the level of specificity you need to make a targeted fix.

‍