Evidence-led Product & UX Evaluation
This publication preserves the completed end-to-end Product & UX evaluation of the NHS Better Health Healthy Choices Quiz. The canonical synthesis reconciles sixty-nine directly observed interaction states with NHS-published product, scoring, privacy and accessibility information. Observed behaviour, published evidence, evaluator judgement and unresolved limitations remain deliberately separated. The record does not claim recruited-user research, analytics evidence, formal accessibility certification or outcomes that were not directly established.
Evaluate whether the Healthy Choices Quiz provides a clear, trustworthy and usable public-health journey.
The evaluation examines whether the quiz communicates eligibility and expectations clearly, supports reliable task completion, gives users appropriate control over optional information, explains health-related scoring responsibly, and provides sufficient context for users to understand how their information and results are handled.
Evidence before judgement
The review followed a staged evaluation method: establish the product objective and public claims, inspect the live journey directly, deliberately test interaction rules and edge conditions, separate observed behaviour from inference, assign severity only where supported by evidence, preserve positive patterns as well as defects, and explicitly record limitations.
The walkthrough was conducted on the live NHS Better Health experience and included deliberate tests of validation, eligibility, optionality, selection limits, exclusive choices, disclosure controls, section transitions and back-navigation state persistence.
The service establishes an intended experience before the interactive journey begins.
Public NHS information positions the Healthy Choices Quiz as a short lifestyle assessment covering multiple areas of health and wellbeing and leading to an overall score, section-level feedback and recommended NHS resources.
Additional NHS material provides information about score calculation, privacy and interactive-tool data handling, while the Better Health accessibility statement documents the service's published accessibility position.
These statements were treated as product claims to be evaluated against the live interaction rather than as proof that the intended behaviour always occurs.
Sixty-nine-screen end-to-end walkthrough
The canonical observation ledger preserves the complete primary evaluation path from eligibility through the final result, score methodology and accessible chart description. Interaction states are retained separately where deliberate testing produced materially different evidence.
-
About you
- S01 Age and eligibility. The first interactive question asks the user's age and states that the quiz is for adults aged 18 and over.
- S02 Empty-age validation. Continuing without an age produces both a prominent error summary and inline guidance to enter an age.
- S03 Under-18 handling. An ineligible age prevents continuation, explains why the quiz is unsuitable and provides a Health for Teens route.
- S04 First-name optionality. The first-name question is explicitly optional and can be skipped without blocking progression.
- S05 Gender optionality. Gender is optional, is stated not to affect the result and includes a Prefer not to say response.
- S06 Gender disclosure. An expandable explanation refers to uses described in the privacy policy rather than naming a specific immediate purpose.
- S07 Postcode optionality. Postcode is explicitly optional and is stated not to affect the result.
- S08 Postcode disclosure. The expandable explanation points to the privacy policy rather than stating a concrete purpose at the question.
- S09 About you transition. Completion of the About you section is explicitly acknowledged before Motivations begins.
-
Motivations
- S10 Motivation selection. The interface says Select up to 3 and presents the choices as large checkbox cards.
- S11 Fourth motivation selection. A fourth motivation can become selected despite the stated maximum of three.
- S12 Motivation limit enforcement. Continuing with four selections produces a clear error instructing the user to select up to three.
- S13 Exclusive motivation alternative. Selecting None of the above clears competing motivation selections.
- S14 Support and guidance. A single-choice question asks how much support and guidance the user feels they have to make healthy changes.
- S15 Areas to improve. Users select up to two lifestyle areas while I'm not sure is visually separated as an alternative.
- S16 Back-navigation persistence. Returning to the preceding question preserves the existing answer rather than requiring re-entry.
- S17 Motivations transition. The service confirms completion of Motivations and previews Eating as the next section.
-
Eating
- S18 Fruit and vegetable portions. Eating begins with a daily fruit-and-vegetable question supported by contextual portion examples.
- S19 Starchy foods. A multi-select question permits up to five choices, including wholegrain and refined options plus an exclusive I don't eat these foods alternative.
- S20 Dairy and alternatives. A long multi-select question permits up to three dairy or plant-based alternatives and required multiple viewport captures to inspect fully.
- S21 Pre-prepared meals. Eating includes a mutually exclusive frequency question about pre-prepared meals.
- S22 Eating transition. The service confirms completion of Eating and previews Alcohol as the next section.
-
Alcohol
- S23 Alcohol frequency. Alcohol begins with a frequency question and provides a collapsed Pregnancy and alcohol disclosure.
- S24 Pregnancy and alcohol disclosure. Pregnancy guidance expands inline without requiring the user to leave the questionnaire.
- S25 Alcohol type. The service asks which alcohol types are usually consumed and explicitly permits all relevant options to be selected.
- S26 Alcohol-type required validation. Submitting without an alcohol type produces both summary and inline guidance to select what type of alcohol is consumed.
- S27 Conditional drink quantities. Selecting beer or cider, wine and spirits or alcopops generates corresponding quantity fields with standard measures, ABV values, examples and illustrations.
- S28 Empty alcohol-quantity validation. Leaving all quantity fields empty produces one grouped instruction to enter an amount for at least one drink.
- S29 Negative quantity validation. A value of -1 is rejected with a measure-specific rule requiring a bottle amount between 1 and 50 using whole numbers.
- S30 Decimal bottle validation. A value of 1.5 is also rejected, confirming that the displayed whole-number rule is enforced.
- S31 Higher-consumption threshold. The service asks whether a single day in the last year included 6 or more units for females or 8 or more for males, with contextual unit explanations.
- S32 Six-unit explanation. The six-unit disclosure translates the threshold into examples using higher-strength beer, large wine and single spirits.
- S33 Eight-unit explanation. Both threshold disclosures can remain open together and the eight-unit guidance includes practical beer, spirit and wine equivalents.
- S34 Threshold required validation. Continuing without Yes or No produces a detailed error while preserving both expanded disclosure states.
- S35 Frequency of higher-consumption days. A Yes response triggers a follow-up asking how often the 6/8-unit threshold was exceeded.
- S36 Six-versus-eight guidance. The service explains explicitly which threshold should be used and repeats practical drink equivalents.
- S37 Alcohol transition. The service confirms completion of Alcohol and previews Movement.
- S38 Occupational physical activity. Movement begins with five ordered activity categories supported by concrete employment examples.
-
Movement
- S39 Brisk walking. Weekly brisk walking is measured using four time bands and a practical definition based on pace, talking and breathlessness.
- S40 Cycling. Weekly cycling is measured separately and explicitly includes commuting and leisure cycling.
- S41 Breathless physical activity. A separate question captures activities such as swimming, jogging, sport and workouts and explicitly excludes walking.
- S42 Movement transition and progress milestone. Completion of Movement produces the message that the user is more than halfway through and previews Smoking and vaping.
- S43 Smoking status. Smoking distinguishes daily use, non-daily use, former smoking and never smoking and provides pregnancy guidance.
-
Smoking and vaping
- S44 Vaping status. Vaping is assessed separately and explicitly includes nicotine-free vapes and electronic cigarettes.
- S45 Pregnancy and vaping. The expanded guidance advises stopping vaping during pregnancy while recognising its harm-reduction role in staying smoke free.
- S46 Vaping to quit smoking. For a user who both smokes and vapes, the questionnaire asks whether vaping is being used to quit smoking.
- S47 Smoking and vaping transition. Completion confirms 4 out of 6 sections finished and previews Mental health.
- S48 Mood. Mental health begins with a two-week mood question whose responses range from consistently positive mood to always feeling extremely low.
-
Mental health
- S49 Anxiety. After the most severe mood response, the service proceeds to a two-week anxiety question without immediate support signposting.
- S50 Stress. After the most severe anxiety response, the service continues to a two-week stress question without immediate support signposting.
- S51 Mental-health transition. After maximum-severity mood, anxiety and stress responses, the service gives an ordinary section-completion message and moves to Sleep.
- S52 Sleep. The final section asks how well the user has slept over the last two weeks, with responses ranging to extremely sleep deprived.
-
Sleep
- S53 End of questions. The service states that the questions are complete and promises a score out of 10 plus advice for each lifestyle area.
- S54 Result first viewport. The deliberately constructed profile receives 1 out of 10. Smoking and Sleep are Focus on changing, Eating and Alcohol are Try to improve, Movement is Great job, and Mental health is handled separately below.
- S55 Mental-health result and urgent support. The dedicated mental-health result includes urgent 111 signposting, Every Mind Matters urgent support, NHS Talking Therapies, GP support and a CBT starting point.
- S56 Mental-health follow-on and Smoking result. Mind Plan is offered as a further personalised mental-health route before the Smoking result recognises smoking, vaping and cessation intent.
-
Quiz completion
- S57 Smoking cessation resources. The Smoking result provides a Personal Quit Plan and the NHS Quit Smoking app alongside tailored cessation advice.
- S58 Smoking service and Sleep result. A local Stop Smoking Service and pregnancy-specific advice complete Smoking before Sleep begins with targeted Every Mind Matters resources.
-
Results
- S59 Eating result. The Try to improve tier identifies insufficient fruit and vegetable intake and provides practical 5 A Day guidance and NHS resources.
- S60 Eating resources and Alcohol result. Eating adds recipe and BMI resources before Alcohol states that the observed drinking pattern raises long-term health risk.
- S61 Alcohol support and Movement result. Alcohol provides Drink Free Days support and pregnancy guidance before Movement is correctly retained as Great job.
- S62 Result persistence. The result closes with movement resources, an Email your result form, a warning that closing the tab loses the result, a Quiz score explained link and Restart quiz.
- S63 Email-result consent validation. Submitting the result-email form empty proves that both an email address and agreement to one checkbox covering the result and supportive emails are required.
-
Scoring, labels and accessibility
- S64 Score explainer entry. The Healthy Choices Quiz explained page states that it documents both the overall calculation and section scoring.
- S65 Overall-score formula. Each of six lifestyle sections scores 0, 1 or 2; the total is divided by 12 and multiplied by 10, except tobacco smoking or an Alcohol score of 0 caps the overall result through a multiplier of 3.
- S66 Section-scoring basis. The explainer documents the conceptual basis for Eating, Alcohol, Movement and Smoking and vaping, while leaving exact answer-to-0/1/2 thresholds undisclosed.
- S67 Mental health, Sleep and section labels. Mental health and Sleep scoring bases are documented and the Focus on this, Try to improve and Great job labels are explained.
- S68 Mental-health label exception and quiz limitations. The NHS explicitly explains that Mental health contributes to the overall score but intentionally receives no section label, and states that the quiz is not a medical diagnosis.
- S69 Accessible score description. The result gauge provides a dedicated text description of the 1 out of 10 score and explains the numeric ranges and meaning of the red, amber and green bands.
Strong interaction and result patterns substantiated across the complete journey
- Eligibility and recovery: eligibility is surfaced early, ineligible users receive an explanation and alternative route, and validation consistently combines summary and inline guidance.
- Domain-aware validation: Alcohol quantity fields reject impossible or incompatible numeric values using measure-specific rules rather than simple presence checks.
- State preservation: Back navigation retains answers, invalid values remain available for correction and expanded help can survive validation failures.
- Conditional branching: Alcohol, smoking and vaping questions adapt meaningfully to preceding answers rather than forcing one generic pathway.
- Progressive disclosure: unit explanations, pregnancy guidance and threshold help are available contextually without permanently overloading the interface.
- Translation of health concepts: the service converts abstract concepts such as alcohol units and brisk walking into practical, recognisable examples.
- Progress orientation: although no persistent overall progress bar is shown, section transitions provide clear milestones including more than halfway and 4 out of 6.
- Section-level nuance: a 1 out of 10 overall result still preserves Movement as Great job rather than allowing poor scores elsewhere to flatten every domain.
- Tailored results: Smoking reflects smoking, vaping and cessation intent; Eating reflects fruit-and-vegetable answers; Sleep and Alcohol receive domain-specific interpretation and resources.
- Actionability: results connect directly to NHS tools and services including Talking Therapies, Stop Smoking Services, Personal Quit Plan, Drink Free Days, Every Mind Matters and movement resources.
- Mental-health support quality: once Results is reached, urgent and non-urgent mental-health routes are substantive and clearly signposted.
- Accessible result representation: the visual score gauge has an explicit textual alternative describing the numeric score, range boundaries and meaning of all colour bands.
- Published scoring documentation: the overall numerical calculation and special Smoking/Alcohol cap are documented in enough detail to reconstruct the observed 1 out of 10 result.
Nine severity-rated findings survive evidence reconciliation
Earlier provisional findings were not automatically preserved. Later evidence was allowed to strengthen, narrow, downgrade or retire them. The register below is therefore the reconciled finding set supported by the completed primary walkthrough.
Eligibility language around existing health conditions remains broad.
- Evidence
- Published eligibility information advises people with an existing health condition not to use the quiz and provides examples, but does not establish a precise boundary for the exclusion.
- User impact
- People with stable, minor or unrelated conditions may be uncertain whether the exclusion applies to them.
- Recommendation
- Clarify the intended exclusion boundary or provide a short decision aid explaining when clinical advice should be sought before using the quiz.
Answer-to-section-score thresholds are only partially transparent.
- Evidence
- The NHS documents the overall 0/1/2 section model, the final normalisation formula and the Smoking/Alcohol score cap. It also describes what each section considers, but does not fully disclose the thresholds that convert particular answer combinations into section scores of 0, 1 or 2.
- User impact
- Users can understand the overall mathematics but cannot fully reconstruct why a particular section received Focus on this, Try to improve or Great job.
- Recommendation
- Publish concise section-level threshold logic or representative examples showing answer patterns that produce scores of 0, 1 and 2.
Some quiz-related data-use and persistence information remains dependent on policy-level explanation.
- Evidence
- Published privacy information explains interactive-tool data handling and progress-related processing, while the live flow does not consistently surface the same detail at the point where information is entered or persistence is relevant.
- User impact
- Users may need to leave the immediate task context to understand important aspects of how quiz-related information is handled.
- Recommendation
- Add concise just-in-time summaries at relevant interaction points while retaining the privacy policy as the complete source.
Current accessibility assurance for the interactive quiz is not fully evidenced by the published testing information.
- Evidence
- The published accessibility position does not establish a fresh, comprehensive independent audit of the current Healthy Choices Quiz interaction. Direct observation nevertheless found positive patterns including textual error handling, preserved state and an accessible text description for the result gauge.
- User impact
- The public assurance evidence cannot by itself establish that the current end-to-end quiz has been comprehensively tested against the stated accessibility standard.
- Recommendation
- Publish current interactive-tool audit evidence with scope, standard, dates, assistive technologies and known limitations clearly identified.
Optional demographic collection lacks a specific just-in-time purpose explanation.
- Evidence
- Gender and postcode are genuinely optional and are stated not to affect the result, but their expandable explanations refer users to the privacy policy rather than stating a concrete purpose at the point of collection.
- User impact
- Users retain control over disclosure but may still be unsure why these particular details are being requested.
- Recommendation
- State the immediate purpose in plain language beside each optional question while preserving the ability to skip it.
The motivation maximum is enforced only after submission.
- Evidence
- The interface says Select up to 3 but permits a fourth motivation to become selected and rejects the state only after Continue.
- User impact
- The error is clear and recoverable but introduces avoidable friction.
- Recommendation
- Prevent a fourth selection, disable remaining choices at three, or provide immediate inline feedback.
Support and guidance combines two potentially different constructs.
- Evidence
- The Motivations section asks how much support and guidance the user has using one shared response scale.
- User impact
- A user may have strong social support but little practical guidance, or the reverse, making one combined answer less precise.
- Recommendation
- Separate the constructs or explain that one deliberately combined judgement is required.
Severe mental-health responses defer urgent-support signposting until Results.
- Evidence
- The evaluation selected the most severe available responses for mood, anxiety and stress. The service then completed Mental health, continued through Sleep and the end-of-questions transition, and only surfaced urgent-support routes in the dedicated result.
- User impact
- A user reporting severe distress must continue through the remaining journey before seeing urgent mental-health support options.
- Recommendation
- Consider a concise, non-blocking safety message immediately after sufficiently severe responses while retaining the fuller support pathway in Results.
Result persistence is coupled to consent for supportive follow-up emails.
- Evidence
- The result is otherwise ephemeral: closing the tab requires the quiz to be completed again. The Email your result form requires one checkbox covering both receipt of the result and supportive emails.
- User impact
- A user who only wants to retain the result is not visibly offered a separate choice from ongoing supportive communications.
- Recommendation
- Separate Email me my result from an independently optional consent for continuing supportive emails.
Important evidence deliberately not promoted to findings
The evaluation distinguishes a demonstrated defect from an open question, design exception or hypothesis that would require a controlled second run or additional evidence.
- Retired F03: Mental health is intentionally included in the overall score but excluded from the coloured section-label model. The exception is disclosed, explained and supported by a substantial dedicated result pathway, so it is retained as a design exception rather than a defect.
- F10 not promoted: the exploratory Alcohol profile mixed a low typical quantity with very frequent threshold exceedance, so the resulting Try to improve label cannot support a controlled claim that a coherent high-risk profile is systematically under-classified.
- Progress: there is no persistent overall progress indicator, but section-completion screens provide strong milestone and numerical progress feedback.
- Movement overlap: cycling is measured separately and the later breathless-activity question excludes walking but does not explicitly state whether previously reported cycling should also be excluded.
- Alcohol threshold framing: the 6-unit and 8-unit pathways use female/male categories and provide contextual guidance, but no further inclusion guidance was observed.
- Response-scale consistency: some Mental health and Sleep answer sets mix frequency and intensity descriptors. This was not shown to prevent completion or interpretation.
- Employment/activity framing: full-time caring appears within I am not in employment even though caring can involve substantial physical activity; later Movement questions may partly compensate for this.
- Smoking granularity: no cigarette-quantity or dependence measure was observed, but the result still produced highly actionable cessation guidance from the available smoking, vaping and quit-intent inputs.
What this evaluation does not claim
- No recruited-user usability study, interview programme or representative behavioural sample was conducted.
- No product analytics, abandonment data, conversion metrics or A/B testing evidence was available.
- No formal keyboard, screen-reader or assistive-technology audit was conducted by the evaluator.
- The primary walkthrough used one deliberately constructed evaluation profile designed to exercise conditional and higher-risk branches; it is not a representative user profile.
- The exploratory Alcohol path mixed a low typical quantity with frequent higher-unit days and therefore is not used to make a controlled claim about the appropriateness of the resulting Alcohol category.
- The score methodology was assessed from the NHS-published explainer and observed result. The underlying implementation was not independently reverse-engineered.
- Current findings relate only to behaviour and published evidence inspected during this evaluation window.
Canonical publication complete
The NHS Healthy Choices Quiz is a generally well-structured and highly recoverable public-health questionnaire. Across the primary journey it demonstrates strong validation, state preservation, conditional branching, progressive disclosure, practical translation of health concepts and substantial section-level personalisation.
The result experience is a particular strength. A low overall score does not flatten individual domains: Movement remained a demonstrated strength while Smoking, Sleep, Eating and Alcohol received distinct interpretation and actionable NHS resources. Mental health is treated separately by design and receives meaningful urgent and non-urgent support once the result is reached.
The most defensible weaknesses are concentrated not in basic task completion but in transparency and choice architecture: incomplete visibility of the thresholds converting answers into section scores, limited point-of-collection purpose explanation for optional demographic data, delayed urgent-support signposting after severe mental-health responses, coupling of result persistence with supportive-email consent, and the evidence supporting current accessibility assurance.
No S3 High or S4 Critical failure was substantiated in the completed primary walkthrough. The canonical evidence and findings synthesis, visual publication QA and Evaluation Archive integration are complete; AI-R-002 is now frozen as the final canonical publication.
Canonical publication complete · Published