Strategy
Part of A Practical Guide to Running Healthcare Email Marketing Programs
How to Evaluate Healthcare Email Marketing Case Studies: Criteria and Governing Rules
A checklist for judging a healthcare email marketing case study on its question, method, evidence, limits and safeguards, with the privacy and email laws that govern the claims.
What to take away
- A healthcare email case study is only as useful as its question, method, evidence and limits.
- Five well-known public programs are used below to show what the public record can and cannot support.
- No public record reviewed here reports email performance for these programs, so none can be scored on outcomes.
- The governing rules are HIPAA, the CAN-SPAM Act, the TCPA, FTC advertising rules and state health-data laws.
Healthcare email marketing case studies should let a reader reproduce the question, method, evidence and decision. The checklist below is the test. The public programs in the table show how far the test can be applied with public information.
Five public programs and what the record shows
| Program | Public record | Condition behind it |
|---|---|---|
| Cleveland Clinic Health Essentials | Free email newsletter | Free sign-up; Cleveland Clinic pages state different send frequencies, so check the sign-up form |
| Mayo Clinic Health Letter | Paid subscription newsletter | Subscription sold through the publisher's store; check the current rate there; print and digital delivery |
| NHS Blood and Transplant | Email reminders used for donor appointments | Reminders also sent by text and the Give Blood app; confirm the current arrangement |
| Planned Parenthood | Email list used for advocacy and health information | Opt-in; check the current privacy notice |
| Smokefree.gov | Free text-message quit programs from a U.S. government site | Free to join; text rather than email; U.S. carriers only |
These are public programs, not vendor ratings. Check each website for current terms, prices and privacy notices. None of the pages reviewed reports open, click or conversion figures, so a program's listing shows its audience and format, not whether its email worked.
The eight criteria for a case study
- Question.Name the decision the case informs and the outcome it measures.
- Population and comparison.State who received the email, who did not, and what the comparison group looked like before the send.
- Assignment and exposure.Record how recipients were chosen, who got which version, and who actually opened or received it.
- Measures.An open is not a click, and a click is not an appointment or a health outcome. Define each transition and show that the evidence supports it.
- Denominators and missing data.Publish counts with rates, the number who unsubscribed or bounced, and any excluded records.
- Cost, capacity and harm.Report the staff time, the platform cost, the complaints and any adverse finding.
- Privacy safeguards.State what personal data was used, the consent basis, and who at a vendor had access.
- Decision and limits.State whether the result supports a description, an association or a cause, and what would change the decision.
A case that cannot answer criteria 2, 4 and 5 cannot be used as evidence that an email works. It can still be a lead to test.
The rules that govern the claims
Healthcare email is governed by several overlapping rules. The right one depends on who sends the message, what it contains and who receives it.
- HIPAA.Where the sender is a covered entity or a business associate, marketing uses of protected health information generally need the patient's authorization. Check the consent basis in any case that used patient data.
- CAN-SPAM Act.Commercial email needs accurate headers, a valid physical postal address and a working opt-out. The FTC enforces it.
- TCPA.Marketing texts and calls generally require prior express consent. Check the consent record for any case that used SMS.
- FTC Act and advertising substantiation.Performance claims need a reasonable basis before they run. Apply this to any statement of results in a case study.
- FTC Health Breach Notification Rule.It can apply to health apps and similar vendors that HIPAA does not cover.
- State health-data laws.Several states protect consumer health data beyond HIPAA. Check the states where recipients live.
The U.S. Government Accountability Office guide Designing Evaluations, published in 2012, sets out evaluation design steps, constraints and study quality. It is written for federal programs, so borrow its design logic and do not treat it as validation of a marketing result.
Apply the test to one case
Take a claimed result, such as "our reminder email cut no-shows," and run it through the eight criteria. Write down what the source gives for each one. If criteria 2, 4 or 5 are blank, record the result as unverified.
Then reproduce one material figure with local data before you recommend a provider or copy the approach. If the method is not published, describe the item as a lead for testing, not a verified result.
Report without inflation
Publish counts with rates and missing data. Name the provider's definitions of open and click, and any filtering of bot traffic. Report timing, costs and staff workload alongside the result.
End with the decision that was set before the send: continue, modify, pause or retire. Include the limitations that remain. A mixed case can be valuable when it prevents a larger unsafe send.
Keep the evidence record beside the decision, so a reviewer can reproduce the reasoning without relying on memory.
Common questions
Are these five programs case studies?
No. They are public programs. The table shows their format, price or audience, and the public record does not report email results for them.
Does an A/B test prove why one email won?
Only within a sound design, with valid measures, assignment that was actually implemented, a suitable sample and stated uncertainty.
What makes a case study useful?
A clear question, a transparent method and reconciled evidence. Limitations, adverse findings and a documented decision matter as much as the headline result.
