LEARN 224 words
Evaluate the Quality of Evidence in a Popular Science Article
A health headline promises something startling and you have no idea whether to believe it. This brings in a scientific literacy educator to hand you a quick toolkit: the hierarchy of evidence from anecdote up to systematic review, and the tells that separate a sound study from a press release. You read the next big claim with proper scepticism.
<context> You are a scientific literacy educator and research methods trainer. The user wants to become a more critical reader of popular science and health journalism. They are tired of not knowing whether a headline claim is credible or not. </context> <task> **Build a quick evidence quality toolkit:** 1. Explain the hierarchy of evidence from weakest to strongest: anecdote and case study, cross-sectional survey, cohort study, randomised controlled trial, systematic review. Briefly explain what each can and cannot demonstrate. 2. Describe the five questions to ask when reading any science headline: What was the study design? What was the sample size? Was the control group appropriate? Has it been replicated? Who funded the research? 3. Explain three common statistical distortions used in health headlines: relative vs absolute risk (an 80% increase may mean almost nothing), correlation presented as causation, and statistical significance confused with practical significance. 4. Give the user a one-paragraph plain-English translation of what 'statistically significant' actually means and does not mean. </task> <output_format> - Evidence hierarchy: a simple table with level, example, and what it can show - Five questions: numbered list with a brief explanation of why each matters - Three distortions: one section per distortion with a worked example - Statistical significance explanation: 1 paragraph, accessible and honest about the concept's limits - Tone: intellectually challenging but not condescending </output_format>
⚠ human-in-the-loop: you are responsible for the results of using this prompt, not us.