Exercise: Analysing Scientific Claims

This exercise helps you to critically evaluate scientific claims and to apply scientific thinking in everyday life.

Task 1: Analysing a Science News Item

Choose a recent news article that reports on a scientific study and analyse it using the following questions:

1. Source check:
   • Is the original study cited or linked?
   • In which journal was the study published?
   • Who carried out and funded the study?

2. Study design:
   • What kind of study was carried out (experiment, observational study, etc.)?
   • How large was the sample?
   • Was there a control group or other comparison groups?

3. Presentation of results:
   • Are the results presented precisely and without exaggeration?
   • Are limitations or uncertainties mentioned?
   • Is a distinction made between correlation and causation?

4. Contextualisation:
   • Is the study placed in the broader research context?
   • Are differing results from other studies mentioned?
   • Are independent experts given a voice?

5. Conclusion:
   • Is the reporting balanced and appropriate?
   • What important information might be missing?
   • How could the reporting be improved?

Task 2: Applying Scientific Thinking in Everyday Life

Choose a personal problem or decision from your everyday life and apply scientific thinking principles:

1. Problem definition:
   • Formulate the problem or decision clearly and precisely.
   • Which factors or variables are relevant?

2. Forming a hypothesis:
   • What possible solutions or options are there?
   • Which assumptions underlie these options?

3. Data collection:
   • What information do you need in order to make a well-founded decision?
   • How can you gather this information systematically?

4. Analysis:
   • How can you analyse the gathered information objectively?
   • Which cognitive biases could influence your analysis?

5. Conclusion and implementation:
   • Which option appears most sensible based on your analysis?
   • How can you check the effectiveness of your decision?

Task 3: Distinguishing Between Science and Pseudoscience

Analyse a potentially pseudoscientific claim using the following criteria:

1. Falsifiability:
   • Is the claim formulated in such a way that it could in principle be refuted?
   • Are conditions named under which the claim would be false?

2. Evidence:
   • What evidence is put forward for the claim?
   • Is the evidence systematically collected or selectively chosen?
   • Are there independent confirmations of the evidence?

3. Methodology:
   • Are the methods used presented transparently?
   • Do the methods meet scientific standards?
   • Are there methodological weaknesses or distortions?

4. Integration:
   • Is the claim in agreement with established scientific knowledge?
   • If not, is it explained why established knowledge should be revised?

5. Development:
   • Has the theory or claim developed further over time?
   • Were earlier versions modified on the basis of new evidence?

6. Community:
   • Is the claim examined by a critical community of experts?
   • Is there an open discourse about strengths and weaknesses?

7. Conclusion:
   • Is it more a matter of science or pseudoscience?
   • Which features were decisive for your assessment?