DR-Claim-Eval: Annotation Tool

How to Annotate (read this first!)

You'll see an Evidence passage and a Claim. Classify the claim into one of 4 categories:

Restatement — Same thing, different words Novel Synthesis — Combines facts into new conclusion Hallucination — Wrong / made up / not in evidence Contradiction — Says the OPPOSITE

Examples:

Restatement	Evidence: "Water boils at 100 C" → Claim: "The boiling point of water is 100 C" Same fact, just reworded
Novel Synthesis	Evidence: "Plants need sunlight. Photosynthesis makes glucose" → Claim: "Plants use sunlight to make glucose" Combines 2 facts
Hallucination	Evidence: "Earth is 150 million km from Sun" → Claim: "Earth is 1.5 billion km from Sun" Wrong number!
Contradiction	Evidence: "Metals conduct electricity" → Claim: "Metals do NOT conduct electricity" Says the opposite

Quick Decision Tree:

1. Does the claim say the OPPOSITE? → Contradiction
2. Does the claim contain WRONG facts? → Hallucination
3. Does the claim just REPHRASE one fact? → Restatement
4. Does the claim COMBINE multiple facts? → Novel Synthesis

0/200

Claim #1

Domain: physics | Source: textbook

Evidence (Source Text)

Claim to Classify

Click one to classify:

Confidence: 3/5

All Done! Thank you!

You annotated 200 claims.

IMPORTANT: Click the button below and send the downloaded file to Turvi

File name: annotations_yourname.jsonl

Send this file to Turvi on WhatsApp/email

DR-Claim-Eval