SarcasmExplain-5K / annotate

Annotate & Access

Contribute 10 minutes of annotation work to unlock free access to the full dataset. Your feedback directly improves sarcasm explanation research.

How it works
01
Choose an explanation type below and pick any available form
→
02
Rate 10 sarcasm explanations for clarity (1–5) and optionally suggest improvements
→
03
Note your form code (e.g. COG014) and enter it below to receive your completion code
→
04
Use your completion code to request dataset access on HuggingFace
COGNITIVE EXPLANATIONS
Explains sarcasm by modeling the mental shift required — why the speaker says the opposite of what they mean and what belief or expectation is being violated.
Task: Rate clarity + correct if misleading
INTENT-BASED EXPLANATIONS
Explains sarcasm by identifying the speaker's communicative goal — what emotion, critique, or social signal they are conveying through the sarcastic utterance.
Task: Rate clarity + correct if misleading

Cognitive Explanation Forms

50 forms available · 10 instances each · ~8 min per form
Step 2 — Get your completion code

Retrieve Your Code

After submitting a form, enter your form ID below (e.g. COG014 or INT031) to receive your unique completion code.

Questions

Can I annotate more than one form?
Yes, and we'd be grateful! Each additional form earns a second completion code (not required for access, but a kind contribution to the research). Simply repeat the process with a different form number.
Do I need to complete both Cognitive and Intent forms?
No — one form of either type earns you full dataset access. Both types feed into the same evaluation study.
What happens with my annotations?
Your annotations will be used to compute human evaluation scores for the SarcasmExplain-5K dataset, which will be reported in our EMNLP 2026 paper. Annotations are collected anonymously.
How long does annotation take?
Each form has 10 instances with a 1–5 clarity rating and optional free-text correction. Most annotators finish in 6–10 minutes.
I lost my completion code. Can I get it again?
Yes — just re-enter your Form ID in the lookup box above. The code is always the same for each form ID.