← Dashboard Ak1dPU8uXiE
Ready annotator_a
Video ID: Ak1dPU8uXiE
Category: speech_dominant
Standard Vision ○
Misleading Vision ○
Standard Audio ○
Misleading Audio ○
As the fairy wearing a pink off-the-shoulder gown with golden curls and iridescent wings releases glittering particles from her palm, what specific visual mark appears on Frank's cheekbone?
A.A glowing red scar that pulses with heat
B.A small, fading bruise shaped like a heart
C.A gleaming 'X' made of sparkles ✓ Correct
D.A patch of frost covering his skin
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [70s-80s]s Modality: vision Category: cross_modality

Annotation

When the dark-robed figure with silver hair and tattered black wings casts a spell into the air, what distinct pattern materializes on the man's face?
A.A glowing red scar that pulses with heat
B.A small, fading bruise shaped like a heart
C.A gleaming 'X' made of sparkles
D.A patch of frost covering his skin
E.The visual detail in the question is incorrect ✓ Correct
F.The audio detail in the question is incorrect
Answer timestamp: [70s-80s]s Modality: vision Category: cross_modality
Misleading Information
Category: person_appearance
Description: By replacing the fairy's distinctive pink gown and golden curls with a dark-robed figure and silver hair, the question tests if the model relies on the actual visual description or hallucinates details based on the wrong premise. A lazy model might guess 'frost' or 'scar' based on the 'dark' theme rather than the specific 'sparkle X' described for the fairy.

Annotation

Immediately after the sharp crack of a slap echoes through the scene and is followed by the muffled cry 'Gosh Frank!', what line does Frank shout in exasperation regarding his injuries?
A."Why are you attacking me in this alley?"
B."Stop! You'll ruin everything!"
C."Fine! Slap me in the face! But you kicked me in the balls!" ✓ Correct
D."I'm through with this nonsense!"
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [20s-30s]s Modality: audio Category: cross_modality

Annotation

Following the loud shattering of glass and the wail of a high-pitched alarm siren, what desperate plea does the character yell about his physical state?
A."Why are you attacking me in this alley?"
B."Stop! You'll ruin everything!"
C."Fine! Slap me in the face! But you kicked me in the balls!"
D."I'm through with this nonsense!"
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect ✓ Correct
Answer timestamp: [20s-30s]s Modality: audio Category: cross_modality
Misleading Information
Category: ambient_sound
Description: Substituting the specific 'slap crack' and 'Gosh Frank' audio cue with 'shattering glass' and 'alarm siren' forces the model to verify the exact audio sequence. If the model assumes the 'glass/alarm' context, it might select the quote associated with the later alley fight ('Stop! You'll ruin everything!') instead of the correct quote tied to the slap sequence.

Annotation