← Dashboard -F1-sTyGvwA
Ready annotator_a
Video ID: -F1-sTyGvwA
Category: speech_dominant
Standard Vision ○
Misleading Vision ○
Standard Audio ○
Misleading Audio ○
As the scene intensifies with the man clutching her tightly, his hands visibly stained with dark crimson blood, what specific action does she perform with her eyes?
A.She opens them wide in primal terror
B.She closes them and leans into him ✓ Correct
C.She looks away toward the shattered window
D.She stares blankly at the ceiling
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [60s-70s]s Modality: vision Category: cross_modality

Annotation

During the moment when the woman grips a green glass bottle so hard her knuckles turn white, what specific action does she perform with her eyes?
A.She opens them wide in primal terror
B.She closes them and leans into him
C.She looks away toward the shattered window
D.She stares blankly at the ceiling
E.The visual detail in the question is incorrect ✓ Correct
F.The audio detail in the question is incorrect
Answer timestamp: [60s-70s]s Modality: vision Category: cross_modality
Misleading Information
Category: person_action
Description: The wrong premise shifts focus to an earlier action (gripping the bottle) where her expression was different (eyes locked on horizon/defiant), whereas the correct premise (bloodied hands embrace) corresponds to her closing her eyes in resignation. A model relying on general context might miss the specific temporal link between the bloodied hands and the eye closure.

Annotation

When the male voice cracks with raw devotion to whisper 'I love you so much' into the dry air, what is the immediate vocal response from the woman?
A.She screams in agony
B.She murmurs 'I'm just bones in a box, Teddy' ✓ Correct
C.She laughs hysterically
D.She remains completely silent
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [60s-70s]s Modality: audio Category: cross_modality

Annotation

Following the female voice trembling with despair as she murmurs 'I'm just bones in a box', what is the immediate vocal response from the man?
A.She screams in agony
B.She murmurs 'I'm just bones in a box, Teddy'
C.She laughs hysterically
D.She remains completely silent
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect ✓ Correct
Answer timestamp: [60s-70s]s Modality: audio Category: cross_modality
Misleading Information
Category: speech_speaker
Description: The wrong premise attributes the line 'I'm just bones in a box' to the trigger event, but that line IS the answer to the correct question. By flipping the speaker attribution in the premise, the question asks for the reaction TO that line instead of the reaction TO the 'I love you' line. This tests if the model tracks who says what and the sequence of dialogue rather than just matching keywords.

Annotation