← Dashboard 0IQgjMYWVGc
Ready annotator_a
Video ID: 0IQgjMYWVGc
Category: scene_dominant
Standard Vision ○
Misleading Vision ○
Standard Audio ○
Misleading Audio ○
When the woman with shoulder-length brown hair wearing a rust-hued jacket steps forward in the shadowy room, what specific physical gesture does she make that signals her sudden panic?
A.She raises both hands above her head in surrender.
B.She lifts one hand to her forehead as she freezes mid-stride. ✓ Correct
C.She turns abruptly and runs toward the nearest exit.
D.She clutches her tote bag tightly against her chest.
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [30s-40s]s Modality: vision Category: scene_description

Annotation

As the figure in the glossy gray hazmat suit grips a hammer outside the frosted-glass door, what action do they perform that causes the glass to fracture?
A.She raises both hands above her head in surrender.
B.She lifts one hand to her forehead as she freezes mid-stride.
C.She turns abruptly and runs toward the nearest exit.
D.She clutches her tote bag tightly against her chest.
E.The visual detail in the question is incorrect ✓ Correct
F.The audio detail in the question is incorrect
Answer timestamp: [30s-40s]s Modality: vision Category: scene_description
Misleading Information
Category: person_appearance
Description: By swapping the premise from the female victim (brown hair, rust jacket) to the male intruder (hazmat suit, hammer), the question forces the model to distinguish between two different characters performing different actions in the same scene. A lazy model might associate 'panic' or 'hammer' incorrectly if it doesn't track who is doing what.

Annotation

While the man in the black hoodie is stuffing a white garbage bag into the trunk of the black Mustang, what distinct sound accompanies the gravelly voice's statement about someone not coming?
A.The rhythmic ticking of a grandfather clock.
B.The sharp crinkle of plastic stretching taut. ✓ Correct
C.The distant whirring of passing cars.
D.The dull thud of a heavy door closing.
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [40s-50s]s Modality: audio Category: scene_description

Annotation

Following the moment when a sharp metallic impact causes glass to shatter loudly in the hallway, what auditory element immediately follows the destruction?
A.The rhythmic ticking of a grandfather clock.
B.The sharp crinkle of plastic stretching taut.
C.The distant whirring of passing cars.
D.The dull thud of a heavy door closing.
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect ✓ Correct
Answer timestamp: [40s-50s]s Modality: audio Category: scene_description
Misleading Information
Category: sound_source
Description: The correct premise focuses on the specific sound source accompanying the dialogue in the car trunk scene (plastic crinkling). The wrong premise shifts the context to a completely different scene involving glass shattering. This tests if the model can isolate the correct audio event associated with the specific visual action described in the premise, rather than just recalling any loud noise from the video.

Annotation