← Dashboard NqJ6llRZg-M
Ready annotator_a
Video ID: NqJ6llRZg-M
Category: scene_dominant
Standard Vision ○
Misleading Vision ○
Standard Audio ○
Misleading Audio ○
When the young boy wearing a pale blue short-sleeve button-up shirt stands frozen near the red armchair, what specific action does the woman perform immediately after commanding him to stay?
A.She collapses onto the nearby sofa in exhaustion.
B.She pivots away sharply and strides toward a weathered wooden closet door.
C.She leans forward aggressively, extending one hand toward the boy before turning away. ✓ Correct
D.She immediately runs to the window to scan the hallway outside.
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [60s-70s]s Modality: vision Category: plot

Annotation

As the young boy in a gray hoodie darts past the hanging jackets within the closet, what distinct movement does the woman make while following him into the dark space?
A.She collapses onto the nearby sofa in exhaustion.
B.She pivots away sharply and strides toward a weathered wooden closet door.
C.She leans forward aggressively, extending one hand toward the boy before turning away.
D.She immediately runs to the window to scan the hallway outside.
E.The visual detail in the question is incorrect ✓ Correct
F.The audio detail in the question is incorrect
Answer timestamp: [60s-70s]s Modality: vision Category: plot
Misleading Information
Category: person_action
Description: The question swaps the scene from the living room (blue shirt boy) to the closet (gray hoodie boy). A lazy model might associate 'boy' and 'woman moving' with the wrong timestamp or action. In the correct scene [60s-70s], she leans forward then turns; in the misleading scene [100s-110s], she follows him into the closet. The phrasing changes significantly to test if the model tracks the specific clothing and location context.

Annotation

Following the moment a sharp, resonant knock reverberates through the room and she utters the unfinished word 'Hey', what ambient sound filters through the walls?
A.The loud, low-frequency electronic tone replaces all other sounds instantly.
B.A high-pitched, plaintive cat meow echoes through the room.
C.The low thrum of distant city traffic filters through the walls. ✓ Correct
D.The distinct sound of crinkling plastic fills the air as a bag is set down.
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect
Answer timestamp: [40s-50s]s Modality: audio Category: plot

Annotation

After three heavy, resonant knocks echo in the vast space and she whispers 'Okay, it's the food', what distinct auditory event occurs as she accepts the delivery?
A.The loud, low-frequency electronic tone replaces all other sounds instantly.
B.A high-pitched, plaintive cat meow echoes through the room.
C.The low thrum of distant city traffic filters through the walls.
D.The distinct sound of crinkling plastic fills the air as a bag is set down.
E.The visual detail in the question is incorrect
F.The audio detail in the question is incorrect ✓ Correct
Answer timestamp: [40s-50s]s Modality: audio Category: plot
Misleading Information
Category: sound_type
Description: This tests the ability to distinguish between two different knocking events and their subsequent audio environments. The correct premise [40s-50s] involves a single sharp knock and city traffic. The wrong premise [20s-30s] involves three heavy knocks and crinkling plastic. The questions are rephrased to force the model to link the specific knock description to the correct background sound, rather than just answering 'what happens after knocking'.

Annotation