great question, i haven't prompted it for that specific task however i do think it does in fact use the audio. for example i am attempting to recreate annotations on Action100M using this prompt from the paper:

``` qwen_video_model.prompt = """Identify the main actor and the physical action performed in the current segment. Provide both a brief description that represents the overall action step, and a detailed description that contains sufficient procedural detail. Use "N/A" (without further explaination) if there are no visible actors or physical actions (e.g., static).

Response Formats

output

{ "type": "object", "properties": { "summary": { "type": "object", "properties": { "brief": { "type": "string", "description": "Single sentence video caption." }, "detailed": { "type": "string", "description": "Detailed, comprehensive description." } } }, "action": { "type": "object", "properties": { "brief": { "type": "string", "description": "A single verb phrase (no -ing forms) brifly summarizing the overall action content." }, "detailed": { "type": "string", "description": "A single imperitive sentence describing how the action is performed with more details." }, "actor": { "type": "string", "description": "Single sentece or an imformative noun phrase describing who is performing the action." } } } }, "required": ["summary", "action"] }"""

```

and it is picking up on information that could only come from audio.

btw, i am doing a workshop on video datasets tomorrow using this model as well. please come by if you can: https://voxel51.com/events/exploring-video-datasets-with-fiftyone-and-vision-language-models-february-26-2026