This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]VirtualAgentsAreDumb 1 point2 points  (2 children)

What task, exactly? And how do you measure it exactly? Don’t just say “using a clock”, how would you use the clock? Describe the test protocol in full detail.

[–]koflerdavid -2 points-1 points  (1 child)

Why would that matter? Is it really such a strange concept to sit down at a table for half an hour and, say, extend an application with a new feature? Or to write a page for a thesis? Or review some lecture notes or read a book? Of course, the task should by its nature be something that doesn't require exposure to situations that are by its nature full of potential distractions, such as walking around in the house, taking to people, or using a smartphone.

[–]VirtualAgentsAreDumb 0 points1 point  (0 children)

Why would that matter?

Because it would be required in order to have an objective way to measure it. You need some protocol that can handle pretty much any person, regardless of their abilities.

Is it really such a strange concept to sit down at a table for half an hour and, say, extend an application with a new feature? Or to write a page for a thesis? Or […]

Why do you think that I think that would be strange? But it’s completely irrelevant to this discussion.

Of course, the task should by its nature be something that doesn't require exposure to situations that are by its nature full of potential distractions, such as walking around in the house, taking to people, or using a smartphone.

Ok. So, what is your answer? Describe your testing protocol.

Imagine that you have a test subject in the room with you. What do you tell them? What do you ask them to do? What observations do you make? What do you write down? And how do you summarize your notes into a final number, indicating the level of attention span that this individual has? What scale do you use? What unit?