Linear Diagram Design Study Part D

The work described here is part of a larger study on the design of linear diagrams.

Design Study Part D. Should we represent the sets in alphabetical order or use adjacency driven set-order?

Here the questions are presented in the random order, as they would appear to the participants. The pages below echo the results, in the study, these answers were sent to Mechanical Turk in a url query string.

• Alphabetical
• Adjacency

Diagrams and Questions:

Page in Test	Question Id	Alphabetical Order Diagram	Adjacency Order Diagram	Asked Question. For the training questions, this also includes the training text	Options - presented in the form of tick boxes	Correct Answer
Page 2	Training 1			guide-lines: none:	,None of the above	Technology
Page 3	Training 2			guide-lines: none:	,None of the above	Food,Games,Programming,Relaxation
Page 4	Training 3			guide-lines: none:	,None of the above	Economics,Games,HiFi,Music
Page 5	Training 4			guide-lines: none:	,None of the above	Books,Economics,Health,Journalism,Media,Programming,Stars
Page 6	Question 1				,None of the above	Games,Internet
Page 7	Question 2				,None of the above	Economics
Page 8	Inattentive 1				,None of the above	click on region
Page 9	Question 3				,None of the above	Camping,News
Page 10	Question 4				,None of the above	Technology
Page 11	Question 5				,None of the above	News,Programming
Page 12	Question 6				,None of the above	Android,Books,Design,Economics,Health,Internet,News,Relaxation
Page 13	Question 7				,None of the above	Bands,Food,Games,Travel
Page 14	Inattentive 2				,None of the above	click on region
Page 15	Question 8				,None of the above	None of the above
Page 16	Question 9				,None of the above	Computers,Games,Health
Page 17	Question 10				,None of the above	Android,Camping,iPhone,News,Technology
Page 18	Question 11				,None of the above	Games,Internet
Page 19	Question 12				,None of the above	Economics,Health,Journalism,Relaxation,Web

The visualizations were generated from source data derived from SNAP Twitter ego networks. The files listed here are from this .gz file: http://snap.stanford.edu/data/twitter.tar.gz.

Anonymised study results in csv format. The time column records the time spent on the question page in seconds. The fraction correct column gives the proportion of buttons in their correct state (selected or not selected). "alpha" is alphabetical set order, "ambig" is adjacency set order. The data here is from the participants who answered both attention testing questions correctly.

Investigators:
Peter Rodgers, University of Kent
Gem Stapleton, University of Brighton
Peter Chapman, University of Brighton