Study Guides (380,000)
CA (150,000)
UTSG (10,000)
CSC (300)
Final

CSC318H1 Study Guide - Final Guide: Exact Sequence, Goms, Jargon


Department
Computer Science
Course Code
CSC318H1
Professor
Olivier St- Cyr
Study Guide
Final

This preview shows page 1. to view the full 4 pages of the document.
!"#$%#&#'()*+,-!'(.#/012-1)'+(#
/012-1)'+(!–!focus:!easability!of!the!system!and!users'!experience!when!
interacting!w/!the!system!!
o How!easy!to!learn/use?!
o How!satisfying/enjoyable/motivating!the!interaction!is?!
o Checks!design!appropriateness,!acceptability!for!wider!use!populations!
Iterative!Design!!!evaluations!is!continuous!throughout!the!process!
o Bruce!Tognazzini:!"Iterative!design,!with!its!repeating!cycle!of!design!and!
testing,!is!the!only!validated!methodology!in!existence!that!will!
consistently!produce!successful!results.!If!you!don’t!have!userJtesting!as!
an!integral!part!of!your!design!process!you!are!going!to!throw!buckets!of!
money!down!the!drain."!
!
Why,%What,%Where,%When%of%Evaluation%
345#/67897:;!!!to!check!
o Users'!requirements!
o Users!can!use!the!product,!and!they!like!it!
347:#:<#/67897:;#!!prototypes#
o Ranges:!Low4Tech%Prototypes!to!Complete%Systems!
! Incl.!Conceptual%Model,!Lo4Fi%Prototypes,!Hi4Fi%Prototypes!
34;=;#:<#/67897:;#
o Varies!depending!on!what!they!of!evaluation!
o Laboratory!!!provides!control!to!systemticalyl!invegistate!requirements!
o In4the4wild%Evaluations%!!natural!settings,!observational!!
o Remote%studies!!!conducted!via!user!logging!and!analytics!
o Living%laboratories!!!simulations!natural!setting!(an!environment)!!
! Provides!control,!and!ability!to!measure/record!activites!
34;>#:<#/67897:;#
o ?<=@7:A6;#/67897:A<>B!–!done!during!design!to!check!product!continues!
to!meet!users'!need!
o C9@@7:A6;#/67897:A<>B!–!done!to!assess!success!of!finished!product!
! May!determine!areas!for!improvement,!inform!new!products!
!
Types%of%Evaluation%
1.!!<>:=<88;D#C;::A>EB#'>6<86A>E#-B;=B#
o Evaluators!control!what!users!do,!when!they!do!it,!and!for!how!long!
! Reduce!outside!influences,!distractions!
o -B7FA8A:5#);B:A>E!–!involves!collecting!data!using!combination!of!
methods!in!a!controlled!setting;!usually!for!evaluating!user!interfaces!
! i.e.!experiemnets,!observation,!interviews,!%!
! Goal:!is!interface!usable!by!intended!user!population!to!carry!out!
tasks!for!which!it!was!designed!for!
! Investgiates!how!typical%users!perform!on!typical%tasks!
! Tasks!performed!by!user!are!recorded,!logged!
! Questionnaires,!interviews!supplement!recorded!data!
! Characteristics%Summary%
! Users:! do!tasks!
! Location:! controlled!
! When:! prototype!stage!
! Data:! quantitative!
! Feedback:! data!via!predefined!metrics!(ex.!num!errors)!
! Typed:! applied!
o Evaluation%Methods%Summary:!Observing,!Asking!Users,!Testing!
2.!(7:9=78#C;::A>E#'>6<86A>E#-B;=B!
o ?A;8DB#C:9DA;B!!!aim:!to!evaluate!people!in!their!natural!settings!
! 1.!Identify!opportunities!for!new!technology!
! 2.!Establish!the!requirements!for!a!new!design!
! 3.!Facilitate!introduction!of!technology,!or!inform!deployment!of!
existing!technology!in!new!contexts!
! Goal:!unobtrusive,!not!to!affect!what!users!do!during!evaluation!
! Methods:!Observational,!Interviews,!logging!
! Data:!Events,!Conversations,!Notes,!Audio/Video!Recordings!
! Characteristics%Summary%
! Users:! natural!
! Location:! natural!
! When:! early!stages!
! Data:! qualitative!
! Feedback:! notes,!descriptions!
! Typed:! naturalistics!
o '>G:4;GHA8D!!!fields!studies!that!look!at!how!new!technologies!/!
prototypes!have!been!deployed!and!used!by!people!in!various!settings!
! Ex.!outdoors,!public!places,!homes!
o Problems:!give!up!control!!!unanticipated!problems/event!occurs!
o Evaluation%Methods%Summary:!Observing,!Asking!Users,!Asking!Experts!
3.!1>5#C;::A>EB#(<:#'>6<86A>E#-B;=B!
o Reseracher!imagines/models!how!interface!is!likely!to!be!used!
o '>BI;J:A<>#K;:4<DB!–!employed!to!predict!user!behavior,!to!identify!
usability!problems!
! Based!on!knowledge!of!usability,!users'!behavior,!context!in!which!
the!system!is!to!be!used,!activites!users!undertake!
! Ex.!Heuristics!Evaluation,!Walkthroughs,!Models!
o !<E>A:A6;#378L:4=<9E4:B!–!Simulate!a!user's!problemJsolving!process!at!
each!step!in!humanJcomputer!dialog!
! Checking!how!users!progress!from!step!to!step!in!these!interactions!
o 1>785:AJB!–!log!data!at!customer's!site!or!remotely!–ex.!Web!Analytics!
! Useful!for!evaluating!design!features!
! Characteristics%Summary!
! Users:! no!involved!
! Location:! anywhere!
! When:! prototype!stage!
! Data:! problems!discovered!
! Feedback:! problems!discovered!
! Typed:! expert!
o K<D;8B!–!compare!efficiency!of!different!interfaces!for!the!same!app!
! Ex.!optimal!arrangement!or!location!of!features!
! Fitt's!Law!to!predict!time!it!takes!to!reach!a!target!using!point!device!
o Evaluation%Methods%Summary:!Asking!Experts,!Modeling!
!
Evaluation%Case%Studies%
!7B;#C:9D5#$:!Experiment!Investigating!a!Computer!Game!(controlled)!
o Evaluating!challenege!&!engagement!in!a!collaborative!immersive!game!
o Measurements%
! Sensors!for!physiological!data!from!participants!
! Ex.!moisture!from!sweat!glands!in!hands/feet,!heart!rates!
! Video!recorded!participants!
! User!satisfaction!questionnaires!at!end!of!expirement!
o Result:!players!were!more!engaged!when!playing!against!another!person!
than!when!playing!against!a!computer!
!7B;#C:9D5#%:!Study!of!Skiers!(field!study)!
o Evaluting!whether!and!how!skiers!might!use!a!mobile!device!designed!to!
help!them!improve!their!performance!
o Skiers!wore!helments!w/!camera!and!sensors!
! Gives!feedback!to!skiers!of!their!performance!on!a!smartphone!
o Measurements:%
! When/how!often!skiers!consulted!their!smartphones!for!feedback!
! Informal!focus!group!a!week!after!
o Result:!skiers!consulted!smartphones!during!breaks,!not!on!the!slopes!
! Didn’t!want!to!interrupt!time!on!the!slopes!
!
!
!
!"#$M#&#/012-1)'+(#?*1K/3+*N#
DECIDE%Framework%
,/)/*K'(/#:4;#.<78B#
o What!are!the!highJlevel!goals!of!the!evaluation?!
! Who!wants!it!and!why?!
o Goals!guide!evaluation!!!determines!scope,!affect!methods!used!
! Example!goals:!
! Identify!the!best!metaphor!for!the!conceptual!design!
! Check!that!user!requirements!are!met!
! Check!for!consistency!
! Investigate!how!technology!affects!working!practices!
! Improve!the!usability!of!an!existing!product!
/OP2+*/#:4;#Q9;B:A<>B#
o Determine!qustions!to!be!answered!by!the!evaluation!study!
! To!make!goals!operational!
! Break!questions!down!into!very!specific!subJquestions!(nested)!
! Want:!make!evaluation!even!more!fine!grained!
You're Reading a Preview

Unlock to view full version