Fieldstone Checkout Study: study data

Surveys

Every section's questions, each answer's distribution, and every participant's answer. Delivered in this order.

Ease - Find a rain shell

SEQ · Post-task: after Find a rain shell

Overall, how difficult or easy was this task?

3 answers

Distribution
1 - Very difficult		0
2		0
3		0
4		0
5		0
6		1
7 - Very easy		2

Average score: 6.67

Participant	Answer	Comment
P02 · Marcus T.	7 - Very easy	It added to my cart with one click (like every other site) and the cart icon updated to show 1 item in it.
P04 · Jordan A.	7 - Very easy	Works like every other cart, pretty much.
P05 · Sam K.	6	It was just another online clothing store.

Ease - Apply a promo & check out

SEQ · Post-task: after Apply a promo & check out

Overall, how difficult or easy was this task?

3 answers

Distribution
1 - Very difficult		0
2		0
3		0
4		1
5		0
6		1
7 - Very easy		1

Average score: 5.67

Participant	Answer	Comment
P02 · Marcus T.	7 - Very easy	Worked like every other checkout. No sales tax and I would expect to see that. Error on click pay button was weird, but I followed the instructions and it worked great.
P04 · Jordan A.	6	It was more "uncertain" than difficult. I wasn't sure why I got that error when I clicked CHECK OUT, but clicking CHECK OUT again did the trick.
P05 · Sam K.	4	That error made me nervous. I just clicked PAY NOW again and it worked.

Ease - Check your order status

SEQ · Post-task: after Check your order status

Overall, how difficult or easy was this task?

3 answers

Distribution
1 - Very difficult		0
2		0
3		1
4		0
5		0
6		0
7 - Very easy		2

Average score: 5.67

Participant	Answer	Comment
P02 · Marcus T.	7 - Very easy	Order Status was at bottom of page, right where I expected it. Status information was clear as to when I should expect delivery. Tracking number would have been nice.
P04 · Jordan A.	7 - Very easy	I liked the terse, clean, sufficient language on the order status message. Link to Order Status was where I expected.... at bottom of page in footer area with lots of other misc links.
P05 · Sam K.	3	Although the link was still on the screen from the last task, I don't think that's realistic. I'd expect something at the top of the page near the CART button and there was nothing at the top of the page except for the CART button.

System Usability Scale

SUS · Post-study: after the last task

I think that I would like to use this system frequently.

3 answers

Distribution
Strongly disagree		0
Disagree		0
Neutral		1
Agree		1
Strongly agree		1

Average score: 4

Participant	Answer
P02 · Marcus T.	Strongly agree
P04 · Jordan A.	Agree
P05 · Sam K.	Neutral

I found the system unnecessarily complex.

3 answers

Distribution
Strongly disagree		2
Disagree		1
Neutral		0
Agree		0
Strongly agree		0

Average score: 1.33

Participant	Answer
P02 · Marcus T.	Strongly disagree
P04 · Jordan A.	Strongly disagree
P05 · Sam K.	Disagree

I thought the system was easy to use.

3 answers

Distribution
Strongly disagree		0
Disagree		0
Neutral		0
Agree		1
Strongly agree		2

Average score: 4.67

Participant	Answer
P02 · Marcus T.	Strongly agree
P04 · Jordan A.	Strongly agree
P05 · Sam K.	Agree

I think that I would need the support of a technical person to be able to use this system.

3 answers

Distribution
Strongly disagree		2
Disagree		1
Neutral		0
Agree		0
Strongly agree		0

Average score: 1.33

Participant	Answer
P02 · Marcus T.	Strongly disagree
P04 · Jordan A.	Strongly disagree
P05 · Sam K.	Disagree

I found the various functions in this system were well integrated.

3 answers

Distribution
Strongly disagree		0
Disagree		0
Neutral		0
Agree		1
Strongly agree		2

Average score: 4.67

Participant	Answer
P02 · Marcus T.	Strongly agree
P04 · Jordan A.	Strongly agree
P05 · Sam K.	Agree

I thought there was too much inconsistency in this system.

3 answers

Distribution
Strongly disagree		2
Disagree		0
Neutral		1
Agree		0
Strongly agree		0

Average score: 1.67

Participant	Answer
P02 · Marcus T.	Strongly disagree
P04 · Jordan A.	Strongly disagree
P05 · Sam K.	Neutral

I would imagine that most people would learn to use this system very quickly.

3 answers

Distribution
Strongly disagree		0
Disagree		0
Neutral		0
Agree		1
Strongly agree		2

Average score: 4.67

Participant	Answer
P02 · Marcus T.	Strongly agree
P04 · Jordan A.	Strongly agree
P05 · Sam K.	Agree

I found the system very cumbersome to use.

3 answers

Distribution
Strongly disagree		2
Disagree		1
Neutral		0
Agree		0
Strongly agree		0

Average score: 1.33

Participant	Answer
P02 · Marcus T.	Strongly disagree
P04 · Jordan A.	Strongly disagree
P05 · Sam K.	Disagree

I felt very confident using the system.

3 answers

Distribution
Strongly disagree		0
Disagree		0
Neutral		0
Agree		0
Strongly agree		3

Average score: 5

Participant	Answer
P02 · Marcus T.	Strongly agree
P04 · Jordan A.	Strongly agree
P05 · Sam K.	Strongly agree

I needed to learn a lot of things before I could get going with this system.

3 answers

Distribution
Strongly disagree		3
Disagree		0
Neutral		0
Agree		0
Strongly agree		0

Average score: 1

Participant	Answer
P02 · Marcus T.	Strongly disagree
P04 · Jordan A.	Strongly disagree
P05 · Sam K.	Strongly disagree

SUS scores

0 to 100; a participant with an incomplete answer set has no score.

Participant	Score
P02 · Marcus T.	100
P04 · Jordan A.	97.5
P05 · Sam K.	75

Mean: 90.8 across 3 participants