Mission:
To evaluate the use of Ben Simo’s usability heuristic for error reporting. Select at least one error you have encountered recently, and use the FAILURE heuristic to evaluate it.

Submit a report evaluating the heuristic.

Descriptions of the heuristic are available here. If you have not had the opportunity to read the post before the session, then I’d recommend just reading the first one to get you started.

• http://bit.ly/cADWnm
• http://bit.ly/bM0n3n

Aspects you might consider in the report should include (but are not limited to):

• Whether the heuristic was useful to you.
• Were there other items you could add to the heuristic?
• If there were other items you felt you could add, you may wish to create your own mnemonic for your new heuristic.

Testers: Phil Kirkham, Shruti Gudi, Ajay Balamurugadas, Anna Baik, Markus Gärtner

Anna Baik facilitated the discussion. Each tester was asked about their experiences.

Markus Gärtner started the discussion. He shared his experiences. He had encountered an error message in a game recently, which he needed to reproduce for the session. He noticed that they all applied in this regard. In addition he tried to apply the mnemonic to his application at work, for which some of the parts did not apply. Since he deals with an application within several subsystems, the UI for example was not applicable.

Ajay Balamurugadas continued the debrief. He stated that he achieved his personal mission of taking half an hour to attend the skype chat, and taking half an hour on the actual mission giving. The mission was easy from his perspective. There are some more questions he wanted to add to his list for the next time. Basically he took the whole list of questions and added answers in his report. Asked on the applicability of the heuristic, he stated that he uses it, since it’s very useful. He continued on his particular error at youtube. While uploading a new profile picture, the error message was misleading, so the heuristic applied there. Ajay pointed out that the questions Ben provided for the mnemonic where actually a sort of a checklist. Therefore they are very useful. For the addition, he explained that he wanted to add reproducibility to the heuristics.

Shruti continued. She explained that she evaluated an error she recently got on her mobile phone. She explained that from the mnemonic the logfile and the support contact did not apply in this domain. She noticed that the error looks different from the QA perspective as from the user’s perspective. In the discussion, the participants found out that these differing perspectives could be related to the emotions in the FAILURE heuristics. Shruti finished with stating that she will definitely use the mnemonic again. The UI and the impact part could be generalized more from her point of view. During the discussion the participants identified that taking a closer look on the users and the stakeholders of the application is a worthwhile thing. Thereby the user of the system could be also another software system. Audible and visible error feedback was also mentioned as a clearly helpful way to provide the user feedback on how to resolve the error by themselves.

The chat transcript from today’s session can be found here.