Researching Usability

Guerilla Usability Testing, Phase 2

Posted on: July 16, 2010

As stated in the previous blog post, the second phase of guerilla testing was conducted on 30th June. It was hoped that in the second phase we would have the opportunity to test with more people as the course finished before lunch. This did appear to be the case as I managed to test 4 individuals who were happy to stay up to 30 minutes in some cases to take part.

Before the testing took place some design changes were made to the prototype based on the feedback from the first phase. Based on the findings a number of recommended changes were made (see Recommendations on project Wiki page). Within the time scale it was possible to implement the following changes before phase two testing:

  • Ensure that categories within the Year facet are presented in a chronological order, most recent first.
  • Provide an additional facet to include Author.
  • Allow users to de-select facets within the facet navigation and not just using the breadcrumb system at the top.

The test plan remained the same and again I alternated the websites between each participant to reduce bias. The most startling finding in phase 2 was the user’s preferred site. Three of the four participants preferred the prototype in one way or another to the NeSC Library. With such small numbers it’s difficult to say that this is a trend, but it is an improvement on the first round of testing. It would be interesting to see if this pattern continues during Phase 3 in August and indeed with the focus group planned in September.

There was more evidence to support a faceted navigation with expanded facet values. Some of the users commented that they liked aspects of the NeSC navigation because the values were visible. However there was also a feeling that this could be overwhelming at times, particularly on the homepage before the user had begun their search. This suggests that a middle ground between the collapsed (or accordian) facet navigation of the prototype and the fully expanded navigation of NeSC may be a realistic compromise. Further discussion on the pros and cons of facet navigation design can be read in the excellent blog post by James Kalbach.

Some users commented that they did not notice the facet navigation in the prototype because it did not immediately look like a faceted navigation system or because it’s design and position meant that users were more attracted to the results in the centre of the page. Currently the facets are closed by default and are styled to look like ordinary links. Although this accordian design of a facet can work, it requires additional features to communicate its purpose to the user. An arrow next to each facet is a common device used to indicate that it can be toggled to reveal the facet values. Additionally, expanding the first two facets and providing the rest closed is another strategy used demonstrate how the system works. It seems clear from the feedback during both phases of testing that additional design features or a different approach is required to make it easier for users to understand and successfully use the facet.

World Digital Library expanded facet example

However, if the prototype facet is open by default then the same issues may arise as was reported in the NeSC library. A compromise could be to limit the number of category values in each facet and provide a ‘Choose more…’ link so that users can expand the list if required. The University of Edinburgh Aquabrowser catalogue and World Digital Library are both examples of digital libraries using this feature in their faceted navigation systems, however each library implements the feature in quite different ways. Aquabrowser’s system is more user-friendly because it provides the full value list on a separate page and gives the user control over its presentation; relevance and alphabetical. World Digital Library expands the values within the facet, often with wordy facet values which are organised by relevance only (image). The list could clearly be difficult for users to navigate quickly and consequently may not enhance the feature. Indeed, this has already been witnessed while testing the NeSC digital library.

Another finding from the testing was the design and implementation of the combined facet navigation and breadcrumb system. I intend to discuss the feedback surrounding this in my next blog post.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s bookmarks

Twitter feed

Error: Twitter did not respond. Please wait a few minutes and refresh this page.


%d bloggers like this: