User Testing Plan for Drupal 7 Overlay

Test plan for the overlay

Please upload videos you record of the tests to this vimeo group:

http://vimeo.com/groups/drupalux/videos/

Vimeo allows for videos longer than 10 minutes.

What needs to be tested

Several tasks that show the strength: short quick jumps to the overlay and back.
This test plan tests the overlay in conjunction with contextual links, as those two are closele related, especially in performing quick Admin tasks (editing in place).
It is set up mainly for A/B Testing with overlay on / off

Recommended setup

Two identical versions of Drupal Head, one with Overlay turned off.
You need to create some content on both.
Our Sample site represents a local bookshop (no online shop).
Content for the sample site at the bottom of this page.

Tasks

How to best do the A/B testing

There are always two similar (but not identical tasks) performed in the version that has the overlay on, and the other one that has it switched
off. The art is the fluent switching so it feels natural to the user. I have not tried out the plan yet, but would think that doing two tasks in the overlay then switching to the non-overlay for two tasks might be a good rhythm.

Tasks that result in clicking through several Admin screens

Overlay site: Change the site title to "Waterbury's Bookshop"

Plain Seven site: The background color of the site can be changed. Change it to green.

Test if Overlay helps in keeping context (and if context helps in orientation)

Overlay site:

Send the user to the full node view of the Harry Potter post. This should be easily memorizable for the large image on there, so the user should recognize when they found their way back.
Add a user "alda" for the shop owner. If they succeed in adding the user (and also if not) try to make them find the close icon on the overlay, without direcly telling them. If they do not use the close icon (cross on red side) make them go back to the users page and ask them if they see another way of returing to the live site. (another valid option is the house symbol in the upper left corner, would be interesting if they use this).
If they still do not use the close button, make them go back once more and try to guide them to it, if still not used, tell them directly to click it. We need the close button to find out if simply closing the overlay helps in orientation.

Plain Seven site:

Send the user to the full node view of the Harry Potter post. This should be easily memorizable for the large image on there, so the user should recognize when they found their way back.
Send the participant to see if they can find a log, where everything that happens on the site is recorded. If they do not find it, try to guide them.
When they have found it, tell them to go back to the Harry Potter full node view. As in the other task, send them back once more and ask, if they see another way in navigating back (as well as before, the home button may be an option, or the menu)

Tasks that shortly call the overlay and go back to frontend

These tasks use the contextual links (gear icon that appears on hovering a block). Try to guide the participant to it without directly telling them what to click. We want to know if the gear is findable and intuitive enough.
If they do not find out by themselves in reasonable time, give them a hint. Else they cannot continue.

Overlay site: Your phone number has changed to 955-1808. Change it in the block on the right side.
(Objective also: find out if the gear for Centextual links is findable and people manage to use it intuitively. If they do not manage, give them a hint.)

Plain Seven site: Change the placement of the search box from the left sidebar to the right sidebar.

Overlay site: (first make sure we are on the front page) Add a sentence in the end of the Harry potter post: "Tents to spend the night in front of the shop will be available."
See if they use the gear icon.

Plain Seven site: (first make sure we are on the front page) There has been a price drop for Dances With Wolves: change the price to £ 0,99 See if they use the gear icon.

Find a task to cancel.
(Objective: Check if people manage to find the close button of the overlay. Keep special eye on additional risk to lose data.)

Content for sample site

See Screenshot for how the frontpage should look like.

Four Nodes:

Pages:
- Opening hours
- Special offers of the day

Stories (also on Front Page, each with image)
- Announcement of new Harry Potter and the Garden of Eden
- Team

Add all nodes to the main menu.

One block (right-hand-side) with phone number and address

Nodes

News for the front page:

Waterbury's first to put out Harry Potter and the Garden of Eden

Image (Harry Potter) http://auweia.org/dateien/harry-potter-eden-small.png

The best-kept secret of the literary world has been unveiled today:
Jeanne K. Rowling wrote an unpublished predecessor of the Harry Potter
Novels. It tells about how Harry became what he is and even turns out
that his personal fate is deeply intertwined with the very history of
mankind... Waterbury books exclusively presents to you this unexpected
beauty which will cast new light upon all of Harry's adventures on next
Monday.

Offers of the day

Image (Sales symbol) http://auweia.org/dateien/special-sale.png

The catcher in the cupboard

Handsigned anniversary edition of the classic novel. Martha faces an
unexpected threat when shen wants to sort her laundry and has to face
her torn childhood to survive all the temptations that follow.

£12.50

Dances with wolves

A man torn between the skin color he is born into and the cruelties
that his race commits on the american natives. Will our hero make the
right decision and can he change the course of history? Special offer,
paperback.

£1.50

Hannah Montana's Cookbook

Does Hannah cook at all, and if so, what's in the pot? Be in for culinary surprises that make a better day. Fully colored.

£21.90

Pages:

Opening Times

During our opening times we take orders also by telephone. At other times you can always send orders and requests by email.

Mo - Fr: 9am - 5pm
Sa:  9am - 2pm
Su:  closed

For special occasions or events like author signing or readings these hours may be changed.

Team

Our staff loves to help you with finding your newst reading adventure. We love books and are passionate about offering you the best service.

Alda Waterbury

Founder and owner of Waterbury's bookshop she is guiding it through all kinds of seasons. In close contact with the purchasing team she makes sure the choice is always appealing.

Peter Shelveshove

Responsible for presentation, Mr. Wesworth arranges shelves and tables in a way you always find your favourite books quickly. He also makes sure our shop-window always has a fresh look.

Susan Marketwick

Waterbury's event manager. When we have authors reading or signing their work or release parties for the latest craze in the world of literature, she makes sure this is really fun.

Block

Contact us

Waterbury's Books
63 Ashton Lane
Liverpool L4 2HY
England

phone: 0151 351 8196
email: sales@waterbury.co.uk

Images

Sales symbol: http://auweia.org/dateien/special-sale.png
Harry Potter:  http://auweia.org/dateien/harry-potter-eden-small.png