Drupal 8 Multilingual User Testing - Oak Park

We used simplytest.me. I forgot to ask the person to sign in. Signing in extends the time limit from 30 mins to 60 mins. 30 is a bit too short, even when testing goes really well.

1. start: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=2m10s (instruction reading, which I'll skip recording next time)
2. find out background of user: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=5m00s New site builder. Has installed 3 sites (a bit more via contributing/testing issues). Only reads english, so task modified for that to be building a site that a friend is going to help translation content of.
3. installing in english on simplytest.me: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=7m20s
4. task explained: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=9m35s Task was modified to be: site with english content, want to configure it so that another person could translate content into another language (french was the example).
   Looked to make content translatable by a user under: Structure, People, Configuration. Found Regional and Language there and thought it would be there. Looked there for a while then tried Extend. Used browser find for Language and found some. (Note if they had used the search on that page, and searched for language, then the content translation would have been hidden.) Read the descriptions and expanded the details.
5. Configuring: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=16m00s Went to configure after enabling content translation and language modules.
6. Made new user (for the translator): http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=16m00s They thought it was strange for the *admin* to need to enter a password when creating the account. Wanted to edit the user account to find how to add a role.
7. create (sample) content: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=18m30s
8. tries to make it translated/translatable: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=20m05s Edited the content (I think to try and translate it). Went to content list and looked under the drop button for "translate". Then looked under Structure. Then looked under Configuration. Saw the language, so didn't scroll to see the settings. In the languages page, tried looking under the drop button next to french for some translate setting. Decides should change what the user can do to be able to translate. So looks for roles to make a translator role. Finds Roles under People. Makes a role. Tries to edit that role to control what the role can do. But it's just changing the name of the role. Does not see the permissions tab. Goes back to People Roles, and sees the link in the help text to the user/account settings page. Sees language settings and personalization.
9. User is Puzzled. Hint: "go under people. Look at the top there." http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=25m20s Sees permissions tab. Reads comment permissions (gets comment momentarily confused with content). Sets the permissions to create, edit, delete translations. Is a bit uncertain about delete. Scroll, Scroll. Save.
10. Review task goal to get back on track: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=27m10s hint: "there is a piece of configuration missing to make a translate button show for content." Finds Languages again. Tries to edit/check drop button next to french. Checks detection and selection. Goes back to configuration.
11. Feeling frustrated. http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=30m25s Finds "content language settings". Clicks content. Clicks Basic Page. Notes body is translatable. Says "Shouldn't title be translatable too?" Checks around default language.. seems not to notice that they have done the thing to make it translatable. Reads the help text at the top of the page. Says it "does not make sense". (Maybe the help text can mention translatable.)
12. worried about initializing: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=30m30s "Oh dear. Initializing. I hope I did not break it."
13. translations tab: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=32m50s closes the overlay and sees the node, which has the translations tab. Adds a translation.
14. "it leaps around all the time" http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=34m20s "It's odd. The page flashes one thing and then another. Jiggle a little bit..." "If I try to click something before it's done.."
15. success: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=35m10s "chrome browser knows it's in french. that's nice."
16. follow-up questions: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=16m00s (first question is not clear) 1 (poor) - 5 (excellent), experience was 3 because "it was difficult to find things. my eyes just did not read it right." "finding the things that I had to click" (simplytest.me expires) thought languages and translation would be a setting and not a module. "it seems like such a huge thing that you would need that it would not be a module. it would just be there."
17. what would have made the process better: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=40m45s They were not sure. Has thoughts about wanting more specific things in the top level menu.
18. would you give this interface to your clients? http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=41m35s "I'd have to show her what buttons to press." "possibly a half an hour" (to show her how to use it)
19. what did you like the most: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=42m23s "it was uncluttered visually" "I really liked how it looked" "it looked really nice" "it was not impossible to use" [it was not a scaring experience] Talks about how setting up the new person and the roles was easy because they were "near" each other.
20. we go off on a tangent and redo the whole test: http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=44m55s Tries Configurations first and looks in Regional and Language. "I'm lost" "Oh, extend" "there is a search here" Searches for language. but then does not see translate so undoes the search. "I would not look under modules for something so completely basic."
21. Adds french. http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=49m37s "it's nice that it pops up with a block with a checkmark in it"
22. adds content http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=50m20s expects to see translate tab. "wait where did it go?" goes under configuration. configures translation. "yay"
23. "it was quite a bit easier the second time" http://www.youtube.com/watch?v=Uj2S5n-77_Y&t=52m45s Then we lose internet.

table of contents to user 2 video

This user has used Drupal 6 before to create content and manage a store, but has not built a site.

1. install in russian: http://www.youtube.com/watch?v=LcXSAKqbWSU&t=00m35s
2. add sample content: http://www.youtube.com/watch?v=LcXSAKqbWSU&t=04m00s
3. follow-up questions: http://www.youtube.com/watch?v=LcXSAKqbWSU&t=06m45s "there is my text", "It took a long time, but I figured it out. It was ok. It seemed sort of blogy. It was pretty intuitive."
4. make the site so could add content in english http://www.youtube.com/watch?v=LcXSAKqbWSU&t=08m05s Small confusion between the chrome translate pop-up and the drupal site. Edits the content to try and find a setting. Looks under Menu. Does not click on those, Looks under short cuts and admin. http://www.youtube.com/watch?v=LcXSAKqbWSU&t=10m20s "scary. everything changed. I clicked on a global thing and that was not a good idea. Now I lost everything. Because I didn't choose it before." Clicked back and landed in the edit form again. Redoes content. Thinks alternative text might be a translation thing http://www.youtube.com/watch?v=LcXSAKqbWSU&t=13m00s Then realizes it's not. Thinks it might be the revision log. Tries the Edit tab on the node http://www.youtube.com/watch?v=LcXSAKqbWSU&t=14m30s
5. Gets hint to look in the admin bar for something to configure to add English. http://www.youtube.com/watch?v=LcXSAKqbWSU&t=17m09s "Let's wildly click on things" [Note when installed in English, to add a language have to go to Extend and enable languages. When installed in another language (Russian) to add English, skip Extend and go right to Configure.]
6. When gets to Extend http://www.youtube.com/watch?v=LcXSAKqbWSU&t=19m50s pages through a lot and misses the language module. Pages, does not search. Gives up and scrolls back up before getting all the way to the bottom. Sees language module. "It wont let me do it." "I'm seeing a box that is lightly clicked." "It's probably a bad thing to unclick it." Misses can expand Language details to see configure or help.
7. "Lets see if this works." http://www.youtube.com/watch?v=LcXSAKqbWSU&t=21m10s (Has clicked to enable Content Translation.
8. Glimpses: Be sure and enable at least two languages. Misses can expand Language details to see configure or help. "It flashed up" "I should enable two languages." "I have to figure out where to do that" "It was back in the beginning where we selected the language." (in the install)
9. Hint: Go under configure http://www.youtube.com/watch?v=LcXSAKqbWSU&t=23m15s "Here we go" "Add a language" "English, why is it not applicable?" "Let me read the whole thing" "uhhhh"
10. Feels confused about if should enable a block http://www.youtube.com/watch?v=LcXSAKqbWSU&t=26m00s
11. Try and add a piece of content in English http://www.youtube.com/watch?v=LcXSAKqbWSU&t=26m50s "So I can x out of here and go back" "I want to edit this" "I guess I dont know what a block is" "Quick edit" Types over Russian, to ... "I'm thinking this would have one in Russian and one in English"
12. Hint: instead of translating something. Make a brand new piece of content. http://www.youtube.com/watch?v=LcXSAKqbWSU&t=29m28s
13. Run out of time on simplytest.me
14. Follow-up questions http://www.youtube.com/watch?v=LcXSAKqbWSU&t=30m25s "It was no more painful than most technical things are." "I do what I do, I just keep looking" What was the easiest thing. "Adding content was easy" "Changing it was hard" [Note I think they mean, changing the language of the content.]