December 4, 2016

WordCamp Contributor Day: Workshop Findings

BACKGROUND

Goals

This test allowed Flow Patrol to 1) observe sign-up and log-in flow, as well as 2) gauge user experience of creating an entirely new site solely through the WordPress Mobile App version 6.2 on Android 5.1.

Tester

The tester has experience using WordPress, but has procrastinated making a blog for a long time. He has used WordPress for other things, commercial sites for example, but has never made a blog because he finds it difficult to get into writing. The tester is a recent Android user, who is new to using smartphones in general, and often expressed that he dislikes prolonged typing on mobile devices.

OBSERVATIONS

Sign-up

Since the tester has trouble typing on mobile devices and was self-conscious about making mistakes, he began looking for a “show password” button as he navigated the sign-up page. He commented that it needs to be more visible and thinks perhaps the image of a crossed-out eye is too abstract for some users.

The tester found that an account already existed under the name he wanted and figured it was his old one. However, he was required to back out of the sign-up page before navigating to the log-in page to try entering it. He commented that it would be nice to simply be taken to the log-in page for the account once WP discovered it, or at least to be prompted to try to log into that site.

The tester clicked on “forgot password” and was redirected to the browser version of WPs’ sign in page, which caused some confusion. He said that he expected to leave the app to retrieve an email confirmation from his email inbox, but he didn’t understand why he was taken outside of the app to reset the password. He said that changing platforms like this takes a person out of their work-flow. He admitted that this left him with a bad impression, explaining that if WordPress can claim to power over a fourth of the Internet, he expects that it “should have this figured out by now.”

Log-in/Log-out

Done with sign-up, the tester tried to log in with what was believed to be his “username”, but could not get in because it turned out that he was using his “public display name.” In the site navigation screen, the “public display name” is emphasized – it’s a darker, larger font and above “username.” Log-in using email address was successful.

The tester attempted to log out to figure out which name was to be used to log in. A “log-out” button was difficult to find, because it was expressed as “disconnect.” The tester expressed fear at the confirmation prompt, which seemed like a warning about permanent deletion of accounts, sites etc. He suggested that it simply be called, “log-out.” Only after two successful log-ins did tester realize the difference between and significance of “username” and “public display name.”

Site Creation

Once logged in again, the user saw past sites displayed on the opening screen. The tester explored other parts of the site looking for a “create new site” button. He openly questioned where he should go, even exploring “account settings.” The tester expressed that he felt stupid and surprised that it was difficult for him to find. After prompting from the interviewer that he search back at the “show sites” screen where he started, he found a plus sign which turned out to be what he was looking for all along.

When asked where he expected it to be, the tester explained that maybe front and center was not appropriate because he already had sites and doesn’t create them all the time. Still, he found “show sites” to be misleading because it implies that it would take him to view existing sites only. He only found it when looking for it intently and with extra help. The tester suggested that the plus sign makes sense, but could be emphasized by making it a brighter color.

First Post

The tester was intent on creating a quick post just to see how it would look. He successfully created a simple post with a title and a sentence in the body. When he then viewed the post, it opened up in the app itself, which he liked. He then checked the post on the mobile browser and was satisfied with the way everything looked. The end result matched his expectation.

VISUAL RECORD

A visual record of this test does not exist. Subsequent testing will hopefully provide such data.

CONCLUSIONS

At the end of the test, the tester offered this feedback:

• Publishing was a great experience and everything went as expected.
• “Switch sites” proved to be misleading and he might not have looked there without guidance.
• Logging in was frustrating and “could have been done better.” The tester was not a strong typist, and was made to do it several times. He admitted that if it wasn’t for the sake of test completion, he would have put the app down and “done it later,” perhaps not revisiting it for some time.
• After the test, the tester admitted that he would likely never pick up the app again anyway. Writing is not something the tester would do on the go; he prefers instead, a laptop or desktop to work from.
• The tester would instead want the app for notifications that would help him keep up to date with happenings on his site. He said that an ideal app would allow him to make quick corrections, approve work submitted by other writers on a shared blog, track business/e-commerce information, and generally keep track of his site when away from keyboard.