User Testing Toolbox

user-testingBryan Eisenberg recently launched a new blog at, and one of his inagural posts is worth 69 bookmarks: 69 Free (Or Low Cost) Tools to Optimize Your Website.

I want to point out 3 in particular that will really help you gather qualitative research. A/B and multivariate testing is great to show the quantitative difference in conversion between a test control and treatment(s) but it doesn’t answer the question WHY one outperforms the other. In some cases you may be able to make an educated guess (big button converts better than smaller button – it must stand out more), but in other cases you can’t.

Enter usability testing – with real people, who can tell you in their own words what they like or dislike about your site, how attractive are your offers, how does your site measure up to user expectations and more. Often retailers avoid testing because they think it’s time consuming or expensive – but it doesn’t have to be. Check out the following resources and you’ll have no more excuses not to user test!

Five Second Test

Five Second Test is “a simple online usability test that helps you identify the most prominent elements of your user interfaces.” I suggest you upload a screenshot of your home page, category page, product page or email creative and choose the “click test.” The click test asks testers to click on what stands out in the image and then describe what they clicked. (The other option is to ask testers what they remember about an image, but that might be more effective for offline/print campaigns when it’s important a viewer can recall your brand messaging or offer).

There’s also entertainment value in taking part in the testing process. Just click on random test and play! For me it was a dose of reality that my short term memory often can only remember one pathetic thing after a 5 second gaze of an image.

Easy Usability

When a new visitor arrives at your site, your site must answer 3 key questions in the visitor’s head:

1. Where am I?
2. What can I do here?
3. Why should I stay?

Bryan mentioned a few user testing survey sites like Feedback Army, Amazon Mechanical Turk and My favorite is Easy Usability as you can create a survey and also qualify the testers who provide you feedback. For example, if you sell mobility products and disability aids, you want to test with people who would typically use your site rather than some punk kids off the street (no offense to punk kids). Similarly, if you sell streetwear and band memorabilia you want testers who are interested in that.

The feedback you receive may also be helpful in developing personas. Check out this sample test result. Your first test is free and you should receive a report back within 24 hours.

For the deepest qualitative testing, you want capture a site user’s verbal comments and on-screen actions (and see how your site displays on various machines, not just your web designer’s 45 inch iMac). For $29, will recruit a pre-screened tester and deliver a video and written summary of the test which is ready in about as long as it takes to bake a potato (in the oven, not microwave). You can ask for testers within an age range, income level, gender or level of Internet savvy. Considering you only need 4 or 5 user tests to get good insight, this is a super-inexpensive way to get involved.

Related Articles

7 Responses to “User Testing Toolbox”

  1. Thanks for pulling out the best ecommerce related tools from the list of 69. I didn’t have time to check them all out, so this is helpful. :)

    Having real feedback besides number crunching A/B tests is invaluable in dtermining future changes and upgrades to an existing store. Just remember to track abandonment rates and conversion rates after making each change to verify the choise you made is paying off.

    Rob – LexiConn

  2. Hi Linda,

    Thanks for taking a great blog post and grabbing three of the most useful items. I agree with you and Bryan about the five-second testing. A while back, our friend Adam L used the site to illustrate how you can take what you learn from these site tests and directly apply it to optimize a page. If you’re interested, you can see Adam’s blog post here:

    As for those 3 key questions, well, they’re certainly near and dear to us too. ;)

  3. I have used the 5-second test some times for tweaking the first impression of a site.
    But when it comes to improving the usability nothing beats the small simple usability test where you sit down with 1-5 users and let them try out your site. It only takes half a day and it gives you redesign ideas that you can spend at least 3 month testing out

  4. Bob Dobalina says:

    If you were going to add a fourth to your list, I think Loop11 ( is another great tool to help you understand the “Why”.
    This is a tool worth adding to your usability/UX arsenal. It’s the only one I’ve come across that lets you easily gather quantitative usability metrics.

  5. [...] This is not just something you can test quantitatively (with a Google Website Optimizer or Omniture Test and Target tool), but qualitatively with real users. [...]

  6. [...] to looking trustworthy, consumers also consider the look and feel of your site. There are several low-cost tools to help you gauge whether your site is aesthetically pleasing (using real people’s [...]

  7. [...] to looking trustworthy, consumers also consider the look and feel of your site. There are several low-cost tools to help you gauge whether your site is aesthetically pleasing (using real people’s [...]

Leave a Reply

© 2014 Get Elastic Ecommerce Blog. All rights reserved. Site Admin · Entries RSS · Comments RSS