Category Archives: user experience

How to set up remote user testing with a Mac

I’ve started venturing into the world of doing remote user testing. This means that instead of recruiting people to come in to the office to do user tests, I use screen sharing technology to see how they use the web site I’m testing on their own computer.

This has lots of benefits, most notably:

  • I’m able to talk to people all over the world, not just in San Francisco.
  • I can see how the participants use the site on their own machines and browsers.
  • Recruiting is typically the most difficult and annoying part of doing user testing. Remote testing is easier to recruit for, since it doesn’t require the participant to go anywhere.

The technical side to this isn’t super easy, but it shouldn’t dissuade you from trying remote testing. I learned the basics of how to set up remote testing thanks to help from my awesome friend Nate Bolt. (Be sure to read his book on remote research when it comes out later this year!)

Here’s the skinny — UserVue is a great tool that is specifically built for remote testing. However, it only works on PCs. If you’re on a Mac, you have to assemble more of a Rube Goldberg-ian app suite. I did lots of tinkering with settings and applications to make this work; when I was done, I realized that these notes could be helpful for others.

THE TOOLS

You will need:

  • Mac (either laptop or desktop)
  • Acrobat Connect for screensharing. You do not need to buy the “Pro” version, Acrobat Connect Pro. Note that the Adobe site hides the cheap, non-Pro version. Cost: $39.95 a month.

    UPDATE:
    There is a free version that is basically the same but has shinier icons. It’s also slightly less annoying. In this version, you need to click on the participant name and request that they share their screen — no need to “autopromote participants to presenters.”
  • Soundflower to enable audio recording. Be sure to also install Soundflowerbed during the installation process. Free
  • iShowU HD for recording screensharing and audio. You do not need to buy the “Pro” version, iShowU HD Pro. $29.95
  • Skype for audio. Free to use but you will need to pay to call phones from Skype. Pay in increments of ‚Ǩ10.
  • Headset for using Skype. You will need a headset that has a built in microphone. I’m using the Plantronics GameCom Pro 1 for no other reason than I found one in our office. It works well.

(Note that if you’re on a PC, UserVue does what Soundflower + Connect + Skype + iShowU does.)

SETUP INSTRUCTIONS

Sound on the computer:

Under System Preferences on the Mac, select Sound, then:

  • Output: Soundflower (2ch)
  • Input: headset

Soundflowerbed:

Under Soundflower (2CH), change from None (OFF) to headset

Soundflower

Select “Audio Setup…” then Audio Devices

  • Input: headset
  • Default Output: headset
  • System Output: headset
  • Soundflower - Audio MIDI Setup

    Skype:

    Under Preferences, select Audio

    • Audio Output > Soundflower (2ch)
    • Audio Input > headset

    Skype preferences

    iShowU HD:

    In the menu bar, make sure:

    • Microphone capture enabled
    • Application capture enabled

    Go to Advanced Options and click on the megaphone to adjust sound preferences.

    • Select: Record audio from applications
    • Select: Record sound from input device
    • DO NOT Select: Monitor input device
    • Select name of headset from dropdown

    Choose the area of your screen to record. Click “Choose” to select your capture area and toggle over to your Adobe Connect window and trace around the meeting space.

    iShowU HD settings

    Adobe Connect:

    Under “Meeting,” select “Auto-Promote Participants to Presenters

    Acrobat Connect preferences

    SESSION MECHANICS

    • Moderator calls participant using Skype. Audio quality will be better if you call them on a mobile or landline number rather than on Skype.
    • Make sure that they are at the Connect URL: http://connect.acrobat.com/XXXX
    • Instruct the participant to Select “Enter as Guest” and type their name. Tell them that you will approve them to enter the meeting. Approve them to enter the meeting once they have done this.
    • Ask the participant to click “Share Your Screen.”
    • Tell the participant that they will be prompted to install the Adobe Acrobat Connect Add-In if they don’t already have it.
    • Connect will then open for them in a new window. Ask them to click “Share Your Screen” again.
    • Tell the participant that where you see “Start Screen Sharing” select “Applications” then the name of the window where the website is open that you’ll be discussing.
    • At the end of the session remind the participant to select “Stop Sharing” at the bottom of the Connect window.

    – – – – – – –

    I’m interested in hearing about your experiences doing remote testing. Do you have gripes? Inspiring stories? Tips for other people doing user research? Good luck and have fun!

    Google AdWords: How to tell a story about interface changes

    Users don’t tend to ask for large-scale site overhauls; massive changes mean having to learn a new UI, and that’s rarely something that folks get excited about. Massive changes also tend to feel unnecessary (it worked before, why fix it?) and arbitrary (why did this thing change and that other thing didn’t?) How, then, to explain to users why changes were necessary, why you made the changes you did, and how to effectively use the new UI?

    (Twitter didn’t do a great job of explaining why it made a small but significant change last week, and users staged a minor revolt.)

    The Google AdWords team made a smart decision to make a video about changes to the AdWords administrative interface. Team members describe how they collected user feedback to inform changes to the interface, and how these changes make the user experience better. The video makes the interface changes feel necessary (they significantly improve site performance) and human (real people put lots of thought into how to make this better, and the new features represent their best efforts).

    Now Scheduled: SXSW Panel “Tools to Know Your Users”

    SXSW is just around the corner! Our panel, “Developing Super Senses: Tools to Know Your Users” has been scheduled for Monday, March 16 at 5pm. Come hear me, Mark Trammell, Nate Bolt, Carla Borsoi, and Andy Budd duke it out over user research best practices.

    Here’s the panel description:

    You know you need to do user research, but how? Should you write surveys, do focus groups, or develop personas? And how do you act on what you’ve learned? We’ve been in the trenches and have concrete suggestions on what you can, and should do NOW to conduct effective user research.

    We expect your attendance. And come equipped with a good question or two. :)

    See me speak at SXSW 2009 (http://sxsw.com)