Troublesome Participants in Experimental Evaluations - A Final Note
In the realm of user research and testing, maintaining a productive and respectful environment is crucial. Here are some strategies to help you avoid problems with users during interviews, ensuring a successful outcome for both parties.
First and foremost, it's essential to approach interviews with honesty and integrity. Misdirection can be used in small measure to ensure test outcomes are not adversely affected, but it should never be employed for unethical reasons.
Involving users in research generally encourages them to help, as they feel valued and respected. This is why it's important to thank participants for attending and debrief them if misdirection was used during the test process.
Handling difficult participants can become second nature due to user involvement in research. However, it's crucial to remember that assertiveness should never veer into rudeness. Considerate language is key when asserting your questions or requirements.
Recruit more candidates than needed for interviews, as some may not show up. This ensures a diverse pool of participants and increases the chances of a successful interview.
For those looking to improve their interview skills, experts like Wendell Tull, a former recruiter for Nvidia and Slack with over 25 years of recruiting experience, can offer valuable insights. Wendell now leads a company specializing in interview preparation and can share his knowledge by offering coaching, training, or consulting services to help others master the interview process.
Feedback on interviews can be obtained through video reviews of interviews or by having someone observe the interview process. This feedback can be invaluable in improving your interview techniques and ensuring a positive experience for both you and the interviewee.
It's important to remember that interviewees are not being tested, but the product is. Their opinions are valued, and direct interviews without using leading questions, aiming for a natural flow, help to ensure genuine feedback.
User research can lead to fewer "difficient" participants over time, as users become more comfortable with the process and more willing to share their honest opinions. By following these strategies, you can help create a positive and productive environment for user research and testing.
Lastly, it's essential to respect participants during the interview process. This respect fosters a positive relationship and encourages participants to help in future research and testing efforts.