Project: Chatbot
  • Chatbot Introduction
  • Challenge & Background
    • Skills & Exploration
  • Project Instructions
    • 1 DEFINE PROBLEM & VALUE PROPOSITION
      • 1.1 Warm-Up Project
      • 1.2 Initial Ideas
      • 1.3 Background Research
      • 1.4 Personas
      • 1.5 Concept Narrowing
      • 1.6 Task Analysis
      • 1.7 Value Proposition & Features
      • 1.8 Team Proposal
    • 2 DESIGN & BUILD SOLUTION
      • 2.1 Database Development
      • 2.2 Sample Dialogues
      • 2.3 Pseudocode Functions
      • 2.4 Develop Complete Dialogue Script
      • 2.5 Style Guide
      • 2.6 Code Development Outline and Begin Coding
      • 2.7 Marketing card
      • 2.8 Code Testing
      • 2.9 Prepare Development Review and Demonstration
    • 3 EVALUATE & REFINE SOLUTION
      • 3.1 Evaluation and Post Interview
      • 3.2 Chatbot Usage Analysis
      • 3.3 App Refinements
      • 3.4 Poster
      • 3.5 Prepare for Poster Review and Demonstration
      • 3.6 Public Presentation Plan and Practice
      • 3.7 Individual Reflection
      • 3.8 Present to the public
      • 3.9 Celebrate
  • Reference
    • Chatbot Code Docs
Powered by GitBook
On this page
  1. Project Instructions
  2. 3 EVALUATE & REFINE SOLUTION

3.1 Evaluation and Post Interview

Previous3 EVALUATE & REFINE SOLUTIONNext3.2 Chatbot Usage Analysis

Plan another evaluation to test your live chatbot using the think-aloud protocol with at least six people. While you did a basic functional test (code testing) earlier, this evaluation will help you determine if the chatbot is fully usable and engaging for people. Prepare a few prompts for participants to complete the main tasks your chatbot supports. For example, you could ask them, "How would you go about reviewing a glossary of terms in our Chemistry Bot to prepare for a quiz?". By observing the interaction and any comments from the participant you will gain insight. Be sure to record your findings promptly. Be sure to evaluate the conversation flow and the quality of the chatbot messages and feedback.

Follow up this evaluation with an informal post interview of participants to get feedback on the overall effectiveness of your solution in addressing your chosen health issue. You want to learn as much as you can while using people's time wisely and respectfully.

.

❏ Deliverable A document or slide that summarizes the results of your user experience evaluation.

✓- Below Standard

✓ At Standard

✓+ Above Standard

The evaluation was completed but did demonstrate a clear effort to understand the user's experience while using the chatbot.

The evaluation and conclusions demonstrate an intentional process to improve the chatbot that led to some useful insights.

The evaluation was exceptionally detailed and the conclusions were insightful, leading to identified improvements that should make the user experience noticeably improved.

Thinking Aloud from Nielsen Norman Group