Speaking Buddies is an innovative early proof-of-concept prototype for an interactive conversational agent designed in 2022, to enhance foreign language speaking practice for adult learners. 

It addresses the need for more engaging and effective online speaking practice tools, a demand that has grown significantly in the context of the recent pandemic.

Overview

Role

UX Researcher, UX/UI Designer,
Chatbot conversation script

Duration

9 weeks

Reflections

Speaking Buddies was one of my first projects using Figma and applying UX research methods in depth. It gave me hands-on experience in both primary and secondary research, helping me translate insights into design decisions.

Experimenting with AI-generated avatars was a bold and valuable learning experience, highlighting the importance of seamless user interaction and iterative testing.

Since then, I have gained more experience in user research and Figma, leading to more refined interactions and a stronger visual approach to my projects. Usability testing is now applied early and often to enhance engagement and fine-tune details.

The process

Challenge

Traditional language learning applications often depend on gamification and pre-recorded dialogues, which do not accurately reflect real-world conversations. As a result, learners frequently memorise set phrases without achieving true fluency.

Furthermore, many lack real-time feedback on pronunciation and fluency, making it difficult to build confidence. The recent pandemic has further highlighted the need for more engaging, interactive, and effective online speaking practice tools.

Users need more than gamification features and pre-recorded interactions to learn how to speak a foreign language eloquently and confidently.

Problem Statement

Many language learning tools lack realistic and engaging speaking practice, making it difficult for adult learners to build confidence and fluency. To address this, learners need interactive, personalised, and accessible solutions that prioritise natural conversation over memorisation, meeting the increasing demand for effective online speaking practice.

Solution

To address these challenges, Speaking Buddies provides:

AI-driven conversation practice – Learners can speak freely and receive instant AI feedback on fluency.

A pressure-free environment – Unlike talking to real people, the AI allows learners to practice without fear of judgment.

Structured, adaptive dialogues – Conversations are designed to build confidence gradually, adjusting based on user responses.

User Research, Design & Testing

User research

I conducted mixed-methods research including interviewing experts within the industry to supplement academic literature.

I interviewed 8 language learners who regularly use Duolingo and other apps.

They shared that:
Fear of making mistakes kept them from speaking.

They lacked real-time feedback on pronunciation and fluency.

They wanted structured, but flexible conversation practice that felt more natural.

Design and Development

I used speech recognition technology to create a natural user interface.

I implemented lip-syncing AI avatars to mimic real conversational scenarios.

I designed subtle facial expressions and optional subtitles for enhanced understanding and comfort.

User Personalisation

Learners can choose between multiple languages and avatars.

Accessibility and Inclusivity

I ensured the design adhered to WCAG regulations and heuristics with contrasting colours, large fonts, and legible buttons.

I included features like session recording and optional subtitles.

Prototyping and Testing

I created high-fidelity wireframes and prototypes using tools like Figma.

I tested the chatbot with 5 learners across different fluency levels:

  • Users found the AI responses helpful but sometimes too robotic.

  • They wanted more personalized conversation paths to match their language level.

Result

User Testing

80% of testers reported increased confidence when speaking after using the chatbot.

“I felt like I could practice without pressure, which made a huge difference.”

Speaking Buddies shows potential for scalability, with future improvements including real-time pronunciation scoring and multi-language support.

Key Achievements

Designed an AI-driven chatbot conversation flow that:

  • Adapts to user input for more natural and engaging practice sessions.

  • Boosts user confidence in speaking a foreign language.

  • Focuses on real conversation skills rather than phrase memorisation.

  • Establishes a solid foundation for future development and testing.

  • Has the potential for expansion into web platforms, standalone apps, and immersive technologies (AR/VR).

Features

Speaking Buddies offers a range of features designed to enhance user engagement and make language learning more natural and accessible.

AI-Powered Conversations

Users practice natural dialogues with a synthetic AI avatar, enhanced by lip-syncing and facial expressions for better comprehension.

Enhanced Interaction

Optional subtitles and session recording help improve pronunciation and fluency.

Flexible Learning Options

Includes mini-group sessions and adaptive experiences tailored to different learning styles.

Personalised Learning

Customisable avatars and lesson recommendations based on user preferences and goals.