Learning a new language at any age can be an incredible difficult process, one that requires significant effort, time and dedication. But a researcher at Ontario Tech University has developed an educational online tool that uses advanced technology to make the learning journey fast, effective, and even fun.
Dr. Mariana Shimabukuro is the creator of LangEye, a tool that helps people learn new words in a foreign language by connecting them with real-life objects. Instead of just memorizing vocabulary from a textbook, LangEye smartphone app users take pictures of things around them (like a chair, a cup, or a tree), and the app helps turn those photos into learning tools.
“The app uses artificial intelligence (AI) image recognition and language to identify the object in the photo, show the word in the target language, and then provide the definition, an example sentence, and how to pronounce it,” says Dr. Shimabukuro, an Associate Teaching Professor with Ontario Tech’s Faculty of Science. “LangEye also helps users review what they’ve learned by moving from recognizing images to recalling words without help, making the learning more active and long-lasting.”
Dr. Shimabukuro recently presented her preliminary LangEye research work at a major international computational linguistics conference in Austria.
What did the LangEye study find?
“We tested the app in a small study with people learning French,” says Dr. Shimabukuro. "Some users took their own photos, while others used AI-generated images of the same items. Everyone found LangEye easy to use, and people who used their own photos felt more connected to what they were learning, saying it was more fun and meaningful. More research is needed to understand how well it helps people remember words long-term.”
- Learn more about the app on the LangEye project website
- LangEye video link
Future research developments
LangEye is one of several projects Dr. Shimabukuro’s research group is working on to explore how AI can help create better educational content, improve assessments, and support more-personalized learning. As AI makes it easier to tailor learning to individual students, it's important that educators (teachers, instructors and facilitators) fully understand how these tools work, so they feel confident using them in the classroom.
”Many educators are excited about the potential of AI, but most of today’s tools don’t quite meet their teaching goals or align with ethical standards set by schools and institutions,” says Dr. Shimabukuro. “Even though there are still big questions about the long-term impact of AI on critical thinking, we see an opportunity. With our background in Human-Computer Interaction (HCI) and applied AI, we’re working to design the next wave of educational tools. These tools aren’t meant to replace teachers, but to support and enhance what they do. The tools will be teacher-guided, focused on students’ needs, and flexible enough for classroom use and as well as independent learning.”
Background
LangEye was developed as part of Dr. Shimabukuro’s PhD (2024) dissertation research at Ontario Tech (titled ‘Promoting autonomy for language learning powered by data-driven methods and learner-centred design’), under the supervision of the Faculty of Science’s Dr. Christopher Collins. Contributors included Ontario Tech alumni Deval Panchal (Computer Science, class of 2024, now a software engineer at Ontario Power Generation), who implemented the app as a research assistant and leading developer; and Shawn Yama (Computer Science class of 2022, now a software engineer at Uncharted Software in Toronto), who worked on the early user interface/user experience design of the application.
Media contact
Bryan Oliver
Communications and Marketing
Ontario Tech University
289.928.3653 (mobile)
bryan.oliver@ontariotechu.ca
