Learning by looking: Ontario Tech researcher’s app design turns everyday objects into vocabulary tools
Learning a new language at any age can be an incredible difficult process, one that requires significant effort, time and dedication. But a researcher at Ontario Tech University has developed an educational online tool that uses advanced technology to make the learning journey fast, effective, and even fun.
Dr. Mariana Shimabukuro is the creator of LangEye, a tool that helps people learn new words in a foreign language by connecting them with real-life objects. Instead of just memorizing vocabulary from a textbook, LangEye smartphone app users take pictures of things around them (like a chair, a cup, or a tree), and the app helps turn those photos into learning tools.
“The app uses artificial intelligence (AI) image recognition and language to identify the object in the photo, show the word in the target language, and then provide the definition, an example sentence, and how to pronounce it,” says Dr. Shimabukuro, an Associate Teaching Professor with Ontario Tech’s Faculty of Science. “LangEye also helps users review what they’ve learned by moving from recognizing images to recalling words without help, making the learning more active and long-lasting.”
Dr. Shimabukuro recently presented her preliminary LangEye research work at a major international computational linguistics conference in Austria.
What did the LangEye study find?
“We tested the app in a small study with people learning French,” says Dr. Shimabukuro. "Some users took their own photos, while others used AI-generated images of the same items. Everyone found LangEye easy to use, and people who used their own photos felt more connected to what they were learning, saying it was more fun and meaningful. More research is needed to understand how well it helps people remember words long-term.”
- Learn more about the app on the LangEye project website
- LangEye video link
Future research developments
LangEye is one of several projects Dr. Shimabukuro’s research group is working on to explore how AI can help create better educational content, improve assessments, and support more-personalized learning. As AI makes it easier to tailor learning to individual students, it's important that educators (teachers, instructors and facilitators) fully understand how these tools work, so they feel confident using them in the classroom.
”Many educators are excited about the potential of AI, but most of today’s tools don’t quite meet their teaching goals or align with ethical standards set by schools and institutions,” says Dr. Shimabukuro. “Even though there are still big questions about the long-term impact of AI on critical thinking, we see an opportunity. With our background in Human-Computer Interaction (HCI) and applied AI, we’re working to design the next wave of educational tools. These tools aren’t meant to replace teachers, but to support and enhance what they do. The tools will be teacher-guided, focused on students’ needs, and flexible enough for classroom use and as well as independent learning.”
Background
LangEye was developed as part of Dr. Shimabukuro’s PhD (2024) dissertation research at Ontario Tech (titled ‘Promoting autonomy for language learning powered by data-driven methods and learner-centred design’), under the supervision of the Faculty of Science’s Dr. Christopher Collins. Contributors included Ontario Tech alumni Deval Panchal (Computer Science, class of 2024, now a software engineer at Ontario Power Generation), who implemented the app as a research assistant and leading developer; and Shawn Yama (Computer Science class of 2022, now a software engineer at Uncharted Software in Toronto), who worked on the early user interface/user experience design of the application.
Media contact
Communications and Marketing
Ontario Tech University
communications@ontariotechu.ca
Latest Alumni news
- From student to nurse: A tradition of recognitionGraduates of Ontario Tech University’s Bachelor of Science in Nursing (BScN) and Advanced Entry BScN programs marked the completion of their studies at the annual Nursing Pinning Ceremony, a tradition rooted in reflection, recognition and celebration.
- Ontario Tech celebrates outstanding alumni who inspire changeAt the recent 2025 Ontario Tech Alumni Association Awards ceremony, Ontario Tech University honoured the remarkable achievements of four alumni whose innovation, leadership and community involvement are making a lasting impact. Selected from a record 31 nominations, this year’s recipients exemplify the university’s values and the power of education to drive meaningful change.
- Ontario Tech launches Canada’s first School of Artificial IntelligenceOntario Tech University has launched Canada's first School of Artificial Intelligence (SEAI), focusing on AI governance and the responsible development of technology.
- Ontario Tech grad students get a career-building experience at Canada’s top nuclear research labFor the second year in a row, Ontario Tech’s School of Graduate and Postdoctoral Studies organized a visit for 16 Ontario Tech master’s and PhD students from a mix of academic programs spent a week at Canadian Nuclear Laboratories (CNL) in Chalk River, Ontario.
- A historic year of giving: Tech with a Conscience donors propel Ontario Tech to new philanthropic heightsOntario Tech University proudly celebrates an important milestone: a record-breaking fiscal year for new investment in the advancement of ethical technology, student success and groundbreaking research.
- Project Arrow 2.0: Ontario Tech University’s next bold step into the future of transportationDesignated the lead academic institution in Project Arrow’s initial development from 2021 to 2024, Ontario Tech will continue to drive innovation in the next phase as the official research and build partner for Canada’s Automotive Parts Manufacturers’ Association.
