Research: Multimodal Summarization
EMNLP 2023 Submission
- First author on a paper currently under review at EMNLP 2023.
- Details will be updated after anonymity period!
Application: Recovo
Class Team Project for Mobile and Ubiquitous Computing SP22
Recovo stands for "Recover Conversation Vocabulary", and is a unique language-learning app that helps users learn the vocabulary words they encounter in real situations in their lives.
When the app is turned on, it listens in the background until the user taps the "Recover" button - then, the app converts the past 10 seconds of audio into text, searches the text for the most challenging vocabulary words, and presents the definitions of these words immediately to the user. The user can then easily check for the words that they missed in the conversation, lecture, or meeting, without having to look things up later or disrupt the flow of conversation.
Recovo was developed as part of a 4-member team project for Professor Younggi Lee's Mobile and Ubiquitous Computing class at SNU. I was particularly proud of this project as I was able to work towards my favorite goal: using AI to help create tools for improved learning!
