SURF Student’s AI Kitchen Tracker Aimed at Empowering Older Adults
Media Inquiries
As a junior majoring in artificial intelligence at Carnegie Mellon University, Glenda Tan is using her Summer Undergraduate Research Fellowship(opens in new window) (SURF) opportunity to address a growing global challenge: helping older adults live independently and with dignity. Her project, developed in collaboration with faculty and fellow students, centers on a smart kitchen tracking system designed to reduce daily frustrations for seniors experiencing cognitive decline.
“I was inspired by my grandmother,” Tan said. “She often struggles to find items in the kitchen, and I realized how common this problem is for older adults. I wanted to use AI to make their lives easier.”
A kitchen that remembers
Tan’s system uses an object detection model and depth-sensing technology to identify and locate kitchen items in real time. The data is stored in a database and connected to a custom-built mobile app called Cooker Looker, which allows users to search for items by name, view their location and check expiration dates.
The Summer Undergraduate Research Fellowship (SURF) program awards $4,500 to undergraduates at Carnegie Mellon for 8-10 full-time weeks of summer research on campus in any field of study.
“We designed the app to be easy to use,” Tan explained. “It uses large fonts, color coding and simple navigation so older adults don’t have to open every cabinet or drawer to find what they need.”
The app is accessible to both residents and family members, making it a helpful tool for caregivers as well.
From inspiration to implementation
Tan’s interest in the project deepened after learning about the work of Reid Simmons(opens in new window) at CMU’s AI Institute for Collaborative Assistance and Responsive Interaction for Networked Groups(opens in new window) (AI-CARING), a multi-university institute focused on supporting older adults through technology.
She joined his lab and began working alongside a team that includes Ph.D. and master’s students, as well as three other undergraduates. The project is also advised by Zackory Erickson(opens in new window) and Pragathi Praveena(opens in new window), all from CMU’s Robotics Institute.
The research began in summer 2024 as a Summer Undergraduate Research Apprenticeship(opens in new window) (SURA) project and has evolved through multiple semesters. Tan contributed to building the tracking system and developing the app.
A broader mission
Originally from Singapore, Tan is acutely aware of the challenges posed by aging populations.
“There’s a large proportion of people over 65 in Singapore,” she said. “This project is very relevant to my home country and many others.”
She sees undergraduate research as a transformative experience.
“Through SURF, I learned how to build an AI system from end to end and communicate my findings. It’s been incredibly meaningful.”
Finding community at CMU
Beyond research, Tan has found a vibrant community at CMU. She co-founded the CMU Star Wars Club(opens in new window), where students gather for lightsaber training and robotics projects like building a BB-8 droid.
“CMU is a place where, if you’re passionate about something, you’ll find others who share that passion,” she said.
