Carnegie Mellon Student Given NSF Grant to ICMI Conference-Silicon Valley Campus - Carnegie Mellon University

Carnegie Mellon Student Given NSF Grant to ICMI Conference-Silicon Valley Campus - Carnegie Mellon University

Carnegie Mellon Student Given NSF Grant to ICMI Conference

Carnegie Mellon Electrical and Computer Engineering Ph.D. student Senaka Buthpitiya was selected by the National Science Foundation (NSF) to attend the 12th International Conference on Multimodal Interfaces and 7th Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI 2010), to be held in Beijing, China this November.

The conference promotes furthering scientific research within the field of multimodal interaction, methods, and systems, with a focus on major trends and challenges, and working towards identifying a roadmap for future research and commercial success.

Ph.D. student Senaka Buthpitiya will present a paper titled “A Language-Based Approach to Indexing Heterogeneous Multimedia Lifelog” in the Doctoral Spotlight Poster Session of the conference. CMU alumni Peng-Wen Chen and Snehal Kumar Chennuru, along with faculty advisor Dr. Joy Zhang, worked together with Buthpitiya on the paper.

The project, LifeLogger, is a system that records one’s life experience as a multimedia database. Most life-logging systems focus mainly on recording and storing various types of sensory data. However, without a convenient method to index and retrieve the recorded data, such logged memory is of limited use. Understanding the content of images, audio, and video remains open to research. This system, Carnegie Mellon LifeLogger, presents an ongoing research of indexing the life logs by behavior language. By converting the ambulatory sensor information such as accelerometer readings into behavior language, the system is able to use statistical natural language processing techniques to index, recognize, cluster, retrieve, and infer high level semantic meanings of life logs.

Assistant Research Professor Joy Zhang commented, “Senaka came up the novel idea of modeling people’s commuting pattern as a language and developed the system that can predict one’s future location from recorded GPS traces. Such geo-trace model can also be used to authenticate a mobile user, such as identifying when a phone is stolen. I am very happy that the NSF awarded Senaka this travel grant to ICMI 2010. Only 6 Ph.D. students are awarded the grant. Other recipients include Ph.D. students from MIT, USC, VT—all top schools in Computer Sciences. Attending conferences to present and discuss research findings with fellow researchers is a critical process for young researchers like Senaka. It allows them to learn the state-of-the-art from the best researchers in the world and establish themselves.”

Congratulations to Senaka and the team!