HYDERABAD: The Hyderabad International Institute of Information Technology (IIITH), India’s only institute in Facebook AI’s ambitious Ego4D project, collected data from people across 25 locations in the country. A global consortium of 13 universities and labs is participating in Facebook’s Ego4D project, which collected first-person images from around the world to train next-generation artificial intelligence (AI) models.
Explaining how the project could help in everyday life, the IIIT-H researchers said a wearable device with first-person vision could do something as simple as help find a missing key or preventing someone from putting extra salt in a dish. It could also help someone with a visual impairment. Similar “assistance” could help boost memory, especially for people with early signs of dementia or memory impairment, they added.
The researchers said the dataset contains a wide variety of scenes, people, and activities. “Initially, we wanted to have a team that could travel across the country and participate in data collection. But with the pandemic, we had to find several local teams and ship cameras as well as data. We had to train people on videos,” said CV Jawahar of the Center for Visual Information Technology, IIITH.
He said that at each location, participants were selected from a variety of backgrounds, including home cooks, carpenters, painters, electricians, farmers, among others. “It was not a scripted activity done by graduate students. Video footage was taken as each individual performed their daily tasks in a normal setting,” Jawahar added.
“Even during surgical operations, it can guide and provide additional cues to the surgeon wearing the device,” Jawahar said, of the outlook for first-person vision technologies.
Explaining how the project could help in everyday life, the IIIT-H researchers said a wearable device with first-person vision could do something as simple as help find a missing key or preventing someone from putting extra salt in a dish. It could also help someone with a visual impairment. Similar “assistance” could help boost memory, especially for people with early signs of dementia or memory impairment, they added.
The researchers said the dataset contains a wide variety of scenes, people, and activities. “Initially, we wanted to have a team that could travel across the country and participate in data collection. But with the pandemic, we had to find several local teams and ship cameras as well as data. We had to train people on videos,” said CV Jawahar of the Center for Visual Information Technology, IIITH.
He said that at each location, participants were selected from a variety of backgrounds, including home cooks, carpenters, painters, electricians, farmers, among others. “It was not a scripted activity done by graduate students. Video footage was taken as each individual performed their daily tasks in a normal setting,” Jawahar added.
“Even during surgical operations, it can guide and provide additional cues to the surgeon wearing the device,” Jawahar said, of the outlook for first-person vision technologies.
