Facebook wants to explore teaching AI models to understand the world in the eyes of a human. The social media giant announced that its Ego4D project would help them understand the challenges differently.

Facebook Ego4D For AI Training

facebook, ai, facebook ego4d, facebook ai model, ego4d project

(Photo : Possessed Photography from Unsplash)
Facebook is aiming to understand the world through training an AI model from a first-person perspective. Here's how Ego4D works.

According to the recent report by CNBC, Facebook aims to merge AI in solving the challenges from the point of view of a human. The next-gen AI model could have an "egocentric perception" of its surroundings by honing the artificial intelligence system through captured video footage.

For the part of the social media firm, the team managed to amass over 2,200 hours of first-person clips involving more than 700 participants. Moreover, the Ego4D project joined various universities and researchers from nine countries.

Saudi Arabia, Singapore, the United Kingdom, the United States, India, Italy, and Japan are the locations where the video footage is captured. Facebook said that it is also preparing to expand the program to other nations, including Rwanda and Colombia.

To make the data collection possible from a first-person POV, the Facebook Reality Labs utilized the Vuzix Blade smart glasses to garner even an extra 400 hours of the data.

Facebook Explains What Ego4D Does

The company's lead research scientist, Kristen Grauman, said that the modern vision systems are different from the usual human perception. To clarify that, she said that there is a need for AI models to interact with the world.

Furthermore, Grauman added that the system should shift to a paradigm that will show the first-person viewpoint. This would also tackle training the artificial intelligence models as to how the daily tasks work in the context of human experience.

Facebook's Ego4D is also a good way for researchers to improve AI. By doing this, they would establish refined systems in building chatbots, self-driving cars, and other AI-related technologies.

Venture Beat was mentioned in its report on Thursday, Oct. 14. that the problem with AI relies on its potential bias, this is a common flaw that many tech firms experience in the field of artificial intelligence.

Facebook researchers admitted that the Ego4D dataset exposes some biases, according to the same source.

In April, faulty face recognition resulted in the wrongful arrest of the suspect. In addition, Zoom's virtual background could show bias to people with dark skin. This also applies to the automatic photo-cropping feature of Twitter.

There's also an AI Project SEER, which sparked concerns among people about their privacy on Instagram. The said program is believed to train AI systems.

Facebook Ego4D Benchmarks

Grauman said that the benchmarks of tasks are at the same level of significance as the data collection. For this part, the AI model is geared toward the egocentric perception where people do interactions with others and non-living things.

The five benchmarks in the Ego4D consist of social interaction, hand-object interaction, audiovisual diarization, episodic memory, and forecasting.

Sometime in May, the company introduced Dynaboard and Dynascore for AI model benchmarks. Facebook said that these components depend on the "fairness" metrics of the systems.

Below is a video explaining more about Ego4D.

Written by Joseph Henry

Internet Explorer Channel Network


LATEST NEWS

NEWS RELATED

Depth Sensing AI Camera OAK-D Lite Gets Smaller and Smaller

(Photo : Image from Kickstart) Depth Sensing AI Camera OAK-D Lite Gets Smaller and Smaller | Full-Color 4K, Greyscale, Onboard AI Machine Vision Processing The new OAK-D is reportedly an open-source, full-color depth sensing camera that is embedded with AI capabilities. Currently, there is now a crowdfunding campaign going on…

Read more: Depth Sensing AI Camera OAK-D Lite Gets Smaller and Smaller

Google AI Department Gets Class-Action Lawsuit for 1.6 Million Confidential Medical Records of NHS Patients

(Photo : Image from Unsplash Website) Google AI Department Gets Class-Action Lawsuit for 1.6 Million Confidential Medical Records of NHS Patients The Google AI department otherwise known as DeepMined, the Google-owned AI research company, is getting a class-action lawsuit. The lawsuit focuses on the company’s use of personal records of…

Read more: Google AI Department Gets Class-Action Lawsuit for 1.6 Million Confidential Medical Records of NHS Patients

Bank Robbers Used Deepfake Voice for $35 Million Heist

(Photo : Image from Unsplash Website) Bank Robbers Used Deepfake Voice for $35 Million Heist | AI-Enhanced Voice Simulation Used Bank robbers appeared to have stolen a massive $35 million from a United Arab Emirates bank by using the help of AI-enhanced voice simulation. The robbers reportedly used deepfake to…

Read more: Bank Robbers Used Deepfake Voice for $35 Million Heist

Facebook is using first-person videos to train future AIs

Karissa Bell One of the obvious goals of almost every computer vision project is to enable a machine to see, and perceive, the world as a human does. Today, Facebook has started talking about Ego4D, its own effort in this space, for which it has created a vast new data…

Read more: Facebook is using first-person videos to train future AIs

Google turns its AI on traffic lights to reduce pollution

Google Poorly timed traffic lights don’t just waste precious minutes. Like Google’s chief sustainability officer Kate Brandt pointed out at a media event yesterday, they’re also bad for the environment and public health. The company unveiled a slew of sustainability-centric products and updates today that aim to help users make…

Read more: Google turns its AI on traffic lights to reduce pollution

Samsung hopes to 'copy and paste' the brain to 3D chip networks

VICTOR HABBICK VISIONS/SCIENCE PHOTO LIBRARY via Getty Images Samsung thinks it has a better way to develop brain-like chips: borrow existing brain structures. The tech firm has proposed a method that would “copy and paste” a brain’s neuron wiring map to 3D neuromorphic chips. The approach would rely on a…

Read more: Samsung hopes to 'copy and paste' the brain to 3D chip networks

AI startup Boomy looks to turn the music industry on its ear

Music publishers have been on a spending spree in recent years, buying the catalogs and copyrights for songs of famous musicians at a frantic pace. Last December, Universal Music Publishing Group bought up Bob Dylan’s entire discography in a deal estimated at more than $300 million. Similarly, Stevie Nicks sold…

Read more: AI startup Boomy looks to turn the music industry on its ear

European Parliament calls for a ban on facial recognition in public spaces

AndreyPopov via Getty Images The European Parliament has lawmakers in the European Union to ban automated in public spaces and to enforce strict safeguards for police use of artificial intelligence. MEPs voted in favor of the by 377-248, with 62 abstentions. The MEPs said citizens should only be monitored when…

Read more: European Parliament calls for a ban on facial recognition in public spaces

NVIDIA's latest tech makes AI voices more expressive and realistic

Google Lens is coming to Chrome on the desktop

What rights does an evil sentient computer have on Star Trek?

Sony's head of AI research wants to build robots that can win a Nobel Prize

Otter's transcription tech now supports Microsoft Teams, Google Meet and Webex

National committee will advise the President on AI competition and ethics

Facebook AI mislabels video of Black men as 'Primates' content

UK appeals court rules AI cannot be listed as a patent inventor

OTHER NEWS