The artificial intelligence learned using video and audio from a helmet-mounted camera worn by Sam here aged 18 months.Credit: Wai Keen Vong
An artificial intelligence (AI) model has learnt to recognize words such as crib and ball, by studying headcam recordings of a tiny fraction of a single babys life.
The results suggest that AI can help us to understand how humans learn, says Wai Keen Vong, co-author of the study and a researcher in AI at New York University. This has previously been unclear, because other language-learning models such as ChatGPT learn on billions of data points, which is not comparable to the real-world experiences of an infant, says Vong. We dont get given the internet when were born.
The authors hope that the research, reported in Science on 1 February1, will feed into long-standing debates about how children learn language. The AI learnt only by building associations between the images and words it saw together; it was not programmed with any other prior knowledge about language. That challenges some cognitive-science theories that, to attach meaning to words, babies need some innate knowledge about how language works, says Vong.
The study is a fascinating approach to understanding early language acquisition in children, says Heather Bortfeld, a cognitive scientist at the University of California, Merced.
Vong and his colleagues used 61 hours of recordings from a camera mounted on a helmet worn by a baby boy named Sam, to gather experiences from the infants perspective. Sam, who lives near Adelaide in Australia, wore the camera for around one hour twice each week (roughly 1% of his waking hours), from the age of six months to around two years.
The researchers trained their neural network an AI inspired by the structure of the brain on frames from the video and words spoken to Sam, transcribed from the recording. The model was exposed to 250,000 words and corresponding images, captured during activities such as playing, reading and eating. The model used a technique called contrastive learning to learn which images and text tend to go together and which do not, to build up information that can used to predict which images certain words, such as ball and bowl, refer to.
To test the AI, the researchers asked the model to match a word with one of four candidate images, a test that is also used to evaluate childrens language abilities. It successfully classified the object 62% of the time much better than the 25% expected by chance, and comparable to a similar AI model that was trained on 400 million imagetext pairs from outside this data set.
For some words, such as apple and dog, the model was able to correctly identify previously unseen examples something humans generally find relatively easy. On average, it did so successfully 35% of the time. The AI was better at identifying objects out of context when they occurred frequently in the training data. It was also best at identifying objects that vary little in their appearance, says Vong. Words which can refer to a variety of different items such as toy were harder to learn.
The studys reliance on data from a single child might raise questions about the generalizability of its findings, because childrens experiences and environments vary greatly, says Bortfeld. But the exercise revealed that a lot can be learnt in the infant's earliest days through only forming associations between different sensory sources, she adds. The findings also challenge scientists such as US linguist Noam Chomsky who claim that language is too complex and the input of information is too sparse, for language acquisition to happen through general learning processes. These are among the strongest data Ive seen showing that such special mechanisms are not necessary, says Bortfeld.
DeepMind AI learns simple physics like a baby
Real-world language learning is much richer and varied than the AI experienced. The researchers say that, because the AI is limited to training on still images and written text, it could not experience interactions that are inherent to a real babys life. The AI struggled to learn the word hand for example, which is usually learnt early on in an infants life, says Vong. Babies have their own hands, they have a lot of experience with them. Thats definitely a missing component of our model.
The potential for further refinements to make the model more aligned with the complexities of human learning is vast, offering exciting avenues for advancements in cognitive sciences, says Anirudh Goyal, a machine learning scientist at the University of Montreal, Canada.
Go here to read the rest:
This AI learnt language by seeing the world through a baby's eyes - Nature.com
- What We Learned From Big Tech's Earnings Reports - Investopedia - February 4th, 2024 [February 4th, 2024]
- Google Maps: It's getting a new generative AI feature - Mashable - February 4th, 2024 [February 4th, 2024]
- Amazon made an AI bot to talk you through buying more stuff on Amazon - The Verge - February 4th, 2024 [February 4th, 2024]
- AI creates what Europeans think Americans from every state look like and it may hurt your feelings - UNILAD - February 4th, 2024 [February 4th, 2024]
- Samsung's Galaxy S24 Ultra Could Be Doing So Much More With AI - CNET - February 4th, 2024 [February 4th, 2024]
- Fact Sheet: Biden-Harris Administration Announces Key AI Actions Following President Bidens Landmark Executive ... - The White House - February 4th, 2024 [February 4th, 2024]
- Google Maps is getting supercharged with generative AI - The Verge - February 4th, 2024 [February 4th, 2024]
- AI chatbots tend to choose violence and nuclear strikes in wargames - New Scientist - February 4th, 2024 [February 4th, 2024]
- Police Turn to AI to Review Bodycam Footage - ProPublica - February 4th, 2024 [February 4th, 2024]
- Apple Just Teased Its AI Plans. You Really Should Take Notice - CNET - February 4th, 2024 [February 4th, 2024]
- AI models are coming to fashion to promote diversitybut some industry insiders are concerned it will end up parodying it - Fortune - February 4th, 2024 [February 4th, 2024]
- In the AI science boom, beware: your results are only as good as your data - Nature.com - February 4th, 2024 [February 4th, 2024]
- Tim Cook confirms Apple's generative AI features are coming later this year - The Verge - February 4th, 2024 [February 4th, 2024]
- I Tried Google Bard's New AI Image Generator. Here's How It Turned Out - CNET - February 4th, 2024 [February 4th, 2024]
- 'Year of AI' Faculty Recruitment Initiative Aims to Bring More World-Class Professors to UT - The University of Texas at Austin - February 4th, 2024 [February 4th, 2024]
- AI Learns Through the Eyes and Ears of a Child - New York University - February 4th, 2024 [February 4th, 2024]
- Amazon Introduces Rufus, an AI Shopping Tool, and Reports Earnings - The New York Times - February 4th, 2024 [February 4th, 2024]
- I Tested a Next-Gen AI Assistant. It Will Blow You Away - WIRED - February 4th, 2024 [February 4th, 2024]
- AI Actors Who Almost Got The Part - BuzzFeed - February 4th, 2024 [February 4th, 2024]
- AI afterlife, robot romance, and slow-burn slashers: the best of Sundance 2024 - The Verge - February 4th, 2024 [February 4th, 2024]
- Is Jumping on the AI Bandwagon Prudent? - Catholic Exchange - February 4th, 2024 [February 4th, 2024]
- Arc Search's AI responses launched as an unfettered experience with no guardrails - Mashable - February 4th, 2024 [February 4th, 2024]
- Generative AI is hot, but predictive AI remains the workhorse - CIO - February 4th, 2024 [February 4th, 2024]
- Nvidia Stock Just Got Amazing Artificial Intelligence (AI) News From These Trillion-Dollar Tech Giants - The Motley Fool - February 4th, 2024 [February 4th, 2024]
- AI Briefing: How Priceline and other e-commerce companies are approaching generative AI - Digiday - February 20th, 2024 [February 20th, 2024]
- OpenAI Unveils A.I. That Instantly Generates Eye-Popping Videos - The New York Times - February 20th, 2024 [February 20th, 2024]
- Technology industry to combat deceptive use of AI in 2024 elections - Stories - Microsoft - February 20th, 2024 [February 20th, 2024]
- What is a deepfake? How AI scams are threatening the 2024 election - USA TODAY - February 20th, 2024 [February 20th, 2024]
- Meeting the moment: combating AI deepfakes in elections through today's new tech accord - Microsoft On the Issues - Microsoft - February 20th, 2024 [February 20th, 2024]
- These Are the Jobs That AI Is Actually Replacing in 2024 - Tech.co - February 20th, 2024 [February 20th, 2024]
- AI company developing software to detect hypersonic missiles from space - SpaceNews - February 20th, 2024 [February 20th, 2024]
- How are AI Systems Assisting Architects and Designers? - ArchDaily - February 20th, 2024 [February 20th, 2024]
- Artificial intelligence is making critical health care decisions. The sheriff is MIA - POLITICO - February 20th, 2024 [February 20th, 2024]
- Google's Chess Experiments Reveal How to Boost the Power of AI - WIRED - February 20th, 2024 [February 20th, 2024]
- Why the only way to ride the company AI wave is experimentation - Big Think - February 20th, 2024 [February 20th, 2024]
- What Are the Best AI Stocks in February 2024? Our Top 3 Picks - InvestorPlace - February 20th, 2024 [February 20th, 2024]
- Media Buying Briefing: Agencies' AI efforts lead to aliens and Whoppers - Digiday - February 20th, 2024 [February 20th, 2024]
- C3.ai Stock Warning: Don't Get Carried Away With AI Euphoria! - InvestorPlace - February 20th, 2024 [February 20th, 2024]
- Google wants you to label AI-generated images used in Merchant Center - Search Engine Land - February 20th, 2024 [February 20th, 2024]
- The State of A.I., and Will Perplexity Beat Google or Destroy the Web? - The New York Times - February 20th, 2024 [February 20th, 2024]
- Donald Trump's father resurrected by AI to tell him he's 'a disgrace' - Euronews - February 20th, 2024 [February 20th, 2024]
- Google Cloud CEO On Huge Investments, AI And Challenges In 2024 - CRN - February 20th, 2024 [February 20th, 2024]
- AI Stocks: Google, Adobe Highlight Threat Even To Big Artificial Intelligence Plays. Take Note Investors. - Investor's Business Daily - February 20th, 2024 [February 20th, 2024]
- Another Big Question About AI: Its Carbon Footprint Mother Jones - Mother Jones - February 20th, 2024 [February 20th, 2024]
- Reddit sells training data to unnamed AI company ahead of IPO - Ars Technica - February 20th, 2024 [February 20th, 2024]
- ChatGPT Stock Predictions: 3 Artificial Intelligence Companies the AI Bot Thinks Have 10X Potential - InvestorPlace - February 20th, 2024 [February 20th, 2024]
- Chinese entrepreneurs express awe and fear of OpenAIs Sora video tool - South China Morning Post - February 20th, 2024 [February 20th, 2024]
- Sanofi CEO: AI promises a great era of drug discovery that could fundamentally change medicinebut only if we allow it to deliver - Fortune - February 20th, 2024 [February 20th, 2024]
- Google's AI Boss Says Scale Only Gets You So Far - WIRED - February 20th, 2024 [February 20th, 2024]
- World's largest computer chip WSE-3 will power massive AI supercomputer 8 times faster than the current record-holder - Livescience.com - March 15th, 2024 [March 15th, 2024]
- Is generative AI truly making disinformation worse? - Euronews - March 15th, 2024 [March 15th, 2024]
- Do This Weekly To Learn About AI Investing, Says Top Trader - Investor's Business Daily - March 15th, 2024 [March 15th, 2024]
- Your Kid May Already Be Watching AI-Generated Videos on YouTube - WIRED - March 15th, 2024 [March 15th, 2024]
- Free Legal Research Startup descrybe.ai Now Has AI Summaries of All State Supreme and Appellate Opinions - LawSites - March 15th, 2024 [March 15th, 2024]
- Google's new AI will play video games with you but not to win - The Verge - March 15th, 2024 [March 15th, 2024]
- Regulators Need AI Expertise. They Can't Afford It - WIRED - March 15th, 2024 [March 15th, 2024]
- CBP wants to use AI to scan for fentanyl at the border - The Verge - March 15th, 2024 [March 15th, 2024]
- Rely on the Spirit when using AI, Elder Gong encourages - Church News - March 15th, 2024 [March 15th, 2024]
- Video Game Made Purely With AI Failed Because Tech Was 'Unable to Replace Talent' - IGN - March 15th, 2024 [March 15th, 2024]
- Among the A.I. Doomsayers - The New Yorker - March 15th, 2024 [March 15th, 2024]
- Self-docking spacecraft could be built with AI system similar to ChatGPT - Space.com - March 15th, 2024 [March 15th, 2024]
- AI books are crowding the marketplace on Amazon - NPR - March 15th, 2024 [March 15th, 2024]
- Hackers can read private AI-assistant chats even though they're encrypted - Ars Technica - March 15th, 2024 [March 15th, 2024]
- EU Presses Big Tech Companies on AI Threats - PYMNTS.com - March 15th, 2024 [March 15th, 2024]
- AI Chips: In the AMD Vs. Nvidia Fight, Second Place Is Still A Winner - Investor's Business Daily - March 15th, 2024 [March 15th, 2024]
- AI fear and excitement are lucrative mix for online training industry - Marketplace - March 15th, 2024 [March 15th, 2024]
- Craig Martell, the Pentagon's first-ever Chief Digital and AI Officer, to depart in April - DefenseScoop - March 15th, 2024 [March 15th, 2024]
- Startup Interloom raises $3 million seed round to take on UiPath and RPA market - Fortune - March 15th, 2024 [March 15th, 2024]
- Forget Chatbots. AI Agents Are the Future - WIRED - March 15th, 2024 [March 15th, 2024]
- SXSW audience boos AI sizzle reel - Quartz - March 15th, 2024 [March 15th, 2024]
- Which AI is best? Our tech expert put three free versions to the test - USA TODAY - March 15th, 2024 [March 15th, 2024]
- Look beyond Nvidia to ride the AI wave there are other potential winners, Fidelity says - CNBC - March 15th, 2024 [March 15th, 2024]