{"id":1502197,"date":"2024-11-14T00:40:00","date_gmt":"2024-11-14T05:40:00","guid":{"rendered":"https:\/\/bugaluu.com\/news\/?p=1502197"},"modified":"2024-11-14T00:40:00","modified_gmt":"2024-11-14T05:40:00","slug":"openai-google-anthropic-face-hurdles-in-advancing-ai-models-casting-doubt-on-near-term-agi","status":"publish","type":"post","link":"https:\/\/bugaluu.com\/news\/openai-google-anthropic-face-hurdles-in-advancing-ai-models-casting-doubt-on-near-term-agi\/1502197\/","title":{"rendered":"OpenAI, Google, & Anthropic Face Hurdles In Advancing AI Models, Casting Doubt On Near-Term AGI"},"content":{"rendered":"

OpenAI, Google, & Anthropic Face Hurdles In Advancing AI Models, Casting Doubt On Near-Term AGI<\/span><\/p>\n

\n

Tech companies\u00a0focused on chatbot development, like\u00a0OpenAI, Google, and Anthropic, have\u00a0faced significant near-term\u00a0headwinds in advancing large language models.\u00a0Despite tens of billions of dollars in investments, these tech firms are experiencing diminishing returns in advancing\u00a0more sophisticated LLMs.<\/p>\n

Sources told Bloomberg<\/a> that\u00a0OpenAI’s new Orion LLM has experienced\u00a0performance limitations. This means the new LLM would outperform the firm’s\u00a0existing models, but it does not mean there will be a significant leap in development, like that of\u00a0GPT-3 to GPT-4.\u00a0<\/p>\n

As of late summer, for example, Orion fell short when trying to answer coding questions that it hadn’t been trained on, the people said. Overall, Orion is so far not considered to be as big a step up from OpenAI’s existing models as GPT-4 was from GPT-3.5, the system that originally powered the company’s flagship chatbot, the people said. -BBG<\/em><\/p>\n

The breakneck pace of developing more sophisticated LLMs appears to have also hit a proverbial brick wall at Google, in which its\u00a0Gemini software has not lived up to expectations, according to sources, adding Anthropic also faces challenges with its\u00a0long-awaited Claude model called 3.5 Opus.\u00a0<\/p>\n

Bloomberg noted one of the top\u00a0obstacles these tech firms have encountered has been\u00a0“finding\u00a0new, untapped sources of high-quality, human-made training data that can be used to build more advanced AI systems.”\u00a0<\/p>\n

Sources said\u00a0Orion’s dismal coding performance was due to the lack of\u00a0sufficient coding data to train the LLM. They added that even though the model has improvements compared to legacy ones, it has become increasingly challenging to justify the massive costs of\u00a0building and operating new models.\u00a0<\/p>\n

The setbacks may reveal an inconvenient truth for\u00a0the tech industry plowing tens of billions of dollars into AI data centers and infrastructure, and the feasibility of reaching\u00a0artificial general intelligence in the near future might be a pipedream.\u00a0<\/p>\n

John Schulman, cofounder and research scientist at OpenAI who recently left, said AGI could be achieved within a few years. Dario Amodei, CEO of Anthropic, believes it could be achieved by 2026.\u00a0<\/p>\n

However, Margaret Mitchell, the chief ethics scientist at AI startup Hugging Face, pointed out,\u00a0“The AGI bubble is bursting a little bit,” adding\u00a0that “different training approaches” may be needed for progress.\u00a0<\/p>\n

In a recent interview<\/a> with Lex Fridman,\u00a0Anthropic’s\u00a0Amodei said there are\u00a0“lots of things” that could “derail” the AI progression, including\u00a0the possibility that “we could run out of data.” However, he was\u00a0optimistic that AI researchers would overcome any hurdles.\u00a0\u00a0<\/p>\n

Scaling efforts are slowing…\u00a0<\/p>\n

Source: Bloomberg<\/em><\/a><\/p>\n

“It is less about quantity and more about quality and diversity of data,” said Lila Tretikov, head of AI strategy at New Enterprise Associates and former deputy CTO at\u00a0Microsoft.<\/p>\n

Tretikov said,\u00a0“We can generate quantity synthetically, yet we struggle to get unique, high-quality datasets without human guidance, especially when it comes to language.”<\/p>\n

Moving forward, Noah Giansiracusa, an associate professor of mathematics at Bentley University in Waltham, Massachusetts, said AI models will continue to improve, but the hypergrowth in recent years is unsustainable:<\/p>\n

“We got very excited for a brief period of very fast progress. That just wasn’t sustainable.”<\/em><\/p>\n

If tech firms are struggling to advance LLM performance, this raises serious doubts about whether large investments can continue to be made in AI\u00a0infrastructure.\u00a0<\/p>\n

“The infrastructure build for AI is the bubble. The AI 2.0 companies that can actually figure out a way to monetize it are the investments years from now. Might as well light a match to this fund. The infrastructure build like the telecom infrastructure during the dotcom boom will be oversupplied and pricing will collapse,”\u00a0Edward Dowd recently noted<\/a> on X.<\/p>\n

Well Nvidia has soared to new highs.\u00a0<\/p>\n

<\/a><\/p>\n

AI companies struggling to develop more advanced LLMs is undoubtedly an ominous sign for the AI bubble.<\/p>\n<\/div>\n

Tyler Durden<\/a><\/span>
\nWed, 11\/13\/2024 – 19:40<\/span><\/p>\n

\u200bhttps:\/\/www.zerohedge.com\/technology\/openai-google-anthropic-face-hurdles-advancing-ai-models-casting-doubt-near-term-agi<\/a>\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"

OpenAI, Google, & Anthropic Face Hurdles In Advancing AI Models, Casting Doubt On Near-Term AGI Tech companies\u00a0focused on chatbot development, like\u00a0OpenAI, Google, and Anthropic, have\u00a0faced…<\/p>\n","protected":false},"author":0,"featured_media":1502198,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1502197","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","wpcat-1-id"],"_links":{"self":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts\/1502197","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/comments?post=1502197"}],"version-history":[{"count":0,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts\/1502197\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/media\/1502198"}],"wp:attachment":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/media?parent=1502197"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/categories?post=1502197"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/tags?post=1502197"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}