Topics
late
AI
Amazon
Image Credits:Jaap Arriens/NurPhoto(opens in a new window)/ Getty Images
Apps
Biotech & Health
Climate
Cloud Computing
Commerce
Crypto
endeavour
EVs
Fintech
fund-raise
convenience
gage
Government & Policy
Hardware
layoff
Media & Entertainment
Meta
Microsoft
secrecy
Robotics
security system
societal
Space
Startups
TikTok
deportation
speculation
More from TechCrunch
event
Startup Battlefield
StrictlyVC
Podcasts
Videos
Partner Content
TechCrunch Brand Studio
Crunchboard
get hold of Us
The inclination of flagship AI models that miss their promised launching window proceed to grow .
Last summer , billionaire Elon Musk , the founding father and CEO of AI company xAI , suppose that Grok 3 , xAI ’s next major AI poser , would get in by “ end of class ” 2024.Grok , xAI ’s answer to fashion model like OpenAI’sGPT-4oand Google’sGemini , can canvas images and respond to questions , and powers a number of feature film on X , Musk ’s societal internet .
“ Grok 3 closing of year after prepare on 100k H100s should be really something exceptional , ” Muskwrotein a July Emily Post on X , refer to xAI’senormous Memphis - ground clusterof GPUs . “ Grok 3 will be a major leap forward , ” hesaidin a mid - December follow - up billet .
Yet it ’s January 2 , and Grok 3 has n’t come — nor are there sign its rollout is at hand .
In fact , some code on xAI ’s site spotted by AI tipster Tibor Blahosuggeststhat an intermediate modelling , “ Grok 2.5 , ” may land first .
Grok[.]com is possibly come soon with Grok 2.5 fashion model ( grok-2 - latest – “ Our most reasoning model ” ) – thanks for the pinch , anon!pic.twitter.com / emsvmZyaf7
— Tibor Blaho ( @btibor91)December 20 , 2024
Granted , this is n’t the first clock time Musk has set a lofty finish and pretermit it . It’swell - establishedthat Musk ’s pronouncements about the timing of product launches are often unrealistic at best .
Join us at TechCrunch Sessions: AI
Exhibit at TechCrunch Sessions: AI
And to be fair , in an consultation with podcaster Lex Fridman in August , Musksaidthat Grok 3 would “ hopefully ” be available in 2024 “ if we ’re lucky . ”
But Grok 3 ’s MIA position is interesting because it ’s part of a grow trend .
Last year , AI startup Anthropic failed to deliver a heir to its top - of - the - lineClaude 3 Opusmodel . Months afterannouncingthat a next - gen model , Claude 3.5 Opus , would by released by the end of 2024 , Anthropicscrappedall mention of the example from its developer software documentation . ( Accordingto one written report , Anthropic did finish training Claude 3.5 Opus sometime last year , but decided that releasing it did n’t make economic sense . )
Reportedly , Google and OpenAI have alsosufferedsetbackswith their flagship model in late calendar month .
This could be evidence of the limitationsof current AI scale laws — the methods companies are using to increase the capableness of their models . In the not - too - removed past , it was potential to reach satisfying performance boosts by training models using massive amounts of computing mightiness and larger and enceinte data point sets . But the gains with each contemporaries of manikin have begun to shrivel , lead company topursuealternative techniques .
Grok 3 is groom with 10X , soon 20X the compute of Grok 2
— Elon Musk ( @elonmusk)September 21 , 2024
Musk himself alluded to this in the Fridman consultation .
“ You ’re hoping for [ Grok 3 ] to be state - of - the - art ? ” Fridman ask .
“ Hopefully , ” Musk answer . “ I mean , this is the end . We may fail at this end . That ’s the breathing in . ”
There could be other reasons for Grok 3 ’s delay . xAI has a much minor squad than many of its rival , for one . notwithstanding , the err launch metre frame total to the body of evidence that ceremonious AI training attack are running up against a wall .
