Topics
belated
AI
Amazon
Image Credits:PAU BARRENA/AFP / Getty Images
Apps
Biotech & Health
mood
Cloud Computing
Commerce
Crypto
enterprisingness
EVs
Fintech
Fundraising
Gadgets
punt
Government & Policy
Hardware
Layoffs
Media & Entertainment
Meta
Microsoft
privateness
Robotics
Security
societal
Space
Startups
TikTok
Transportation
Venture
More from TechCrunch
Events
Startup Battlefield
StrictlyVC
newssheet
Podcasts
Videos
Partner Content
TechCrunch Brand Studio
Crunchboard
adjoin Us
Red Hat , the IBM - owned open source computer software firm , isacquiringNeural Magic , a startup that optimizes AI models to run faster on commodity CPU and GPUs .
The term of the deal were n’t divulge .
MIT enquiry scientist Alex Matveev and professor Nir Shavit establish Somerville , Massachusetts - ground Neural Magic in 2018 , inspired by their body of work in high - performance execution engines for AI .
Neural Magic ’s software take to process AI workloads on processors and GPUs at speeds tantamount to specialised AI chip ( e.g. TPUs ) . By run for models on off - the - ledge processor , which usually have more useable memory , the company ’s software can bring in these performance addition .
Big technical school companies like AMD and a host of other startups , includingNeuReality , Deci , CoCoPie , OctoML , and DeepCube , offer some sort of AI optimisation software system . But Neural Magic is one of the few with a free platform and a collection of candid source tools to complement it .
Neural Magic had so far managed to recruit $ 50 million in venture uppercase from angel like Andreessen Horowitz , New Enterprise Associations , Amdocs , Comcast Ventures , Pillar VC , and Ridgeline Ventures .
Red Hat CEO Matt Hicks say Neural Magic ’s workplace on vLLM , an clear source undertaking for model serving , was of particular interest to Red Hat . With Neural Magic , the opened source company is benefiting from a vLLM - based “ enterprisingness - grade ” stack that allows client to optimize and deploy models across cloud surroundings , Hicks say , with full control over substructure and security .
Join us at TechCrunch Sessions: AI
Exhibit at TechCrunch Sessions: AI
Red Hat is already involved in the vLLM project , which it leverage to carry example in product like Red Hat Enterprise Linux AI and Red Hat OpenShift AI . Hick said through the combined body of work of Red Hat and Neural Magic , its infrastructure partners will be able to better scale AI across platforms , and its integrated Robert William Service provider partners will gain more robust illation and performance to integrate with their offerings .
“ AI work load involve to run wherever client data lives across the hybrid cloud ; this get pliant , standardised and receptive platforms and tools a necessity , as they enable organizations to select the environments , imagination and architectures that best align with their unique useable and data need , ” Hicks said in a statement . “ We ’re thrilled to complement our intercrossed swarm - focused AI portfolio with Neural Magic ’s innovative AI innovation , furthering our drive to not only be the ‘ Red Hat ’ of open source , but the ‘ Red Hat ’ of AI as well . ”
Red Hat ’s acquisition of Neural Magic occur as the company makes a routine of AI - connect announcements at KubeCon , the annual computation conference , in Salt Lake City this hebdomad . Red Hat also reveal Climatik , a tool developed in collaboration with Intel , Bloomberg and IBM to optimise data point nerve center vigor efficiency , and new releases of its OpenShift AI and gadget Edge growth platforms .
As the power demands and price of make and deploying AI increment , big tech providers have run to snap up firms with products that could facilitate optimise AI algorithms . In April , NvidiaacquiredRun : ai , a companionship that makes it easy for devs to cope and optimise their AI infrastructure . And in October 2020 , IntelboughtSigOpt , a specialist in modeling optimization .
