Published Social post

DFINITY Developers ∞ (@DFINITYDev): In an upcoming update of ICGPT 2, a playground for #onchain #Llama2 models,@icpp_pro limits 4 #LLMs on a subnet on #ICP to reduce #AI generation wait…

Estimated coin impact

Scores are not price-change percentages. High impact means a score of +70 or more, or -70 or less.

In an upcoming update of ICGPT 2, a playground for #onchain #Llama2 models,@icpp_pro limits 4 #LLMs on a subnet on #ICP to reduce #AI generation wait times. Learn more 👉 https://forum.dfinity.org/t/technical-working-group-deai/24621/ Get more updates from the #DeAI working group 👉 forum.dfinity.org/t/technical-wo… twitter.com/icpp_pro/statu… Quote [@icpp_pro](https://www.twitter.com/icpp_pro/status/1781055584214700361) > Big progress in scaling my LLM on the IC to multiple concurrent users, thanks to the scalability experts from DFINITY. > > This is a great configuration for my case, using 4 LLMs per subnet. Check out how much faster inference is when you go from 1 to 4 LLMs behind a load-balancer…

Back to news archive