Anyscale – Urubuga rw'ubucuruzi rw'amatsinda ya mudasobwa za Ray, gutoza no gutanga serivisi za modeli | Quasa.io

#Quasa #QUA #Anyscale

Anyscale ni urubuga rw'ubucuruzi rwakozwe n'abahanze Ray: gutunganya amakuru ku buryo bukwirakwijwe kuri mudasobwa nyinshi, gutoza modeli, gukoresha modeli ku matsinda y'amakuru no gutanga serivisi za modeli ku matsinda ya mudasobwa akoresha CPU/GPU/TPU. Uburyo bwemewe bwo kwishyura bushingiye kuri Anyscale Credits hakurikijwe ibyo wakoresheje—nta giciro kidahinduka cya SaaS kuri buri mukoresha gitangazwa ku mugaragaro. Hosted: imashini ziboneka mu buryo bw'ikoranabuhanga zicungwa na Anyscale, kwishyura ukoresheje ikarita, ubufasha mu masaha y'akazi. BYOC: VPC yawe na GPU wabikiwe, inyemezabwishyu yo ku isoko rya serivisi, amasezerano ya SLA ya 24×7. Ingero z'ibiciro bya Hosted zatangajwe: gukoresha CPU gusa guhera hafi kuri AC $0.0135/hr, T4 ~$0.57, L4 ~$0.95, A10G ~$1.36, A100 ~$4.96; ku byiciro bya H/B, ugomba kubavugisha. Ibiciro bya Kubernetes n'iby'amatsinda y'imashini biratandukanye (H100 ~AC $7.16/hr y'urubuga hiyongereyeho ikiguzi cya serivisi zawe zo mu gicu). Inyandikorugero zo gutangiriraho zikoreshwa uhereye ku nguzanyo y'amadolari make. Ray ifite kode ifunguye ikomeza kuba ubuntu iyo uyikoresha ku bikoresho wicungira. Si API ya LLM ukoresha ukanze rimwe kandi ntihendutse kurusha gukoresha ibikoresho byo mu gicu utanyuze kuri uru rubuga iyo amatsinda ya mudasobwa adakora. Tangirira kuri Hosted. Himukira kuri BYOC igihe kubikirwa ibikoresho n'aho amakuru abikwa bifite akamaro.

IBYIZA BY'INGENZI
• Yakozwe n'abahanze Ray
• API za Python zimwe kuva kuri mudasobwa igendanwa kugeza kuri GPU 64+
• Hosted cyangwa serivisi zawe zo mu gicu
• Guhuriza hamwe GPU zo muri serivisi zitandukanye zo mu gicu
• Gukurikirana imikorere y'imirimo na Serve  

IBEREYE CYANE
Amatsinda asanzwe yandika porogaramu akoresheje Ray akeneye amatsinda ya mudasobwa yo gukoresha mu kazi nyakuri, aho gukenera indi porogaramu itanga gusa uburyo bwo gukoresha amakaye ya kode.

IBY'INGENZI
• Bavuga ko Ray imaze gukururwa inshuro 500M+
• Wishyura gusa amasaha ibikoresho bikora
• vLLM / Train / Data ku rubuga rumwe
• Kwishyura BYOC binyuze ku isoko rya serivisi
• Inyandikorugero uhereye ku madolari make  

IBYO KWITONDERA
• Ikiguzi cy'urubuga kiyongera ku cya GPU zo mu gicu
• Uturere Hosted ibonekamo ni duke
• Kuri H100+ ugomba kuvugana n'abashinzwe kugurisha
• Amatsinda ya mudasobwa adakora akomeza kugutwara amafaranga iyo uyasize acanye
• Amakuru yerekeye ba nyir'ikigo (amasezerano ya Nscale) atandukanye n'ibirebana n'igicuruzwa  

UMWANZURO RUSANGE
Inyenyeri 4.4/5. Koresha inguzanyo za Hosted kugira ngo ugenzure ko umurimo ukora neza. Gura BYOC igihe usanzwe wishyura GPU kandi ukeneye gucunga imikorere ya Ray ukagumana VPC yawe. Nawe bona igihembo cya 1 QUA utanze isuzuma kuri Quasa.io!

TANGIRA: https://quasa.io/projects/anyscale