Anyscale – Urubuga rw'ubudandaji rw'imigwi ya Ray, kumenyereza no gutanga serivisi | Quasa.io
#Quasa #QUA #Anyscale
Anyscale ni urubuga rw'ubudandaji rwakozwe n'abaremye Ray: amakuru akwiragijwe ku mashini nyinshi, kumenyereza, gukoresha imodeli mu migwi y'ibikorwa, no gutanga serivisi ku migwi y'amashini za CPU/GPU/TPU. Uburyo bwemewe bwo kuriha bushingiye kuri Anyscale Credits hakurikijwe ivyakoreshejwe—nta giciro kidahinduka ca SaaS ku mukoresha gitangazwa ku mugaragaro. Hosted: VMs zicungwa na Anyscale, kuriha n'ikarata, gufashwa mu masaha y'akazi. BYOC: VPC yawe na GPUs wabikiwe, fagitire yo kw'isoko ry'ubuhinga, SLAs za 24×7. Uburorero bw'ibiciro vya Hosted bwatangajwe: CPU gusa guhera nko kuri AC $0.0135/hr, T4 ~$0.57, L4 ~$0.95, A10G ~$1.36, A100 ~$4.96; ku zo mu rwego rwa H/B, bisaba kutwandikira. Ibiciro vya Kubernetes n'imigwi y'amashini biratandukanye (H100 ~AC $7.16/hr y'amahera y'urubuga yiyongera kuri fagitire yawe ya cloud). Ingero zo gutangurirako zitanguzwa n'amadolari makeyi y'inguzanyo yo gukoresha. Ray ifise kode yuguruye iguma ari ubuntu iyo uyikoresha ku mashini ucungira. Si API ya LLM ikoreshwa ukandagiye rimwe gusa, kandi ntizimbutse kuruta gukoresha cloud ata rundi rubuga rwiyongeyeko iyo imigwi y'amashini iguma ata co ikora. Tangurira kuri Hosted. Himukira kuri BYOC igihe kubikirwa ibikoresho n'aho amakuru abikwa bifise akamaro.
INKOMEZI NYAMUKURU
• Yubatswe n'abanditsi ba Ray
• APIs za Python zimwe, kuva kuri mudasobwa ngendanwa gushika kuri 64+ GPUs
• Hosted canke cloud yawe
• Guhuriza hamwe GPUs zo muri cloud zitandukanye
• Gukurikirana ingene ibikorwa na Serve bikora
IBEREYE CANE
Imigwi isanzwe yandika porogarama ikoresheje Ray ikeneye imigwi y'amashini yo gukoresha mu bikorwa nyavyo, aho gukenera urundi rubuga rupfuka notebook gusa.
IVY'INGENZI
• Bivugwa ko Ray imaze gukururwa incuro 500M+
• Riha gusa amasaha imara ikora
• vLLM / Train / Data ku rubuga rumwe
• Kuriha biciye kw'isoko ry'ubuhinga kuri BYOC
• Ingero zo gutangurirako kuva ku madolari makeyi
IVYO KWITWARARIKA
• Amahera y'urubuga yiyongera ku ya GPUs zo muri cloud
• Uturere Hosted ibonekamwo ni duke
• H100+ isaba kuganira n'abajejwe kugurisha
• Imigwi y'amashini ata co iriko irakora iguma itwara amahera iyo uyiretse yaka
• Amakuru yerekeye nyene ikigo (amasezerano ya Nscale) aratandukanye n'igicuruzwa
ISUZUMA RYA VYOSE
Inyenyeri 4.4/5. Koresha inguzanyo za Hosted kugira wemeze ko igikorwa kigenda neza. Gura BYOC igihe usanzwe uriha GPUs kandi ukeneye gucungirwa Ray utaretse VPC yawe. Ronswa kandi agashimwe ka 1 QUA mu kwandika isuzuma kuri Quasa.io!
TANGURA: https://quasa.io/projects/anyscale























