Anyscale – Inkundla Yezentengiselwano Yamaqoqo e-Ray, Ukuqeqetsha Lokuhlinzeka | Quasa.io

#Quasa #QUA #Anyscale

I-Anyscale yinkundla yezentengiselwano evela kubadali be-Ray: idatha esatshalaliswe kumakhomphyutha amanengi, ukuqeqetsha, ukwenza izibikezelo ngamaqoqo, lokuhlinzeka ngamamodeli kumaqoqo e-CPU/GPU/TPU. Indlela esemthethweni yokubhadala isebenzisa ama-Anyscale Credits kusiya ngokusetshenzisiweyo—kakulantengo ye-SaaS engaguquki yomsebenzisi ngamunye evezwe emphakathini. I-Hosted: ama-VM aphethwe yi-Anyscale, ukubhadala ngekhadi, loncedo ngezikhathi zomsebenzi. I-BYOC: i-VPC yakho lama-GPU owagcinele ukuwasebenzisa, i-invoyisi yemakethe, lama-SLA e-24×7. Izibonelo ze-Hosted ezishicilelweyo: i-CPU kuphela iqala phose ku-AC $0.0135/hr, i-T4 ~$0.57, i-L4 ~$0.95, i-A10G ~$1.36, i-A100 ~$4.96; ngezigaba ze-H/B kumele uxhumane labo. Izindleko ze-Kubernetes/amaqoqo emishini ziyehluka (i-H100 ~AC $7.16/hr njengemali yenkundla, phezu kwemali oyibhadalela ikhompuyutha yamafu). Amathempulethi okuqalisa asebenza ngesikweletu samadola amalutshwana. I-Ray elekhodi yomthombo evulelekileyo ilokhu imahala nxa uziqhubela yona. Kayisiyo i-LLM API oyivula ngokuchofoza kanye njalo kayitshibhile kulokusebenzisa ikhompuyutha yamafu ngokuqondileyo nxa amaqoqo engasebenzi. Qalisa nge-Hosted. Dlulela ku-BYOC nxa ukugcinelwa izinsiza lendawo okugcinwa kuyo idatha sekuqakathekile.

AMANDLA ASEM QOKA
• Yakhiwe ngabadali be-Ray
• Ama-Python API afanayo kusukela kukhomphyutha ephathwayo kusiya kuma-GPU angu-64+
• I-Hosted kumbe ikhompuyutha yakho yamafu
• Ukuhlanganisa ama-GPU avela kubahlinzeki bamafu abatshiyeneyo
• Ukulandelela lokuhlola imisebenzi le-Serve  

IFANELE KAKHULU
Amaqembu asevele ebhala ikhodi ye-Ray adinga amaqoqo okusebenza ekusetshenzisweni kwangempela, engadingi olunye nje ungqimba lwe-notebook.

OKUQAKATHEKILEYO
• Kuthiwa i-Ray isilandwe izikhathi ezingu-500M+
• Bhadalela amahola esebenza kuphela
• I-vLLM / Train / Data enkundleni eyodwa
• Ukubhadala ngemakethe ku-BYOC
• Amathempulethi aqala ngamadola amalutshwana  

IZINTO ONGADINGA UKUZICABANGELA
• Imali yenkundla yengezwa ezindlekweni zama-GPU ekhompuyutha yamafu
• Izifunda ezitholakala ku-Hosted zilutshwana
• Nge-H100+ kumele uxoxe labathengisayo
• Amaqoqo angasebenziyo alokhu ebiza imali nxa uwatshiya evuliwe
• Izindaba zobunikazi (isivumelwano se-Nscale) zehlukene lomkhiqizo  

ISINQUMO SISONKE
Izinkanyezi ezingu-4.4/5. Sebenzisa izikweletu ze-Hosted ukuqinisekisa ukuthi umsebenzi uyaphumelela. Thenga i-BYOC nxa usuvele ubhadalela ama-GPU njalo udinga ukuphathwa kwe-Ray ungadeli i-VPC. Zuza lomvuzo we-1 QUA ngokubhala ukuhlola ku-Quasa.io!

QALISA: https://quasa.io/projects/anyscale