Anyscale – Iqonga loRhwebo lee-Cluster ze-Ray, loQeqesho nokuNikezela iiModeli | Quasa.io

#Quasa #QUA #Anyscale

I-Anyscale liqonga lorhwebo elivela kubadali be-Ray: idatha esasaziweyo, uqeqesho, uqikelelo ngeebhetshi, nokunikezelwa kweemodeli kwii-cluster ze-CPU/GPU/TPU. Inkqubo esemthethweni yokuhlawula isebenzisa i-Anyscale Credits ngokomlinganiselo wokusetyenziswa—akukho xabiso limiselweyo nelipapashiweyo le-SaaS ngomsebenzisi ngamnye. I-Hosted: ii-VM ezilawulwa yi-Anyscale, ukuhlawula ngekhadi, inkxaso ngeeyure zomsebenzi. I-BYOC: i-VPC yakho nee-GPU ezibekelwe bucala, i-invoyisi yemarike, ii-SLA ze-24×7. Imizekelo epapashiweyo ye-Hosted: i-CPU kuphela iqala malunga ne-AC $0.0135/hr, i-T4 ~$0.57, i-L4 ~$0.95, i-A10G ~$1.36, i-A100 ~$4.96; kudidi lwe-H/B kufuneka uqhagamshelane nathi. Amaxabiso e-Kubernetes/eendawo eziqokelela oomatshini ayahluka (i-H100 ~AC $7.16/hr njengentlawulo yeqonga kunye netyala lakho lelifu). Iitempleyithi zokuqalisa zisebenza ngetyala leedola ezimbalwa. I-Ray enekhowudi yomthombo evulekileyo isahlala isimahla xa uziqhubela yona. Asiyo-API ye-LLM esebenza ngokucofa kanye, kwaye ayibizi ngaphantsi kokusebenzisa ilifu ngokuthe ngqo xa ii-cluster zihleli zingasebenzi. Qala nge-Hosted. Tshintshela kwi-BYOC xa ukubekela izixhobo bucala nendawo egcinwa kuyo idatha kubalulekile.

AMANDLA APHAMBILI
• Yakhiwe ngababhali be-Ray
• Ii-API ze-Python ezifanayo ukusuka kwilaptop ukuya kwii-GPU ezingama-64+
• I-Hosted okanye ilifu lakho
• Ukuqokelelwa kwee-GPU kumafu amaninzi
• Ukubeka iliso kwimisebenzi nakwi-Serve  

ILUNGELE
Amaqela asele ebhala ikhowudi ye-Ray afuna ii-cluster zokusetyenziswa kwimveliso, endaweni yolunye ujongano olugquma i-notebook.

AMANQAKU ABALASELEYO
• Kuthiwa i-Ray ikhutshelwe izihlandlo ezingama-500M+
• Hlawula kuphela iiyure zokusebenza
• I-vLLM / Train / Data kwiqonga elinye
• Ukuhlawuliswa ngemarike kwi-BYOC
• Iitempleyithi eziqala ngeedola ezimbalwa  

IZINTO EKUSENOKUFUNEKA UZIQWALASELE
• Intlawulo yeqonga yongezwa kwiindleko zee-GPU zelifu
• Imimandla ye-Hosted imbalwa
• I-H100+ ifuna ingxoxo neqela lezentengiso
• Ii-cluster ezingasebenziyo zisabiza imali xa uzishiya zivuliwe
• Iindaba zobunini (isivumelwano se-Nscale) zahlukile kwimveliso  

ISIGQIBO SISONKE
Iinkwenkwezi eziyi-4.4/5. Sebenzisa iikhredithi ze-Hosted ukuqinisekisa ukuba umsebenzi uyasebenza. Thenga i-BYOC xa sele uhlawulela ii-GPU kwaye ufuna ukulawulwa kwe-Ray ngaphandle kokuncama i-VPC. Fumana nomvuzo we-1 QUA ngokubhala uphononongo kwi-Quasa.io!

QALISA: https://quasa.io/projects/anyscale