Anyscale – Inkundla Yezentengiselwano Yamaqoqo e-Ray, Ukuqeqesha Nokuhlinzeka Ngamamodeli | Quasa.io

#Quasa #QUA #Anyscale

I-Anyscale iyinkundla yezentengiselwano evela kubadali be-Ray: idatha esatshalalisiwe, ukuqeqesha, ukwenza izibikezelo ngamaqoqo nokuhlinzeka ngamamodeli kumaqoqo e-CPU/GPU/TPU. Indlela esemthethweni yokukhokha isebenzisa ama-Anyscale Credits ngokwezinga lokusetshenziswa—ayikho intengo engaguquki eshicilelwe yomsebenzisi ngamunye we-SaaS. I-Hosted: ama-VM aphethwe yi-Anyscale, ukukhokha ngekhadi, ukwesekwa ngezikhathi zokusebenza. I-BYOC: i-VPC yakho nama-GPU abhukhelwe kusengaphambili, i-invoyisi yemakethe, ama-SLA angu-24×7. Izibonelo ezishicilelwe ze-Hosted: i-CPU kuphela iqala cishe ku-AC $0.0135/hr, i-T4 ~$0.57, i-L4 ~$0.95, i-A10G ~$1.36, i-A100 ~$4.96; ukuze uthole amanani esigaba se-H/B, xhumana nathi. Amanani e-Kubernetes/amaqoqo emishini ayahluka (i-H100 ~AC $7.16/hr njengemali yenkundla kanye nenkokhelo yakho yamasevisi amafu). Izifanekiso zokuqala zingaqaliswa ngesikweletu samadola ambalwa. I-Ray enekhodi yomthombo evulekile ihlala imahhala uma uziqhubela yona. Ayiyona i-API ye-LLM esebenza ngokuchofoza kanye futhi ayishibhile kunokusebenzisa amasevisi amafu ngokuqondile uma amaqoqo engenzi msebenzi. Qala nge-Hosted. Shintshela ku-BYOC lapho ukubhukha kusengaphambili nendawo lapho idatha igcinwa khona kubalulekile.

AMANDLA AYINHLOKO
• Yakhiwe ngababhali be-Ray
• Ama-API afanayo e-Python kusukela kukhompyutha ephathekayo kuya kuma-GPU angu-64+
• I-Hosted noma amasevisi akho amafu
• Ukuhlanganisa ama-GPU avela kumasevisi amafu ahlukahlukene
• Ukuqapha imisebenzi ne-Serve  

ILUNGELE KAKHULU
Amaqembu asevele ebhala ikhodi ye-Ray adinga amaqoqo okusebenzisa izinhlelo emsebenzini wangempela, angadingi esinye isendlalelo sokusebenzisa ama-notebook.

OKUGQAMILE
• Kuthiwa i-Ray isilandwe izikhathi ezingu-500M+
• Khokhela amahora esebenza kuphela
• I-vLLM / Train / Data enkundleni eyodwa
• Ukukhokhiswa ngemakethe ku-BYOC
• Izifanekiso ziqala ngamadola ambalwa  

IZINTO OKUNGASE KUDINGEKE UZICABANGELE
• Imali yenkundla yengezwa enkokhelweni yama-GPU asemafini
• Izifunda ezitholakala ku-Hosted zimbalwa
• I-H100+ idinga ingxoxo nabathengisi
• Amaqoqo angenzi msebenzi asabiza imali uma uwashiya evuliwe
• Izindaba zobunikazi (isivumelwano se-Nscale) zihlukile emkhiqizweni  

ISINQUMO ESIPHELELE
Izinkanyezi ezingu-4.4/5. Sebenzisa amakhredithi e-Hosted ukuze uqinisekise ukuthi umsebenzi uyasebenza. Thenga i-BYOC uma usuvele ukhokhela ama-GPU futhi udinga ukuphathwa kwe-Ray ngaphandle kokulahla i-VPC yakho. Thola nomklomelo ongu-1 QUA ngokubhala isibuyekezo ku-Quasa.io!

QALA: https://quasa.io/projects/anyscale