Anyscale – Pulatifomu Yamalonda ya Ma Cluster a Ray, Yophunzitsira ndi Kupereka Ntchito za Ma Model | Quasa.io
#Quasa #QUA #Anyscale
Anyscale ndi pulatifomu yamalonda yochokera kwa omwe anapanga Ray: imagwira ntchito ndi data yogawidwa, kuphunzitsa ma model, kuchita inference m'magulu, ndi kupereka ntchito za ma model pa ma cluster a CPU/GPU/TPU. Njira yovomerezeka yolipirira imagwiritsa ntchito Anyscale Credits potengera kuchuluka kwa ntchito—palibe mtengo wokhazikika wa SaaS pa wogwiritsa ntchito womwe walengezedwa poyera. Hosted: ma VM oyendetsedwa ndi Anyscale, kulipira ndi khadi, thandizo pa nthawi yogwira ntchito. BYOC: VPC yanu ndi ma GPU osungidwira inu, invoice ya marketplace, ma SLA a 24×7. Zitsanzo za mitengo ya Hosted zomwe zasindikizidwa: CPU yokha kuyambira pafupifupi AC $0.0135/hr, T4 ~$0.57, L4 ~$0.95, A10G ~$1.36, A100 ~$4.96; pa H/B-class muyenera kulankhula ndi kampaniyo. Mitengo ya Kubernetes/machine-pool imasiyana (H100 ~AC $7.16/hr monga chindapusa cha pulatifomu kuwonjezera pa bilu yanu ya cloud). Ma template oyambira amayamba kugwira ntchito ndi ngongole ya madola ochepa. Ray ya open-source imakhalabe yaulere kuti muziyendetsa nokha. Si LLM API yogwiritsidwa ntchito pongodina kamodzi ndipo si yotsika mtengo kuposa kugwiritsa ntchito cloud mwachindunji ngati ma cluster sakugwira ntchito. Yambani ndi Hosted. Samukirani ku BYOC pamene kusungitsa ma GPU ndi malo osungirako data kuli kofunika.
MFUNDO ZAZIKULU ZAMPHAMVU
• Yapangidwa ndi omwe analemba Ray
• Ma API omwewo a Python kuchokera pa laputopu mpaka pa ma GPU a 64+
• Hosted kapena cloud yanu
• Kusonkhanitsa ma GPU ochokera ku ma cloud osiyanasiyana kuti agwiritsidwe ntchito pamodzi
• Kuona momwe ntchito ndi Serve zikuyendera
YOYENERA KWAMBIRI KWA
Magulu omwe akulemba kale mapulogalamu ogwiritsa ntchito Ray ndipo akufunika ma cluster ogwiritsira ntchito zenizeni, osati pulogalamu inanso yowonjezera pa notebook.
MFUNDO ZOFUNIKA
• Akuti Ray yatsitsidwa 500M+
• Lipirani maola omwe ikugwira ntchito okha
• vLLM / Train / Data pa pulatifomu imodzi
• Kulipirira BYOC kudzera mu marketplace
• Ma template kuyambira pa madola ochepa
ZINTHU ZOFUNIKA KUZIGANIZIRA
• Chindapusa cha pulatifomu chimawonjezedwa pa mtengo wa ma GPU a cloud
• Madera omwe Hosted ikupezekamo ndi ochepa
• Kuti mupeze H100+ muyenera kulankhula ndi gulu la zamalonda
• Ma cluster osagwira ntchito amalipiritsidwabe ngati muwasiya ali oyatsidwa
• Nkhani za umwini (mgwirizano wa Nscale) ndi zosiyana ndi pulogalamuyi
CHIWERUZO CHONSE
Nyenyezi 4.4/5. Gwiritsani ntchito ma credit a Hosted kuti mutsimikizire kuti ntchito yanu ikuyenda bwino. Gulani BYOC ngati mukulipira kale ma GPU ndipo mukufuna ntchito zoyendetsera Ray popitiriza kugwiritsa ntchito VPC yanu. Pezaninso mphotho ya 1 QUA polemba ndemanga pa Quasa.io!
YAMBANI: https://quasa.io/projects/anyscale























