Subquadratic kuri Quasa: Isuzuma rya LLM ya mbere ikora ku gipimo kiri munsi ya kare

#Quasa #QUA #subquadratic

Subquadratic ni ikigo gikora ubushakashatsi buhanitse ku bwenge bw'ubukorano (AI) n'ibikorwaremezo byabwo, cyubaka icyiciro gishya cya moderi nini z'ururimi. Moderi yacyo y'ibanze, SubQ, ni LLM ya mbere yubakiye ku bwubatsi bwita ku bice bimwe na bimwe by'amakuru gusa, bukora bwose ku gipimo kiri munsi ya kare. Mu gihe Transformers zisanzwe zikenera ubushobozi bwo kubara bwiyongera ku gipimo cya kare y'uburebure bw'amakuru yifashishwa ($O(n^2)$), ubukenewe kuri SubQ bwiyongera ku gipimo gihwanye n'ubwo burebure ($O(n)$), bigatuma gusesengura amakuru agizwe na tokens miliyoni nyinshi bishoboka kandi bigakoresha neza ubushobozi buhari.

SubQ yagenewe by'umwihariko imirimo ikoresha amakuru menshi y'ishingiro. Ishobora gutunganya ububiko bwose bwa kode, amateka maremare y'imikorere ya porogaramu zigenga, ubusabe bwo kwinjiza impinduka muri kode bw'amezi menshi, n'imiterere ibikwa ikomeza gukoreshwa, byose mu mabwiriza amwe, bitagabanyije ireme ry'ibisubizo. Ubu iyi moderi ishobora kwakira amakuru y'ishingiro agera kuri tokens miliyoni 12 kandi igatanga umusaruro mwiza mu bipimo byo gushakisha no kugarura amakuru mu makuru menshi y'ishingiro no mu byo gusesengura muri rusange. Ku makuru agizwe na tokens miliyoni 1, SubQ ikenera ubushobozi bwo kubara buke cyane (bivugwa ko ari buke ho 64.5× ugereranyije n'uburyo bwita ku bice byose by'amakuru) kandi ikora vuba cyane kurusha uburyo busanzwe bwo kwita ku makuru.

Ikigo gishingira ku ihame rivuga ko “gukoresha neza ubushobozi buhari ari ubwenge.” Mu gukemura imbogamizi y'ubushobozi bukenewe bwiyongera ku gipimo cya kare ihereye ku bwubatsi, Subquadratic igamije gutuma habaho igisekuru gishya cya porogaramu zigenga za AI zishobora koko gukorana n'amakuru menshi y'ishingiro, aho kwishingikiriza ku kuyacamo ibice, kuyahina, cyangwa amayeri yo kuyashakisha no kuyagarura.

Subquadratic ibereye cyane abategura porogaramu, porogaramu zigenga zandika kode, amatsinda yo mu bigo, n'abashakashatsi bakeneye isesengura ryizewe ry'amakuru menshi y'ishingiro — cyane cyane mu gusesengura kode yose y'umushinga, mu gukoresha porogaramu zigenga zikora igihe kirekire, no mu mirimo igoye ikoresha inyandiko nyinshi.

Iby'ingenzi

• Ubwubatsi bwa mbere bwa LLM bukora bwose ku gipimo kiri munsi ya kare (ubushobozi bukenewe bwiyongera ku gipimo gihwanye n'uburebure bw'amakuru).
• Amakuru y'ishingiro agizwe na tokens miliyoni nyinshi (agera kuri 12M tokens).
• Ubushobozi buhanitse bwo gushakisha no kugarura amakuru mu makuru menshi y'ishingiro ikoresheje neza cyane ubushobozi buhari.
• Yagenewe ububiko bwose bwa kode n'imiterere ya porogaramu yigenga ibikwa igakomeza gukoreshwa.
• API ihuza na OpenAI n'uburyo bwo kuyihuza na porogaramu zigenga zandika kode.

• Ibishobora gukenera kwitabwaho

• Kubera ko ari moderi y'ubushakashatsi buhanitse, urusobe rwagutse rw'ibikoresho na serivisi bikorana na yo, ndetse n'ubwoko bwayo bufite ingano zitandukanye, biracyagenda byaguka.
• Ibereye cyane imirimo ikoresha amakuru menshi y'ishingiro kurusha ibiganiro bisanzwe bishingiye ku mabwiriza magufi.

Isuzuma rusange: inyenyeri 4.7/5

Subquadratic irimo gukemura imwe mu mbogamizi zikomeye cyane za LLM z'ubu — ubukene bw'ubushobozi bwo kwita ku makuru bwiyongera ku gipimo cya kare. Mu gutuma gusesengura amakuru agizwe na tokens miliyoni nyinshi bishoboka hakoreshejwe ubushobozi bwo kubara buke cyane, SubQ igaragaza intambwe ikomeye mu bwubatsi bwa porogaramu zigenga na porogaramu zikoresha amakuru menshi y'ishingiro.

Nawe bona igihembo cya QUA utanga isuzuma kuri Quasa.io!

Tangira: https://quasa.io/projects/subquadratic