The 2m2k3r
Nhasi (18/4) the Meta yakazivisa mhando mbiri dzekutanga dzechizvarwa chinotevera cheLlama, iyo Meta Llama 3, yakagadzirira kushandiswa zvakakwana. Iyi vhezheni itsva inosanganisira pre-yakadzidziswa uye yakanyatso gadziridzwa mhando dzemitauro, ine paramita 8B e 70B, inokwanisa kusvitsa zvakasiana-siana zvezvinodikanwa. Kutevera tsika yekutsigira yakavhurika sosi nharaunda, Meta yakagadzira iyo moto 3 kunharaunda. Izvi zvinoreva zvakare kuti Meta AI, hungwaru hwekugadzira huripo pasocial network yekambani, ichavandudzwa zvakare, kusanganisira kugona kugadzira mifananidzo munguva chaiyo mu WhatsApp. Ona zvimwe! 2t2i2u
Sangana naLlama 3 402m3m
With the moto 3 kambani inotarisira kugadzira mamodheru akavhurika anokwikwidza emhando yepamusoro yemitauro inowanika parizvino, sezvazvakaita GPT-4. Mhinduro yevagadziri yakaiswa pamberi kuvandudza kushandiswa kwese kweLlama 3, maererano neMeta, "kuchengetedza kuzvipira kuhutungamiriri mukushandiswa zvine hunyanzvi uye kuita kweGrand Language Models (LLMs)".
Kutevedzera misimboti ye Open code, nzira yepakutanga uye yenguva dzose yekusunungurwa yakagamuchirwa, ichibvumira mharaunda kuti iwane uye ibatsire mukugadzirwa kwemhando idzi munguva chaiyo. Iwo matemplate-akavakirwa matemplate akaunzwa nhasi angori ekutanga muLlama 3 akatevedzana Chiono cheramangwana chinosanganisira kuwedzera Llama 3 kupa rutsigiro rwemitauro yakawanda uye yakawanda, kuwedzera kugona kwemamiriro ezvinhu, uye kuenderera mberi nekuvandudza mashandiro pane ese akakosha maficha. LLMs, sekufunga uye kukodha.
Zvinoenderana nemaitiro ekugadzira mu moto 3, Meta yakasarudza dhizaini yekushandura decoder-chete, inova sarudzo yakasarudzika. Llama 3 inoshandisa tokenization ine yakawedzera mazwi e 128 zviuru zviratidzo, zvichiita kuti pave nekodha yemutauro inobudirira uye, nokudaro, kuvandudza kushanda kwemuenzaniso. Kukwirisa kugona kwekufungidzira kweLlama 3 modhi, kambani yakabatanidza yakaunganidzwa yemibvunzo yekutarisisa maitiro (GQA) muhukuru huviri hwakasiyana: 8B uye 70B. Munguva yekudzidziswa, kutevedzana kunoshandiswa kune hurefu hwe8.192 tokens, uye mask inoiswa kuti ive nechokwadi chekuti kuzvidzora kunoramba kuri mukati megwaro miganhu.
Kuti udzidzise mhando yemutauro yakanakisa, zvakakosha kuve nedata hombe, yemhando yepamusoro yedata. Zvinoenderana nemisimboti yedu yekugadzira, takaisa mari yakawanda mu data yepre-training yeLlama 3. Iyi modhi yakafanodzidziswa pa zvinopfuura 15 trillion tokens, ose kubva kunzvimbo dzinowanikwa pachena. Dhata redu rekudzidzisa rakakura zvakapetwa kanomwe pane rakashandiswa kuLlama 2 uye rinosanganisira kakapetwa kana kodhi yakawanda.
Mukugadzirira nyaya dzemangwana dzekushandisa mitauro yakawanda, inopfuura 5% yeLlama 3 pre-training dataset ine data remhando yepamusoro mumitauro isiri Chirungu, ichifukidza mitauro inopfuura 30. Nekudaro, Meta haitarisire kuwana nhanho imwe chete yekuita mumitauro iyi sezvakawanikwa muChirungu.
Kuti ive nechokwadi chekuti Llama 3 yakadzidziswa nedata remhando yepamusoro, nhevedzano yemapaipi ekusefa data akagadzirwa. Mapaipi aya anosanganisira kushandiswa kwe heuristic filters, mafirita ezvisina kufanira zvemukati, semantic deduplication matekiniki uye zvinyorwa zvemhando yekuongorora mhando yedata. Shanduro dzakapfuura dzeLlama dzinoshanda mukati yemhando yepamusoro data identification, ipapo Llama 2 yakashandiswa kugadzira iyo data yekudzidziswa yemhando yemhando yezvinyorwa zvinodyisa Llama 3.
Pamusoro pezvo, Meta yakashandisa zviedzo kuona nzira dzakanakisa dzekubatanidza data kubva kwakasiyana masosi kusvika kune yekupedzisira pre-kudzidziswa dataset. Zviyedzo izvi zvakatibvumira kusarudza musanganiswa wedata inoita kuti Llama 3 iite zvakanaka mumhando dzakasiyana dzekushandisa, kusanganisira. trivia mibvunzo, nhengo (sainzi, tekinoroji, engineering uye masvomhu), codification, ruzivo rwenhoroondo, pakati pevamwe.
Kuenzanisa naLlama 2 264d28
Iwo mamodheru matsva moto 3, ine parameters ye8B uye 70B, inomiririra mberi maererano ne moto 2, kuseta chiyero chitsva chemhando dzeLLM pazvikero izvi. Meta inotaura kuti nekuda kwekuvandudzwa mune zvese zviri zviviri pre-kudzidziswa uye post-kudzidziswa, pre-yakadzidziswa uye kuraira-yakakwenenzverwa mamodheru pari zvino vatungamiriri vasina kupokana pa8B uye 70B parameter scale.
Optimizations mumashure-ekudzidzira maitiro akakonzera a kuderedza zvikanganiso zvekurambwa, kunze kwekuvandudza kurongeka uye kuwedzera kusiyana-siyana mumhinduro dzemuenzaniso. Kuvandudzwa kwakakosha kwakaonekwawo muzvinhu zvakaita sekufunga, chizvarwa chekodhi uye kutungamira kweramangwana, zvichiita kuti Llama 3 iwedzere kuchinjika uye yakanangwa.
Munguva yekuvandudzwa kweLlama 3 pakave nekuongororwa kwekuita kwemodhiyo, zvese mumabhenji akajairwa uye mumamiriro epasirese chaiwo. Kuti ive nechokwadi chekugadzirisa kunoshanda kwezvishandiso zvinoshanda, imwe yemhando yepamusoro yekuongorora yemunhu yakagadzirwa. Iyi seti ine 1.800 yekukurudzira inovhara gumi nembiri makesi ekushandisa, kusanganisira kukumbira mazano, kufunga, kuronga, kupindura mibvunzo yakavharwa, kukodha, kunyora kwekugadzira, kutora, kuedzesera vatambi/vanhu, kupindura mibvunzo yakavhurika, kufunga, kunyora patsva. e pfupiso.
To avoid the overfitting (kana overfitting, izwi rinonyanya kushandiswa) netsaona yemamodheru kune iyi seti yekuongorora, kunyangwe Meta's ega zvikwata zvekuenzanisira haazvikwanisi. Girafu yakaratidzwa inoratidza yakaunganidzwa mhedzisiro yekuongororwa kwevanhu muzvikamu izvi uye zvinokurudzira, tichienzanisa kuita kweLlama 3 nemamodheru. Claude Sonnet, Mistral Medium e GPT-3.5.
Sei Llama 3 Inovandudza Meta AI 1o5832
Nekuda kwekufambira mberi kwakaitwa neMeta Llama 3, kambani inozivisa kuwedzera kwenyika dzese kweMeta AI - ichirangarira kuti iyo sosi yaingove kuUnited States. Kuuya semukwikwidzi akasimba kune mamodheru aripo, Meta AI yave kuwanikwa kune vanhu vazhinji pasi rese, ichibvumira vashandisi veiyo. Facebook, Instagram, WhatsApp e mutumwa Nakidzwa neiyi tekinoroji yemahara kuita zviito zvakasiyana, kugadzira zvirimo uye kuwana ruzivo munguva chaiyo.
Meta AI yakatanga kuratidzwa panguva yeBatanidza gore rapfuura, uye ikozvino vashandisi munyika dzakadai Australia, Canada, Ghana, Jamaica, Malawi, New Zealand, Nigeria, Pakistan, Singapore, South Africa, Uganda, Zambia e Zimbabwe inogonawo kunakidzwa nebetsero dzayo. Sechikamu chekuwedzera kweMeta AI, vanhu vanozogonawo kuiwana pairi meta.ai, muwebhu vhezheni.
Uri kuronga kuenda kunotandara manheru neshamwari here? Bvunza Meta AI kuti ikurudzire resitorendi ine maonero anoshamisa uye kunyange vegan sarudzo. Uri kuronga rwendo rwekupera kwevhiki here? Bvunza Meta AI kuti iwane zviratidzo zveMugovera manheru. Uri kugadzirira bvunzo here? Bvunza Meta AI kuti ikutsanangurire kuti hunhu hwenhaka hunoshanda sei. Uri kutamira muimba yako yekutanga here? Bvunza Meta AI kuti "ifungidzire" kunaka kwaunoda uye mubatsiri achagadzira mamwe mafoto ekukurudzira efenicha yako.
Meta inotsanangura zvishoma kuti AI ingakubatsira sei
O Meta AI ichave inowanikwawo zvakananga mubasa rekutsvaga reFacebook, Instagram, WhatsApp uye Messenger. Izvi zvinoreva kuti unogona kuwana ruzivo kubva painternet munguva chaiyo pasina kuchinja pakati pemaapplication. Semuenzaniso, fungidzira uri kuronga rwendo neshamwari muMessenger group chat. Nekutsvaga kweMessenger, unogona kubvunza Meta AI - inofambiswa neLlama 3 itsva - kuti uwane ndege kubva kwaunobva kuenda kwauchaenda, uye nekutsvaga kupera kwevhiki kunononoka kushanya. Uye zvechokwadi, zvese izvi pasina kusiya iyo Messenger app.
Vanhu vanozove nekwaniso yekuwana Meta AI pavanenge vachitsvaga yavo Facebook Feed. Kana iwe ukawana chinyorwa chinokwevera kufarira kwako, unogona kukumbira rumwe ruzivo zvakananga kubva kuMeta AI kubva kune iyo positi, seyakajairwa kutsvaga kweGoogle, mukati meFacebook post.
Meta iri kusimudzira maitiro ekufungidzira kuitira kuti vanhu vakwanise kugadzira mifananidzo chaiyo-nguva kubva kumavara vachishandisa Meta AI's Fungidzira chimiro. Kuburitswa kwechinhu ichi kwakatanga mubeta nhasi, inowanikwa paWhatsApp uye Meta AI yewebhu ruzivo muUnited States. Pavanotanga kutaipa, vanhu vanoona mufananidzo uchibuda ipapo ipapo. Ichi chifananidzo chinoshanduka nemavara mashoma ega ega aunonyora, zvichikubvumidza kuti utarise sezvo Meta AI ichiunza zano rako kuhupenyu munguva chaiyo.
Maererano nekambani, iyi mifananidzo yakagadzirwa inopa a kunatsiridza kupinza uye kunaka, inopa kugona kurinani kwekubatanidza zvinyorwa mumifananidzo. Pamusoro pezvo, ichapa mazano ekuvandudza chifananidzo, zvichikutendera kuti uenderere mberi nekunatsa kubva paunotanga kutanga. Kana iwe ukawana mufananidzo, ingo bvunza Meta AI kuti iite kuti irarame, ichichinjire kune imwe fomati, kana kutoishandura kuita GIF kugovera neshamwari dzako.
Kunyange izvi zvigadziriso zvakanangana neMeta AI paFacebook, Instagram, WhatsApp, Messenger, uye webhu, zvakakosha kuyeuka kuti Meta AI inowanikwawo muUnited States yemagirazi akangwara. Ray-Ban Meta, uye nokukurumidza kupinda Meta quest - Meta chaiyo chaiyo zvishandiso.
Transparency ine yakavhurika sosi uye chengetedzo 5p3621
Iko kugona kwekugadzira AI tekinoroji inogona kunyatso kuvandudza ruzivo rwemushandisi wezvigadzirwa zveMeta uye yakafararira ecosystem. Zvakadaro, imwe pfungwa inofanirwa kutariswa ndeye kuona kuti izvi zvaitwa mu mutoro e chokwadi. Naizvozvo, kambani iri kutora matanho ekuongorora uye kudzikisira njodzi pamatanho ese ekuvandudza nekuita kweAI. Izvi zvinosanganisira kubatanidza dziviriro muLlama base modhi dhizaini uye kuburitsa maitiro, pamwe nekutsigira yekuvandudza ecosystem kusimudzira maitiro ane mutoro.
Nokudaro, neLlama 3, nzira yakarongeka yakagamuchirwa iyo inobatanidza dziviriro pamatanho ese ebudiriro. Izvi zvinoreva kuti kutarisirwa kwakakosha kwave kuchishandiswa pakudzidzisa nekugadzirisa maitiro, pamwe nekupa maturusi anogonesa vanogadzira kuita mamodheru zvine hungwaru.
Iyi nzira haingosimbisi kuedza muAI ine mutoro, asi zvakare inoratidza chiono cheyakavhurika hunyanzvi, ichipa simba vanogadzira kuti vagadzirise zvigadzirwa zvavo zvakachengeteka kubatsira vashandisi vavo. Meta zvakare ine Responsible Use Guide, sosi yakakosha yevagadziri, inopa nhungamiro yekuvaka zvigadzirwa.
Sezvatakatsanangura patakaburitsa Llama 2, zvakakosha kuve nemaune mukugadzira matanho aya, sezvo paine mamwe anogona kungoitwa nemazvo neanopa muenzaniso, uye mamwe anongoshanda nemazvo kana aitwa nemugadziri sechikamu chezvavanoda. application.
Inosimbisa kambani
Kubva zvakatanga Meta AI gore rapfuura, mhando yakaramba ichivandudza ruzivo munzvimbo dzinoverengeka:
- Mhinduro dzeMeta AI kunhau dzezvematongerwo enyika nedzemagariro dzakanatswa, kusanganisira nhungamiro dzemisoro iyi. Chinangwa ndechekupa akasiyana mapoinzi akakodzera ekuona pane imwe nyaya, uku uchiremekedza zvinangwa zvemushandisi pakubvunza mibvunzo chaiyo.
- Kusanganisira mirairo chaiyo uye mhinduro kuti zvinyatsobatsira, uchishandisa mibairo mienzaniso kutungamira maitiro ako.
- Kuita kweMeta AI kunoongororwa mumabhenji uye kuburikidza nekuyedzwa nenyanzvi dzevanhu, kugadzirisa chero nyaya dzakaonekwa mukuenderera mberi.
- Chengetedzo yekukumbira uye yekupindura nhanho, kusanganisira mafirita uye maclassifiers kuti ive nechokwadi chekuti kupindirana kwanoenderana negwara uye kwakachengeteka.
- Maturusi emhinduro kuti vashandisi vagovane zvavakasangana nazvo, zvichitibvumira kuramba tichivandudza kuita kweMeta AI.
Uye iwe, wakafungei nezvenhau? Hatina kumirira kuti tisvike kuBrazil, handiti? Tiudze zvawakawana matiri mashoko!
Onawo:
Mapikicha eGoogle libera yemahara AI mufananidzo kugadzirisa kune vese vashandisi.
Neruzivo kubva: Chinangwa [1], [2] e [3].
Yakaongororwa na Glaucon Vital musi wa18/4/24.
