Maitiro ekushandisa PC yako seyeNharaunda AI Hub: A Inoshanda uye Inoenzanisa Gwaro

¿Maitiro ekushandisa PC yako seyemuno AI hub? Artificial intelligence haisisiri iyo yakasarudzika dhizaini yemakambani makuru kana nyanzvi dzemakore. Vazhinji vashandisi vari kutsvaga kukwidziridza mhinduro dzeAI zvakananga kubva kumakomputa avo emabasa kubva pakugadzira zvinyorwa kusvika kune otomatiki ekugadzira kana tekinoroji maitiro, ese ane yakanyanya kuvanzika uye pasina kuvimba nemaseva ekunze. Shandura PC yako ive yemuno AI hub Icho chinhu chinokwanisika uye chiri mukati mekusvika kune chero anofarira, nyanzvi kana mudzidzi, kunyangwe kana mudziyo wako usiri wepamusoro-soro.

Muchikamu chino, iwe uchaona maitiro ekushandura komputa yako kuita musimboti weAI yako ecosystem. Isu tichatarisa anonyanya kukurudzirwa masoftware mamwe maitiro, zvakakosha kufunga nezve Hardware, modhi, uye maficha, pamwe nemabhenefiti ekushanda neAI yemuno maererano nekuvanzika uye munhu. Uyezve, ini ndichakutungamirira kuburikidza nekusarudza, kuisa, uye kuwana zvakanyanya kubva kuLLM modhi, maapplication, uye zviwanikwa, tichienzanisa zvirongwa zvakanakisa uye nekupa matipi ekuita yako AI ruzivo rwakatsetseka uye rwakachengeteka, kungave paWindows, Mac, kana Linux.

Sei uchishandisa PC yako senzvimbo yeAI hub?

Kushandisa komputa yako seyepakati AI chikuva kunopa zvakanakira izvo zvakaoma kuenzanisa nemasevhisi emakore. Chimwe chezvikonzero zvakakosha ndeyekuvanzika: kana iwe uchidyidzana nechatbots mugore, data rako uye zvikumbiro zvinopedzisira zvachengetwa pamasevha echitatu-bato uye, kunyangwe makambani anoita matanho ekuchengetedza, Pane nguva dzose njodzi yekudonha kana kushandiswa zvisizvo. Kugadzirisa ruzivo munharaunda kunoreva kuti une kutonga kwakazara pamusoro pedata rako. Hapana mumwe munhu anogona kuwana mibvunzo yako, mhinduro, kana mafaera.

Imwe mukana mukuru kusavapo kweInternet connection zvinodiwa. Iine pane-nzvimbo system, unogona kunakidzwa neAI maficha kunyangwe uine isina kugadzikana yekubatanidza, gara munzvimbo isina kuvharika, kana kungoda kushanda kunze kwenyika nekuda kwezvikonzero zvekuchengetedza. Mukuwedzera, customization yakakura zvikuru: Iwe unogona kusarudza iyo modhi inonyatsokunakira iwe, ita kuti ienderane nezvido zvako, uye nyatso-tuta yega yega parameter-chimwe chinhu chisingawanzo kuitika nemasevhisi emaketeni emakore.

Hapana zvishoma zvakakosha iyo yehupfumi. Kunyangwe masevhisi emakore achipa emahara vhezheni, kushandiswa kwepamberi kunosanganisira kunyoreswa, kubhadhara tokeni, kana kushandisa zviwanikwa. Paunenge uchishanda munharaunda, muganhu chete ndiko kugona kwehardware yako.

Chii chaunoda kuti utange? Hardware uye zvakakosha zvinodiwa

Pfungwa yakajairika yekuti kushanda neAI kunoda kucheka-kumucheto makomputa kana ekupedzisira-ane simba maGPU ikozvino chinhu chekare. Mamodheru emitauro azvino akagadziridzwa kuti ashande pamakomputa epamba, uye mazhinji acho, kunyanya iwo akaverengerwa, inogona kumhanya kunyangwe isina yakatsaurirwa kadhi yemifananidzo, uchishandisa CPU chete.

Kuti ushande zvakanaka uye chiitiko chinonakidza, zvinokurudzirwa kuve ne8-16 GB ye RAM. uye inonzwisisika yemazuva ano processor (Core i5 kana i7 yechizvarwa chechitanhatu zvichienda mberi, kana Ryzen yakaenzana). Kana uri kushanda nemamodheru makuru kana kuti uchida kukurumidza kuita, GPU ine 4GB yeVRAM inoita mutsauko, kunyanya kumabasa akaita sekugadzira mifananidzo kana mhinduro dzemavara marefu kwazvo.

PaMac, Apple M1 machipi uye yepamusoro zvakare inotsigira emuno LLM modhi ine yakanaka kwazvo yekupindura nguva. Muchidimbu, kana PC yako kana laptop yako isingasviki makore manomwe, unogona kutanga kuyedza neAI yemuno.

Ndeapi maapplication uye mapuratifomu aunoda kushandura PC yako kuita yemuno AI hub?

Mwoyo wenzvimbo yako yeAI sisitimu ndiyo yakasarudzika maapplication anovhara mukaha pakati pe Hardware yako neAI modhi. Pakati pezvinonyanya kuzivikanwa nekuda kwekushandisa kwavo nyore, simba uye kushanduka, zvakakodzera kutaura:

• GPT4All: Imwe yeanonyanya kufarirwa uye ane hushamwari sarudzo. Iyo inokutendera iwe kurodha uye kuisa akawanda emitauro modhi, kupindirana nawo, uye kugadzirisa akasiyana ma paramita. Iyo muchinjika-chikuva (Windows, Mac, uye Linux) uye maitiro ayo ekuisa ari nyore senge chero imwe desktop desktop.
• Jan AI: Iyo inomira pachena kune yayo yemazuva ano interface, kugona kuronga tambo dzekukurukurirana, uye kuenderana kwayo neese emuno uye kure mamodheru (kubva kuOpenAI, semuenzaniso, kuburikidza neAPI). Pamusoro pezvo, inopa yayo yemuno API inotevedzera OpenAI's, ichibvumira Jan kuti abatanidzwe seAI backend mune mamwe maapplication anoda ChatGPT API kiyi, asi pasina kuvimba neInternet.
• Llama.cpp uye LM Studio: Zvishandiso izvi zvinokutendera kuti umhanye modhi yeLLM munharaunda uye nekupa mukana kune yakazara raibhurari yemamodheru kubva kuHugging Face uye mamwe marepositori.

Iyo yekutanga maitiro anowanzo seanotevera: Dhawunirodha app yakasarudzwa kubva kune yayo yepamutemo webhusaiti, isa pane yako sisitimu, uye utarise iyo gallery yematemplate anowanikwa (anowanzonzi "The Hub" kana zvakafanana). Ikoko iwe unogona kusarudza modhi yaunoda, tarisa saizi yayo uye ndangariro zvinodiwa, uye dhawunirodha zvese kubva kune iyo interface pachayo.

Yepamusoro AI modhi yekuisa munharaunda

Nyika yeakavhurika sosi LLM modhi yakakura uye inogara ichikura. Kunze kweiyo inopihwa neOpenAI (inoda cloud connection), kune dzimwe nzira dzakawanda dzakagadzirirwa kushanda munharaunda: Mistral 7B, TinyLlama Chat, Nous Hermes 2, Mixol 8X 7B, pakati pevamwe. Mazhinji emhando idzi akaverengerwa, zvinoreva kuti anotora nzvimbo shoma uye anoda shoma RAM pamutengo wekupira hushoma hwechokwadi.

Kune vanotanga Madiki-epakati modhi, akadai seMistro Instruct 7B kana TinyLlama Chat, anokurudzirwa, sezvo achiburitsa nekukurumidza uye asingaremedze sisitimu. Kana komputa yako iine RAM yakawanda uye nzvimbo yekuchengetedza, edza mamwe mamodheru akazara seMixol 8X 7B, uchiziva kuti, semuenzaniso, inogona kuda kusvika ku26 GB yedhisiki nzvimbo chete yemuenzaniso.

Munenge maapplications unogona kusefa mamodheru zvichienderana nehukuru hwawo, mutauro wekutanga, marezinesi kana rudzi rwemabasa avakadzidziswa. (kunyora zvinyorwa, kugadzira kodhi, kushandura, nezvimwewo). Iyo yakanyanya kujeka chinangwa chemuenzaniso, iyo yakanyanya kunyatso mhedzisiro yaunowana.

Iyo nhanho-nhanho maitiro ekuisa uye kushandisa yemuno AI

1. Dhawunirodha uye isa iyo application: Enda kuwebhusaiti yepamutemo yechishandiso chako chaunofarira (semuenzaniso, GPT4All kana Jan AI), dhawunirodha chigadziriso chesystem yako yekushandisa, uye tevera matanho ari pa-skrini. MuWindows, inowanzova wizard yekare; PaMac, zvingada kugonesa Rosetta yemakomputa ane M1/M2 processor; PaLinux, iwe unenge uine DEB kana AppImage mapakeji aripo.

2. Ongorora uye dhawunirodha AI modhi: Kana wangovhura application, pinda muongorori wemodhi (muGPT4All ndiyo "Discovery Model Space", muna Jan AI, "The Hub"). Sefa, ongorora maitiro, uye paunowana iyo modhi inokufadza zvakanyanya, tinya "Kudhawunirodha." Iwe uchaziviswa nezvehukuru uye zvinodiwa usati waenderera mberi.

3. Kusarudzwa uye kuuraya kwekutanga: Kana template yatorwa, sarudza iyo mu-app uye tanga hurukuro itsva kana basa. Nyora mubvunzo wako kana chikumbiro uye mirira mhinduro. Kana ukaona mhinduro dzinononoka, edza kushandisa mamodheru akareruka kana kugadzirisa marongero.

4. Gadzirisa parameter uye kuedza: Muzvirongwa zvakawanda unogona kushandura huwandu hwehuwandu hwematokens (izvo zvinomisa kureba kwemhinduro), pamwe chete nezvimwe zvinhu zvakadai setembiricha, top_p, etc. Edza zvirongwa zvakasiyana kusvikira wawana chiyero pakati pekumhanya uye kunaka kwemigumisiro inokushandira iwe.

5. Ronga uye gadzirisa tambo: Zvirongwa zvakawanda zvinokutendera kuti ugadzire tambo dzehurukuro dzine mazita akasiyana uye zvinangwa (mazano evhidhiyo, kunyora kwekugadzira, rubatsiro nekodha, nezvimwewo), uye iwe unogona zvakare kuchengetedza mirairo yetsika kune yega yega tambo, iyo inofambisa kudyidzana.

Resource management uye performance optimization

Icho chinodzikisira chikuru cheAI yemuno hardware: Kana iyo modhi yakakurisa ku RAM yako, kudzikira, kubondera, kana kukanganisa kuuraya kunogona kuitika. Iwo akanakisa maapplication anopa yambiro yepamberi paunosarudza modhi inorema zvakanyanya kune yako kifaa.

Jan AI inokunda nekubatanidza on-screen resource monitor iyo inokuratidza munguva chaiyo mashandisirwo eRAM, CPU uye kumhanya kwekugadzirisa (tokens pasekondi). Nenzira iyi, iwe unogona kugara uchiziva kana timu yako iri pamuganho wayo kana kana iwe uchikwanisa kudzvanya zvimwe kubva mairi.

Kana PC yako ine kadhi yemifananidzo yeNvidia uye iwe uchida kutora mukana wayo, Mamwe maapplication anobvumira GPU kukurumidza nekuisa CUDA. Izvi zvinogona kuwanza kumhanya mumabasa anorema. Gara uchitarisa kune zviri pamutemo zvinyorwa kuti uise zvakanaka uye ugone kugonesa GPU rutsigiro.

Zvakanakira quantification: akareruka uye anobudirira mamodheru

Izwi rinowanzozivikanwa kana uchitaura nezvenzvimbo yeAI ndeye "quantization." Izvi zvinosanganisira kudzikisa huremu hwekuchengetedza modhi nekuvashandura kuita manhamba ane mabhiti mashoma, izvo zvinoderedza zvakanyanya dhisiki remodhi uye saizi yendangariro, nekukanganisa kushoma pamhando yekupindura.

Mazhinji anodhawunirodha modhi atouya akaverengerwa mumhando dzakasiyana (4-bit, 8-bit, nezvimwewo). Kana iyo modhi yaunoda ichingovepo mune "yakazara" vhezheni uye timu yako haigone kuifambisa, pane zvikumbiro zvinokutendera kuti uzviverengere wega (semuenzaniso, GPTQ).

Iyi nzira inoita kuti zvikwanise kumhanyisa mamodheru ane simba pane akura kana zviwanikwa-zvishoma maPC, uchichengetedza kuvanzika uye kuzvimiririra kubva mugore.

Kuenzanisa kweakanakisa emunharaunda maAI zvishandiso: GPT4All vs. Jan AI

Zvese zviri zviviri zvikumbiro zvinopa zvese zvaunoda kushandura PC yako kuita ine simba AI hub, asi imwe neimwe ine yayo yakasarudzika maficha ayo anogona kukubatsira iwe kusarudza chimwe kana chimwe zvichienderana nezvaunoda.

• Kunzwisisa kwekushandisa: GPT4All Zviri nyore kwazvo, kuisirwa kunokurumidza uye kudhawunirodha modhi kunoitwa kubva kujeka uye mushandisi-ane hushamwari interface. Jan AI, kune rumwe rutivi, inopa yakawedzera kutaurirana sangano uye kugona kuenderera mberi nekugadzirisa mirairo uye mafambiro ebasa.
• Kubatana: Ose ari maviri anotsigira Windows, Mac uye Linux. Jan AI inowedzera kubatanidzwa kwakananga nemamwe maapplication kuburikidza neayo API yemuno.
• Resource monitoring: Jan AI inopa chaiyo-nguva dashboard yekushandisa zviwanikwa, inobatsira zvikwata zvine zvinonetsa. GPT4All inoshuma izvo zvidiki zvinodiwa uye inokuyambira kana Hardware yako ingadonha.
• Kuwedzera: Jan inokutendera iwe kuti uise ekuwedzera iyo inowedzera kushanda (semuenzaniso, yambotaurwa sosi yekutarisa), iyo isipo muGPT4All.

Kurudziro yangu ndeyekuyedza zvese uye kuona kuti ndeipi inonyatsoenderana nekufamba kwako uye timu yako.

Kugadzirisa matambudziko uye FAQs

Zvakajairika kusangana nemamwe matambudziko pakurodha nekuisa maAI modhi, kunyanya kana uchibata nemafaira makuru kana uine zviwanikwa zvishoma pachikwata. Imwe yezvikanganiso zvinowanzoitika kutadza kutora. Muzviitiko izvi, ipfungwa yakanaka kutarisa kubatana kwako, kujekesa dhisiki nzvimbo, kana kutangazve application. Nharaunda dzekutsigira chirongwa chega chega, pamwe nemawiki kana maforamu avo epamutemo, anowanzo kupa mhinduro nhanho-nhanho.

Panyaya yechengetedzo, kushandisa yemuno AI kwakajeka zvakanyanya pane kufambidzana nemasevhisi ari kure. Yako data uye nhaurirano nhoroondo inoramba iri pamudziyo wako uye haishandiswe kudzidzisa ekunze algorithms. Nekudaro, sekuchenjerera, zvinokurudzirwa kusagovana ruzivo rwakadzama mune chero AI application, kunyangwe munharaunda.

Ko kana iwe uchida kutowedzera kuita? Kana uchikwanisa kubhadhara RAM kukwidziridzwa (16 kana 32 GB) kana GPU yemazuva ano, mamodheru makuru anomhanya zvakapfava uye uchakwanisa kuyedza nemhando yepamusoro senge multimodal interaction (zvinyorwa, mufananidzo, izwi). Zvikasadaro, kune akareruka, akakwenenzverwa mamodheru anoita zvakanaka kwazvo mumabasa emazuva ese.

Chiitiko chacho hachina Indaneti zvachose: Kana mamodheru angotorwa, chishandiso chinoshanda pasina chinongedzo cheInternet, kuwedzera kuvanzika uye kukubvumira kushanda mune chero mamiriro.

Iyo inogara ichichinja yemuno AI ecosystem

Zvazvino zvigadziriso zveAI zvePC zvePC zvasvika padanho rekukura izvo zvino zvinovaita imwe nzira yakasimba kune makore masevhisi. Iwo akakura akasiyana-siyana emamodheru, nyore kuisirwa, uye kugadzirisa kugona kuita demokrasi kuwana yekucheka-kumucheto kungwara kwekugadzira.

Makambani akaita seGoogle neMicrosoft arikupawo chikamu chavo kuburikidza nemapuratifomu epakati (semuenzaniso AI Hub kana Copilot paWindows), asi iyo chaiyo kugona kweAI yemuno iri muchokwadi chekuti. Iwe unogona kugadzirisa hubhu yako yetsika kune yako chaiyo mafambiro, kuvanzika, uye zvinangwa..

Kuziva kuti uri mushandisi akajeka weAI, isu tinokurudzira kuti utange kudzidza zvakanyanya uye kutora mukana weiyo ChatGPT nevamwe, sezvo semuenzaniso, iwe zvino unogona mutengo wekuenzanisa paChatGPT.

Iye zvino une maturusi, madhairekitori uye matipi anodiwa kuti ushandure PC yako kuita yechokwadi yehungwaru hub, Kutora hunyanzvi uye kutonga kwakazara pamusoro peruzivo rwako kune imwe nhanho. Tinovimba iwe ikozvino unoziva mashandisiro ePC yako seyemuno AI hub.