Yuav Siv Koj Lub PC li cas hauv AI Hub Hauv Zos: Phau Ntawv Qhia Txog Tswv Yim thiab Sib Piv

¿Yuav siv koj lub PC li AI hub li cas? Artificial txawj ntse tsis yog qhov tshwj xeeb ntawm cov tuam txhab loj lossis cov kws tshaj lij huab. Ntau thiab ntau tus neeg siv tab tom nrhiav kom siv AI cov kev daws teeb meem ncaj qha los ntawm lawv lub khoos phis tawj ntawm tus kheej rau cov haujlwm xws li cov ntawv sau mus rau kev ua kom muaj tswv yim lossis cov txheej txheem thev naus laus zis, tag nrho nrog kev ceev ntiag tug siab tshaj plaws thiab tsis muaj kev cia siab rau cov servers sab nraud. Tig koj lub PC rau hauv AI hub hauv zos Nws yog qhov muaj nqis pheej yig thiab muaj nyob rau ntawm yuav luag txhua tus neeg nyiam, kws tshaj lij lossis cov tub ntxhais kawm, txawm tias koj cov khoom siv tsis yog lub xeev-ntawm-tus-kos duab.

Hauv tsab xov xwm no, koj yuav pom yuav ua li cas hloov koj tus kheej lub computer mus rau hauv lub hauv paus ntawm koj AI ecosystem. Peb yuav saib cov kev xaiv software uas pom zoo tshaj plaws, kev txiav txim siab tseem ceeb txog kho vajtse, qauv, thiab cov yam ntxwv, nrog rau qhov zoo ntawm kev ua haujlwm nrog AI hauv zos ntawm ob qho tib si ntiag tug thiab tus kheej. Ntxiv rau, kuv yuav coj koj los ntawm kev xaiv, txhim kho, thiab tau txais txiaj ntsig zoo tshaj plaws ntawm LLM qauv, apps, thiab cov peev txheej, sib piv cov kev pabcuam zoo tshaj plaws thiab muab cov lus qhia los ua kom koj qhov kev paub AI du thiab nyab xeeb, txawm nyob hauv Windows, Mac, lossis Linux.

Vim li cas thiaj siv koj lub PC ua lub chaw AI hauv zos?

Siv koj lub khoos phis tawj ua lub hauv paus AI platform muaj qhov zoo uas nyuaj rau kev sib tw nrog cov kev pabcuam huab. Ib qho ntawm cov laj thawj tseem ceeb tshaj plaws yog kev ceev ntiag tug: thaum koj cuam tshuam nrog chatbots hauv huab, koj cov ntaub ntawv thiab cov lus thov xaus rau ntawm cov neeg sab nrauv servers thiab, txawm tias cov tuam txhab siv kev ntsuas kev nyab xeeb, Muaj ib txwm muaj kev pheej hmoo ntawm kev xau lossis siv tsis raug. Kev ua cov ntaub ntawv hauv zos txhais tau tias koj muaj kev tswj hwm koj cov ntaub ntawv tiav. Tsis muaj leej twg nkag tau rau koj cov lus nug, lus teb, lossis cov ntaub ntawv.

Lwm qhov zoo dua yog qhov tsis muaj kev sib txuas hauv Is Taws Nem. Nrog rau lub hauv paus system, koj tuaj yeem txaus siab rau AI cov yam ntxwv txawm tias koj muaj kev sib txuas tsis ruaj khov, nyob hauv thaj chaw uas tsis muaj kev pov hwm, lossis tsuas yog xav ua haujlwm offline rau kev nyab xeeb. Tsis tas li ntawd, customization yog ntau dua: Koj tuaj yeem xaiv tus qauv uas haum rau koj zoo tshaj plaws, kho nws raws li koj xav tau, thiab kho kom zoo txhua qhov ntsuas - qee yam uas tsis tshua muaj peev xwm nrog cov kev pabcuam huab cua.

Tsis muaj tsawg tseem ceeb yog qhov kev lag luam. Txawm hais tias huab kev pabcuam muab cov qauv dawb, kev siv qib siab suav nrog kev tso npe, them nyiaj token, lossis kev siv peev txheej. Thaum ua haujlwm hauv zos, qhov kev txwv nkaus xwb yog lub peev xwm ntawm koj cov khoom siv.

Koj xav tau dab tsi los pib? Hardware thiab cov kev cai yooj yim

Lub tswv yim dav dav uas ua haujlwm nrog AI xav tau cov khoos phis tawj thev naus laus zis lossis GPU muaj zog heev tam sim no yog qhov dhau los. Cov qauv lus tam sim no tau ua kom zoo rau kev khiav ntawm cov khoos phis tawj hauv tsev, thiab ntau ntawm lawv, tshwj xeeb tshaj yog cov quantized, tuaj yeem khiav txawm tias tsis muaj daim npav tshwj xeeb, tsuas yog siv lub CPU.

Rau kev ua haujlwm zoo thiab kev paub zoo, nws raug pom zoo kom muaj tsawg kawg 8-16 GB ntawm RAM. thiab cov txheej txheem niaj hnub tsim nyog (Core i5 lossis i7 ntawm lub thib rau tiam tom ntej, lossis Ryzen sib npaug). Yog tias koj ua haujlwm nrog cov qauv loj dua lossis xav tau kev ua haujlwm sai dua, GPU nrog 4GB ntawm VRAM ua qhov sib txawv, tshwj xeeb tshaj yog rau cov haujlwm xws li cov duab tsim lossis cov lus teb ntev heev.

Ntawm Mac, Apple M1 chips thiab siab dua kuj txhawb nqa LLM cov qauv hauv zos nrog lub sijhawm teb zoo heev. Hauv ntej, yog tias koj lub PC lossis lub laptop muaj hnub nyoog qis dua xya xyoo, koj tuaj yeem pib sim nrog AI hauv zos.

Dab tsi apps thiab platforms koj yuav tsum tau tig koj lub PC mus rau hauv lub zos AI hub?

Lub plawv ntawm koj lub zos AI system yog cov ntawv thov tshwj xeeb uas txuas qhov sib txawv ntawm koj cov khoom kho vajtse thiab AI qauv. Ntawm qhov tseem ceeb tshaj plaws rau lawv qhov yooj yim ntawm kev siv, lub zog thiab yoog raws, nws tsim nyog hais txog:

• GPT4Tag nrho: Ib qho ntawm cov kev xaiv nrov tshaj plaws thiab tus phooj ywg. Nws tso cai rau koj rub tawm thiab nruab ntau hom lus, cuam tshuam nrog lawv, thiab teeb tsa qhov sib txawv. Nws yog tus ntoo khaub lig-platform (Windows, Mac, thiab Linux) thiab nws cov txheej txheem kev teeb tsa yog yooj yim li lwm yam kev pab cuam desktop.
• Jan AI: Nws sawv tawm rau nws qhov kev sib txuas niaj hnub no, muaj peev xwm los teeb tsa kev sib tham xov, thiab nws qhov sib haum nrog ob qho tib si hauv zos thiab cov qauv chaw taws teeb (los ntawm OpenAI, piv txwv li, ntawm API). Tsis tas li ntawd, nws muaj nws tus kheej hauv zos API uas ua raws li OpenAI's, tso cai rau Jan ua ke ua ib qho AI backend rau lwm daim ntawv thov uas xav tau ChatGPT API tus yuam sij, tab sis tsis muaj kev cia siab hauv Is Taws Nem.
• Llama.cpp thiab LM Studio: Cov cuab yeej no tso cai rau koj khiav LLM cov qauv hauv zos thiab muab kev nkag mus rau lub tsev qiv ntawv dav dav ntawm cov qauv ntawm Hugging Face thiab lwm qhov chaw cia khoom.

Cov txheej txheem yooj yim feem ntau yog raws li hauv qab no: Rub tawm lub app xaiv los ntawm nws lub vev xaib official, nruab rau hauv koj lub cev, thiab tshawb xyuas cov duab ntawm cov qauv muaj (feem ntau hu ua "The Hub" lossis zoo sib xws). Nyob ntawd koj tuaj yeem xaiv tus qauv koj xav tau, tshawb xyuas nws qhov loj me thiab qhov xav tau nco, thiab rub tawm txhua yam ntawm lub interface nws tus kheej.

Sab saum toj AI qauv rau nruab hauv zos

Lub ntiaj teb ntawm cov qauv qhib LLM yog qhov loj thiab loj hlob tas li. Sib nrug los ntawm cov uas tau muab los ntawm OpenAI (uas xav tau kev sib txuas ntawm huab), muaj ntau txoj hauv kev npaj los ua haujlwm hauv zos: Mistral 7B, TinyLlama Chat, Nous Hermes 2, Mixol 8X 7B, thiab lwm yam. Ntau ntawm cov qauv no yog quantized, uas txhais tau hais tias lawv siv qhov chaw tsawg dua thiab xav tau RAM tsawg dua ntawm tus nqi ntawm kev txi me me ntawm qhov raug.

Rau beginners Cov qauv me me, xws li Mistro Instruct 7B lossis TinyLlama Chat, tau pom zoo, vim tias lawv tso tawm sai thiab tsis txhob hla lub kaw lus. Yog tias koj lub computer muaj ntau RAM thiab chaw cia, sim ua tiav cov qauv zoo li Mixol 8X 7B, paub tias, piv txwv li, nws tuaj yeem xav tau txog li 26 GB ntawm qhov chaw disk rau tus qauv.

Hauv yuav luag txhua daim ntawv thov koj tuaj yeem lim cov qauv raws li lawv qhov loj me, thawj hom lus, ntawv tso cai lossis hom haujlwm uas lawv tau kawm. (kev sau ntawv, cim cim, txhais lus, thiab lwm yam). Qhov tshwj xeeb ntawm lub hom phiaj ntawm tus qauv, qhov tseeb dua qhov koj tau txais.

Cov txheej txheem ib ntus rau kev txhim kho thiab siv AI hauv zos

1. Download tau thiab nruab daim ntawv thov: Mus rau lub vev xaib official ntawm koj lub cuab yeej nyiam (piv txwv li, GPT4All lossis Jan AI), rub lub installer rau koj lub operating system, thiab ua raws li cov kauj ruam ntawm lub vijtsam. Hauv Windows, feem ntau nws yog ib qho classic wizard; Ntawm Mac, tej zaum yuav xav tau kev ua kom Rosetta rau cov khoos phis tawj nrog M1 / ​​M2 processor; Ntawm Linux, koj yuav muaj DEB lossis AppImage pob muaj.

2. Tshawb thiab rub tawm AI qauv: Thaum koj qhib daim ntawv thov, nkag mus rau tus qauv tshawb nrhiav (hauv GPT4All nws yog "Discovery Model Space", hauv Jan AI, "Lub Hub"). Lim, tshuaj xyuas cov yam ntxwv, thiab thaum koj pom cov qauv uas txaus siab rau koj tshaj plaws, nyem "Download." Koj yuav raug ceeb toom txog qhov loj thiab qhov yuav tsum tau ua ua ntej txuas ntxiv mus.

3. Kev xaiv thiab ua thawj zaug: Thaum lub template yog downloaded, xaiv nws nyob rau hauv lub app thiab pib ib tug tshiab kev sib tham los yog ua hauj lwm. Sau koj cov lus nug lossis thov thiab tos cov lus teb. Yog tias koj pom cov lus teb qeeb, sim siv cov qauv sib dua lossis kho cov teeb tsa.

4. Kho qhov ntsuas thiab sim: Hauv cov kev pab cuam feem ntau koj tuaj yeem hloov kho qhov siab tshaj plaws ntawm cov tokens (uas txwv qhov ntev ntawm cov lus teb), nrog rau lwm cov ntsiab lus xws li kub, top_p, thiab lwm yam. Sim cov chaw sib txawv kom txog thaum koj pom qhov sib npaug ntawm qhov ceev thiab cov txiaj ntsig zoo uas ua haujlwm rau koj.

5. Npaj thiab kho cov xov: Ntau cov kev pab cuam tso cai rau koj los tsim cov kev sib tham nrog cov npe sib txawv thiab lub hom phiaj (cov tswv yim yees duab, kev sau muaj tswv yim, pab nrog coding, thiab lwm yam), thiab koj tuaj yeem txuag cov lus qhia kev cai rau txhua txoj xov, uas ua kom muaj kev sib cuam tshuam.

Kev tswj cov peev txheej thiab kev ua haujlwm zoo

Qhov kev txwv tseem ceeb ntawm AI hauv zos yog kho vajtse: Thaum tus qauv loj dhau rau koj lub RAM, kev poob qis, kev sib tsoo, lossis txawm tias ua yuam kev tuaj yeem tshwm sim. Cov apps zoo tshaj plaws muab cov lus ceeb toom ua ntej thaum koj xaiv tus qauv uas hnyav dhau rau koj lub cuab yeej.

Jan AI ua tau zoo los ntawm kev sib koom ua ke ntawm cov khoom siv ntawm lub vijtsam uas qhia koj nyob rau lub sijhawm ntawm kev noj RAM, CPU thiab kev ua haujlwm ceev (tokens ib ob). Txoj kev no, koj tuaj yeem paub ib txwm yog tias koj pab neeg nyob ntawm nws qhov txwv lossis yog tias koj tseem tuaj yeem nyem ntxiv ntawm nws.

Yog tias koj lub PC muaj daim npav Nvidia graphics thiab koj xav coj kom zoo dua nws, Qee daim ntawv thov tso cai GPU nrawm los ntawm kev txhim kho CUDA. Qhov no tuaj yeem ua kom nrawm nrawm hauv cov haujlwm hnyav. Ib txwm xa mus rau cov ntaub ntawv raug cai los txhim kho thiab pab txhawb GPU.

Qhov zoo ntawm quantification: sib dua thiab ua tau zoo dua qauv

Ib lo lus nquag thaum tham txog AI hauv zos yog "quantization." Qhov no suav nrog txo qhov tseeb ntawm kev khaws cov qauv hnyav los ntawm kev hloov lawv mus rau hauv cov lej nrog cov khoom tsawg dua, uas ua rau txo qis tus qauv disk thiab nco me me, nrog rau kev cuam tshuam me me rau cov lus teb zoo.

Feem ntau cov qauv rub tawm tau tuaj quantized nyob rau hauv ntau yam versions (4-ntsis, 8-ntsis, thiab lwm yam). Yog tias tus qauv koj xav tau tsuas yog muaj nyob rau hauv "tag nrho" version thiab koj pab neeg tsis tuaj yeem txav nws, muaj cov ntawv thov uas tso cai rau koj los ntsuas koj tus kheej (piv txwv li, GPTQ).

Cov txheej txheem no ua rau nws muaj peev xwm khiav cov qauv muaj zog ntawm cov laus lossis cov peev txheej txwv tsis pub siv PCs, thaum tswj kev ceev ntiag tug thiab kev ywj pheej ntawm huab.

Kev sib piv ntawm qhov zoo tshaj plaws AI cov cuab yeej hauv zos: GPT4All vs. Jan AI

Ob daim ntawv thov muab txhua yam koj xav tau los hloov koj lub PC mus rau hauv lub chaw muaj zog AI, tab sis txhua tus muaj nws tus kheej tshwj xeeb uas yuav pab koj xaiv ib lossis lwm qhov nyob ntawm koj nyiam.

• Yooj yim ntawm kev siv: GPT4 Txhua Nws yog ib qho yooj yim heev, installation yog ceev thiab downloading qauv yog ua los ntawm ib tug meej thiab user-friendly interface. Jan AI, ntawm qhov tod tes, muaj ntau lub koom haum sib tham thiab muaj peev xwm los kho cov lus qhia ntxiv thiab kev ua haujlwm.
• Compatibility: Ob leeg txhawb Windows, Mac thiab Linux. Jan AI ntxiv kev koom ua ke ncaj qha nrog lwm cov ntawv thov los ntawm nws qhov API hauv zos.
• Kev saib xyuas cov peev txheej: Jan AI muab lub sijhawm tiag tiag dashboard ntawm kev siv cov peev txheej, muaj txiaj ntsig zoo rau pab pawg nrog kev txwv. GPT4All qhia txog qhov yuav tsum tau ua yam tsawg kawg nkaus thiab ceeb toom koj yog tias koj lub cuab yeej yuav poob qis.
• Txuas ntxiv: Jan tso cai rau koj los nruab qhov txuas ntxiv uas txuas ntxiv ua haujlwm (piv txwv li, cov khoom siv tau hais los saum no), uas tsis muaj nyob hauv GPT4All.

Kuv qhov kev pom zoo yog sim ob qho tib si thiab pom qhov twg zoo tshaj plaws haum rau koj txoj haujlwm thiab koj pab neeg.

Kev daws teeb meem thiab FAQs

Nws yog ib qho uas yuav ntsib qee qhov kev sib tw thaum rub tawm thiab txhim kho AI qauv, tshwj xeeb tshaj yog thaum cuam tshuam nrog cov ntaub ntawv loj lossis muaj peev txheej tsawg ntawm pab pawg. Ib qho yuam kev feem ntau yog tsis ua haujlwm. Nyob rau hauv cov ntaub ntawv no, nws yog ib lub tswv yim zoo los xyuas koj cov kev twb kev txuas, tshem tawm qhov chaw disk, los yog rov pib dua daim ntawv thov. Txhua qhov kev pab cuam txhawb cov zej zog, nrog rau lawv cov wikis lossis cov rooj sab laj, feem ntau muab cov kev daws teeb meem ib ntus.

Hais txog kev ruaj ntseg, kev siv AI hauv zos yog pob tshab ntau dua li kev cuam tshuam nrog cov kev pabcuam hauv chaw taws teeb. Koj cov ntaub ntawv thiab keeb kwm kev sib tham tseem nyob hauv koj lub cuab yeej thiab tsis siv los cob qhia lwm tus algorithms. Txawm li cas los xij, raws li kev ceev faj, nws raug nquahu kom tsis txhob qhia cov ntaub ntawv rhiab hauv txhua daim ntawv thov AI, txawm tias hauv zos.

Yuav ua li cas yog tias koj xav tau kev ua haujlwm ntau dua? Yog tias koj tuaj yeem them taus qhov hloov kho RAM (16 lossis 32 GB) lossis GPU niaj hnub, cov qauv loj dua yuav ua haujlwm zoo dua thiab koj yuav tuaj yeem sim nrog cov yam ntxwv siab heev xws li kev sib cuam tshuam ntau yam (ntawv nyeem, duab, suab). Txwv tsis pub, muaj lub teeb yuag, kev ua kom zoo tshaj plaws uas ua tau zoo heev hauv feem ntau cov haujlwm niaj hnub.

Qhov kev paub yog offline kiag li: Thaum cov qauv raug rub tawm, daim ntawv thov ua haujlwm yam tsis muaj kev sib txuas hauv Is Taws Nem, ua kom muaj kev ceev ntiag tug thiab tso cai rau koj ua haujlwm txhua qhov xwm txheej.

Ib ntus hloov zuj zus hauv zos AI ecosystem

Tam sim no hauv zos AI cov kev daws teeb meem rau PCs tau mus txog theem ntawm kev loj hlob uas tam sim no ua rau lawv muaj lwm txoj hauv kev rau kev pabcuam huab. Qhov ntau yam ntawm cov qauv, yooj yim ntawm installation, thiab customization muaj peev xwm yog democratizing nkag mus rau tej-edge artificial txawj ntse.

Cov tuam txhab xws li Google thiab Microsoft kuj tau txhawb nqa lawv txoj hauv kev los ntawm lub hauv paus platforms (piv txwv li AI Hub lossis Copilot ntawm Windows), tab sis lub peev xwm tiag tiag ntawm AI hauv zos nyob hauv qhov tseeb tias Koj tuaj yeem kho koj lub hub kev cai rau koj cov haujlwm tshwj xeeb, kev ceev ntiag tug, thiab cov hom phiaj..

Paub tias koj yog tus neeg siv AI ntshiab, peb xav kom koj pib kawm ntau ntxiv thiab siv qhov muaj peev xwm ntawm ChatGPT thiab lwm tus, txij li piv txwv, tam sim no koj tuaj yeem muaj lub peev xwm. kev sib piv tus nqi ntawm ChatGPT.

Tam sim no koj muaj nyob rau ntawm koj pov tseg cov cuab yeej, cov lus qhia thiab tricks tsim nyog los hloov koj lub PC mus rau hauv ib tug tiag tiag txawj ntse hub, Kev tsim kho tshiab thiab kev tswj hwm koj cov ntaub ntawv mus rau lwm qib. Peb cia siab tias tam sim no koj paub siv koj lub PC li AI hub hauv zos.