Yuav ua li cas rau nruab Gemma 3 LLM ntawm Windows 11 kauj ruam yog kauj ruam

Cov qauv lus qhib tau hloov zuj zus los ntawm kev nce thiab ciam teb, thiab Niaj hnub no nws muaj peev xwm txaus siab rau lawv ncaj qha los ntawm tus kheej lub computer yam tsis muaj nyob ntawm cov kev pabcuam huab.. Ib qho tseem ceeb tshaj plaws tam sim no yog Gemma 3, Google's LLM tshiab raws li Gemini thev naus laus zis, uas sawv tawm rau nws lub peev xwm los ua cov ntawv nyeem thiab cov duab, nrog rau nws cov ntsiab lus loj ntawm qhov rais mus txog 128k tokens hauv nws cov qib siab heev. Yog xav paub ntxiv txog qhov kev tso tawm no, koj tuaj yeem mus saib peb tsab xov xwm ntawm kev nthuav qhia ntawm Gemma 3.

Yog tias koj siv Windows 11 thiab tab tom nrhiav rau nruab Gemma 3 rau kev sim lossis txawm tias tsim khoom hauv zos, koj tuaj rau qhov chaw zoo. Cia peb mus ntxiv txhua txoj hauv kev kom tau txais nws nce thiab khiav ntawm koj lub computer, suav nrog cov kev xaiv pom zoo tshaj plaws xws li Ollama, LM Studio, thiab tseem muaj huab-raws li lwm txoj hauv kev nrog Google AI Studio. Tsis tas li ntawd, peb yuav hais txog cov kev xav tau, qhov zoo ntawm txhua txoj kev thiab Yuav ua li cas ua kom muaj peev xwm tshaj plaws ntawm qhov kev txawj ntse muaj zog no.

Gemma 3 yog dab tsi thiab yog vim li cas rau nruab nws?

Gemma 3 yog lub cim thib peb ntawm LLM qauv tso tawm los ntawm Google raws li daim ntawv tso cai qhib.. Tsis zoo li cov kev daws teeb meem yav dhau los xws li Llama lossis Mistral, nws muaj kev txhawb nqa ncaj qha rau cov duab nkag, ntau lub ntsiab lus dav dua, thiab kev txhawb nqa rau ntau dua 140 hom lus. Nyob ntawm koj qhov kev xav tau, koj tuaj yeem xaiv los ntawm ntau qhov qauv ntawm tus qauv xws li 1B txog 27B tsis:

• kwm 3:1b: Lub teeb yuag qauv zoo tagnrho rau cov haujlwm yooj yim thiab cov peev txheej txwv ib puag ncig.
• kwm 3:4b: Ntsuas kev ua tau zoo thiab kev ua haujlwm zoo rau kev siv nruab nrab.
• kwm 3:12b: Pom zoo rau kev tsom xam, kev ua haujlwm thiab kev ua ntau yam lus.
• kwm 3:27b: Qhov kev xaiv muaj zog tshaj plaws, tsim los rau kev siv ntau, kev siv ntau yam nrog lub peev xwm loj.

Muaj peev xwm khiav xws li tus qauv siab heev los ntawm koj lub PC Nws hloov cov kev cai ntawm qhov kev ua si nyob rau hauv cov nqe lus ntawm kev ceev ntiag tug, teb ceev, thiab dependence rau peb tog. Koj tsis tas yuav them nyiaj txhua hli lossis tso koj cov ntaub ntawv. Txhua yam nws yuav siv yog me ntsis kev npaj thiab muaj lub siab xav kawm. Yog tias koj xav paub ntau ntxiv txog cov txiaj ntsig ntawm cov qauv no, mus saib peb tsab xov xwm ntawm qhib qhov hnyav AI qauv.

Kev xaiv 1: Kev teeb tsa nrog Ollama

Ollama yog qhov yooj yim tshaj plaws los khiav LLM zoo li Gemma 3 los ntawm Windows 11. Nws lub davhlau ya nyob twg-raws li interface tso cai rau koj los nruab thiab khiav cov qauv nrog cov kab hais kom yooj yim. Ntxiv rau, nws tau sib xws nrog macOS, Linux, thiab Windows, ua rau nws yooj yim rau siv hauv ntau qhov chaw.

Cov kauj ruam rau nruab Ollama thiab khiav Gemma 3:

1. Nkag mus rau lub vev xaib official: yog ollama.com.
2. Download tau lub installer rau Windows thiab khiav nws zoo li lwm yam kev pab cuam.
3. Qhib Command Prompt (CMD) lossis PowerShell thiab txheeb xyuas qhov kev teeb tsa nrog:

ollama --version

Yog tias txhua yam mus zoo, tam sim no koj tuaj yeem rub tawm ib qho ntawm Gemma 3 templates muaj. Tsuas yog khiav ib qho ntawm cov lus txib no nyob ntawm tus qauv koj xav tau:

ollama run gemma3:1b
ollama run gemma3:4b
ollama run gemma3:12b
ollama run gemma3:27b

Thaum rub tawm, koj tuaj yeem pib tus qauv yooj yim.. Txhawm rau ua qhov no, khiav:

ollama init gemma3

Txij thaum ntawd los, koj tuaj yeem pib cuam tshuam nrog LLM los ntawm:

ollama query gemma3 "¿Cuál es la capital de Japón?"

Yog hais tias koj xav coj kom zoo dua ntawm multimodal functions, koj tuaj yeem siv cov duab hauv koj cov lus nug:

ollama query gemma3 --image "ruta-de-la-imagen.jpg"

Koj xav tau dab tsi los ua kom nws ua haujlwm zoo? Txawm hais tias Ollama tsis ua kom nruj yam tsawg kawg nkaus, cov qauv loj (xws li 27B) yuav tsum muaj tsawg kawg yog 32GB ntawm RAM. Nrog 16GB koj tuaj yeem ua haujlwm yam tsis muaj teeb meem nrog tus qauv 7B, thiab txawm hais tias kev siv GPU tsis tas yuav tsum tau ua, nws yuav pab tau ntau yam ceev.

Kev xaiv 2: Siv LM Studio

LM Studio yog lwm lub cuab yeej pub dawb uas tso cai rau koj los nruab thiab khiav LLM qauv hauv zos los ntawm kev sib cuam tshuam graphical.. Nws yog sib xws nrog Windows, macOS, thiab Linux, thiab nws cov txiaj ntsig zoo yog tias nws tsis tas yuav muaj kev paub txog kev ua haujlwm.

Cov lus qhia:

1. Rub tawm LM Studio los ntawm nws lub vev xaib official: ib lmstudio.
2. Nruab thiab khiav nws.
3. Nyem rau ntawm lub iav tsom iav uas hais tias "Discover."
4. Ntaus "Gemma 3" rau hauv lub tshuab tshawb nrhiav kom pom cov qauv muaj.

Ua ntej txhim kho, xyuas seb tus qauv puas haum rau koj cov khoom siv. Yog tias koj pom cov lus ceeb toom "Zoo heev rau lub tshuab no," koj tseem tuaj yeem nruab nws, tab sis kev ua haujlwm zoo tsis tau lees paub.

Thaum tus qauv sib xws tau rub tawm:

• Nias "Load Model" mus thauj nws.
• Los yog qhib kev sib tham tshiab thiab xaiv tus qauv los ntawm cov ntawv qhia zaub mov nco.

Qhov zoo tshaj plaws ntawm LM Studio yog tias nws ua raws li hom ChatGPT hauv zos, offline thiab hauv koj cov lus. Koj tuaj yeem tsim ntau qhov kev sib tham thiab txuag koj cov kev sib tham yog tias koj xav tau. Tsis tas li ntawd, yog tias koj qhib qhov "Local Server" kev xaiv, koj tuaj yeem ua ke nrog koj cov ntawv thov Python siv OpenAI-tshaj API.

Kev xaiv 3: Siv Google AI Studio (online)

Yog tias koj ua tsis tau lossis tsis xav nruab dab tsi, koj tuaj yeem siv Gemma 3 ncaj qha los ntawm huab nrog Google AI Studio. Tsis tas yuav tsum tau teeb tsa, tab sis yuav tsum muaj kev sib txuas hauv Is Taws Nem thiab Google account.

Koj tsuas yog yuav tsum mus rau aistudio.google.com thiab xaiv "Gemma 3" los ntawm cov npe ntawm cov qauv. Txij thaum ntawd los, koj tuaj yeem pib sib tham nrog tus qauv zoo li nws yog qhov kev tshaj tawm ntawm Bard lossis ChatGPT, suav nrog cov duab nkag.

Kev teeb tsa huab nrog NodeShift (yeem)

Rau cov uas tab tom nrhiav rau ntau lub zog los yog siv cov qauv kev tshaj lij, muaj kev xaiv siv huab huab zoo li NodeShift. Nrog lawv, koj tuaj yeem xauj cov tshuab nrog GPUs muaj zog thiab teeb tsa koj qhov chaw zoo tshaj plaws los khiav Gemma 3 yam tsis muaj kev txwv.

Cov kauj ruam yooj yim hauv NodeShift:

1. Tsim ib tug account thaum app.nodeshift.com.
2. Pib qhov kev cai GPU Node (piv txwv li nrog 2x RTX 4090).
3. Xaiv cov duab preconfigured nrog Ubuntu + Nvidia CUDA lossis Jupyter Notebook, nyob ntawm seb koj yuav siv Ollama lossis Transformers.
4. Txuas ntawm SSH thiab nruab tus qauv los ntawm kab hais kom ua.

Hom kev teeb tsa no muab rau koj nkag mus rau kev teeb tsa kev tshaj lij, zoo tagnrho rau cov qauv kev cob qhia, ntsuas kev ua tau zoo, thiab lwm yam. Txawm hais tias tsis yog qhov tseem ceeb rau cov neeg siv hauv tsev, nws muaj txiaj ntsig zoo rau cov neeg uas xav sim hauv qhov tob lossis tsim cov ntawv thov ntawm LLMs siab heev.

Cov kev xav tau ntawm qhov system thiab cov lus pom zoo

Tsis yog txhua tus qauv Gemma 3 yuav khiav ntawm ib lub PC. Hauv qab no peb tso koj ib qho kev siv dav dav raws li hom qauv:

• Rau Model 1B to 7B: yam tsawg kawg nkaus 8 GB ntawm RAM. Lawv ua haujlwm ntawm yuav luag txhua lub PC niaj hnub, txawm tias tsis muaj GPU.
• Rau 13B model: raug pom zoo 16GB rau 24GB RAM.
• Rau 27B model: xav tau tsawg kawg 32 GB ntawm RAM thiab zoo dua yog lub siab GPU.

Muaj ntau RAM ua kom lub sijhawm ua haujlwm thiab tiv thaiv kev ua yuam kev vim tsis muaj lub cim xeeb. Thaum Ollama thiab LM Studio sim siv cov peev txheej kom muaj txiaj ntsig, nws yuav nyob ntawm ntau yam ntawm koj cov khoom siv. Tsis tas li ntawd, cov lus teb ceev tau zoo dua yog tias GPU siv los ntawm CPU.

Txhim kho Gemma 3 ntawm Windows 11 yooj yim dua li nws zoo li.. Nws tsis muaj teeb meem yog tias koj txiav txim siab siv Ollama rau nws txoj kev yooj yim, LM Studio rau nws cov graphical interface, lossis Google AI Studio ua si nws nyab xeeb hauv huab. Qhov tseem ceeb tshaj plaws yog tias txhua txoj kev hloov mus rau ntau theem ntawm kev paub thiab kev muaj peev xwm. Tam sim no koj paub tag nrho cov kev xaiv thiab dab tsi koj yuav tsum tau pib, koj tuaj yeem pib sim nrog qhov kev txawj ntse zoo nkauj hauv zos niaj hnub no.