E faʻafefea ona taʻavale DeepSeek R1 i luga o lau Raspberry Pi 5 laasaga i lea laasaga

E faʻafefea ona faʻatautaia DeepSeek R1 i luga o lau Rasipi Pi 5? E mafai? Sei o tatou vaai i ai. Talu mai le oʻo mai o faʻataʻitaʻiga faʻapitoa AI, o le toʻatele o tagata fiafia o loʻo sailia ni auala e faʻatautaia ai i latou lava masini. O se tasi o mea sili ona folafola o DeepSeek R1, o se faʻataʻitaʻiga na atiaʻe i Saina ua faʻamaonia e tauva ma OpenAI sili ona maualuga filifiliga. Ae o le fesili tele, o le mea lea.

O le tali vave o le ioe, ae e iai ni tapula'a. I lenei tusiga o le a tatou iloiloina auiliili mea e manaʻomia e faʻatino ai, pe faapefea ona seti y o le a se taunuuga e mafai ona faamoemoeina fa'alagolago i meafaigaluega e maua. O iinei matou te o ai ma le tusiga i luga o le auala e tamoe ai DeepSeek R1 i lau Raspberry Pi 5. Manatua o le faʻaaogaina o le masini suʻesuʻe Tecnobits, o le ae mauaina nisi faʻamatalaga e uiga i Raspberry ma isi meafaigaluega poʻo polokalama.

O le a le DeepSeek R1 ma o le a le mea e fa'apitoa ai?

DeepSeek R1 o se punaoa tatala faʻataʻitaʻiga AI lea na faateia ai le alalafaga faʻafetai i lona lelei y faatinoga. E le pei o le tele o isi faʻataʻitaʻiga, e ofoina atu le avanoa e taʻavale ai i luga o meafaigaluega faʻapitonuʻu, ma avea ai ma se mea manaia i ao fofo pei o ChatGPT.

Ae ui i lea, o le ata sili ona atoatoa, o le DeepSeek R1 671B, e sili atu nai lo 400 GB ma e mana'omia le tele o kata fa'ata'ita'iga maualuga e fa'agasolo lelei. E ui lava e le mafai ona maua le lomiga atoa mo le tele, e iai fa'amama fa'aliliuga e mafai ona tamoʻe i luga o meafaigaluega sili atu ona tauagafau e pei o le Raspberry Pi.

Afai e te fiafia i le lalolagi o Raspberry i totonu Tecnobits E tele a matou faʻamatalaga e uiga i meafaigaluega faʻapitoa. Mo se faʻataʻitaʻiga, matou te avatu ia te oe le tala fou lea matou te talanoa ai Raspberry Pi Pico: o le laupapa fou e tau na o le 4 euros.

Fa'atino DeepSeek R1 i luga ole Raspberry Pi 5

O le Rasipi Pi 5 o le a mini pc malosi fa'atusatusa i ona muamua, ae o lo'o i ai pea ni tapula'a taua pe a o'o mai i le atamai fa'apitoa. Ina ia maua DeepSeek R1 galue i luga o lenei masini, e manaʻomia le faʻaogaina mama moli o le fa'ata'ita'iga.

Tulaga e manaʻomia muamua

• Una Rasipeli Pi 5 ma le itiiti ifo i le 8 GB o le RAM.
• O se microSD card o maualuga le gafatia ma le saoasaoa e teu ai faila talafeagai.
• O se faiga fa'aogaina Linux, pei ole Rasipi Pi Pi poʻo le Ubuntu.
• Feso'ota'iga Initaneti e la'u mai ai faila fa'ata'ita'iga.
• Avanoa i se nofoaga e fa'apipi'i ma fa'agaoioi ai le polokalama talafeagai.

O lea ua i ai mea uma matou te manaʻomia e amata aʻoaʻo ai pe faʻafefea ona taʻavale DeepSeek R1 i lau Raspberry Pi 5.

Fa'apipi'i vaega autu

Ina ia faʻatautaia DeepSeek R1 i luga ole Raspberry Pi, e tatau ona e faʻapipiʻi se seti meafaigaluega autu. I lalo tatou te faʻamatalaina laʻasaga taʻitasi pe faʻafefea ona fai.

1. Fa'apipi'i Llama.cpp

Llama.cpp o se polokalama e mafai ai ona e faʻatautaia faʻataʻitaʻiga AI lelei i luga o masini ma utiuti punaoa. Ina ia faʻapipiʻi, faʻaaoga tulafono nei:

sudo apt update && sudo apt upgrade -y sudo apt fa'apipi'i git cmake fausia-taua -y git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp fai

O lenei faagasologa o le a sii mai ma o le a tuufaatasia le meafaigaluega i lau Rasipi Pi.

2. Si'itia le fa'ata'ita'iga DeepSeek R1 fa'amama

Ina ia mautinoa le faʻatinoina o le faʻatinoga i luga ole Raspberry Pi 5, e fautuaina e faʻaoga le faʻasologa DeepSeek R1 1.5B, e tusa ma le 1 GB le tele.

E mafai ona e siiina mai le Hugging Face ma le poloaiga lenei i le Python:

mai le huggingface_hub import snapshot_download snapshot_download(repo_id='DeepSeek-R1-1.5B', local_dir='DeepSeek-R1')

3. Faʻatulagaina ma faʻagaoioia le server

O le taimi lava e sii mai ai le faʻataʻitaʻiga, o le isi laasaga o le faʻatautaia lea i le Llama.cpp. Fa'aaoga le poloaiga lenei:

./llama-server --model /path_to_your_model/DeepSeek-R1-1.5B.gguf --port 10000 --ctx-size 1024 --n-gpu-layers 40

Afai e lelei mea uma, o le a faʻaoga le server http://127.0.0.1:10000.

4. Fa'atasi ma Open WebUI

Ina ia faafaigofieina le Fegalegaleaiga Faatasi ai ma le faʻataʻitaʻiga, Open WebUI o se faʻataʻitaʻiga faʻataʻitaʻi e mafai ai ona e lafoina fesili ma maua tali e aunoa ma le tusiaina o poloaiga. ma le lima. Ina ia faʻafesoʻotaʻi i le Llama.cpp server, mulimuli i laasaga nei:

1. Tatala Tatala WebUI.
2. Alu ile Fa'atonu> So'oga> OpenAI.
3. Ulufale i le URL http://127.0.0.1:10000 i nofoaga.
4. Faasaoina suiga ma amata faʻaaoga DeepSeek R1 mai le upega tafaʻilagi.

E manino pe faʻafefea ona taʻavale DeepSeek R1 i lau Rasipi Pi 5? E iai isi mea mo oe.

O a ni taunuuga e mafai ona faamoemoeina?

E ui o DeepSeek R1 e mafai ona tamoʻe i luga ole Raspberry Pi 5, e tele faʻamatalaga e mafaufau i ai: tele tapulaʻa:

• O se faatinoga matua faʻatapulaʻa faʻatusatusa i le faʻataʻitaʻiga atoa o le faʻataʻitaʻiga.
• Fausia tusitusiga telegese, aemaise lava i faʻataʻitaʻiga e sili atu nai lo le 7B faʻasologa.
• Tali itiiti le sa'o faʻatusatusa i faʻataʻitaʻiga tetele o loʻo faʻaogaina i luga o meafaigaluega malosi.

I faʻataʻitaʻiga faʻataʻitaʻiga ma faʻasologa eseese o le faʻataʻitaʻiga, na maua ai le faʻasologa 1.5B e sili ona fautuaina mo Raspberry Pi 5, e ui lava o le faatinoga e tauagafau. Ae matou te leʻi faʻamaeʻaina lenei tusiga i le auala e taʻavale ai DeepSeek R1 i luga o lau Raspberry Pi 5 matou te iai se isi mea e taʻu atu ia te oe e uiga i mataupu faʻaoga eseese i faʻataʻitaʻiga mama.

Fa'aoga pusa mo fa'ata'ita'iga mama

E ui lava e le mafai e le Raspberry Pi ona taulimaina faʻataʻitaʻiga tetele, e mafai lava ona aoga faʻasologa faʻasolosolo i lalo vaaiga:

• Fausia tulafono faavae ma fesoasoani numera.
• Otometi i galuega fa'akomepiuta fale.
• Lagolago mo galuega faʻapitoa i faiga faʻapipiʻi.

O le mafai ona faʻataʻitaʻiina faʻataʻitaʻiga faʻataʻitaʻi AI i luga o meafaigaluega taugofie e mautinoa lava o se laʻasaga tele i luma i le lalolagi avanoa. E ui o le Rasipi Pi 5 o le a le ofoina atu se poto masani e faʻatusatusa i se 'auʻaunaga ma le tele o GPU, suʻesuʻeina nei filifiliga e tatalaina ai le fou. avanoa mo tau taugofie. Afai e te manaʻo e faʻataʻitaʻi, mulimuli i laʻasaga i lenei taʻiala ma faʻataʻitaʻi i faʻasologa eseese o le faʻataʻitaʻiga i faatinoga fati i ou manaoga. Matou te faʻamoemoe na e mauaina lenei tusiga ile auala e taʻavale DeepSeek R1 i lau Raspberry Pi 5 fesoasoani.