- SAM 3 nthuav qhia cov duab thiab video segmentation coj los ntawm cov ntawv nyeem thiab pom cov piv txwv, nrog cov lus ntawm ntau lab lub ntsiab lus.
- SAM 3D tso cai rau koj los tsim kho cov khoom, scenes, thiab tib neeg lub cev hauv 3D los ntawm ib daim duab, siv cov qauv qhib.
- Cov qauv tuaj yeem raug sim yam tsis muaj kev paub txog hauv Segment Anything Playground, nrog rau cov qauv siv tau zoo thiab muaj tswv yim.
- Meta tso tawm qhov hnyav, qhov chaw kuaj xyuas, thiab cov qauv ntsuas tshiab kom cov neeg tsim khoom thiab cov kws tshawb fawb hauv Tebchaws Europe thiab lwm lub ntiaj teb tuaj yeem koom ua ke cov peev txheej no rau hauv lawv cov haujlwm.
Meta tau ua lwm kauj ruam hauv nws txoj kev cog lus rau Artificial Intelligence siv rau kev pom hauv computer nrog rau tso tawm SAM 3 thiab SAM 3D, ob tus qauv uas nthuav dav Segment Txhua yam tsev neeg thiab qhov ntawd Lawv tsom los hloov txoj hauv kev uas peb ua haujlwm nrog cov duab thiab yeeb yaj kiabNyob deb ntawm qhov seem ntawm kev sim sim, lub tuam txhab xav kom cov cuab yeej no siv los ntawm ob tus kws tshaj lij thiab cov neeg siv yam tsis muaj keeb kwm yav dhau los.
Nrog rau tiam tshiab no, Meta yog tsom rau txhim kho kev tshawb nrhiav thiab segmentation thiab coj cov peb-dimensional reconstruction rau cov neeg tuaj saib ntauLos ntawm kev kho video rau cov khoom muag pom rau e-lag luam hauv Spain thiab cov teb chaws Europe, lub tuam txhab xav txog qhov xwm txheej uas Tsuas piav qhia txog yam koj xav ua hauv cov lus yog txaus rau AI ua feem ntau ntawm kev nqa hnyav..
SAM 3 muab dab tsi piv rau yav dhau los versions?
SAM 3 yog positioned raws li qhov ncaj qha evolution ntawm cov qauv segmentation uas Meta tau nthuav tawm hauv xyoo 2023 thiab 2024, hu ua SAM 1 thiab SAM 2. Cov qauv thaum ntxov tau tsom mus rau kev txheeb xyuas cov pixels twg los ntawm txhua yam khoom, feem ntau yog siv cov duab pom xws li dots, thawv lossis qhov ncauj qhov ntswg, thiab nyob rau hauv rooj plaub ntawm SAM 2, ua raws cov khoom thoob plaws hauv video yuav luag ntawm lub sijhawm tiag tiag.
Txoj kev loj hlob tshiab tseem ceeb tam sim no yog SAM 3 nkag siab nplua nuj thiab meej cov ntawv qhiatsis yog cov ntawv sau dav dav xwb. Thaum ua ntej cov ntsiab lus yooj yim xws li "tsheb npav" lossis "tsheb npav" tau siv, tus qauv tshiab muaj peev xwm teb tau cov lus piav qhia tshwj xeeb, piv txwv li "daj tsev kawm ntawv tsheb npav" lossis " tsheb liab ob-nres".
Hauv kev xyaum, qhov no txhais tau hais tias nws txaus los sau ib yam dab tsi zoo li “red baseball cap” kom lub kaw lus tuaj yeem nrhiav thiab cais tag nrho cov ntsiab lus uas haum cov lus piav qhia hauv ib daim duab lossis yees duab. Qhov kev muaj peev xwm ua kom zoo dua nrog cov lus no tshwj xeeb tshaj yog muaj txiaj ntsig hauv kws kho cov ntsiab lus, kev tshaj tawm lossis cov ntsiab lus tsom xam, qhov twg koj feem ntau yuav tsum tau saib cov ntsiab lus tshwj xeeb.
Tsis tas li ntawd, SAM 3 tau tsim los ua ke nrog loj multimodal lus qauvQhov no tso cai rau koj mus dhau cov kab lus yooj yim thiab siv cov lus qhia nyuaj xws li: "Tib neeg zaum tab sis tsis hnav lub kaus mom liab" los yog "cov neeg taug kev uas tab tom saib lub koob yees duab tab sis tsis muaj lub hnab ev ntawv." Hom kev qhia no muab cov xwm txheej thiab kev cais tawm uas tsis ntev los no nyuaj rau kev txhais lus rau hauv lub khoos phis tawj pom kev.
Kev ua tau zoo thiab nplai ntawm SAM 3 qauv
Meta kuj xav qhia qhov pom tsawg dua tab sis qhov tseem ceeb: qhov kev ua tau zoo thiab kev txawj ntse ntawm tus qauv. Raws li lub tuam txhab cov ntaub ntawv, SAM 3 muaj peev xwm ua tiav ib daim duab nrog ntau tshaj li ib puas cov khoom kuaj pom nyob rau hauv ib ncig ntawm 30 milliseconds siv H200 GPU, qhov ceev heev ze rau qhov xav tau rau kev xav tau kev ua haujlwm.
Nyob rau hauv cov ntaub ntawv ntawm video, lub tuam txhab paub tseeb tias lub kaw lus tswj kev ua tau zoo zoo li ntawm lub sijhawm thaum ua hauj lwm nrog ib ncig ntawm tsib yam khoom ib txhij, ua rau nws siv tau rau kev taug qab thiab segmenting txav cov ntsiab lus, los ntawm luv luv social media clips mus rau ntau ambition ntau lawm tej yaam num.
Yuav kom ua tiav tus cwj pwm no, Meta tau tsim lub hauv paus kev cob qhia nrog ntau dua 4 lab cov ntsiab lus tshwj xeebKev sib koom ua ke ntawm tib neeg cov neeg sau ntawv nrog AI qauv los pab sau cov ntaub ntawv loj, qhov kev sib xyaw ntawm phau ntawv qhia thiab kev saib xyuas kev siv lub hom phiaj txhawm rau sib npaug qhov raug thiab nplai - qhov tseem ceeb kom ntseeg tau tias tus qauv teb zoo rau ntau yam khoom siv hauv European, Latin American, thiab lwm yam kev lag luam.
Lub tuam txhab tsim SAM 3 hauv qhov nws hu Segment Anything CollectionIb tsev neeg ntawm cov qauv, cov qauv ntsuas, thiab cov peev txheej tsim los nthuav dav AI qhov pom kev nkag siab. Lub community launch yog nrog los ntawm ib tug tshiab benchmark rau "qhib lus" segmentation, tsom rau kev ntsuas qhov twg lub system tuaj yeem nkag siab yuav luag txhua lub tswv yim hais hauv cov lus ntuj.
Kev koom ua ke nrog Edits, Vibes, thiab lwm yam Meta cov cuab yeej
Tshaj li qhov kev tivthaiv, Meta twb tau pib integrate SAM 3 rau hauv cov khoom tshwj xeeb uas yog npaj rau kev siv txhua hnub. Ib qho ntawm thawj qhov chaw yuav yog Edits, lawv cov video tsim thiab kho daim ntawv thov, qhov twg lub tswv yim yog tias tus neeg siv tuaj yeem xaiv cov neeg tshwj xeeb lossis cov khoom siv nrog cov lus piav qhia yooj yim thiab siv cov teebmeem, lim lossis hloov pauv rau cov seem ntawm cov duab.
Lwm txoj hauv kev rau kev sib koom ua ke yuav pom hauv Vibes, hauv Meta AI app thiab meta.ai platformNyob rau hauv ib puag ncig no, cov ntawv segmentation yuav ua ke nrog cov cuab yeej tsim los tsim kho tshiab thiab muaj tswv yim kev paub, xws li kev cai keeb kwm yav dhau los, cov teebmeem kev txav, lossis xaiv cov duab hloov kho uas tsim los rau kev sib raug zoo uas nrov heev hauv Spain thiab cov teb chaws Europe.
Lub tuam txhab cov lus pom zoo yog tias cov peev txheej no tsis txwv rau kev kawm txuj ci, tab sis qhov ncav cuag ... cov neeg tsim kev ywj pheej, cov koom haum me me, thiab cov neeg siv siab heev uas ua haujlwm txhua hnub nrog cov ntsiab lus pom. Lub peev xwm los faib cov scenes los ntawm kev sau cov lus piav qhia hauv cov lus ntuj txo cov kev kawm nkhaus piv rau cov cuab yeej ib txwm siv raws li phau ntawv npog qhov ncauj qhov ntswg thiab txheej.
Tib lub sijhawm, Meta tuav txoj hauv kev qhib rau cov neeg tsim tawm sab nraud, tawm tswv yim tias cov ntawv thov sab nraud -los ntawm kev kho cov cuab yeej mus rau cov kev daws teeb meem rau kev tshuaj ntsuam video hauv khw muag khoom lossis kev ruaj ntseg- tuaj yeem tso siab rau SAM 3 tsuav yog lub tuam txhab txoj cai siv tau hwm.
SAM 3D: Peb-dimensional reconstruction ntawm ib daim duab
Lwm qhov xov xwm loj yog SAM 3Dib qhov system tsim los ua peb-dimensional reconstructions pib los ntawm 2D duab. Hloov chaw ntawm kev xav tau ntau yam kev ntes los ntawm ntau lub kaum ntse ntse, tus qauv tsim kom muaj kev ntseeg siab 3D sawv cev los ntawm ib daim duab, ib yam dab tsi tshwj xeeb tshaj yog rau cov uas tsis muaj cov cuab yeej tshwj xeeb scanning lossis kev ua haujlwm.
SAM 3D muaj ob lub qauv qhib nrog cov haujlwm sib txawv: SAM 3D Objectstsom rau reconstructing khoom thiab scenes, thiab SAM 3D lub cev, npaj rau kev kwv yees tib neeg lub cev thiab lub cev. Qhov kev sib cais no tso cai rau lub kaw lus kom hloov mus rau ntau qhov sib txawv ntawm cov khoom siv, los ntawm cov khoom catalogs mus rau kev noj qab haus huv lossis kev ua kis las.
Raws li Meta, SAM 3D Objects cim a Qhov kev ua tau zoo tshiab hauv AI-tau coj 3D rov tsim khoyooj yim tshaj cov txheej txheem dhau los hauv cov kev ntsuas qhov tseem ceeb. Txhawm rau ntsuas cov txiaj ntsig tau zoo dua, lub tuam txhab tau ua haujlwm nrog cov kws ua yeeb yam los tsim SAM 3D Artist Objects, cov ntaub ntawv tshwj xeeb tsim los ntsuas qhov ncaj ncees thiab nthuav dav ntawm kev tsim kho dua tshiab thoob plaws ntau yam duab thiab cov khoom.
Qhov kev nce qib no qhib qhov rooj rau cov kev siv tswv yim hauv thaj chaw xws li robotics, science, sports medicine, lossis digital creativityPiv txwv li, hauv robotics nws tuaj yeem pab cov tshuab kom nkag siab zoo dua qhov ntim ntawm cov khoom uas lawv cuam tshuam nrog; hauv kev tshawb nrhiav kev kho mob lossis kev ua kis las, nws tuaj yeem pab txheeb xyuas lub cev lub cev thiab kev txav mus los; thiab hauv kev tsim muaj tswv yim, nws ua lub hauv paus rau kev tsim cov qauv 3D rau kev ua yeeb yaj kiab, kev ua yeeb yaj kiab, lossis kev paub dhau los.
Ib qho ntawm thawj daim ntawv thov kev lag luam twb pom lawm yog qhov ua haujlwm “Saib hauv Chav” de Kev Lag Luam Facebookuas tso cai rau koj pom tias yuav ua li cas ib daim ntawm cov rooj tog lossis cov khoom zoo nkauj yuav saib hauv chav tiag tiag ua ntej yuav nws. Nrog SAM 3D, Meta nrhiav kom ua tiav cov hom kev paub no, muaj feem cuam tshuam rau European e-lag luam, qhov twg cov khoom xa rov qab vim qhov kev cia siab tsis txaus ntseeg sawv cev rau tus nqi nce.
Segment Anything Playground: ib puag ncig rau kev sim
Txhawm rau tso cai rau pej xeem sim cov peev txheej no yam tsis tau txhim kho dab tsi, Meta tau qhib lub Segment Anything PlaygroundNws yog lub vev xaib platform uas tso cai rau koj rub tawm cov duab lossis yeeb yaj kiab thiab sim nrog SAM 3 thiab SAM 3D ncaj qha los ntawm koj tus browser. Lub tswv yim yog tias leej twg xav paub txog kev pom AI tuaj yeem tshawb nrhiav qhov ua tau yam tsis muaj kev paub txog kev ua haujlwm.
Nyob rau hauv rooj plaub ntawm SAM 3, Chaw Ua Si tso cai segmenting khoom siv cov lus luv luv lossis cov lus qhia ntxawsMuab cov ntawv nyeem thiab, yog tias xav tau, pom cov piv txwv. Qhov no ua kom yooj yim cov haujlwm xws li xaiv tib neeg, tsheb, tsiaj txhu, lossis cov ntsiab lus tshwj xeeb ntawm qhov chaw thiab siv cov kev ua tshwj xeeb rau lawv, los ntawm kev zoo nkauj rau qhov muag plooj lossis hloov tom qab.
Thaum ua haujlwm nrog SAM 3D, lub platform ua rau nws ua tau Tshawb cov scenes los ntawm cov kev xav tshiabrearrange khoom, siv peb-dimensional teebmeem, los yog tsim lwm yam views. Rau cov neeg uas ua haujlwm hauv kev tsim, tshaj tawm, lossis 3D cov ntsiab lus, nws muaj txoj hauv kev sai rau cov tswv yim qauv yam tsis tas yuav siv cov cuab yeej siv nyuaj los ntawm qhov pib.
Lub Chaw Ua Si kuj suav nrog cov koob Cov qauv npaj siv tau Cov yam ntxwv no yog npaj rau cov haujlwm tshwj xeeb. Lawv suav nrog cov kev xaiv ua tau zoo xws li lub ntsej muag pixelating lossis daim ntawv tso cai rau kev ceev ntiag tug, thiab cov teebmeem pom kev zoo li kev taug kev, xaiv qhov tseem ceeb, lossis tsom teeb ntawm thaj chaw nyiam hauv video. Cov kev ua haujlwm no tuaj yeem yog qhov tshwj xeeb zoo rau kev ua haujlwm ntawm cov xov xwm digital thiab cov neeg tsim cov ntsiab lus hauv Spain, qhov chaw tsim cov yeeb yaj kiab luv luv thiab cov ntsiab lus hauv social media yog tas li.
Qhib cov peev txheej rau cov tsim tawm thiab cov kws tshawb fawb
Raws li lub tswv yim Meta tau ua raws li hauv lwm qhov kev tshaj tawm AI, lub tuam txhab tau txiav txim siab tso tawm ib feem tseem ceeb ntawm kev pab cuam cuam tshuam nrog SAM 3 thiab SAM 3DRau thawj zaug, tus qauv hnyav, tus qauv ntsuas tshiab tsom rau kev qhib cov lus ntu ntu, thiab cov ntaub ntawv qhia txog kev txhim kho tau raug tshaj tawm rau pej xeem.
Nyob rau hauv rooj plaub ntawm SAM 3D, cov hauv qab no muaj: qauv checkpoints, inference code, thiab cov ntaub ntawv ntsuam xyuas tiam tom ntej. Cov ntaub ntawv no suav nrog ntau yam duab thiab cov khoom siv uas lub hom phiaj mus dhau cov ntsiab lus siv 3D ib txwm muaj, muab ntau dua qhov tseeb thiab qhov nyuaj, ib yam uas tuaj yeem pab tau zoo rau cov pab pawg tshawb fawb European ua haujlwm hauv computer pom thiab duab.
Meta kuj tau tshaj tawm kev koom tes nrog annotation platforms zoo li Roboflow, nrog rau lub hom phiaj ntawm kev ua kom cov neeg tsim khoom thiab cov tuam txhab ua haujlwm. Sau koj tus kheej cov ntaub ntawv thiab kho SAM 3 rau cov kev xav tau tshwj xeeb. Qhov no qhib qhov rooj rau cov kev daws teeb meem tshwj xeeb, los ntawm kev tshuaj xyuas kev lag luam mus rau kev tsom xam tsheb hauv nroog, suav nrog cov cuab yeej cuab tam cov cuab yeej cuab tam uas nws yog ib qho tseem ceeb kom raug ntu ntu ntu vaj tsev lossis kos duab.
Los ntawm kev xaiv rau txoj hauv kev qhib, lub tuam txhab nrhiav kom paub tseeb tias tus tsim tawm ecosystem, universities thiab startups -xws li cov kev khiav haujlwm hauv Spain thiab lwm cov teb chaws Europe- tuaj yeem sim nrog cov thev naus laus zis no, sib koom ua ke rau hauv lawv tus kheej cov khoom thiab, thaum kawg, pab txhawb kev siv cov teeb meem uas mus dhau qhov uas Meta tuaj yeem txhim kho sab hauv.
Nrog SAM 3 thiab SAM 3D, Meta lub hom phiaj los sib sau ua ke a hloov tau yooj yim dua thiab siv tau pom AI platformqhov twg cov ntawv qhia segmentation thiab 3D rov tsim dua los ntawm ib daim duab tsis muaj peev xwm tshwj tseg rau cov pab pawg tshwj xeeb. Qhov muaj peev xwm cuam tshuam txuas ntxiv los ntawm kev kho video niaj hnub mus rau cov ntawv thov hauv kev tshawb fawb, kev lag luam, thiab kev lag luam e-lag luam, nyob rau hauv cov ntsiab lus uas kev sib xyaw ntawm cov lus, lub zeem muag hauv computer, thiab kev muaj tswv yim tau dhau los ua cov cuab yeej ua haujlwm thiab tsis yog kev cog lus thev naus laus zis xwb.
Kuv yog ib tus neeg nyiam siv thev naus laus zis uas tau hloov nws txoj kev nyiam "geek" rau hauv txoj haujlwm. Kuv tau siv ntau tshaj 10 xyoo ntawm kuv lub neej siv cov cuab yeej siv thev naus laus zis thiab tinkering nrog txhua yam kev pab cuam tawm ntawm kev xav paub dawb huv. Tam sim no kuv tau tshwj xeeb hauv computer technology thiab video games. Qhov no yog vim ntau tshaj 5 xyoo kuv tau sau rau ntau lub vev xaib ntawm kev siv tshuab thiab kev ua si video, tsim cov ntawv uas nrhiav kom muab cov ntaub ntawv koj xav tau hauv hom lus uas txhua tus neeg nkag siab.
Yog tias koj muaj lus nug, kuv qhov kev paub yog los ntawm txhua yam ntsig txog Windows operating system nrog rau Android rau cov xov tooj ntawm tes. Thiab kuv txoj kev cog lus yog rau koj, Kuv ib txwm kam siv ob peb feeb thiab pab koj daws cov lus nug uas koj muaj nyob hauv lub ntiaj teb no hauv internet.