Texas Instruments AM6x Tsim Ntau Lub Koob Yees Duab

Specifications

• Khoom npe: AM6x tsev neeg ntawm cov khoom siv
• Txhawb Lub Koob Yees Duab: AM62A (Nrog lossis tsis muaj ISP built-in), AM62P (Nrog Built-in ISP)
• Lub koob yees duab tso zis cov ntaub ntawv: AM62A (Raw/YUV/RGB), AM62P (YUV/RGB)
• ISP HWA: AM62A (Yog), AM62P (Tsis yog)
• Deep Learning HWA: AM62A (Yog), AM62P (Tsis yog)
• 3-D Graphics HWA: AM62A (No), AM62P (Yog)

Taw qhia rau Kev Siv Ntau Lub Koob Yees Duab ntawm AM6x:

• Embedded koob yees duab ua lub luag haujlwm tseem ceeb hauv cov tshuab pom kev niaj hnub.
• Kev siv ntau lub koob yees duab hauv ib lub kaw lus txhim kho lub peev xwm thiab ua kom cov haujlwm tsis tuaj yeem ua tiav nrog ib lub koob yees duab.

Daim ntawv thov siv ntau lub koob yees duab:

• Kev soj ntsuam kev ruaj ntseg: Txhim kho qhov kev soj ntsuam, kev taug qab cov khoom, thiab kev lees paub qhov tseeb.
• Ib puag ncig View: Ua kom pom lub suab tso suab rau cov haujlwm xws li kev kuaj pom kev teeb meem thiab kev tswj cov khoom.
• Cabin Recorder thiab Yees Duab Daim iav System: Muab kev pab txuas ntxiv thiab tshem tawm qhov muag tsis pom kev.
• Cov duab kho mob: Muab kev txhim kho precision hauv kev phais navigation thiab endoscopy.
• Drones thiab Aerial Imaging: Khaws cov duab siab daws teeb meem los ntawm ntau lub ces kaum rau ntau yam kev siv.

Txuas Ntau CSI-2 Lub Koob Yees Duab rau SoC:
Txhawm rau txuas ntau lub koob yees duab CSI-2 rau SoC, ua raws li cov lus qhia hauv cov neeg siv phau ntawv. Xyuas kom muaj kev sib raug zoo thiab kev sib txuas ntawm txhua lub koob yees duab rau cov chaw nres nkoj uas tau xaiv ntawm SoC.

Daim ntawv thov
Tsim ntau daim ntawv thov lub koob yees duab ntawm AM6x

Jianzhong Xu, Qutaiba Saleh

TSAB NTAWV
Daim ntawv tshaj tawm no piav qhia txog kev txhim kho daim ntawv thov siv ntau lub koob yees duab CSI-2 ntawm AM6x tsev neeg ntawm cov khoom siv. Ib qho kev tsim qauv ntawm kev tshawb pom cov khoom nrog kev kawm tob ntawm 4 lub koob yees duab ntawm AM62A SoC tau nthuav tawm nrog kev ntsuas kev ua tau zoo. Cov ntsiab cai dav dav ntawm kev tsim siv rau lwm yam SoCs nrog CSI-2 interface, xws li AM62x thiab AM62P.

Taw qhia

Embedded koob yees duab ua lub luag haujlwm tseem ceeb hauv cov tshuab pom kev niaj hnub. Siv ntau lub koob yees duab hauv ib lub kaw lus nthuav dav lub peev xwm ntawm cov tshuab no thiab ua kom muaj peev xwm ua tsis tau nrog ib lub koob yees duab. Hauv qab no yog ib co examples ntawm daim ntawv thov siv ntau lub koob yees duab embedded:

• Kev Saib Xyuas Kev Ruaj Ntseg: Ntau lub koob yees duab tso tawm tswv yim muab kev saib xyuas dav dav. Lawv pab panoramic views, txo qhov muag tsis pom kev, thiab txhim kho qhov tseeb ntawm cov khoom taug qab thiab kev paub, txhim kho kev ntsuas kev nyab xeeb tag nrho.
• Ib puag ncig View: Ntau lub koob yees duab yog siv los tsim lub tso suab pom kev teeb tsa, ua kom cov ntaub ntawv peb sab thiab kev kwv yees qhov tob. Qhov no yog qhov tseem ceeb rau cov dej num xws li kev tshawb nrhiav teeb meem hauv cov tsheb uas tsis muaj kev tswj hwm, kev tswj cov khoom siv hauv cov neeg hlau, thiab txhim kho qhov tseeb ntawm kev paub txog kev muaj tiag.
• Cabin Recorder thiab Camera Mirror System: Lub tsheb cabin recorder nrog ntau lub koob yees duab tuaj yeem muab kev pab them nqi ntau dua siv ib lub processor. Ib yam li ntawd, lub koob yees duab daim iav system nrog ob lossis ntau lub koob yees duab tuaj yeem nthuav dav tus neeg tsav tsheb qhov chaw view thiab tshem tawm qhov muag tsis pom ntawm txhua sab ntawm lub tsheb.
• Kev Kho Mob Imaging: Ntau lub koob yees duab tuaj yeem siv rau hauv kev kho mob rau kev ua haujlwm xws li kev phais navigation, muab cov kws phais nrog ntau qhov kev xav rau kev txhim kho qhov tseeb. Hauv kev endoscopy, ntau lub koob yees duab ua kom muaj kev ntsuam xyuas tag nrho ntawm lub cev.
• Drones thiab Aerial Imaging: Drones feem ntau tuaj nrog ntau lub koob yees duab los ntes cov duab lossis cov yeeb yaj kiab los ntawm ntau lub kaum ntse ntse. Qhov no muaj txiaj ntsig zoo hauv cov ntawv thov xws li kev yees duab saum huab cua, saib xyuas kev ua liaj ua teb, thiab kev soj ntsuam av.
• Nrog rau kev nce qib ntawm microprocessors, ntau lub koob yees duab tuaj yeem muab tso rau hauv ib qho System-on-Chip.
  (SoC) los muab cov kev daws teeb meem zoo thiab muaj txiaj ntsig. AM62Ax SoC, nrog rau kev ua yeeb yaj kiab / pom kev ua haujlwm siab thiab kev kawm sib sib zog nqus nrawm, yog ib qho khoom siv zoo tshaj plaws rau kev siv cov lus hais saum toj no. Lwm lub AM6x ntaus ntawv, AM62P, yog tsim rau kev ua haujlwm siab embedded 3D zaub daim ntaub ntawv. Nruab nrog 3D graphics acceleration, AM62P tuaj yeem yooj yim stitch ua ke cov duab los ntawm ntau lub koob yees duab thiab tsim kom muaj kev daws teeb meem panoramic. view. Cov yam ntxwv tshiab ntawm AM62A / AM62P SoC tau nthuav tawm hauv ntau cov ntawv tshaj tawm, xws li [4], [5], [6], thiab lwm yam. Daim ntawv thov no yuav tsis rov hais dua cov lus piav qhia no tab sis tsis yog tsom rau kev sib koom ua ke ntau lub koob yees duab CSI-2 rau hauv daim ntawv thov kev pom ntawm AM62A / AM62P.
• Table 1-1 qhia txog qhov sib txawv tseem ceeb ntawm AM62A thiab AM62P kom deb li deb tau hais txog kev ua cov duab.

Table 1-1. Qhov sib txawv ntawm AM62A thiab AM62P hauv Kev Ua Duab

SoC	AWM 62 A	AM62 P
Txhawb Lub Koob Yees Duab Hom	Nrog lossis tsis muaj ISP built-in	Nrog Built-in ISP
Lub koob yees duab tso zis cov ntaub ntawv	Raw/YUV/RGB	YUV/RGB
ISP HWM	Yog lawm	Tsis muaj
Deep Learning HWA	Yog lawm	Tsis muaj
3-D Graphics HWA	Tsis muaj	Yog lawm

Txuas Ntau CSI-2 Lub Koob Yees Duab rau SoC
Lub Koob Yees Duab Subsystem ntawm AM6x SoC muaj cov khoom nram qab no, raws li pom hauv daim duab 2-1:

• MIPI D-PHY Receiver: tau txais cov kwj video los ntawm cov koob yees duab sab nraud, txhawb nqa txog li 1.5 Gbps rau ib txoj kab cov ntaub ntawv rau 4 kab.
• CSI-2 Receiver (RX): tau txais cov kwj video los ntawm D-PHY txais thiab xa ncaj qha xa cov kwj mus rau ISP lossis muab cov ntaub ntawv pov tseg rau DDR nco. Cov qauv no txhawb nqa txog li 16 lub vev xaib virtual.
• SHIM: DMA wrapper uas tso cai rau xa cov kwj ntws mus rau lub cim xeeb ntawm DMA. Ntau lub ntsiab lus DMA tuaj yeem tsim los ntawm cov ntaub qhwv no, nrog rau txhua lub ntsiab lus sib raug rau ib qho chaw virtual ntawm CSI-2 Receiver.

Ntau lub koob yees duab tuaj yeem txhawb nqa ntawm AM6x los ntawm kev siv cov channel virtual ntawm CSI-2 RX, txawm tias tsuas muaj ib qho CSI-2 RX interface ntawm SoC. Ib qho kev sib txuas sab nraud CSI-2 yog xav tau los ua ke ntau lub koob yees duab ntws thiab xa mus rau ib qho SoC. Ob hom CSI-2 aggregating kev daws teeb meem tuaj yeem siv tau, piav qhia hauv ntu hauv qab no.

CSI-2 Aggregator Siv SerDes
Ib txoj hauv kev ntawm kev sib txuas ntau lub koob yees duab ntws yog siv cov tshuaj serializing thiab deserializing (SerDes). CSI-2 cov ntaub ntawv los ntawm txhua lub koob yees duab yog hloov dua siab tshiab los ntawm ib tug serializer thiab kis los ntawm ib tug cable. Lub deserializer tau txais tag nrho cov ntaub ntawv serialized pauv los ntawm cov cables (ib cable ib lub koob yees duab), hloov cov kwj rov qab mus rau CSI-2 cov ntaub ntawv, thiab tom qab ntawd xa tawm cov kwj deg CSI-2 mus rau ib qho CSI-2 RX interface ntawm SoC. Txhua lub koob yees duab ntws tau txheeb xyuas los ntawm ib qho tshwj xeeb virtual channel. Qhov kev daws teeb meem no muab cov txiaj ntsig ntxiv ntawm kev tso cai rau kev sib txuas ntev txog li 15m los ntawm cov koob yees duab mus rau SoC.

FPD-Txuas lossis V3-Link serializers thiab deserializers (SerDes), txhawb nqa hauv AM6x Linux SDK, yog cov thev naus laus zis nrov tshaj plaws rau hom CSI-2 aggregating tov. Ob lub FPD-Txuas thiab V3-Txuas deserializers muaj cov kab rov qab uas tuaj yeem siv los xa cov cim synchronization rau synchronize tag nrho cov koob yees duab, raws li tau piav qhia hauv [7].
Daim duab 2-2 qhia ib qho example ntawm kev siv SerDes los txuas ntau lub koob yees duab rau ib leeg AM6x SoC.

Ib example ntawm qhov kev daws teeb meem no tuaj yeem pom hauv Arducam V3Link Lub Koob Yees Duab Cov Khoom Siv. Cov khoom siv no muaj deserializer hub uas sib sau ua ke 4 CSI-2 lub koob yees duab ntws, nrog rau 4 khub ntawm V3link serializers thiab IMX219 lub koob yees duab, suav nrog FAKRA coaxial cables thiab 22-pin FPC cables. Cov qauv siv los tham tom qab yog tsim los ntawm cov khoom siv no.

CSI-2 Aggregator tsis siv SerDes
Hom aggregator no tuaj yeem cuam tshuam ncaj qha nrog ntau lub koob yees duab MIPI CSI-2 thiab sib sau cov ntaub ntawv los ntawm txhua lub koob yees duab mus rau ib qho CSI-2 tso zis kwj.

Daim duab 2-3 qhia ib qho example ntawm qhov system. Hom kev sib sau ua ke no tsis siv cov serializer / deserializer tab sis raug txwv los ntawm qhov siab tshaj plaws ntawm CSI-2 cov ntaub ntawv hloov chaw, uas yog mus txog 30cm. AM6x Linux SDK tsis txhawb hom CSI-2 aggregator

Enabling Ntau Lub Koob Yees Duab hauv Software

Lub Koob Yees Duab Subsystem Software Architecture
Daim duab 3-1 qhia txog qib siab thaiv daim duab ntawm lub koob yees duab capture system software hauv AM62A/AM62P Linux SDK, sib xws rau HW system hauv daim duab 2-2.

• Qhov software architecture no ua rau SoC tau txais ntau lub koob yees duab ntws nrog kev siv SerDes, raws li pom hauv daim duab 2-2. FPD-Txuas / V3-Txuas SerDes muab qhov tshwj xeeb I2C chaw nyob thiab cov channel virtual rau txhua lub koob yees duab. Ib qho cuab yeej tshwj xeeb ntoo overlay yuav tsum tau tsim nrog qhov tshwj xeeb I2C chaw nyob rau txhua lub koob yees duab. Tus tsav tsheb CSI-2 RX lees paub txhua lub koob yees duab siv tus lej cim virtual channel thiab tsim cov ntsiab lus DMA rau ib lub koob yees duab kwj. Ib qho video node yog tsim rau txhua lub ntsiab lus DMA. Cov ntaub ntawv los ntawm txhua lub koob yees duab tau txais thiab khaws cia siv DMA rau lub cim xeeb raws li. Cov neeg siv qhov chaw thov siv cov video nodes sib thooj rau txhua lub koob yees duab kom nkag mus rau lub koob yees duab cov ntaub ntawv. Examples ntawm kev siv cov software architecture no tau muab rau hauv Tshooj 4 - Kev Tsim Qauv Siv.
• Txhua tus neeg tsav tsheb tshwj xeeb uas tau ua raws li V4L2 lub moj khaum tuaj yeem ntsaws thiab ua si hauv cov qauv no. Xa mus rau [8] hais txog yuav ua li cas koom ua ke tus tsav tsheb tshiab rau hauv Linux SDK.

Duab Pipeline Software Architecture

• AM6x Linux SDK muab GStreamer (GST) lub moj khaum, uas tuaj yeem siv rau hauv qhov chaw ser los ua ke cov duab ua cov khoom siv rau ntau yam kev siv. Hardware Accelerators (HWA) ntawm SoC, xws li Vision Pre-processing Accelerator (VPAC) lossis ISP, video encoder / decoder, thiab kev kawm sib sib zog nqus tshuab, tau nkag los ntawm GST plugins. Lub VPAC (ISP) nws tus kheej muaj ntau qhov thaiv, suav nrog Lub Zeem Muag Kev Pom Zoo Sub-System (VISS), Lens Distortion Correction (LDC), thiab Multiscalar (MSC), txhua qhov sib xws rau GST plugin.
• Daim duab 3-2 qhia txog daim duab thaiv ntawm cov duab kos duab los ntawm lub koob yees duab mus rau encoding lossis sib sib zog nqus
  Cov ntawv thov kev kawm ntawm AM62A. Yog xav paub ntxiv txog cov ntaub ntawv kawg-rau-kawg, xa mus rau EdgeAI SDK cov ntaub ntawv.

Rau AM62P, cov duab pipeline yooj yim dua vim tias tsis muaj ISP ntawm AM62P.

Nrog rau qhov video node tsim rau txhua lub koob yees duab, GStreamer-raws li cov duab kav dej tso cai rau kev ua haujlwm ntawm ntau lub koob yees duab inputs (txuas los ntawm tib lub CSI-2 RX interface) ib txhij. Ib qho qauv siv siv GStreamer rau kev siv ntau lub koob yees duab tau muab rau hauv tshooj tom ntej.

Kev Tsim Qauv

Tshooj lus no nthuav tawm cov qauv siv ntawm kev siv ntau lub koob yees duab ntawm AM62A EVM, siv Arducam V3Link Lub Koob Yees Duab Cov Khoom Siv los txuas 4 CSI-2 lub koob yees duab rau AM62A thiab khiav cov khoom tshawb nrhiav rau tag nrho 4 lub koob yees duab.

Txhawb koob yees duab
Cov khoom siv Arducam V3Link ua haujlwm nrog ob lub koob yees duab FPD-Link / V3-Link-based thiab Raspberry Pi-tshaj CSI-2 koob yees duab. Cov koob yees duab hauv qab no tau sim:

• D3 Engineering D3RCM-IMX390-953
• Leopard Imaging LI-OV2312-FPDLINKIII-110H
• IMX219 koob yees duab hauv Arducam V3Link Lub Koob Yees Duab Cov Khoom Siv

Teeb tsa Plaub IMX219 Lub Koob Yees Duab
Ua raws li cov lus qhia hauv AM62A Starter Kit EVM Quick Start Guide los teeb tsa SK-AM62A-LP EVM (AM62A SK) thiab ArduCam V3Link Lub Koob Yees Duab Solution Quick Start Guide kom txuas cov koob yees duab rau AM62A SK los ntawm cov khoom siv V3Link. Xyuas kom tseeb tias cov pins ntawm flex cables, koob yees duab, V3Link board, thiab AM62A SK yog txhua yam ua kom zoo.

Daim duab 4-1 qhia txog kev teeb tsa siv rau cov qauv siv hauv daim ntawv qhia no. Cov khoom tseem ceeb hauv kev teeb tsa muaj xws li:

• 1X SK-AM62A-LP EVM board
• 1X Arducam V3Link d-ch adapter board
• FPC cable txuas Arducam V3Link rau SK-AM62A
• 4X V3Link lub koob yees duab adapters (serializers)
• 4X RF coaxial cables txuas V3Link serializers rau V3Link d-ch cov khoom siv
• 4X IMX219 koob yees duab
• 4X CSI-2 22-pin cables txuas lub koob yees duab rau serializers
• Cables: HDMI cable, USB-C rau lub zog SK-AM62A-LP thiab 12V lub zog los ntawm V3Link d-ch cov khoom siv)
• Lwm yam khoom tsis muaj nyob hauv daim duab 4-1: micro-SD daim npav, micro-USB cable nkag mus rau SK-AM62A-LP, thiab Ethernet rau streaming

Configuring Cameras thiab CSI-2 RX Interface
Teem lub software raws li cov lus qhia hauv Arducam V3Link Quick Start Guide. Tom qab khiav lub koob yees duab teeb tsab ntawv, teeb-imx219.sh, lub koob yees duab hom, CSI-2 RX interface hom, thiab cov kev los ntawm txhua lub koob yees duab mus rau qhov sib txuas video node yuav raug teeb tsa kom raug. Plaub lub koob yees duab yog tsim rau plaub lub koob yees duab IMX219. Hais kom "v4l2-ctl -list-devices" qhia tag nrho cov V4L2 video li, raws li qhia hauv qab no:

Muaj 6 qhov video nodes thiab 1 media node nyob rau hauv tiscsi2rx. Txhua qhov video no sib haum rau DMA cov ntsiab lus faib los ntawm CSI2 RX tsav tsheb. Tawm ntawm 6 lub koob yees duab, 4 yog siv rau 4 lub koob yees duab IMX219, raws li qhia hauv cov yeeb nkab xov xwm hauv qab no:

Raws li qhia saum toj no, media entity 30102000.ticsi2rx muaj 6 qhov ntaub qhwv, tab sis tsuas yog thawj 4 tau siv, txhua qhov rau ib qho IMX219. Cov yeeb nkab xov xwm topology kuj tuaj yeem ua duab kos duab. Khiav cov lus txib hauv qab no los tsim ib qho chaw file:

Tom qab ntawd khiav cov lus txib hauv qab no ntawm Linux host PC los tsim PNG file:

Daim duab 4-2 yog ib daim duab uas tsim los siv cov lus txib saum toj no. Cov khoom hauv software architecture ntawm daim duab 3-1 tuaj yeem pom hauv daim duab no.

Streaming los ntawm Plaub Lub Koob Yees Duab
Nrog rau ob qho tib si kho vajtse thiab software tau teeb tsa kom zoo, ntau daim ntawv thov lub koob yees duab tuaj yeem khiav ntawm tus neeg siv qhov chaw. Rau AM62A, ISP yuav tsum tau kho kom tsim tau cov duab zoo. Xa mus rau AM6xA ISP Tuning Guide rau yuav ua li cas ua ISP tuning. Cov ntu hauv qab no nthuav tawm examples ntawm streaming koob yees duab cov ntaub ntawv rau ib qho screen, streaming koob yees duab cov ntaub ntawv mus rau ib tug network, thiab khaws cia cov ntaub ntawv lub koob yees duab rau files.

Streaming Lub koob yees duab cov ntaub ntawv los tso saib
Ib qho yooj yim daim ntawv thov ntawm no ntau lub koob yees duab system yog kwj cov yeeb yaj duab los ntawm txhua lub koob yees duab mus rau ib tug zaub txuas nrog tib SoC. Hauv qab no yog GStreamer pipeline example ntawm streaming plaub IMX219 rau ib qho zaub (cov video node naj npawb thiab v4l-subdev tooj nyob rau hauv lub raj xa dej yuav zoo li hloov ntawm reboot rau reboot).

Streaming Lub koob yees duab cov ntaub ntawv los ntawm Ethernet
Hloov chaw streaming mus rau ib qho zaub txuas nrog tib SoC, cov ntaub ntawv lub koob yees duab kuj tuaj yeem xa tawm los ntawm Ethernet. Sab tau txais tuaj yeem yog lwm tus AM62A / AM62P processor lossis host PC. Hauv qab no yog ib qho example ntawm streaming lub koob yees duab cov ntaub ntawv los ntawm Ethernet (siv ob lub koob yees duab rau simplicity) (nco ntsoov lub encoder plugin siv nyob rau hauv lub pipeline):

Hauv qab no yog ib qho example ntawm tau txais lub koob yees duab cov ntaub ntawv thiab streaming rau ib qho screen ntawm lwm AM62A / AM62P processor:

Khaws cov ntaub ntawv lub koob yees duab rau Files
Es tsis txhob streaming rau ib qho screen lossis los ntawm lub network, cov ntaub ntawv lub koob yees duab tuaj yeem khaws cia hauv zos files. Cov raj xa dej hauv qab no khaws txhua lub koob yees duab cov ntaub ntawv rau a file (siv ob lub koob yees duab ua tus example for simplicity).

Multicamera Deep Learning Inference

AM62A tau nruab nrog lub ntsuas kev sib sib zog nqus (C7x-MMA) nrog txog li ob lub TOPS, uas muaj peev xwm khiav ntau hom kev kawm sib sib zog nqus rau kev faib tawm, tshawb pom cov khoom, ntu ntu, thiab ntau dua. Ntu no qhia tau hais tias yuav ua li cas AM62A ib txhij khiav plaub tus qauv kev kawm sib sib zog nqus ntawm plaub lub koob yees duab sib txawv.

Kev xaiv qauv
TI's EdgeAI-ModelZoo muab ntau pua tus qauv ntawm lub xeev-ntawm-tus-kos duab, uas tau hloov pauv / xa tawm los ntawm lawv cov kev cob qhia thawj zaug rau ib qho kev sib koom ua ke-phooj ywg kom lawv tuaj yeem tawm mus rau C7x-MMA sib sib zog nqus kev kawm accelerator. Huab-based Edge AI Studio Model Analyzer muab qhov yooj yim-rau-siv "Kev Xaiv Qauv" cuab yeej. Nws tau hloov kho tshiab kom suav nrog txhua tus qauv txhawb nqa hauv TI EdgeAI-ModelZoo. Cov cuab yeej yuav tsum tsis muaj kev paub dhau los thiab muab qhov yooj yim-rau-siv interface nkag mus rau cov yam ntxwv xav tau hauv cov qauv xav tau.

TFL-OD-2000-ssd-mobV1-coco-mlperf tau raug xaiv rau qhov kev sim ntau lub koob yees duab sib sib zog nqus. Cov qauv kev tshawb nrhiav ntau yam khoom no yog tsim nyob rau hauv TensorFlow lub moj khaum nrog 300 × 300 input daws teeb meem. Table 4-1 qhia txog cov yam ntxwv tseem ceeb ntawm cov qauv no thaum kawm ntawm cCOCO dataset nrog txog 80 chav sib txawv.

Table 4-1. Lub ntsiab nta ntawm tus qauv TFL-OD-2000-ssd-mobV1-coco-mlperf.

Qauv	Ua haujlwm	Kev daws teeb meem	FPS	MAP 50% Qhov tseeb ntawm COCO	Latency / Ncej (ms)	DDR BW Kev siv (MB / Frame)
TFL-OD-2000-ssd- mobV1-coco-mlperf	Kev Tshawb Nrhiav Ntau Yam	300 × 300 hli	~ 152	15.9	6.5	18.839

Kev teeb tsa kav dej
Daim duab 4-3 qhia txog 4-lub koob yees duab sib sib zog nqus kawm GStreamer pipeline. TI muab cov suite ntawm GStreamer plugins uas tso cai rau offloading ib co ntawm cov xov xwm ua thiab cov kev kawm tob inference rau lub hardware accelerators. Ib co examples cov plugins suav nrog tiovxisp, tiovxmultiscaler, tiovxmosaic, thiab tidlinferer. Cov kav dej hauv daim duab 4-3 suav nrog txhua qhov yuav tsum tau ua plugins rau ib tug multipath GStreamer pipeline rau 4-lub koob yees duab inputs, txhua tus nrog media preprocess, sib sib zog nqus kawm inference, thiab postprocess. Cov duplicated plugins rau txhua qhov ntawm lub koob yees duab txoj hauv kev tau muab tso rau hauv daim duab kom yooj yim ua qauv qhia.
Cov khoom siv kho vajtse muaj nyob sib npaug ntawm plaub lub koob yees duab txoj hauv kev. Piv txwv li, AM62A muaj ob daim duab multiscalers: MSC0 thiab MSC1. Lub raj xa dej qhia meej meej rau MSC0 ua cov koob yees duab 1 thiab lub koob yees duab 2 txoj hauv kev, thaum MSC1 mob siab rau lub koob yees duab 3 thiab lub koob yees duab 4.

Cov zis ntawm plaub lub koob yees duab pipelines yog scaled down thiab concatenated ua ke siv tiovxmosaic plugin. Cov zis yog tso tawm kom pom ntawm ib qho screen. Daim duab 4-4 qhia cov zis ntawm plaub lub koob yees duab nrog cov qauv kev kawm sib sib zog nqus uas khiav cov khoom tshawb pom. Txhua lub raj xa dej (lub koob yees duab) khiav ntawm 30 FPS thiab tag nrho ntawm 120 FPS.

Tom ntej no yog tag nrho cov ntawv xa mus rau multicamera sib sib zog nqus kev kawm siv rooj plaub qhia hauv daim duab 4-3.

Kev Ntsuam Xyuas Kev Ua Haujlwm

Kev teeb tsa nrog plaub lub koob yees duab siv V3Link pawg thawj coj saib thiab AM62A SK tau sim hauv ntau yam kev thov, suav nrog kev tso ncaj qha rau ntawm lub vijtsam, streaming hla Ethernet (plaub UDP channel), kaw rau 4 cais. files, thiab nrog kev kawm tob tob. Hauv txhua qhov kev sim, peb tau saib xyuas tus ncej tus nqi thiab kev siv ntawm CPU cores los tshawb txog tag nrho lub cev muaj peev xwm.

Raws li yav dhau los tau pom hauv daim duab 4-4, txoj kev kawm sib sib zog nqus siv lub tiperfoverlay GStreamer plugin los qhia CPU core loads raws li daim duab qhia hauv qab ntawm qhov screen. Los ntawm lub neej ntawd, daim duab tau hloov kho txhua ob lub vib nas this los qhia cov loads raws li kev siv percentage. Ntxiv rau qhov tiperfoverlay GStreamer plugin, cov cuab yeej perf_stats yog qhov kev xaiv thib ob los qhia cov tub ntxhais kawm ncaj qha rau ntawm lub davhlau ya nyob twg nrog kev xaiv rau kev txuag rau ib qho. file. Cov cuab yeej no yog qhov tseeb dua piv rau tTiperfoverlayas tom kawg ntxiv cov load ntxiv ntawm theARMm cores thiab DDR los kos daim duab thiab muab nws tso rau ntawm qhov screen. Cov cuab yeej perf_stats feem ntau yog siv los sau cov txiaj ntsig siv kho vajtse hauv txhua qhov kev sim ntsuas pom hauv daim ntawv no. Qee qhov tseem ceeb ua cov cores thiab accelerators tau kawm hauv cov kev xeem no suav nrog cov txheej txheem tseem ceeb (plaub A53 Arm cores @ 1.25GHz), kev kawm tob (C7x-MMA @ 850MHz), VPAC (ISP) nrog VISS thiab multiscalers (MSC0 thiab MSC1), thiab DDR kev ua haujlwm.

Table 5-1 qhia txog kev ua tau zoo thiab kev siv cov peev txheej thaum siv AM62A nrog plaub lub koob yees duab rau peb qhov kev siv, suav nrog streaming plaub lub koob yees duab rau ib qho zaub, streaming dhau Ethernet, thiab kaw rau plaub cais. files. Ob qhov kev ntsuam xyuas tau ua tiav hauv txhua qhov kev siv: nrog lub koob yees duab nkaus xwb thiab nrog kev kawm tob tob. Tsis tas li ntawd, thawj kab hauv Table 5-1 qhia txog kev siv kho vajtse thaum tsuas yog lub operating system khiav ntawm AM62A yam tsis muaj kev siv cov neeg siv. Qhov no yog siv los ua cov hauv paus ntsiab lus los sib piv thaum ntsuas kev siv kho vajtse ntawm lwm qhov kev sim. Raws li qhia hauv lub rooj, plaub lub koob yees duab nrog kev kawm tob thiab kev tshuaj ntsuam ua haujlwm ntawm 30 FPS txhua, nrog rau tag nrho ntawm 120 FPS rau plaub lub koob yees duab. Tus ncej siab no tau ua tiav nrog tsuas yog 86% ntawm qhov kev kawm sib sib zog nqus accelerator (C7x-MMA) tag nrho. Tsis tas li ntawd, nws yog ib qho tseem ceeb uas yuav tsum nco ntsoov tias qhov kev kawm sib sib zog nqus accelerator tau teev ntawm 850MHz es tsis yog 1000MHz hauv cov kev sim no, uas tsuas yog 85% ntawm nws qhov kev ua tau zoo tshaj plaws.

Table 5-1. Kev ua tau zoo (FPS) thiab Kev Siv Cov Khoom Siv ntawm AM62A thaum siv nrog 4 IMX219 Lub Koob Yees Duab rau Cov Zaub, Ethernet kwj, Sau rau Files, thiab Ua Kev Tshawb Fawb Txog Kev Tshawb Fawb

Daim ntawv thov n	Pipeline (kev ua haujlwm )	Tso zis	FPS avg cev s	FPS tag nrho	MPUs A53s @ 1.25 GHz [%]	MCU R5 [%]	DLA (C7x- MMA) @ 850 MHz [%]	VISS [%]	MSC0 [%]	MSC1 [%]	DDR Rd [MB/s]	DDR Wr [MB/s]	DDR Tag nrho [MB/s]
Tsis muaj App	Baseline Tsis muaj kev ua haujlwm	NA	NA	NA	1.87	1	0	0	0	0	560	19	579
Lub koob yees duab nkaus xwb	Kwj rau Screen	Screen	30	120	12	12	0	70	61	60	1015	757	1782
	Kwj dhau Ethernet	PIB: 4 cov chaw nres nkoj 1920 × 1080	30	120	23	6	0	70	0	0	2071	1390	3461
	Cov ntaub ntawv rau files	4 files 1920 × 1080	30	120	25	3	0	70	0	0	2100	1403	3503
Cam nrog kev kawm tob	Deep learning: Object detection MobV1-coco	Screen	30	120	38	25	86	71	85	82	2926	1676	4602
	Kev kawm sib sib zog nqus: tshawb pom cov khoom MobV1- coco thiab kwj hla Ethernet	PIB: 4 cov chaw nres nkoj 1920 × 1080	28	112	84	20	99	66	65	72	4157	2563	6720
	Kev kawm tob: Object detection MobV1- coco thiab sau rau files	4 files 1920 × 1080	28	112	87	22	98	75	82	61	2024	2458	6482

Cov ntsiab lus
Daim ntawv tshaj tawm daim ntawv thov no piav qhia yuav ua li cas siv ntau lub koob yees duab daim ntawv thov ntawm AM6x tsev neeg ntawm cov khoom siv. Ib qho qauv siv raws li Arducam's V3Link Lub Koob Yees Duab Cov Khoom Siv thiab AM62A SK EVM tau muab rau hauv daim ntawv tshaj tawm, nrog rau ntau lub koob yees duab siv siv plaub lub koob yees duab IMX219, xws li streaming thiab tshawb pom cov khoom. Cov neeg siv tau raug txhawb kom tau txais V3Link Lub Koob Yees Duab Cov Khoom Siv los ntawm Arducam thiab rov ua dua cov examples. Daim ntawv tshaj tawm kuj tseem muab cov ncauj lus kom ntxaws txog kev ua tau zoo ntawm AM62A thaum siv plaub lub koob yees duab nyob rau hauv ntau qhov kev teeb tsa, suav nrog kev tso tawm rau lub vijtsam, streaming dhau Ethernet, thiab kaw rau files. Nws tseem qhia tau hais tias AM62A'sA muaj peev xwm ua tau qhov kev kawm tob tob ntawm plaub lub koob yees duab sib cais nyob rau hauv tib lub sijhawm. Yog tias muaj lus nug txog kev khiav cov examples, xa cov lus nug ntawm TI E2E lub rooj sab laj.

Cov ntaub ntawv

1. AM62A Starter Kit EVM Quick Start Guide
2. ArduCam V3Link Lub Koob Yees Duab Solution Quick Start Guide
3. Ntug AI SDK cov ntaub ntawv rau AM62A
4. Ntug AI Ntse Lub Koob Yees Duab Siv Lub Zog Siv Hluav Taws Xob AM62A Processor
5. Lub koob yees duab Daim iav Systems ntawm AM62A
6. Tsav Tsheb thiab Cov Neeg Nyob Hauv Kev Saib Xyuas ntawm AM62A
7. Quad Channel Lub Koob Yees Duab Daim Ntawv Thov rau Surround View thiab CMS Camera Systems
8. AM62Ax Linux Academy ntawm Enabling CIS-2 Sensor
9. Edge AI ModelZoo
10. Edge AI Studio
11. Perf_stats cuab yeej

TI Parts xa mus rau hauv daim ntawv thov no:

• https://www.ti.com/product/AM62A7
• https://www.ti.com/product/AM62A7-Q1
• https://www.ti.com/product/AM62A3
• https://www.ti.com/product/AM62A3-Q1
• https://www.ti.com/product/AM62P
• https://www.ti.com/product/AM62P-Q1
• https://www.ti.com/product/DS90UB960-Q1
• https://www.ti.com/product/DS90UB953-Q1
• https://www.ti.com/product/TDES960
• https://www.ti.com/product/TSER953

DAIM NTAWV CEEB TOOM THIAB TSIS TXAUS SIAB

TI muab TECHNICAL AND RELIABILITY DATA (nrog rau cov ntaub ntawv SHEETS), DESIGN RESOURCES (nrog rau REFERENCE DESIGNS), APPLICATION OR LWM YAM NTAWM DEJ NTAUB NTAWV, WEB Cov cuab yeej, cov ntaub ntawv kev nyab xeeb, thiab lwm yam khoom siv "raws li yog" thiab nrog txhua qhov ua txhaum cai, thiab tsis lees paub txhua qhov kev lees paub, nthuav tawm thiab hais qhia, suav nrog yam tsis muaj kev txwv tsis pub muaj kev lav phib xaub, kev lag luam kev lag luam. -Kev ua txhaum cai ntawm THIRD PARTY INSTALLECTUAL PROPERTY RIGHTS .

Cov peev txheej no yog tsim los rau cov neeg tsim khoom txawj tsim nrog TI cov khoom. Koj tsuas yog lub luag haujlwm rau

1. xaiv cov khoom tsim nyog TI rau koj daim ntawv thov,
2. tsim, validating, thiab sim koj daim ntawv thov, thiab
3. Ua kom koj daim ntawv thov ua tau raws li cov qauv tsim nyog, thiab lwm yam kev nyab xeeb, kev ruaj ntseg, kev tswj hwm, lossis lwm yam yuav tsum tau ua.

Cov peev txheej no raug hloov pauv yam tsis tau ceeb toom. TI tso cai rau koj siv cov peev txheej no nkaus xwb rau kev txhim kho daim ntawv thov uas siv TI cov khoom tau piav qhia hauv cov peev txheej. Lwm yam kev tsim tawm thiab tso tawm ntawm cov peev txheej no raug txwv. Tsis muaj daim ntawv tso cai tso cai rau lwm yam TI kev txawj ntse txoj cai lossis rau lwm tus neeg sab nrauv txoj cai kev txawj ntse. TI tsis lees paub lub luag haujlwm rau, thiab koj yuav them tag nrho TI thiab nws cov neeg sawv cev tawm tsam, txhua qhov kev thov, kev puas tsuaj, nqi, kev poob, thiab kev lav phib xaub ntawm koj siv cov peev txheej no.

TI cov khoom raug muab raws li TI Cov Lus Cog Tseg ntawm Kev Muag Khoom lossis lwm cov ntsiab lus siv tau muaj nyob rau ntawm tsi.com los yog muab ua ke nrog cov khoom TI. TI txoj kev muab cov peev txheej no tsis nthuav lossis hloov pauv TI cov kev lav phib xaub lossis kev lees paub tsis lees paub rau TI cov khoom lag luam.

TI tawm tsam thiab tsis lees paub cov ntsiab lus ntxiv lossis sib txawv uas koj tau thov.

TSEEM CEEB

• Chaw Nyob: Texas Instruments, Post Office Box 655303, Dallas, Texas 75265
• Copyright © 2024, Texas Instruments Incorporated

Cov lus nug nquag

Q: Kuv puas tuaj yeem siv txhua hom koob yees duab nrog AM6x tsev neeg ntawm cov khoom siv?

AM6x tsev neeg txhawb nqa ntau hom koob yees duab, suav nrog cov uas muaj lossis tsis muaj ISP built-in. Xa mus rau cov lus qhia tshwj xeeb kom paub meej ntxiv ntawm hom koob yees duab txhawb nqa.

: Dab tsi yog qhov txawv ntawm AM62A thiab AM62P hauv kev ua duab?

Cov kev hloov pauv tseem ceeb suav nrog hom koob yees duab txhawb nqa, cov ntaub ntawv tso tawm lub koob yees duab, muaj ISP HWA, Deep Learning HWA, thiab 3-D Graphics HWA. Saib rau nqe lus qhia tshwj xeeb rau kev sib piv kom ntxaws.

 

Cov ntaub ntawv / Cov ntaub ntawv

Texas Instruments AM6x Tsim Ntau Lub Koob Yees Duab [ua pdf] Cov neeg siv phau ntawv qhia AM62A, AM62P, AM6x Tsim Ntau Lub Koob Yees Duab, AM6x, Tsim Ntau Lub Koob Yees Duab, Ntau Lub Koob Yees Duab, Lub Koob Yees Duab

Cov ntaub ntawv

• Cov neeg siv phau ntawv