Texas Instruments AM6x Haɓaka Jagorar Mai Amfani da Kyamara da yawa

Sa ido kan Tsaro: Yana haɓaka ɗaukar hoto, bin diddigin abu, da daidaiton ganewa.
Kewaye View: Yana ba da damar hangen nesa na sitiriyo don ayyuka kamar gano cikas da sarrafa abu.

Rikodin Cabin da Tsarin Madubin Kyamara: Yana ba da ɗaukar hoto mai tsawo kuma yana kawar da wuraren makafi.
Hoton Likita: Yana ba da ingantaccen daidaito a kewayawar fiɗa da endoscopy.

Drones da Hoto na iska: Ɗauki hotuna masu girma daga kusurwoyi daban-daban don aikace-aikace daban-daban.

Haɗa Kyamarar CSI-2 da yawa zuwa SoC:
Don haɗa kyamarori CSI-2 da yawa zuwa SoC, bi jagororin da aka bayar a cikin littafin mai amfani. Tabbatar da daidaita daidai da haɗin kowane kyamara zuwa wuraren da aka keɓance akan SoC.

Bayanin Aikace-aikace
Haɓaka Aikace-aikacen Kamara da yawa akan AM6x

Jianzhong Xu, Qutaiba Saleh

GASKIYA
Wannan rahoton yana bayyana haɓaka aikace-aikacen ta amfani da kyamarori CSI-2 da yawa akan dangin AM6x na na'urori. An gabatar da ƙirar gano abu tare da zurfin koyo akan kyamarori 4 akan AM62A SoC tare da nazarin aikin. Gabaɗaya ƙa'idodin ƙira sun shafi sauran SoCs masu haɗin CSI-2, kamar AM62x da AM62P.

Gabatarwa

Kyamarar da aka haɗa suna taka muhimmiyar rawa a tsarin hangen nesa na zamani. Yin amfani da kyamarori da yawa a cikin tsarin yana faɗaɗa ƙarfin waɗannan tsarin kuma yana ba da damar damar da ba ta yiwuwa tare da kyamara ɗaya. A ƙasa akwai wasu examples na aikace-aikace ta amfani da kyamarori masu yawa da aka saka:

Sa ido kan Tsaro: Kyamarorin da aka sanya su da dabaru suna ba da cikakkiyar ɗaukar hoto. Suna kunna panoramic views, rage makafi, da haɓaka daidaiton bin diddigin abu da ganewa, haɓaka matakan tsaro gabaɗaya.
Kewaye View: Ana amfani da kyamarori da yawa don ƙirƙirar saitin hangen nesa na sitiriyo, yana ba da damar bayanai masu girma uku da kimanta zurfin. Wannan yana da mahimmanci ga ayyuka kamar gano cikas a cikin motoci masu cin gashin kansu, daidaitaccen sarrafa abu a cikin injiniyoyi, da haɓaka haƙiƙanin haɓaka abubuwan gaskiya.

Rikodin Cabin da Tsarin Madubin Kyamara: Mai rikodin gidan mota tare da kyamarori da yawa na iya ba da ƙarin ɗaukar hoto ta amfani da mai sarrafawa guda ɗaya. Hakazalika, tsarin madubin kyamara mai kyamarori biyu ko fiye na iya fadada filin direban view da kuma kawar da makafi daga kowane bangare na mota.
Hoto na Likita: Ana iya amfani da kyamarori da yawa a cikin hoton likitanci don ayyuka kamar kewayawa na tiyata, samar da likitocin fiɗa tare da ra'ayoyi da yawa don ingantaccen daidaito. A cikin endoscopy, kyamarori da yawa suna ba da damar bincikar gabobin ciki.

Jiragen Ruwa da Hoto na Sama: Sau da yawa jiragen sama suna zuwa sanye take da kyamarori da yawa don ɗaukar hotuna masu inganci ko bidiyo daga kusurwoyi daban-daban. Wannan yana da amfani a aikace-aikace kamar daukar hoto na iska, sa ido kan aikin gona, da binciken ƙasa.
Tare da ci gaban microprocessors, ana iya haɗa kyamarori da yawa a cikin Tsarin-on-Chip guda ɗaya.
(SoC) don samar da ƙaƙƙarfan mafita masu inganci. AM62Ax SoC, tare da babban aiki na bidiyo/ sarrafa hangen nesa da zurfafa ilmantarwa, na'urar da ta dace don abubuwan amfani da aka ambata a sama. Wata na'urar AM6x, AM62P, an gina ta ne don aikace-aikacen nuni na 3D masu inganci. An sanye shi da haɓakar zane na 3D, AM62P na iya sauƙaƙe tare da hotuna daga kyamarorin da yawa kuma yana samar da babban fa'ida. view. An gabatar da sabbin fasalolin AM62A/AM62P SoC a cikin wallafe-wallafe daban-daban, kamar [4], [5], [6], da sauransu. Wannan bayanin kula na aikace-aikacen ba zai sake maimaita waɗancan bayanan fasalin ba amma a maimakon haka yana mai da hankali kan haɗa kyamarorin CSI-2 da yawa a cikin aikace-aikacen hangen nesa na AM62A/AM62P.

Tebur 1-1 yana nuna babban bambance-bambance tsakanin AM62A da AM62P dangane da sarrafa hoto.

Tebur 1-1. Bambance-bambance Tsakanin AM62A da AM62P a Tsarin Hoto

SoC	AM62A	AM62P
Nau'in Kyamara mai goyan baya	Tare da ko ba tare da ginanniyar ISP ba	Tare da Gina-in ISP
Bayanan Fitar Kamara	Raw/YUV/RGB	YUV/RGB
ISP HWA	Ee	A'a
Zurfin Ilimin HWA	Ee	A'a
3-D Graphics HWA	A'a	Ee

Haɗin Kyamara da yawa CSI-2 zuwa SoC
Tsarin Kyamara akan AM6x SoC ya ƙunshi abubuwa masu zuwa, kamar yadda aka nuna a Hoto 2-1:

Mai karɓar MIPI D-PHY: yana karɓar rafukan bidiyo daga kyamarori na waje, yana tallafawa har zuwa 1.5 Gbps akan kowane layin bayanai don hanyoyi 4.

Mai karɓar CSI-2 (RX): yana karɓar rafukan bidiyo daga mai karɓar D-PHY kuma ko dai yana aika rafukan kai tsaye zuwa ISP ko zubar da bayanan zuwa ƙwaƙwalwar DDR. Wannan tsarin yana tallafawa har zuwa tashoshi na kama-da-wane 16.
SHIM: Kundin DMA wanda ke ba da damar aika rafukan da aka kama zuwa ƙwaƙwalwar ajiya akan DMA. Za a iya ƙirƙirar mahallin DMA da yawa ta wannan kundi, tare da kowane mahallin da ya yi daidai da tasha mai kama da mai karɓar CSI-2.

Ana iya tallafawa kyamarori da yawa akan AM6x ta hanyar amfani da tashoshi masu kama-da-wane na CSI-2 RX, kodayake akwai CSI-2 RX guda ɗaya kawai akan SoC. Ana buƙatar ɓangaren haɗin CSI-2 na waje don haɗa rafukan kamara da yawa da aika su zuwa SoC guda ɗaya. Ana iya amfani da nau'i biyu na CSI-2 aggregating mafita, wanda aka bayyana a cikin wadannan sassan.

CSI-2 Aggregator Amfani da SerDes
Hanya ɗaya ta haɗa rafukan kamara da yawa shine a yi amfani da maganin serializing da deserializing (SerDes). Ana canza bayanan CSI-2 daga kowace kamara ta serializer kuma ana canja su ta hanyar kebul. Deserializer yana karɓar duk bayanan serialized da aka canjawa wuri daga igiyoyi (kebul ɗaya a kowace kamara), yana canza rafukan zuwa bayanan CSI-2, sannan ya aika rafin CSI-2 mai tsaka-tsaki zuwa ƙirar CSI-2 RX guda ɗaya akan SoC. Ana gano kowane rafi na kamara ta wata tashoshi na musamman na musamman. Wannan maganin haɗakarwa yana ba da ƙarin fa'idar barin haɗin nesa mai nisa har zuwa 15m daga kyamarori zuwa SoC.

The FPD-Link ko V3-Link serializers da deserializers (SerDes), da aka goyan bayan AM6x Linux SDK, su ne mafi mashahuri fasahar ga irin wannan CSI-2 aggregating bayani. Dukansu FPD-Link da V3-Link deserializers suna da tashoshi na baya waɗanda za a iya amfani da su don aika siginar daidaitawa na firam don daidaita duk kyamarori, kamar yadda aka bayyana a [7].
Hoto na 2-2 yana nuna tsohonampYin amfani da SerDes don haɗa kyamarori da yawa zuwa AM6x SoC guda ɗaya.

TsohonampZa'a iya samun wannan maganin tari a cikin Arducam V3Link Maganin Maganin Kyamara. Wannan kit ɗin yana da tashar deserializer wanda ke haɗa rafukan kyamarar 4 CSI-2, da nau'ikan nau'ikan 4 na V3link serializers da kyamarori IMX219, gami da igiyoyin coaxial FAKRA da igiyoyin FPC 22-pin. An gina ƙirar tunani da aka tattauna daga baya akan wannan kit ɗin.

CSI-2 Aggregator ba tare da Amfani da SerDes ba
Wannan nau'in mai tarawa zai iya yin mu'amala kai tsaye tare da kyamarori MIPI CSI-2 da yawa kuma ya haɗa bayanai daga duk kyamarori zuwa rafi na CSI-2 guda ɗaya.

Hoto na 2-3 yana nuna tsohonampirin wannan tsarin. Wannan nau'in maganin haɗakarwa baya amfani da kowane serializer/deserializer amma an iyakance shi da matsakaicin nisa na canja wurin bayanai na CSI-2, wanda ya kai 30cm. AM6x Linux SDK baya goyan bayan wannan nau'in tarawar CSI-2

Kunna Kyamara da yawa a cikin Software

Tsarin Tsarin Tsarin Kyamara Software Architecture
Hoto 3-1 yana nuna babban matakin toshe zane na software na tsarin ɗaukar kyamara a cikin AM62A/AM62P Linux SDK, daidai da tsarin HW a cikin Hoto 2-2.

Wannan tsarin gine-ginen software yana bawa SoC damar karɓar rafukan kamara da yawa tare da amfani da SerDes, kamar yadda aka nuna a Hoto 2-2. FPD-Link/V3-Link SerDes yana ba da adireshin I2C na musamman da tashar kama-da-wane ga kowane kamara. Yakamata a ƙirƙiri abin rufe bishiyar na'ura na musamman tare da keɓaɓɓen adireshin I2C na kowane kamara. Direban CSI-2 RX yana gane kowace kamara ta amfani da lambar tashoshi na musamman kuma yana ƙirƙirar mahallin DMA a kowane rafi na kyamara. An ƙirƙiri kumburin bidiyo don kowane mahallin DMA. Ana karɓar bayanai daga kowace kamara kuma ana adana su ta amfani da DMA zuwa ƙwaƙwalwar ajiya daidai. Aikace-aikacen sarari na mai amfani suna amfani da nodes ɗin bidiyo masu dacewa da kowace kamara don samun damar bayanan kamara. ExampAn ba da damar yin amfani da wannan gine-ginen software a Babi na 4 - Tsarin Magana.
Duk wani takamaiman direban firikwensin da ya dace da tsarin V4L2 zai iya toshewa da wasa a cikin wannan gine-gine. Koma zuwa [8] game da yadda ake haɗa sabon direban firikwensin cikin Linux SDK.

Gine-ginen Fasahar Bututun Hoto

AM6x Linux SDK yana ba da tsarin GStreamer (GST), wanda za'a iya amfani dashi a cikin sararin ser don haɗa abubuwan sarrafa hoto don aikace-aikace daban-daban. Hardware Accelerators (HWA) akan SoC, kamar Vision Pre-processing Accelerator (VPAC) ko ISP, rikodin bidiyo/dekodar, da injin ƙididdigewa mai zurfi, ana samun dama ta hanyar GST. plugins. VPAC (ISP) da kanta yana da tubalan da yawa, gami da Tsarin Tsarin Hoto na hangen nesa (VISS), Gyaran Lantarki na Lens (LDC), da Multiscalar (MSC), kowane daidai da kayan aikin GST.

Hoto na 3-2 yana nuna zane mai toshe bututun hoto na yau da kullun daga kyamara zuwa ɓoye ko zurfi
aikace-aikacen koyo akan AM62A. Don ƙarin cikakkun bayanai game da kwararar bayanai daga ƙarshen-zuwa-ƙarshen, koma zuwa takaddun EdgeAI SDK.

Don AM62P, bututun hoton ya fi sauƙi saboda babu ISP akan AM62P.

Tare da kumburin bidiyo da aka ƙirƙira don kowane ɗayan kyamarori, bututun hoto na tushen GStreamer yana ba da damar sarrafa abubuwan shigar da kyamara da yawa (wanda aka haɗa ta hanyar CSI-2 RX iri ɗaya) a lokaci guda. An ba da ƙirar ƙira ta amfani da GStreamer don aikace-aikacen kyamara da yawa a babi na gaba.

Tsarin Magana

Wannan babin yana gabatar da tsarin tunani na gudanar da aikace-aikacen kyamara da yawa akan AM62A EVM, ta amfani da Arducam V3Link Camera Solution Kit don haɗa kyamarori 4 CSI-2 zuwa AM62A da kuma gano abu mai gudana don duk kyamarori 4.

Kyamara masu goyan baya
Kit ɗin Arducam V3Link yana aiki tare da kyamarorin tushen FPD-Link/V3-Link da kyamarorin CSI-2 masu dacewa da Rasberi Pi. An gwada kyamarori masu zuwa:

D3 Injiniya D3RCM-IMX390-953
Hoton Damisa LI-OV2312-FPDLINKIII-110H

IMX219 kyamarori a cikin Arducam V3Link Maganin Maganin Kamara

Saita Kyamara Hudu IMX219
Bi umarnin da aka bayar a cikin AM62A Starter Kit EVM Jagoran Farawa Mai Sauƙi don saita SK-AM62A-LP EVM (AM62A SK) da ArduCam V3Link Maganin Kamara Mai Saurin Jagora don haɗa kyamarori zuwa AM62A SK ta cikin kayan aikin V3Link. Tabbatar cewa fil a kan igiyoyi masu sassauƙa, kyamarori, allon V3Link, da AM62A SK duk sun daidaita daidai.

Hoto na 4-1 yana nuna saitin da aka yi amfani da shi don ƙirar tunani a cikin wannan rahoton. Babban abubuwan da ke cikin saitin sun haɗa da:

1X SK-AM62A-LP EVM
1X Arducam V3Link d-ch adaftar allo
Kebul na FPC mai haɗa Arducam V3Link zuwa SK-AM62A

4X V3Link adaftar kyamara (serializers)
4X RF coaxial igiyoyi don haɗa serializers V3Link zuwa V3Link d-ch kit
4X IMX219 Kyamara

4X CSI-2 22-pin igiyoyi don haɗa kyamarori zuwa serializers
Kebul: HDMI na USB, USB-C zuwa ikon SK-AM62A-LP da wutar lantarki 12V da aka samo don V3Link d-ch kit)
Sauran abubuwan da ba a nuna su a cikin Hoto 4-1: Katin micro-SD, kebul na USB micro-USB don samun damar SK-AM62A-LP, da Ethernet don yawo

Saita Kyamara da Mu'amalar CSI-2 RX
Saita software bisa ga umarnin da aka bayar a cikin Arducam V3Link Quick Start Guide. Bayan gudanar da rubutun saitin kyamara, saitin-imx219.sh, tsarin kyamara, tsarin dubawar CSI-2 RX, da hanyoyin daga kowace kyamara zuwa kullin bidiyo mai dacewa za a daidaita su yadda ya kamata. An ƙirƙiri nodes na bidiyo guda huɗu don kyamarori huɗu na IMX219. Umurnin "v4l2-ctl -list-na'urori" yana nuna duk na'urorin bidiyo na V4L2, kamar yadda aka nuna a kasa:

Akwai nodes na bidiyo 6 da kumburin media 1 a ƙarƙashin tiscsi2rx. Kowane kumburin bidiyo yayi daidai da mahallin DMA wanda direban CSI2 RX ya ware. Daga cikin nodes na bidiyo na 6, ana amfani da 4 don kyamarori 4 IMX219, kamar yadda aka nuna a cikin bututun watsa labarai a ƙasa:

Kamar yadda aka nuna a sama, mahaɗan kafofin watsa labaru 30102000.ticsi2rx yana da ginshiƙan tushe guda 6, amma 4 na farko kawai ana amfani da su, kowanne don IMX219 ɗaya. Hakanan za'a iya misalta tafsirin bututun watsa labarai ta hoto. Gudun umarni mai zuwa don samar da digo file:

Sannan gudanar da umarnin da ke ƙasa akan PC mai masaukin baki na Linux don samar da PNG file:

Hoto na 4-2 hoto ne da aka samar ta amfani da umarnin da aka bayar a sama. Ana iya samun abubuwan da ke cikin ƙirar software na Hoto 3-1 a cikin wannan jadawali.

Yawo daga Kyamarar Hudu
Tare da duka kayan aiki da software ana saita su yadda ya kamata, aikace-aikacen kyamara da yawa na iya gudana daga sararin mai amfani. Don AM62A, dole ne a kunna ISP don samar da ingancin hoto mai kyau. Koma zuwa AM6xA ISP Tuning Guide don yadda ake yin kunna ISP. Sassan da ke gaba suna gabatar da examples na watsa bayanan kamara zuwa nuni, watsa bayanan kamara zuwa cibiyar sadarwa, da adana bayanan kamara zuwa files.

Bayanan Kamara Mai Yawo don Nunawa
Babban aikace-aikacen wannan tsarin kamara da yawa shine don watsa bidiyo daga duk kyamarori zuwa nunin da aka haɗa da SoC iri ɗaya. Mai zuwa shine bututun GStreamer example na yawo hudu IMX219 zuwa nuni (lambobin node na bidiyo da lambobin v4l-subdev a cikin bututun za su iya canzawa daga sake yi zuwa sake yin aiki).

Bayanan Kamara mai yawo ta hanyar Ethernet
Maimakon yawo zuwa nunin da aka haɗa da SoC iri ɗaya, ana iya watsa bayanan kamara ta hanyar Ethernet. Gefen karɓa na iya zama ko dai wani mai sarrafa AM62A/AM62P ko PC mai masaukin baki. Mai zuwa shine tsohonample na yawo bayanan kamara ta hanyar Ethernet (ta amfani da kyamarori biyu don sauƙi) (lura da kayan aikin encoder da aka yi amfani da shi a cikin bututun):

Mai zuwa shine tsohonampna karɓar bayanan kamara da yawo zuwa nuni akan wani mai sarrafa AM62A/AM62P:

Ajiye bayanan Kamara zuwa Files
Maimakon yawo zuwa nuni ko ta hanyar hanyar sadarwa, ana iya adana bayanan kamara a cikin gida files. Bututun da ke ƙasa yana adana bayanan kowace kyamara zuwa a file (ta amfani da kyamarori biyu a matsayin example don sauki).

Ƙirƙirar Ilimin Kyamara da yawa

AM62A an sanye shi da na'urar hanzarin koyo mai zurfi (C7x-MMA) tare da har zuwa TOPs guda biyu, waɗanda ke da ikon gudanar da nau'ikan nau'ikan nau'ikan nau'ikan ilmantarwa mai zurfi don rarrabuwa, gano abu, rarrabuwar ma'ana, da ƙari. Wannan sashe yana nuna yadda AM62A zai iya gudanar da ƙirar koyo mai zurfi guda huɗu a lokaci guda akan ciyarwar kamara daban-daban guda huɗu.

Zaɓin Samfura
EdgeAI-ModelZoo na TI yana ba da ɗaruruwan ƙira na zamani, waɗanda ake canzawa/fitar da su daga ainihin tsarin horon su zuwa tsarin abokantaka na haɗaɗɗiya ta yadda za a iya sauke su zuwa ga mai saurin koyo mai zurfi na C7x-MMA. Tushen girgije na Edge AI Studio Model Analyzer yana ba da kayan aiki mai sauƙin amfani "Zaɓin Model". An sabunta shi sosai don haɗa duk samfuran da aka goyan baya a cikin TI EdgeAI-ModelZoo. Kayan aiki ba ya buƙatar ƙwarewar da ta gabata kuma yana ba da sauƙi mai sauƙin amfani don shigar da abubuwan da ake buƙata a cikin samfurin da ake so.

An zaɓi TFL-OD-2000-ssd-mobV1-coco-mlperf don wannan gwajin zurfin ilmantarwa na kamara da yawa. An haɓaka wannan ƙirar gano abubuwa da yawa a cikin tsarin TensorFlow tare da ƙudurin shigarwar 300 × 300. Tebur na 4-1 yana nuna mahimman fasalulluka na wannan ƙirar lokacin da aka horar da su akan tsarin bayanan cCOCO tare da azuzuwan kusan 80 daban-daban.

Tebur 4-1. Haskaka Halayen Model TFL-OD-2000-ssd-mobV1-coco-mlperf.

Samfura	Aiki	Ƙaddamarwa	FPS	mAP 50% Daidaito akan COCO	Latency/Frame (ms)	DDR BW Amfani (MB/ Frame)
TFL-OD-2000-ssd- mobV1-coco-mlperf	Gano Abubuwa da yawa	300×300	~152	15.9	6.5	18.839

Saita bututun mai
Hoto na 4-3 yana nuna bututun GStreamer mai zurfin koyo mai kamara 4. TI yana ba da rukunin GStreamer plugins wanda ke ba da damar sauke wasu sarrafa kafofin watsa labarai da zurfin koyo ga masu haɓaka kayan aikin. Wasu examples daga cikin wadannan plugins sun haɗa da tiovxisp, tiovxmultiscaler, tiovxmosaic, da tidlinferer. Bututun da ke cikin hoto 4-3 ya haɗa da duk abin da ake buƙata plugins don bututun GStreamer mai yawa don abubuwan shigar da kyamarori 4, kowannensu yana da riga-kafi na kafofin watsa labarai, zurfin koyo, da kuma bayan tsari. Kwafi plugins ga kowane ɗayan hanyoyin kamara an jera su a cikin jadawali don sauƙin nunawa.
Ana rarraba albarkatun kayan masarufi a ko'ina tsakanin hanyoyin kyamara huɗu. Misali, AM62A ya ƙunshi nau'ikan sikeli na hoto guda biyu: MSC0 da MSC1. Bututun ya keɓe MSC0 a sarari don aiwatar da kyamarar 1 da hanyoyin kyamara 2, yayin da aka keɓe MSC1 ga kyamarar 3 da kamara 4.

Fitar bututun kamara guda huɗu an rage girman su kuma an haɗa su tare ta amfani da plugin tiovxmosaic. Ana nuna fitarwa akan allo guda. Hoto na 4-4 yana nuna fitowar kyamarori huɗu tare da ƙirar koyo mai zurfi da ke tafiyar da gano abu. Kowane bututu (kamara) yana gudana a 30 FPS da jimillar 120 FPS.

Na gaba shine cikakken rubutun bututun don yanayin amfani da zurfin ilmantarwa na kyamara da yawa wanda aka nuna a cikin Hoto na 4-3.

Binciken Ayyuka

Saitin tare da kyamarori huɗu ta amfani da allon V3Link da AM62A SK an gwada su a cikin yanayin aikace-aikacen daban-daban, gami da nunawa kai tsaye akan allon, yawo akan Ethernet (tashoshin UDP huɗu), yin rikodi zuwa 4 daban. files, kuma tare da zurfin ilmantarwa. A cikin kowane gwaji, mun sanya ido kan ƙimar firam ɗin da kuma yin amfani da muryoyin CPU don bincika dukkan ƙarfin tsarin.

Kamar yadda aka nuna a baya a Hoto na 4-4, bututun koyo mai zurfi yana amfani da kayan aikin tiperfoverlay GStreamer don nuna nauyin CPU core a matsayin jadawali a kasan allon. Ta hanyar tsoho, ana sabunta jadawali kowane daƙiƙa biyu don nuna lodi azaman kashi na amfanitage. Baya ga plugin ɗin tiperfoverlay GStreamer, kayan aikin perf_stats zaɓi ne na biyu don nuna ainihin aikin kai tsaye akan tashar tare da zaɓi don adanawa zuwa ga file. Wannan kayan aikin ya fi daidai idan aka kwatanta da tTiperfoverlayas na karshen yana ƙara ƙarin nauyi akan abubuwan da ke cikin theARMm da DDR don zana jadawali kuma ya rufe shi akan allon. Ana amfani da kayan aikin perf_stats musamman don tattara sakamakon amfani da kayan masarufi a cikin duk shari'ar gwajin da aka nuna a cikin wannan takaddar. Wasu daga cikin mahimman abubuwan sarrafawa da masu haɓakawa da aka yi nazari a cikin waɗannan gwaje-gwajen sun haɗa da manyan na'urori masu sarrafawa (hudu A53 Arm cores @ 1.25GHz), mai zurfin ilmantarwa accelerator (C7x-MMA @ 850MHz), VPAC (ISP) tare da VISS da multiscalers (MSC0 da MSC1), da ayyukan DDR.

Tebur 5-1 yana nuna aiki da amfani da albarkatu yayin amfani da AM62A tare da kyamarori huɗu don lokuta masu amfani guda uku, gami da yawo kyamarori huɗu zuwa nuni, yawo akan Ethernet, da yin rikodi zuwa huɗu daban. files. Ana aiwatar da gwaje-gwaje biyu a kowane yanayin amfani: tare da kamara kawai kuma tare da zurfin fahimtar ilmantarwa. Bugu da ƙari, jere na farko a cikin Tebura 5-1 yana nuna kayan amfani da kayan aiki lokacin da tsarin aiki kawai ke gudana akan AM62A ba tare da wani aikace-aikacen mai amfani ba. Ana amfani da wannan azaman tushe don kwatanta lokacin da ake kimanta amfanin kayan aiki na sauran shari'o'in gwaji. Kamar yadda aka nuna a cikin tebur, kyamarori huɗu masu zurfin koyo da nunin allo suna aiki a 30 FPS kowanne, tare da jimlar 120 FPS don kyamarori huɗu. Wannan babban ƙimar firam ɗin yana samuwa tare da kawai 86% na zurfin ilmantarwa mai sauri (C7x-MMA) cikakken iya aiki. Bugu da ƙari, yana da mahimmanci a lura cewa an rufe mai saurin ilmantarwa mai zurfi a 850MHz maimakon 1000MHz a cikin waɗannan gwaje-gwajen, wanda shine kawai 85% na iyakar aikinsa.

Tebur 5-1. Ayyuka (FPS) da Amfani da Albarkatun AM62A lokacin da aka yi amfani da su tare da 4 IMX219 kyamarori don Nunin allo, Rafi na Ethernet, Yi rikodin zuwa Files, da Gudanar da Zurfafa Ilmantarwa

Aikace-aikace n	Pipeline (aiki )	Fitowa	FPS avg bututun s	FPS duka	MPUs A53s @ 1.25 GHz [%]	MCU R5 [%]	DLA (C7x- MMA) @ 850 MHz [%]	VISS [%]	MSC0 [%]	MSC1 [%]	DDR Rd [MB/s]	DDR Wr [MB/s]	DDR Jimlar [MB/s]
Babu App	Baseline Babu aiki	NA	NA	NA	1.87	1	0	0	0	0	560	19	579
Kamara kawai	Ruwa zuwa Screen	Allon	30	120	12	12	0	70	61	60	1015	757	1782
	Yawo akan Ethernet	Shafin: 4 tashar jiragen ruwa 1920×1080	30	120	23	6	0	70	0	0	2071	1390	3461
	Yi rikodin ku files	4 files 1920×1080	30	120	25	3	0	70	0	0	2100	1403	3503
Cam tare da zurfafa ilmantarwa	Koyo mai zurfi: Gane abu MobV1- koko	Allon	30	120	38	25	86	71	85	82	2926	1676	4602
	Koyo mai zurfi: Gano abu MobV1-coco da Yawo akan Ethernet	Shafin: 4 tashar jiragen ruwa 1920×1080	28	112	84	20	99	66	65	72	4157	2563	6720
	Koyo mai zurfi: Gano abu MobV1- koko da yin rikodin zuwa files	4 files 1920×1080	28	112	87	22	98	75	82	61	2024	2458	6482

Takaitawa
Wannan rahoton aikace-aikacen yana bayyana yadda ake aiwatar da aikace-aikacen kyamara da yawa akan dangin AM6x na na'urori. An samar da ƙirar ƙira ta Arducam's V3Link Camera Solution Kit da AM62A SK EVM a cikin rahoton, tare da aikace-aikacen kyamara da yawa ta amfani da kyamarori huɗu na IMX219, kamar yawo da gano abu. Ana ƙarfafa masu amfani don siyan Kit ɗin Maganin Kamara na V3Link daga Arducam kuma su kwafi waɗannan tsoffinamples. Rahoton ya kuma ba da cikakken bincike game da ayyukan AM62A yayin amfani da kyamarori huɗu a ƙarƙashin gyare-gyare daban-daban, gami da nunawa zuwa allo, yawo akan Ethernet, da yin rikodi zuwa files. Hakanan yana nuna damar AM62A'sA na aiwatar da zurfin ilmantarwa akan rafukan kamara guda huɗu a layi daya. Idan akwai wasu tambayoyi game da gudanar da waɗannan tsoffinamples, ƙaddamar da bincike a dandalin TI E2E.

Magana

AM62A Starter Kit EVM Jagoran Fara Mai Sauri

ArduCam V3Link Maganin Kamara Mai Saurin Jagora
Bayanan Edge AI SDK don AM62A
Edge AI Smart kyamarori Ta amfani da Ingantattun Makamashi AM62A Processor

Tsarin madubin kyamara akan AM62A
Tsarukan Kula da Direba da Mazauna akan AM62A
Aikace-aikacen kyamarar tashar Quad don Kewaye View da CMS Kamara Systems

AM62Ax Linux Academy akan Ba da damar CIS-2 Sensor
Edge AI ModelZoo
Edge AI Studio

Perf_stats kayan aiki

Sassan TI da Aka Nuna a cikin Wannan Bayanin Aikace-aikacen:

https://www.ti.com/product/AM62A7

MUHIMMAN SANARWA DA RA'AYI

TI YA BADA BAYANIN FASAHA DA DOMIN AMINCI (HADA DA RUBUTUN DATA), KYAUTATA ARZIKI (HADA DA SIFFOFIN NASARA), APPLICATION KO SAURAN SHAWARAR TSIRA, WEB KAYAN NAN, BAYANIN TSIRA, DA SAURAN ASABAR “KAMAR YADDA YAKE” KUMA TARE DA DUKKAN LAIFI, DA KUMA KYAUTA DUK GARANTI, BAYANI DA BAYANI, BA TARE DA IYAKA KOWANE GARANTIN CIN ARZIKI BA, DOGARO LISSAFI. HAKKIN DUKIYAR ARTY .

Waɗannan albarkatun an yi niyya ne don ƙwararrun masu haɓaka ƙira tare da samfuran TI. Kai kaɗai ke da alhakin

zaɓi samfuran TI masu dacewa don aikace-aikacen ku,

ƙira, ingantawa, da gwada aikace-aikacenku, da
tabbatar da aikace-aikacenku ya cika ƙa'idodi masu dacewa, da kowane aminci, tsaro, tsari, ko wasu buƙatu.

Waɗannan albarkatun suna iya canzawa ba tare da sanarwa ba. TI yana ba ku damar amfani da waɗannan albarkatun kawai don haɓaka aikace-aikacen da ke amfani da samfuran TI da aka bayyana a cikin albarkatun. An haramta sauran haifuwa da nunin waɗannan albarkatun. Babu lasisi da aka bayar ga kowane haƙƙin mallakar fasaha na TI ko ga kowane haƙƙin mallakar fasaha na ɓangare na uku. TI yayi watsi da alhakin, kuma za ku ci gaba da ladabtar da TI da wakilansa a kan, duk wani da'awar, lalacewa, farashi, asara, da kuma abin da kuka samu ta amfani da waɗannan albarkatun.

Ana ba da samfuran TI bisa ga Sharuɗɗan Siyarwa na TI ko wasu sharuɗɗan da suka dace da akwai ko dai a kunne ta.com ko bayar da su tare da irin waɗannan samfuran TI. Samar da TI na waɗannan albarkatun baya faɗaɗa ko in ba haka ba ya canza garantin da suka dace na TI ko rashin yarda da samfuran TI.

TI ya ƙi kuma ya ƙi kowane ƙarin ko wasu sharuɗɗan da ƙila ka gabatar.

MUHIMMAN SANARWA

Adireshin aikawa: Texas Instruments, Akwatin gidan waya 655303, Dallas, Texas 75265

Tambayoyin da ake yawan yi

Tambaya: Zan iya amfani da kowane nau'in kamara tare da dangin AM6x?

Iyalin AM6x suna goyan bayan nau'ikan kamara daban-daban, gami da waɗanda ke da ko ba tare da ginanniyar ISP ba. Koma zuwa ƙayyadaddun bayanai don ƙarin cikakkun bayanai kan nau'ikan kamara masu goyan baya.

: Menene babban bambance-bambance tsakanin AM62A da AM62P wajen sarrafa hoto?

Maɓallin maɓalli sun haɗa da nau'ikan kamara masu goyan baya, bayanan fitarwa na kyamara, kasancewar ISP HWA, Deep Learning HWA, da 3-D Graphics HWA. Koma zuwa sashin ƙayyadaddun bayanai don kwatancen daki-daki.

Takardu / Albarkatu

Texas Instruments AM6x Haɓaka Kyamara da yawa [pdf] Jagorar mai amfani
AM62A, AM62P, AM6x Haɓaka Kyamara da yawa, AM6x, Haɓaka Kyamara da yawa, Kyamara da yawa, Kyamara

Magana

Manual mai amfani

Texas Instruments AM6x Haɓaka Kyamara da yawa

Ƙayyadaddun bayanai