I-Texas Instruments AM6x Ithuthukisa Umhlahlandlela Womsebenzisi Wekhamera Eningi

Okuqukethwe fihla

1 I-Texas Instruments AM6x Ithuthukisa Amakhamera Amaningi

2 Imininingwane

3 Isingeniso

4 Inika amandla amakhamera amaningi ku-Software

5 I-Reference Design

6 I-Multicamera Deep Learning Inference

7 Ukuhlaziya Ukusebenza

8 ISAZISO ESIBALULEKILE KANYE NOMKHONDO

9 imibuzo ejwayelekile ukubuzwa

10 Amadokhumenti / Izinsiza

10.1 Izithenjwa

I-Texas Instruments AM6x Ithuthukisa Amakhamera Amaningi

Imininingwane

Igama Lomkhiqizo: AM6x umndeni wamadivayisi
Uhlobo Lwekhamera Esekelwe: AM62A (Nge-ISP eyakhelwe ngaphakathi noma ngaphandle kwayo), i-AM62P (Nge-ISP eyakhelwe ngaphakathi)

Idatha yokuphuma kwekhamera: AM62A (Raw/YUV/RGB), AM62P (YUV/RGB)
I-ISP HWA: AM62A (Yebo), AM62P (Cha)

I-HWA yokufunda Okujulile: AM62A (Yebo), AM62P (Cha)
I-3-D Graphics HWA: AM62A (Cha), AM62P (Yebo)

Isingeniso sezinhlelo zokusebenza zamakhamera amaningi ku-AM6x:

Amakhamera ashumekiwe adlala indima ebalulekile ezinhlelweni zesimanje zokubona.

Ukusebenzisa amakhamera amaningi ohlelweni kuthuthukisa amakhono futhi kwenza imisebenzi ingafezeki ngekhamera eyodwa.

Izinhlelo zokusebenza ezisebenzisa amakhamera amaningi:

Ukubhekwa Kwezokuphepha: Ithuthukisa ukumbozwa kokugadwa, ukulandelela into, nokunemba kokubonwa.
Zungeza View: Inika amandla umbono we-stereo wemisebenzi efana nokutholwa kwezithiyo kanye nokukhohliswa kwento.

Irekhoda yeKhabhinethi kanye nesistimu yesibuko sekhamera: Inikeza ukumbozwa okunwetshiwe futhi isuse izindawo eziyimpumputhe.
Isithombe sezokwelapha: Inikeza ukunemba okuthuthukisiwe ekuzulazuleni kokuhlinzwa kanye ne-endoscopy.

I-Drones kanye ne-Aerial imaging: Thwebula izithombe ezinokulungiswa okuphezulu kusuka kuma-engeli ahlukene wezinhlelo zokusebenza ezahlukahlukene.

Ixhuma Amakhamera amaningi e-CSI-2 ku-SoC:
Ukuze uxhume amakhamera amaningi e-CSI-2 ku-SoC, landela imihlahlandlela enikezwe kumanuwali yomsebenzisi. Qinisekisa ukuqondanisa okufanele nokuxhumana kwekhamera ngayinye kumachweba aqokiwe ku-SoC.

Inothi Lokusebenza
Ukuthuthukisa izinhlelo zokusebenza zamakhamera amaningi ku-AM6x

Jianzhong Xu, Qutaiba Saleh

ABSTRACT
Lo mbiko uchaza ukuthuthukiswa kohlelo lokusebenza kusetshenziswa amakhamera amaningi e-CSI-2 emndenini wamadivayisi we-AM6x. Idizayini eyireferensi yokutholwa kwento ngokufunda okujulile kumakhamera angu-4 ku-AM62A SoC yethulwa ngokuhlaziywa kokusebenza. Izimiso ezijwayelekile zomklamo zisebenza kwamanye ama-SoC ane-interface ye-CSI-2, efana ne-AM62x ne-AM62P.

Isingeniso

Amakhamera ashumekiwe adlala indima ebalulekile ezinhlelweni zesimanje zokubona. Ukusebenzisa amakhamera amaningi ohlelweni kukhulisa amandla alezi zinhlelo futhi kuvumela amakhono angenzeki ngekhamera eyodwa. Ngezansi kukhona ama-exampizinhlelo zokusebenza ezisebenzisa amakhamera amaningi ashumekiwe:

Ukubhekwa Kwezokuphepha: Amakhamera amaningi abekwe ngendlela ehlelekile ahlinzeka ngokubhekwa okubanzi. Bavumela i-panoramic views, ukunciphisa izindawo eziyimpumputhe, futhi kuthuthukise ukunemba kokulandelelwa kwento nokubonwa, ukuthuthukisa izindlela zokuphepha zizonke.
Zungeza View: Amakhamera amaningi asetshenziselwa ukudala ukusethwa kombono we-stereo, okuvumela ulwazi lwezinhlangothi ezintathu kanye nesilinganiso sokujula. Lokhu kubalulekile emisebenzini efana nokutholwa kwezithiyo ezimotweni ezizimele, ukukhohliswa kwento okunembayo kumarobhothi, kanye namaqiniso athuthukisiwe wokuzizwisa okungokoqobo okungathandwa kwabathelisi esikubona.

I-Cabin Recorder kanye ne-Camera Mirror System: Isirekhoda sekhabethe lemoto elinamakhamera amaningi singanikeza ukumbozwa okwengeziwe kusetshenziswa iphrosesa eyodwa. Ngokufanayo, uhlelo lwesibuko sekhamera olunamakhamera amabili noma ngaphezulu lunganweba inkambu yomshayeli view futhi ususe izindawo ezingaboni kuzo zonke izinhlangothi zemoto.
I-Medical Imaging: Amakhamera amaningi angasetshenziswa emfanekisweni wezokwelapha ngemisebenzi efana nokuzulazula kokuhlinzwa, ukuhlinzeka odokotela abahlinzayo ngemibono eminingi yokunemba okuthuthukisiwe. Ku-endoscopy, amakhamera amaningi anika amandla ukuhlolwa okuphelele kwezitho zangaphakathi.

Ama-Drones kanye Nokufanekisa kwasemoyeni: Ama-Drones avame ukuza efakwe amakhamera amaningi ukuze athwebule izithombe ezinokulungiswa okuphezulu noma amavidiyo avela emazingeni ahlukene. Lokhu kuwusizo ezinhlelweni ezifana nokuthatha izithombe zasemoyeni, ukuqapha ezolimo, nokuhlola umhlaba.
Ngokuthuthuka kwama-microprocessors, amakhamera amaningi angahlanganiswa abe yi-System-on-Chip eyodwa.
(SoC) ukuhlinzeka ngezixazululo ezihlangene nezisebenza kahle. I-AM62Ax SoC, enokucubungula okuphezulu kokusebenza kwevidiyo/nombono kanye nokusheshisa ukufunda okujulile, iyithuluzi elikahle lamacala okusetshenziswa ashiwo ngenhla. Enye idivayisi ye-AM6x, i-AM62P, yakhelwe izinhlelo zokusebenza zokubonisa ze-3D ezishumekiwe ezisebenza kahle kakhulu. Ifakwe ukusheshisa kwezithombe ze-3D, i-AM62P ingakwazi ukuhlanganisa kalula izithombe ezivela kumakhamera amaningi futhi ikhiqize i-panoramic yokucaca okuphezulu. view. Izici ezintsha ze-AM62A/AM62P SoC zethulwe ekushicilelweni okuhlukahlukene, okufana ne-[4], [5], [6], njll. Leli nothi lohlelo lokusebenza ngeke liphinde lezo zincazelo zesici kodwa ligxile ekuhlanganiseni amakhamera amaningi e-CSI-2 ezinhlelweni zokusebenza zombono ezishunyekiwe ku-AM62A/AM62P.

Ithebula 1-1 libonisa umehluko omkhulu phakathi kwe-AM62A ne-AM62P mayelana nokucutshungulwa kwesithombe.

Ithebula 1-1. Umehluko Phakathi kwe-AM62A ne-AM62P Ekucubunguleni Isithombe

I-SoC	AM62A	I-AM62P
Uhlobo Lwekhamera Esekelwe	Nge-ISP eyakhelwe ngaphakathi noma ngaphandle kwayo	Nge-ISP eyakhelwe ngaphakathi
Idatha Yokuphuma Kwekhamera	Okuluhlaza/YUV/RGB	I-YUV/RGB
I-ISP HWA	Yebo	Cha
Ukufunda Okujulile kwe-HWA	Yebo	Cha
3-D Graphics HWA	Cha	Yebo

Ixhuma Amakhamera amaningi e-CSI-2 ku-SoC
I-Subsystem yekhamera ku-AM6x SoC iqukethe izingxenye ezilandelayo, njengoba kukhonjisiwe kuMfanekiso 2-1:

I-MIPI D-PHY Receiver: ithola ukusakazwa kwevidiyo kumakhamera angaphandle, isekela kufika ku-1.5 Gbps ngomzila wedatha wemizila emi-4.

I-CSI-2 Receiver (RX): ithola ukusakazwa kwevidiyo kumamukeli we-D-PHY futhi ithumele ngokuqondile ukusakaza ku-ISP noma ilahle idatha kumemori ye-DDR. Le mojula isekela iziteshi ezibonakalayo ezingafika kwezingu-16.
I-SHIM: isembozo se-DMA esivumela ukuthumela ukusakaza okuthwebuliwe kumemori nge-DMA. Okuqukethwe kwe-DMA okuningi kungadalwa yilesi sisonga, ngomongo ngamunye ohambisana nesiteshi esibonakalayo Sesamukeli se-CSI-2.

Amakhamera amaningi angasekelwa ku-AM6x ngokusebenzisa iziteshi ezibonakalayo ze-CSI-2 RX, nakuba kune-interface ye-CSI-2 RX eyodwa kuphela ku-SoC. Ingxenye yangaphandle yokuhlanganisa ye-CSI-2 iyadingeka ukuze kuhlanganiswe ukusakazwa kwekhamera okuningi futhi kuyithumele ku-SoC eyodwa. Izinhlobo ezimbili zezixazululo ze-CSI-2 zokuhlanganisa zingasetshenziswa, ezichazwe ezigabeni ezilandelayo.

I-CSI-2 Aggregator Esebenzisa ama-SerDes
Enye indlela yokuhlanganisa ukusakaza kwekhamera okuningi ukusebenzisa isixazululo se-serializing ne-deserializing (SerDes). Idatha ye-CSI-2 evela kukhamera ngayinye iguqulwa nge-serializer futhi idluliselwe ngekhebula. I-deserializer ithola yonke idatha ye-serialized edluliswa isuka kuzintambo (ikhebula eyodwa ngekhamera ngayinye), iguqule ukusakazwa kubuyele kudatha ye-CSI-2, bese ithumela ukusakazwa kwe-CSI-2 okuphambanisiwe kusixhumi esibonakalayo esisodwa se-CSI-2 RX ku-SoC. Ukusakaza kwekhamera ngakunye kukhonjwa yisiteshi esiyingqayizivele esibonakalayo. Lesi sixazululo sokuhlanganisa sinikeza inzuzo eyengeziwe yokuvumela ukuxhumana okude okungafika ku-15m ukusuka kumakhamera kuya ku-SoC.

I-FPD-Link noma i-V3-Link serializers kanye nama-deserializers (SerDes), asekelwa ku-AM6x Linux SDK, ubuchwepheshe obudume kakhulu balolu hlobo lwesixazululo sokuhlanganisa se-CSI-2. Kokubili i-FPD-Link kanye ne-V3-Link deserializers ineziteshi ezingemuva ezingasetshenziswa ukuthumela amasiginali wokuvumelanisa uzimele ukuze avumelanise wonke amakhamera, njengoba kuchazwe ku-[7].
Umfanekiso 2-2 ubonisa i-exampukusetshenziswa kwe-SerDes ukuxhuma amakhamera amaningi ku-AM6x SoC eyodwa.

Umuntu wakudalaampLesi sixazululo sokuhlanganisa singatholakala ku-Arducam V3Link Camera Solution Kit. Le khithi inehabhu ye-deserializer ehlanganisa ukusakazwa kwekhamera okungu-4 CSI-2, kanye namapheya angu-4 wama-V3link serializers namakhamera e-IMX219, okuhlanganisa izintambo ze-FAKRA coaxial kanye nezintambo ezingu-22-pin FPC. Idizayini yesithenjwa okuxoxwe ngayo kamuva yakhelwe kule kit.

I-CSI-2 Aggregator ngaphandle kokusebenzisa i-SerDes
Lolu hlobo lwesihlanganisi lungakwazi ukuxhumana ngokuqondile namakhamera amaningi e-MIPI CSI-2 futhi luhlanganise idatha kusuka kuwo wonke amakhamera kuya kokuphumayo okukodwa kwe-CSI-2.

Umfanekiso 2-3 ubonisa i-example yesistimu enjalo. Lolu hlobo lwesixazululo sokuhlanganisa alusebenzisi noma iyiphi i-serializer/deserializer kodwa lunqunyelwe ibanga eliphakeme lokudluliswa kwedatha ye-CSI-2, elingafika ku-30cm. I-AM6x Linux SDK ayilusekeli lolu hlobo lwe-CSI-2 aggregator

Inika amandla amakhamera amaningi ku-Software

I-Camera Subsystem Software Architecture
Umfanekiso 3-1 ubonisa umdwebo webhulokhi wezinga eliphezulu wesofthiwe yesistimu yokuthwebula ikhamera ku-AM62A/AM62P Linux SDK, ehambisana nesistimu ye-HW kuMfanekiso 2-2.

Lesi sakhiwo sesofthiwe sinika amandla i-SoC ukuthi yamukele ukusakazwa kwamakhamera amaningi kusetshenziswa ama-SerDes, njengoba kuboniswe kuMfanekiso 2-2. I-FPD-Link/V3-Link SerDes yabela ikhamera ngayinye ikheli le-I2C eliyingqayizivele nesiteshi esibonakalayo. Imbondela yesihlahla sedivayisi ehlukile kufanele idalwe ngekheli le-I2C eliyingqayizivele layo yonke ikhamera. Umshayeli we-CSI-2 RX ubona ikhamera ngayinye esebenzisa inombolo eyingqayizivele yesiteshi futhi udale umongo we-DMA ngokusakaza ngakunye kwekhamera. Inodi yevidiyo idalelwe wonke umongo we-DMA. Idatha evela kukhamera ngayinye ibe isitholwa futhi igcinwe kusetshenziswa i-DMA kumemori ngokufanele. Izinhlelo zokusebenza zesikhala somsebenzisi zisebenzisa amanodi evidiyo ahambisana nekhamera ngayinye ukufinyelela idatha yekhamera. ExampIzifundo zokusebenzisa lesi sakhiwo sesoftware zinikezwe eSahlukweni 4 - I-Reference Design.
Noma yimuphi umshayeli wezinzwa othize othobela uhlaka lwe-V4L2 angaxhuma futhi adlale kulesi sakhiwo. Bheka ku-[8] mayelana nendlela yokuhlanganisa umshayeli wezinzwa omusha ku-Linux SDK.

I-Image Pipeline Software Architecture

I-AM6x Linux SDK ihlinzeka ngohlaka lwe-GStreamer (GST), olungasetshenziswa esikhaleni se-ser ukuhlanganisa izingxenye zokucubungula izithombe zezinhlelo zokusebenza ezihlukahlukene. Ama-Hardware Accelerators (HWA) ku-SoC, njenge-Vision Pre-processing Accelerator (VPAC) noma i-ISP, isifaki khodi/isiqophisi vidiyo, kanye nenjini yekhompyutha yokufunda ejulile, ifinyelelwa nge-GST. plugins. I-VPAC (ISP) ngokwayo inamabhulokhi amaningi, okuhlanganisa i-Vision Imaging Sub-System (VISS), I-Lens Distortion Correction (LDC), kanye ne-Multiscalar (MSC), ngalinye elihambisana ne-plugin ye-GST.

Umfanekiso 3-2 ubonisa umdwebo webhulokhi wepayipi lesithombe esijwayelekile ukusuka kukhamera ukuya ekubhaleni ngekhodi noma ekujuleni
izicelo zokufunda ku-AM62A. Ukuze uthole imininingwane eyengeziwe mayelana nokugeleza kwedatha ukusuka ekupheleni ukuya ekupheleni, bheka imibhalo ye-EdgeAI SDK.

Ku-AM62P, ipayipi lesithombe lilula ngoba ayikho i-ISP ku-AM62P.

Ngenodi yevidiyo edalelwe ikhamera ngayinye, ipayipi lesithombe elisuselwa ku-GStreamer livumela ukucutshungulwa kokufakwayo kwamakhamera amaningi (axhunywe ngesixhumi esibonakalayo se-CSI-2 RX) ngesikhathi esisodwa. Idizayini yesithenjwa esebenzisa i-GStreamer yezinhlelo zokusebenza zamakhamera amaningi inikezwe esahlukweni esilandelayo.

I-Reference Design

Lesi sahluko sethula umklamo oyisithenjwa wokusebenzisa izinhlelo zokusebenza zamakhamera amaningi ku-AM62A EVM, kusetshenziswa i-Arducam V3Link Camera Solution Kit ukuze kuxhunywe amakhamera angu-4 CSI-2 ku-AM62A nokusebenzisa ukutholwa kwento kuwo wonke amakhamera angu-4.

Amakhamera Asekelwe
Ikhithi ye-Arducam V3Link isebenza ngawo womabili amakhamera asuselwa ku-FPD-Link/V3-Link kanye namakhamera e-Raspberry Pi-ahambisana ne-CSI-2. Amakhamera alandelayo ahloliwe:

I-D3 Engineering D3RCM-IMX390-953
I-Leopard Imaging LI-OV2312-FPDLINKIII-110H

Amakhamera e-IMX219 ku-Arducam V3Link Camera Solution Kit

Isetha Amakhamera Amane e-IMX219
Landela imiyalelo ehlinzekwe kumhlahlandlela wokuqala osheshayo we-AM62A Starter Kit EVM ukuze usethe i-SK-AM62A-LP EVM (AM62A SK) kanye ne-ArduCam V3Link Camera Solution Quick Start Guide ukuxhuma amakhamera ku-AM62A SK ngekhithi ye-V3Link. Qiniseka ukuthi izikhonkwane zezintambo eziguqukayo, amakhamera, ibhodi le-V3Link, ne-AM62A SK zonke ziqondaniswe kahle.

Umfanekiso 4-1 ubonisa ukusethwa okusetshenziselwa ukwakheka kwesithenjwa kulo mbiko. Izingxenye eziyinhloko ekusetheni zihlanganisa:

1X SK-AM62A-LP EVM ibhodi
Ibhodi ye-adaptha ye-1X Arducam V3Link d-ch
Ikhebula le-FPC elixhuma i-Arducam V3Link ku-SK-AM62A

Ama-adaptha ekhamera e-4X V3Link (ama-serializer)
Izintambo ezingu-4X RF coaxial zokuxhuma ama-serializer e-V3Link ku-V3Link d-ch kit
4X IMX219 Amakhamera

4X CSI-2 22-pin izintambo zokuxhuma amakhamera kuma-serializer
Amakhebuli: Ikhebula le-HDMI, i-USB-C ukunika amandla i-SK-AM62A-LP kanye namandla angu-12V atholelwe ikhithi ye-V3Link d-ch)
Ezinye izingxenye ezingabonisiwe kuMfanekiso 4-1: ikhadi le-Micro-SD, intambo ye-Micro-USB ukuze ufinyelele ku-SK-AM62A-LP, ne-Ethernet ukuze usakaze.

Ilungiselela Amakhamera kanye ne-CSI-2 RX Interface
Setha isofthiwe ngokulandela imiyalelo enikezwe ku-Arducam V3Link Quick Start Guide. Ngemva kokusebenzisa isikripthi sokusetha ikhamera, i-setup-imx219.sh, ifomethi yekhamera, ifomethi yesixhumi esibonakalayo ye-CSI-2 RX, kanye nemizila esuka kukhamera ngayinye ukuya endaweni ehambisanayo yevidiyo izomiswa kahle. Ama-video node amane enzelwe amakhamera amane e-IMX219. Umyalo "v4l2-ctl -list-devices" ubonisa wonke amadivaysi evidiyo e-V4L2, njengoba kukhonjisiwe ngezansi:

Kukhona ama-video node angu-6 kanye ne-media node engu-1 ngaphansi kwe-tiscsi2rx. Inodi yevidiyo ngayinye ihambisana nomxholo we-DMA onikezwe umshayeli we-CSI2 RX. Kuma-video node angu-6, 4 asetshenziselwa amakhamera angu-4 IMX219, njengoba kukhonjisiwe ku-topology yamapayipi emidiya ngezansi:

Njengoba kuboniswe ngenhla, inkampane yemidiya 30102000.ticsi2rx inamaphedi omthombo angu-6, kodwa kusetshenziswa awokuqala angu-4 kuphela, ngalinye ku-IMX219 eyodwa. I-topology yamapayipi abezindaba ingaphinda iboniswe ngemidwebo. Qalisa umyalo olandelayo ukuze ukhiqize ichashazi file:

Bese ugijima umyalo ongezansi ku-PC host ye-Linux ukuze ukhiqize i-PNG file:

Umfanekiso 4-2 yisithombe esenziwe kusetshenziswa imiyalo enikezwe ngenhla. Izingxenye ekwakhiweni kwesoftware yoMfanekiso 3-1 zingatholakala kule grafu.

Ukusakaza kusuka kumakhamera amane
Ngokusethwa kwehadiwe nesofthiwe ngokuyikho, izinhlelo zokusebenza zamakhamera amaningi zingasebenza zisuka endaweni yomsebenzisi. Ku-AM62A, i-ISP kufanele ishunwe ukuze ikhiqize ikhwalithi yesithombe esihle. Bheka Umhlahlandlela Wokushuna we-AM6xA we-ISP mayelana nendlela yokwenza ukushuna kwe-ISP. Izigaba ezilandelayo zethula isibampokuncane kokusakaza idatha yekhamera kusibonisi, ukusakaza idatha yekhamera kunethiwekhi, nokugcina idatha yekhamera kuyo files.

Ukusakazwa kwedatha yekhamera ezoboniswa
Uhlelo lokusebenza oluyisisekelo lwalolu hlelo lwamakhamera amaningi ukusakaza amavidiyo kusuka kuwo wonke amakhamera kuya kusibonisi esixhunywe ku-SoC efanayo. Okulandelayo yi-GStreamer pipeline example yokusakaza i-IMX219 emine kusibonisi (izinombolo ze-node yevidiyo nezinombolo ze-v4l-subdev epayipini zingashintsha ukusuka ekuqaliseni kabusha kuya ekuqaliseni kabusha).

Sakaza Idatha Yekhamera nge-Ethernet
Esikhundleni sokusakaza isibonisi esixhunywe ku-SoC efanayo, idatha yekhamera ingasakazwa nge-Ethernet. Uhlangothi olutholayo lungaba enye iphrosesa ye-AM62A/AM62P noma i-PC engumsingathi. Okulandelayo yi-example yokusakaza idatha yekhamera nge-Ethernet (usebenzisa amakhamera amabili ukwenza lula) (qaphela i-plugin yesishumeki esisetshenziswe epayipini):

Okulandelayo yi-exampUkuthola idatha yekhamera nokusakazwa kusibonisi kwenye iphrosesa ye-AM62A/AM62P:

Igcina Idatha Yekhamera ku Files
Esikhundleni sokusakaza-bukhoma kusibonisi noma ngenethiwekhi, idatha yekhamera ingagcinwa endaweni files. Ipayipi elingezansi ligcina idatha yekhamera ngayinye ku- file (usebenzisa amakhamera amabili njenge-example ukuze kube lula).

I-Multicamera Deep Learning Inference

I-AM62A ifakwe isisheshisi sokufunda esijulile (i-C7x-MMA) esifika kuma-TOPS amabili, akwazi ukusebenzisa izinhlobo ezahlukene zamamodeli okufunda okujulile okuhlukanisa, ukutholwa kwezinto, ukuhlukaniswa kwe-semantic, nokuningi. Lesi sigaba sibonisa ukuthi i-AM62A ingakwazi kanjani ukusebenzisa ngesikhathi esisodwa amamodeli okufunda amane ajulile kuma-feed amakhamera amane ahlukene.

Ukukhetha Imodeli
I-TI's EdgeAI-ModelZoo inikeza amakhulukhulu amamodeli esimanjemanje, aguqulwayo/akhishelwa ngaphandle kusukela kuzinhlaka zawo zokuqeqesha zangempela ukuya kufomethi e-anembedded-friendly ukuze akwazi ukulayishwa kusisheshisi sokufunda esijulile se-C7x-MMA. I-Edge AI Studio Model Analyzer esekwe emafini inikeza ithuluzi “lokukhetha imodeli” elisebenziseka kalula. Ibuyekezwa ngamandla ukuze ifake wonke amamodeli asekelwa ku-TI EdgeAI-ModelZoo. Ithuluzi alidingi ulwazi lwangaphambilini futhi linikeza isixhumi esibonakalayo esisebenziseka kalula ukuze ufake izici ezidingekayo kumodeli oyifunayo.

I-TFL-OD-2000-ssd-mobV1-coco-mlperf ikhethelwe lesi silingo sokufunda okujulile samakhamera amaningi. Le modeli yokutholwa kwezinto eziningi ithuthukiswa kuhlaka lwe-TensorFlow enokulungiswa kokufaka okungu-300×300. Ithebula 4-1 libonisa izici ezibalulekile zalo modeli lapho uqeqeshwa kudathasethi ye-cCOCO enamakilasi ahlukene angaba ngu-80.

Ithebula 4-1. Gqamisa Izici ze-Model TFL-OD-2000-ssd-mobV1-coco-mlperf.

Imodeli	Umsebenzi	Isixazululo	I-FPS	I-map 50% Ukunemba Ku-COCO	Ukubambezeleka/Uhlaka (ms)	DDR BW Ukusetshenziswa (MB/ Uzimele)
TFL-OD-2000-ssd- mobV1-coco-mlperf	Ukutholwa Kwezinto Eziningi	300×300	~152	15.9	6.5	18.839

Ukusethwa Kwepayipi
Umfanekiso 4-3 ubonisa ipayipi lokufunda elijulile le-GStreamer elinamakhamera angu-4. I-TI ihlinzeka ngohlelo lwe-GStreamer plugins okuvumela ukuthulula okunye ukucutshungulwa kwemidiya kanye nencazelo ejulile yokufunda kuma-accelerator wehadiwe. Abanye exampokuncane kwalokhu plugins kufaka phakathi i-tiovxisp, i-tiovxmultiscaler, i-tiovxmosaic, ne-tidlinferer. Ipayipi elikuMdwebo 4-3 lihlanganisa konke okudingekayo plugins ngepayipi le-GStreamer le-multipath yokokufaka kwamakhamera angu-4, ngayinye enenqubo yangaphambili yemidiya, inkomba yokufunda ejulile, kanye nenqubo yangemuva. Okuphindiwe plugins kumzila ngamunye wekhamera kustakiwe kugrafu ukuze kube lula ukuboniswa.
Izinsiza ezitholakalayo zehadiwe zisakazwa ngokulinganayo phakathi kwezindlela ezine zamakhamera. Isibonelo, i-AM62A iqukethe izikali zezithombe ezimbili: i-MSC0 ne-MSC1. Ipayipi linikezela ngokusobala i-MSC0 ukucubungula izindlela zekhamera 1 kanye nekhamera 2, kuyilapho i-MSC1 inikezelwe kukhamera 3 kanye nekhamera 4.

Okukhiphayo kwamapayipi amakhamera amane kwehliswa futhi kuhlanganiswe ndawonye kusetshenziswa i-tiovxmosaic plugin. Okukhiphayo kuboniswa esikrinini esisodwa. Umfanekiso 4-4 ubonisa okukhiphayo kwamakhamera amane anemodeli yokufunda ejulile esebenzisa ukutholwa kwento. Ipayipi ngalinye (ikhamera) lisebenza ku-30 FPS kanye nesamba esingu-120 FPS.

Okulandelayo iskripthi sephayiphi egcwele yecala lokusebenzisa ukufunda okujulile kwekhamera eningi eliboniswe kuMfanekiso 4-3.

Ukuhlaziya Ukusebenza

Ukusetha okunamakhamera amane asebenzisa ibhodi le-V3Link kanye ne-AM62A SK kwavivinywa ezimweni ezihlukahlukene zohlelo lokusebenza, okuhlanganisa ukuboniswa ngokuqondile esikrinini, ukusakaza nge-Ethernet (iziteshi ezine ze-UDP), ukuqopha ku-4 ehlukene. files, kanye nencazelo ejulile yokufunda. Esivivinyweni ngasinye, siqaphe izinga lozimele kanye nokusetshenziswa kwama-CPU cores ukuze sihlole amakhono esistimu yonke.

Njengoba kuboniswe ngaphambilini Emfanekisweni 4-4, ipayipi lokufunda okujulile lisebenzisa i-plugin ye-tiperfoverlay GStreamer ukuze ibonise imithwalo eyinhloko ye-CPU njengegrafu yebha ngaphansi kwesikrini. Ngokuzenzakalelayo, igrafu ibuyekezwa njalo ngemizuzwana emibili ukuze ibonise imithwalo njengephesenti lokusetshenziswatage. Ngokungeziwe ku-plugin ye-tiperfoverlay GStreamer, ithuluzi le-perf_stats liyinketho yesibili yokubonisa ukusebenza okubalulekile ngqo kutheminali ngenketho yokulondoloza ku- file. Leli thuluzi linembe kakhulu uma liqhathaniswa ne-tTiperfoverlayas eyokugcina ingeza umthwalo owengeziwe kuma-ARMm cores kanye ne-DDR ukudweba igrafu nokuyimboza esikrinini. Ithuluzi le-perf_stats lisetshenziswa kakhulu ukuqoqa imiphumela yokusebenzisa ihadiwe kuzo zonke izimo zokuhlola eziboniswe kulo mbhalo. Amanye ama-cores okucubungula abalulekile nama-accelerator afundwe kulezi zivivinyo ahlanganisa ama-processor amakhulu (ama-A53 Arm cores amane @ 1.25GHz), isisheshisi esijulile sokufunda (C7x-MMA @ 850MHz), i-VPAC (ISP) ene-VISS kanye nama-multiscaler (MSC0 ne-MSC1), kanye nemisebenzi ye-DDR.

Ithebula 5-1 libonisa ukusebenza kanye nokusetshenziswa kwensiza lapho usebenzisa i-AM62A enamakhamera amane ezimweni ezintathu zokusetshenziswa, okuhlanganisa ukusakaza amakhamera amane kusibonisi, ukusakaza nge-Ethernet, nokuqopha kumakhamera amane ahlukene. files. Kusetshenziswa izivivinyo ezimbili esimweni ngasinye sokusetshenziswa: ngekhamera kuphela kanye nencazelo ejulile yokufunda. Ngaphezu kwalokho, umugqa wokuqala kuThebula 5-1 ubonisa ukusetshenziswa kwezingxenyekazi zekhompiyutha lapho kuphela isistimu yokusebenza eyayisebenza ku-AM62A ngaphandle kwezinhlelo zokusebenza zomsebenzisi. Lokhu kusetshenziswa njengesisekelo sokuqhathanisa lapho kuhlolwa ukusetshenziswa kwehadiwe kwamanye amacala okuhlola. Njengoba kukhonjisiwe kuthebula, amakhamera amane anokufunda okujulile nokuboniswa kwesikrini asebenza ku-30 FPS ngalinye, anesamba se-120 FPS kumakhamera amane. Leli zinga eliphezulu lozimele lifinyelelwa ngama-86% kuphela we-deep learning accelerator (C7x-MMA) umthamo ogcwele. Ngaphezu kwalokho, kubalulekile ukuqaphela ukuthi isisheshisi sokufunda esijulile savalwa ku-850MHz esikhundleni sika-1000MHz kulezi zivivinyo, okungama-85% kuphela okusebenza kwaso okuphezulu.

Ithebula 5-1. Ukusebenza (i-FPS) nokusetshenziswa kwensiza kwe-AM62A uma isetshenziswa namakhamera angu-4 IMX219 wokuboniswa kwesikrini, i-Ethernet Stream, Rekhoda ku- Files, kanye nokwenza i-Deep Learning Inferencing

Uhlelo lokusebenza n	Ipayipi (ukusebenza )	Okukhiphayo	I-FPS ipayipi elimaphakathi s	I-FPS ingqikithi	I-MPUs A53s @ 1.25 GHz [%]	I-MCU R5 [%]	I-DLA (C7x- MMA) @ 850 MHz [%]	VAKALISA [%]	I-MSC0 [%]	I-MSC1 [%]	I-DDR Rd [MB/s]	I-DDR Wr [MB/s]	I-DDR Ingqikithi [MB/s]
Alukho uhlelo lokusebenza	Isisekelo Akukho ukusebenza	NA	NA	NA	1.87	1	0	0	0	0	560	19	579
Ikhamera kuphela	Sakaza ku-Screen	Isikrini	30	120	12	12	0	70	61	60	1015	757	1782
	Sakaza nge-Ethernet	I-UDP: 4 amachweba 1920×1080	30	120	23	6	0	70	0	0	2071	1390	3461
	Qopha ku files	4 files 1920×1080	30	120	25	3	0	70	0	0	2100	1403	3503
Ikhamera ngokufunda Okujulile	Ukufunda okujulile: Ukutholwa kwento MobV1- coco	Isikrini	30	120	38	25	86	71	85	82	2926	1676	4602
	Ukufunda okujulile: Ukutholwa kwento i-MobV1- coco kanye nokusakaza nge-Ethernet	I-UDP: 4 amachweba 1920×1080	28	112	84	20	99	66	65	72	4157	2563	6720
	Ukufunda okujulile: Ukutholwa kwento MobV1- coco bese urekhoda ku files	4 files 1920×1080	28	112	87	22	98	75	82	61	2024	2458	6482

Isifinyezo
Lo mbiko wohlelo lokusebenza uchaza ukuthi zisetshenziswa kanjani izinhlelo zokusebenza zamakhamera amaningi emndenini we-AM6x wamadivayisi. Idizayini eyireferensi esuselwe ku-Arducam's V3Link Camera Solution Kit kanye ne-AM62A SK EVM inikeziwe embikweni, nezinhlelo zokusebenza zamakhamera ezimbalwa ezisebenzisa amakhamera amane e-IMX219, njengokusakaza-bukhoma nokutholwa kwento. Abasebenzisi bayakhuthazwa ukuthi bathole i-V3Link Camera Solution Kit ku-Arducam futhi baphindaphinde lezi ziboneloampLes. Umbiko uphinde uhlinzeke ngokuhlaziywa okuningiliziwe kokusebenza kwe-AM62A ngenkathi kusetshenziswa amakhamera amane ngaphansi kokuhlelwa okuhlukahlukene, okuhlanganisa ukuvezwa esikrinini, ukusakaza nge-Ethernet, nokuqopha files. Iphinde ibonise amandla e-AM62A'sA okwenza inkomba yokufunda ejulile kumakhamera amane ahlukene ngokuhambisana. Uma kukhona imibuzo mayelana nokugijima lezi examples, thumela uphenyo esithangamini se-TI E2E.

Izithenjwa

I-AM62A Starter Kit EVM Umhlahlandlela Wokuqala Okusheshayo

I-ArduCam V3Link Camera Solution Quick Guide
Imibhalo ye-Edge AI SDK ye-AM62A
Amakhamera e-Edge AI Smart Asebenzisa Iphrosesa ye-AM62A Eyonga Amandla

I-Mirror Mirror Systems ku-AM62A
Amasistimu Okuqapha Umshayeli Nomsebenzi ku-AM62A
Isicelo Sekhamera Yesiteshi Esine Indawo Ezungezile View kanye ne-CMS Camera Systems

I-AM62Ax Linux Academy ekunikezeni amandla inzwa ye-CIS-2
I-Edge AI ModelZoo
I-Edge AI Studio

Ithuluzi le-Perf_stats

Izingxenye ze-TI ezibhekiswe kulolu hlelo lokusebenza:

https://www.ti.com/product/AM62A7

ISAZISO ESIBALULEKILE KANYE NOMKHONDO

I-TI INIKEZA IDATHA YOBUCHWEPHESHE NOKUTHEMBEKA (KUHLANGANISA NAMANAZULU EDATHA), IZISIZATHU ZOKUDIYINA (KUHLANGANISA AMAQINISO ESIQINISEKISO), ISICELO NOMA EZINYE ISELULEKO SOKHIPHA, WEB AMATHULUSI, ULWAZI LOKUPHEPHA, KANYE NEZINYE IZINSIZA EZINYE “NJENGOBA ZINJALO” NAWO WONKE AMAPHUTHA, FUTHI IZINDULA ZONKE IZIQINISEKISO, EZISHIYELWE KAKHULU KANYE OKANYE OKUSHIWO, KUHLANGANISA NGAPHANDLE KOMKHAWULO IZIQINISEKISO EZISHIYELWE ZOKUTHENGISA, UKULUNGELA INKAMPANI ETHILE. AMALUNGELO EMPAHLA .

Lezi zinsiza zihloselwe onjiniyela abanekhono abaklama ngemikhiqizo ye-TI. Unesibopho sakho kuphela

ukukhetha imikhiqizo ye-TI efanele yesicelo sakho,

ukuklama, ukuqinisekisa, nokuhlola isicelo sakho, futhi
ukuqinisekisa ukuthi isicelo sakho sihlangabezana nezindinganiso ezisebenzayo, kanye nanoma yikuphi okunye ukuphepha, ukuphepha, iziqondiso, noma ezinye izimfuneko.

Lezi zinsiza zingase zishintshe ngaphandle kwesaziso. I-TI ikuvumela ukuthi usebenzise lezi zinsiza kuphela ukuthuthukisa uhlelo lokusebenza olusebenzisa imikhiqizo ye-TI echazwe kusisetshenziswa. Okunye ukukhiqizwa nokuvezwa kwalezi zinsiza akuvunyelwe. Ayikho ilayisensi enikezwa noma yiliphi elinye ilungelo lempahla yengqondo ye-TI noma kunoma yiliphi ilungu lesithathu lempahla yengqondo. I-TI iyakulahla isibopho salokho, futhi uzobuyisela ngokugcwele i-TI nabameleli bayo, kunoma yiziphi izimangalo, umonakalo, izindleko, ukulahlekelwa, nezikweletu ezivela ngokusebenzisa kwakho lezi zinsiza.

Imikhiqizo ye-TI inikezwa ngaphansi Kwemigomo Yokuthengisa ye-TI noma eminye imigomo esebenzayo etholakalayo ti.com noma ihlinzekwe ngokuhambisana nemikhiqizo enjalo ye-TI. Ukunikezwa kwe-TI kwalezi zinsiza akukhuli noma akuguquli iziqinisekiso ezisebenzayo ze-TI noma imishwana yokuzihlangula yesiqinisekiso yemikhiqizo ye-TI.

I-TI iyaphikisana futhi yenqaba noma yimiphi imigomo eyengeziwe noma ehlukile okungenzeka ukuthi uyihlongozile.

ISAZISO ESIBALULEKILE

Ikheli Leposi: Texas Instruments, Post Office Box 655303, Dallas, Texas 75265

imibuzo ejwayelekile ukubuzwa

Q: Ngingakwazi ukusebenzisa noma yiluphi uhlobo lwekhamera nomndeni we-AM6x wamadivayisi?

Umndeni we-AM6x usekela izinhlobo ezahlukene zamakhamera, okuhlanganisa nalawo ane-ISP eyakhelwe ngaphakathi noma engenawo. Bheka ukucaciswa ukuze uthole imininingwane eyengeziwe ngezinhlobo zamakhamera asekelwayo.

: Yimuphi umehluko omkhulu phakathi kwe-AM62A ne-AM62P ekucutshungulweni kwesithombe?

Izinguquko ezibalulekile zihlanganisa izinhlobo zamakhamera ezisekelwayo, idatha yokuphuma kwekhamera, ukuba khona kwe-ISP HWA, i-Deep Learning HWA, kanye ne-3-D Graphics HWA. Bheka esigabeni sokucaciswa ukuze uthole ukuqhathanisa okuningiliziwe.

Amadokhumenti / Izinsiza

I-Texas Instruments AM6x Ithuthukisa Ikhamera Eningi [pdf] Umhlahlandlela Womsebenzisi
I-AM62A, AM62P, AM6x Ukuthuthukisa Ikhamera Eningi, i-AM6x, Ukuthuthukisa Ikhamera Eningi, Ikhamera Eningi, Ikhamera

Izithenjwa

Imaniwali yosebenzisayo