Texas Zvishandiso AM6x Kugadzira Yakawanda Kamera Mushandisi Yekushandisa

Chengetedzo Yekutarisa: Inovandudza kuvharika kwekutarisa, kutarisisa chinhu, uye kurongeka kwekuziva.
Surround View: Inogonesa kuratidzwa kwestereo kumabasa akaita sekuona zvipingaidzo uye kugadzirisa chinhu.

Kabhini Recorder uye Kamera Mirror System: Inopa kuvharika kwakawedzera uye inobvisa mapofu mavara.
Medical imaging: Inopa yakawedzera kurongeka mukuvhiya navigation uye endoscopy.

Drones uye Aerial Imaging: Bata mifananidzo yakakwira-resolution kubva kumakona akasiyana ekushandisa kwakasiyana.

Kubatanidza Multiple CSI-2 Makamera kune iyo SoC:
Kuti ubatanidze akawanda CSI-2 makamera kuSoC, tevera nhungamiro inopihwa mubhuku remushandisi. Ita shuwa kurongeka kwakaringana uye kubatana kwekamera yega yega kune yakatemerwa zviteshi paSoC.

Application Note
Kugadzira Multiple-Kamera Zvishandiso paAM6x

Jianzhong Xu, Qutaiba Saleh

ABSTRACT
Chirevo ichi chinotsanangura kusimudzira kwekushandisa uchishandisa akawanda CSI-2 makamera pane AM6x mhuri yemidziyo. Dhizaini yedhizaini yekuonekwa kwechinhu nekudzidza kwakadzama pamakamera mana paAM4A SoC inounzwa nekuongororwa kwekuita. General misimboti yedhizaini inoshanda kune mamwe maSoCs ane CSI-62 interface, senge AM2x uye AM62P.

Nhanganyaya

Makamera akaiswa anoita basa rakakosha muhurongwa hwemazuva ano hwekuona. Kushandisa akawanda makamera muhurongwa kunowedzera kugona kweaya masisitimu uye kunogonesa kugona kusingagoneke nekamera imwe chete. Pazasi pane vamwe vekareampzvishoma zvekushandisa uchishandisa akawanda akamisikidzwa makamera:

Chengetedzo Yekutarisa: Makamera akawanda akaiswa zvine hungwaru anopa yakazara yekutarisa kufukidzwa. Ivo vanogonesa panoramic views, kuderedza mapofu, uye kuwedzera kurongeka kwekutsvaga kwechinhu uye kuzivikanwa, kuvandudza zviyero zvekuchengetedza zvakazara.
Surround View: Makamera akawanda anoshandiswa kugadzira stereo yekuona setup, inogonesa ruzivo rwematatu-dimensional uye fungidziro yekudzika. Izvi zvakakosha kumabasa akadai sekuona zvipingamupinyi mumotokari dzinozvimiririra, kunyatsoita zvinhu mumarobhoti, uye nekusimudzira realism yeaugmented reality experiences.

Cabin Recorder uye Kamera Mirror System: Rekodha yemotokari kabhini ine akawanda makamera inogona kupa yakawanda kufukidzwa uchishandisa imwechete processor. Saizvozvo, kamera girazi system ine maviri kana anopfuura makamera anogona kuwedzera mutyairi munda we view uye kubvisa mapofu kubva kumativi ose emotokari.
Kufungidzira Kwezvokurapa: Makamera akawanda anogona kushandiswa mukufungidzira kwekurapa kumabasa akaita sekuvhiya navigation, kupa vanachiremba vanovhiya vane akawanda maonero ekuwedzera kurongeka. Mu endoscopy, makamera akawanda anogonesa kunyatsoongorora nhengo dzemukati.

Drones uye Aerial Imaging: Drones dzinowanzouya dzakashongedzerwa nemakamera akawanda kutora mifananidzo yakakwira-resolution kana mavhidhiyo kubva kumakona akasiyana. Izvi zvinobatsira mumashandisirwo akaita semuchadenga mafoto, kuongorora zvekurima, uye kuongorora ivhu.
Nekufambira mberi kwemamicroprocessors, akawanda makamera anogona kubatanidzwa mune imwechete System-on-Chip.
(SoC) kupa compact uye inoshanda mhinduro. Iyo AM62Ax SoC, ine-yepamusoro-inoshanda vhidhiyo / kuona kugadzirisa uye kwakadzama kukwidziridza kudzidza, chishandiso chakakodzera kune chataurwa pamusoro apa. Imwe AM6x mudziyo, iyo AM62P, yakavakirwa yepamusoro-inoshanda yakamisikidzwa 3D kuratidza zvikumbiro. Yakashongedzerwa ne 3D graphics kukwidziridzwa, iyo AM62P inokwanisa kusona pamwechete mifananidzo kubva kune akawanda makamera uye kuburitsa yakakwirira-resolution panoramic. view. Zvinhu zvitsva zve AM62A/AM62P SoC zvakaiswa muzvinyorwa zvakasiyana-siyana, zvakadai se [4], [5], [6], etc. Ichi chinyorwa chekushandisa hachizodzokorora izvo tsanangudzo yezvinyorwa asi panzvimbo pacho chinotarisa kubatanidza makamera akawanda eCSI-2 mumapurogiramu ekuona akaiswa pa AM62A/AM62P.

Tafura 1-1 inoratidza misiyano mikuru pakati pe AM62A ne AM62P maererano nekugadziriswa kwemifananidzo.

Tafura 1-1. Misiyano Pakati pe AM62A ne AM62P muKugadzira Mifananidzo

SoC	AM62A	AM62P
Inotsigirwa Kamera Type	Iine kana isina yakavakirwa-mukati ISP	Ne Yakavakwa-mukati ISP
Camera Output Data	Raw/YUV/RGB	YUV/RGB
ISP HWA	Ehe	Aihwa
Kudzidza Kwakadzika HWA	Ehe	Aihwa
3-D Graphics HWA	Aihwa	Ehe

Kubatanidza Multiple CSI-2 Makamera kune iyo SoC
Iyo Kamera Subsystem pane AM6x SoC ine zvinotevera zvikamu, sezvakaratidzwa mumufananidzo 2-1:

MIPI D-PHY Receiver: inogamuchira vhidhiyo hova kubva kunze kwekamera, inotsigira kusvika ku1.5 Gbps panzira yedata ye4 nzira.

CSI-2 Receiver (RX): inogamuchira vhidhiyo hova kubva kuD-PHY inogamuchira uye ingave inotumira zvakananga nzizi kuISP kana kurasa data kuDDR memory. Iyi module inotsigira anosvika gumi nematanhatu chiteshi.
SHIM: DMA wrapper inogonesa kutumira hova dzakatorwa kundangariro pamusoro peDMA. Multiple DMA mamiriro anogona kugadzirwa neiyi wrapper, ine yega yega mamiriro inoenderana neyakajeka chiteshi cheCSI-2 Receiver.

Makamera akawanda anogona kutsigirwa paAM6x kuburikidza nekushandiswa kwechokwadi chiteshi cheCSI-2 RX, kunyangwe paine imwe chete CSI-2 RX interface paSoC. Yekunze CSI-2 yekubatanidza chikamu inodiwa kubatanidza akawanda kamera hova uye kutumira kune imwechete SoC. Mhando mbiri dzeCSI-2 aggregating solutions dzinogona kushandiswa, dzinotsanangurwa muzvikamu zvinotevera.

CSI-2 Aggregator Ichishandisa SerDes
Imwe nzira yekubatanidza akawanda kamera hova ndeye kushandisa serializing uye deserializing (SerDes) mhinduro. Iyo CSI-2 data kubva kune yega kamera inoshandurwa ne serializer uye inotamiswa kuburikidza netambo. Iyo deserializer inogamuchira ese serialized data inotamiswa kubva kumatambo (imwe tambo pakamera), inoshandura nzizi kudzokera kuCSI-2 data, uye yozotumira yakasangana CSI-2 rukova kune imwechete CSI-2 RX interface paSoC. Imwe neimwe kamera inoyerera inoratidzwa neyakasarudzika chaiyo chiteshi. Iyi mhinduro yekuunganidza inopa iyo yekuwedzera bhenefiti yekubvumidza kureba kwekubatanidza kusvika ku15m kubva kumakamera kuenda kuSoC.

Iyo FPD-Link kana V3-Link serializers uye deserializers (SerDes), inotsigirwa muAM6x Linux SDK, ndiyo inonyanya kufarirwa matekinoroji emhando iyi yeCSI-2 aggregating solution. Ose ari maviri FPD-Link uye V3-Link deserializers ane kumashure chiteshi anogona kushandiswa kutumira furemu sync masiginecha kuwiriranisa ese makamera, sezvakatsanangurwa mu [7].
Mufananidzo 2-2 unoratidza example rekushandisa maSerDes kubatanidza akawanda makamera kune imwechete AM6x SoC.

Anove example yeiyi mhinduro yekuunganidza inogona kuwanikwa muArducam V3Link Kamera Solution Kit. Iyi kit ine deserializer hub inounganidza 4 CSI-2 kamera hova, pamwe ne 4 paviri eV3link serializers uye IMX219 kamera, kusanganisira FAKRA coaxial tambo uye 22-pini FPC tambo. Iyo referensi dhizaini inokurukurwa gare gare yakavakirwa pane iyi kit.

CSI-2 Aggregator pasina Kushandisa SerDes
Iyi mhando yeaggregator inogona kutarisana zvakananga neakawanda MIPI CSI-2 makamera uye kuunganidza iyo data kubva kumakamera ese kune imwechete CSI-2 inobuda rwizi.

Mufananidzo 2-3 unoratidza exampyehurongwa hwakadaro. Iyi mhando yeaggregating solution haishandisi chero serializer/deserializer asi inoganhurwa nehupamhi hwedaro reCSI-2 data transfer, iyo inosvika 30cm. Iyo AM6x Linux SDK haitsigire rudzi urwu rweCSI-2 aggregator

Kugonesa Multiple Camera muSoftware

Kamera Subsystem Software Architecture
Mufananidzo 3-1 inoratidza yakakwira-level block dhizaini yecamera capture system software mu AM62A/AM62P Linux SDK, inoenderana neHW system muMufananidzo 2-2.

Iyi software yekuvaka inoita kuti SoC igamuchire akawanda kamera hova nekushandiswa kweSerDes, sezvakaratidzwa muFigure 2-2. Iyo FPD-Link/V3-Link SerDes inopa yakasarudzika I2C kero uye chaiyo chiteshi kune yega yega kamera. Iyo yakasarudzika mudziyo wemuti wakafukidzwa unofanirwa kugadzirwa ine yakasarudzika I2C kero kune yega kamera. Mutyairi weCSI-2 RX anoona kamera yega yega ichishandisa yakasarudzika chiteshi nhamba uye inogadzira mamiriro eDMA parukova rwekamera. Vhidhiyo node inogadzirwa kune yega DMA mamiriro. Dhata kubva kune yega kamera inozogamuchirwa uye kuchengetwa uchishandisa DMA kundangariro zvinoenderana. Mushandisi nzvimbo yekushandisa anoshandisa vhidhiyo node inoenderana nekamera yega yega kuwana data rekhamera. Exampzvishoma zvekushandisa iyi software yekuvaka zvinopihwa muChitsauko 4 - Reference Dhizaini.
Chero chaiyo sensor mutyairi anowirirana neV4L2 chimiro anogona plug uye kutamba mune ino dhizaini. Tarisa ku [8] maererano nekubatanidza mutyairi mutsva muLinux SDK.

Mufananidzo Pipeline Software Architecture

Iyo AM6x Linux SDK inopa iyo GStreamer (GST) dhizaini, iyo inogona kushandiswa munzvimbo ye ser kubatanidza iyo mifananidzo yekugadzirisa zvikamu zvekushandisa kwakasiyana. Iyo Hardware Accelerators (HWA) paSoC, yakadai seVision Pre-processing Accelerator (VPAC) kana ISP, vhidhiyo encoder/decoder, uye yakadzika yekudzidza komputa injini, inowanikwa kuburikidza neGST. plugins. Iyo VPAC (ISP) pachayo ine zvidhinha zvakawanda, zvinosanganisira Vision Imaging Sub-System (VISS), Lens Distortion Correction (LDC), uye Multiscalar (MSC), imwe neimwe inoenderana neGST plugin.

Mufananidzo 3-2 inoratidza dhayagiramu yebhuroka yepiipi yemufananidzo kubva pakamera kuenda kune encoding kana kudzika
kudzidza zvikumbiro pa AM62A. Kuti uwane rumwe ruzivo nezve yekupedzisira-kusvika-kumagumo data kuyerera, tarisa kune EdgeAI SDK zvinyorwa.

Kune AM62P, pombi yemufananidzo iri nyore nekuti hapana ISP paAM62P.

Iine vhidhiyo node yakagadzirwa kune imwe neimwe yekamera, iyo GStreamer-yakavakirwa mufananidzo pombi inobvumira kugadziridzwa kweakawanda kamera yekupinza (yakabatana kuburikidza yakafanana CSI-2 RX interface) panguva imwe chete. Dhizaini yereferensi uchishandisa GStreamer kune akawanda-kamera maapplication anopihwa muchitsauko chinotevera.

Reference Design

Ichi chitsauko chinopa referensi dhizaini yekumhanyisa akawanda-kamera application paAM62A EVM, uchishandisa iyo Arducam V3Link Kamera Solution Kit kubatanidza 4 CSI-2 kamera ku AM62A uye inomhanyisa kuona chinhu kumakamera ese mana.

Inotsigirwa Makamera
Iyo Arducam V3Link kit inoshanda neese FPD-Link/V3-Link-based makamera uye Raspberry Pi-inoenderana CSI-2 kamera. Makamera anotevera akaedzwa:

D3 Injiniya D3RCM-IMX390-953
Leopard Imaging LI-OV2312-FPDLINKIII-110H

IMX219 makamera muArducam V3Link Kamera Solution Kit

Kumisikidza ina IMX219 Makamera
Tevedza mirairo yakapihwa mu AM62A Starter Kit EVM Kurumidza Kutanga Guide kuseta iyo SK-AM62A-LP EVM (AM62A SK) uye ArduCam V3Link Kamera Solution Kurumidza Kutanga Guide kubatanidza makamera kuAM62A SK kuburikidza neV3Link kit. Ita shuwa kuti mapini ari patambo dzinochinjika, makamera, V3Link bhodhi, uye AM62A SK ese akanyatsoenderana.

Mufananidzo 4-1 inoratidza kuseta yakashandiswa kudhizaini yereferensi mumushumo uyu. Zvikamu zvikuru mukugadzirisa zvinosanganisira:

1X SK-AM62A-LP EVM bhodhi
1X Arducam V3Link d-ch adapta bhodhi
FPC tambo yekubatanidza Arducam V3Link kune SK-AM62A

4X V3Link kamera adapters (serializers)
4X RF coaxial tambo dzekubatanidza V3Link serializers kuV3Link d-ch kit
4X IMX219 makamera

4X CSI-2 22-pini tambo dzekubatanidza makamera kune serilizers
Matambo: HDMI tambo, USB-C kusimba SK-AM62A-LP uye 12V simba rakagadzirirwa V3Link d-ch kit)
Zvimwe zvikamu zvisina kuratidzwa muMufananidzo 4-1: micro-SD kadhi, micro-USB tambo yekuwana SK-AM62A-LP, uye Ethernet yekutenderera.

Kugadzirisa Makamera uye CSI-2 RX Interface
Seta iyo software zvinoenderana nemirairo yakapihwa muArducam V3Link Kurumidza Kutanga Guide. Mushure mekushandisa script yekuseta kamera, setup-imx219.sh, chimiro chekhamera, iyo CSI-2 RX interface fomati, uye nzira kubva kune yega kamera kuenda kune inoenderana vhidhiyo node ichagadziriswa nemazvo. Manodhi mana evhidhiyo anogadzirwa kune ina IMX219 kamera. Raira "v4l2-ctl -list-devices" inoratidza ese V4L2 vhidhiyo zvishandiso, sezvakaratidzwa pazasi:

Kune matanhatu evhidhiyo node uye 6 midhiya node pasi petiscsi1rx. Imwe neimwe vhidhiyo node inoenderana neDMA mamiriro akagoverwa neCSI2 RX mutyairi. Kunze kwe2 vhidhiyo node, 6 anoshandiswa kune 4 IMX4 kamera, sezvakaratidzwa mune midhiya pombi topology pazasi:

Sezvaratidzwa pamusoro, media entity 30102000.ticsi2rx ine 6 sosi pads, asi yekutanga 4 chete ndiyo inoshandiswa, imwe neimwe yeIMX219 imwe. Iyo media pombi topology inogona zvakare kuenzanisirwa nemifananidzo. Mhanya unotevera kuraira kuti uite dot file:

Wobva wamhanyisa iwo murairo pazasi pane Linux host PC kugadzira PNG file:

Mufananidzo 4-2 mufananidzo wakagadzirwa uchishandisa mirairo yakapihwa pamusoro. Izvo zvikamu zviri musoftware architecture yeFigure 3-1 zvinogona kuwanikwa mune ino girafu.

Kutenderera kubva kuMakamera mana
Nezvose zviri zviviri Hardware uye software kumisikidzwa nemazvo, akawanda-kamera maapplication anogona kumhanya kubva munzvimbo yemushandisi. Ye AM62A, iyo ISP inofanirwa kugadziridzwa kuti ibudise kunaka kwemufananidzo. Tarisa kune iyo AM6xA ISP Tuning Guide yemaitirwo eISP tuning. Zvikamu zvinotevera zvinopa exampmashoma ekutepfenyura data yekamera kuchiratidziro, kutenderera kamera data kunetiweki, uye kuchengetedza iyo kamera data kune files.

Yekutepfenyura Kamera Dhata kuratidza
Chishandiso chakakosha cheiyi akawanda-kamera sisitimu ndeyekufambisa mavhidhiyo kubva kumakamera ese kune chiratidziro chakabatana kune imwecheteyo SoC. Izvi zvinotevera GStreamer pombi example yekutepfenyura ina IMX219 kune chiratidziro (iyo vhidhiyo node nhamba uye v4l-subdev nhamba mupombi ingangochinja kubva pakutangazve kuti itangezve).

Kutenderera Kamera Data kuburikidza neEthernet
Panzvimbo pekutenderera kune chiratidziro chakabatana kune imwecheteyo SoC, iyo kamera data inogona zvakare kufambiswa kuburikidza neEthernet. Rutivi rwunogamuchira runogona kuve imwe AM62A/AM62P processor kana PC inotambira. Inotevera ndeye example yekutepfenyura data yekamera kuburikidza neEthernet (uchishandisa makamera maviri kuti zvive nyore) (ona iyo encoder plugin inoshandiswa mupombi):

Inotevera ndeye example yekugamuchira iyo kamera data uye kutenderera kune chiratidziro pane imwe AM62A/AM62P processor:

Kuchengeta Kamera Data ku Files
Panzvimbo pekutenderera kuchiratidziro kana kuburikidza netiweki, iyo kamera data inogona kuchengetwa munharaunda files. Iyo pombi iri pazasi inochengetedza data yekamera yega yega kune a file (uchishandisa makamera maviri se example kuitira nyore).

Multicamera Deep Kudzidza Inference

AM62A yakashongedzerwa neyakadzama yekudzidzira accelerator (C7x-MMA) inosvika mbiri TOPS, iyo inokwanisa kumhanyisa mhando dzakasiyana dzemhando dzekudzidza dzakadzika dzemhando, kuona chinhu, semantic segmentation, nezvimwe. Ichi chikamu chinoratidza kuti AM62A inogona sei panguva imwe chete kumhanya ina yakadzika modhi yekudzidza pamakamera mana akasiyana emakamera.

Model Selection
Iyo TI's EdgeAI-ModelZoo inopa mazana emhando-ye-the-art modhi, iyo inoshandurwa / kutumirwa kunze kubva kune yavo yekutanga masisitimu ekudzidziswa kuenda kune anembedded-ane hushamwari fomati kuitira kuti ikwanise kuburitswa kuC7x-MMA yakadzama yekudzidza accelerator. Iyo yegore-yakavakirwa Edge AI Studio Model Analyzer inopa iri nyore kushandisa "Modhi Sarudzo" chishandiso. Iyo inogadziridzwa zvine simba kuti ibatanidze ese mamodheru anotsigirwa muTI EdgeAI-ModelZoo. Chishandiso chacho hachidi ruzivo rwekare uye chinopa iri nyore-kushandisa-interface yekuisa maficha anodiwa mune yaunoda modhi.

Iyo TFL-OD-2000-ssd-mobV1-coco-mlperf yakasarudzirwa iyi yakawanda-kamera yekudzidza zvakadzama kuedza. Iyi modhi yekuona zvinhu zvakawanda inogadzirwa muTensorFlow framework ine 300×300 yekuisa resolution. Tafura 4-1 inoratidza zvakakosha zvemuenzaniso uyu pawakadzidziswa pane cCOCO dataset ine makirasi makumi masere akasiyana.

Tafura 4-1. Simbisa Zvimiro zveMuenzaniso TFL-OD-2000-ssd-mobV1-coco-mlperf.

Model	Basa	Resolution	FPS	mAP 50% Kururama PaCOCO	Latency/Fremu (ms)	DDR BW Kushandiswa (MB/ Frame)
TFL-OD-2000-ssd- mobV1-coco-mlperf	Multi Object Detection	300×300	~152	15.9	6.5	18.839

Pipeline Setup
Mufananidzo 4-3 inoratidza iyo 4-kamera yakadzika yekudzidza GStreamer pombi. TI inopa sutu yeGStreamer plugins izvo zvinobvumira kurodha mamwe enhau kugadzirisa uye yakadzika yekudzidza inference kune hardware accelerators. Vamwe exampzvishoma zveizvi plugins zvinosanganisira tiovxisp, tiovxmultiscaler, tiovxmosaic, uye tidlinferer. Iyo pombi iri muFigure 4-3 inosanganisira zvese zvinodiwa plugins yepombi yeGStreamer yakawanda ye4-kamera yekupinda, imwe neimwe iine media preprocess, yakadzika yekudzidza inference, uye postprocess. The duplicated plugins kune yega yega nzira dzekamera dzakarongedzerwa mugirafu kuti zvive nyore kuratidza.
Izvo zviripo hardware zviwanikwa zvakagoverwa zvakaenzana pakati penzira ina dzekamera. Semuenzaniso, AM62A ine maviri emifananidzo multiscaler: MSC0 uye MSC1. Iyo pombi inotsaurira zvakajeka MSC0 kugadzirisa kamera 1 uye kamera 2 nzira, nepo MSC1 yakatsaurirwa kune kamera 3 uye kamera 4.

Kubuda kwemapaipi mana emakamera kunodzikiswa uye kubatanidzwa pamwechete uchishandisa tiovxmosaic plugin. Kubuda kunoratidzwa pane imwe skrini. Mufananidzo 4-4 unoratidza kubuda kwemakamera mana ane yakadzika yekudzidza modhi inomhanyisa kuona chinhu. Imwe neimwe pombi (kamera) iri kushanda pa30 FPS uye yakazara ye120 FPS.

Inotevera ndiyo yakazara pombi script yekamera yakawanda yekudzidza yakadzama kesi inoratidzwa muMufananidzo 4-3.

Performance Analysis

Iyo setup ine makamera mana uchishandisa V3Link board uye AM62A SK yakaedzwa mumamiriro akasiyana ekushandisa, kusanganisira kuratidzwa zvakananga pachiratidziro, kutenderera pamusoro peEthernet (mana UDP chiteshi), kurekodha kune 4 dzakasiyana. files, uye nepfungwa yekudzidza yakadzama. Muchiyedzo chega chega, takatarisa chiyero uye mashandisirwo eCPU cores kuongorora kugona kwehurongwa hwese.

Sezvakamboratidzwa muMufananidzo 4-4, pombi yekudzidza yakadzika inoshandisa tiperfoverlay GStreamer plugin kuratidza CPU mitoro yepakati sebharari pazasi pechidzitiro. Nekusagadzikana, girafu inovandudzwa masekonzi maviri ega ega kuratidza mitoro sechikamu chekushandisatage. Pamusoro peiyo tiperfoverlay GStreamer plugin, iyo perf_stats chishandiso isarudzo yechipiri kuratidza musimboti kuita zvakananga pane terminal ine sarudzo yekuchengetedza kune a. file. Ichi chishandiso chakanyatso kuenzaniswa netTiperfoverlayas iyo yekupedzisira inowedzera imwe mutoro paARMm cores uye iyo DDR kudhirowa girafu nekuifukidza pachiratidziri. Iyo perf_stats chishandiso chinonyanya kushandiswa kuunganidza mashandisiro e Hardware mune ese ebvunzo makesi anoratidzwa mugwaro iri. Mamwe eakakosha ekugadzirisa macores uye accelerators akadzidzwa mubvunzo idzi anosanganisira iwo ma processors (mana A53 Arm cores @ 1.25GHz), iyo yakadzika yekudzidza accelerator (C7x-MMA @ 850MHz), iyo VPAC (ISP) ine VISS uye multiscaler (MSC0 uye MSC1), uye DDR mashandiro.

Tafura 5-1 inoratidza kuita uye kushandiswa kwezviwanikwa paunenge uchishandisa AM62A ine makamera mana kune matatu ekushandisa kesi, kusanganisira kutenderera makamera mana kuchiratidziro, kuyerera pamusoro peEthernet, uye kurekodha kune mana akasiyana. files. Miedzo miviri inoitwa mune yega yega kesi yekushandisa: nekamera chete uye neyakadzama yekudzidza inference. Pamusoro pezvo, mutsara wekutanga muTable 5-1 unoratidza mashandisirwo ehardware apo chete sisitimu yekushandisa yaimhanya paAM62A isina chero mushandisi application. Izvi zvinoshandiswa seyekutanga kuenzanisa uchipokana kana uchiongorora mashandisirwo ehardware emamwe makesi ebvunzo. Sezvinoratidzwa patafura, makamera mana ane kudzidza kwakadzama uye skrini inoratidzwa inoshanda pa30 FPS imwe neimwe, iine huwandu hwe120 FPS kumakamera mana. Iyi yepamusoro furemu chiyero inowanikwa ne86% chete yeyakadzama yekudzidzira accelerator (C7x-MMA) yakazara huwandu. Pamusoro pezvo, zvakakosha kuti uzive kuti iyo yakadzama yekudzidzira accelerator yakavharwa pa850MHz pachinzvimbo che1000MHz mune izvi zviedzo, inova ingangoita 85% yehukuru hwekuita kwayo.

Tafura 5-1. Performance (FPS) uye Resource Utilization ye AM62A kana yashandiswa ne 4 IMX219 Makamera eScreen Display, Ethernet Stream, Rekodha ku. Files, uye Kuita Deep Learning Inferencing

Application n	Pipeline (operation )	Output	FPS avg pombi s	FPS zvachose	MPUs A53s @ 1.25 GHz [%]	MCU R5 [%]	DLA (C7x- MMA) @ 850 MHz [%]	VISS [%]	MSC0 [%]	MSC1 [%]	DDR Rd [MB/s]	DDR Wr [MB/s]	DDR Zvose [MB/s]
Hapana App	Baseline Hapana kushanda	NA	NA	NA	1.87	1	0	0	0	0	560	19	579
Kamera chete	Stream ku Screen	Sikirini	30	120	12	12	0	70	61	60	1015	757	1782
	Dzvanya pamusoro peEthernet	PDU: 4 zviteshi 1920 × 1080	30	120	23	6	0	70	0	0	2071	1390	3461
	Record ku files	4 files 1920 × 1080	30	120	25	3	0	70	0	0	2100	1403	3503
Cam neKudzidza Kwakadzika	Kudzidza kwakadzama: Kuonekwa kwechinhu MobV1- coco	Sikirini	30	120	38	25	86	71	85	82	2926	1676	4602
	Kudzidza kwakadzama: Kuonekwa kwechinhu MobV1- coco uye Kuyerera pamusoro peEthernet	PDU: 4 zviteshi 1920 × 1080	28	112	84	20	99	66	65	72	4157	2563	6720
	Kudzidza kwakadzama: Kuonekwa kwechinhu MobV1- coco uye kurekodha kune files	4 files 1920 × 1080	28	112	87	22	98	75	82	61	2024	2458	6482

Summary
Chirevo chechishandiso ichi chinotsanangura maitiro ekushandisa akawanda-kamera maapplication pane AM6x mhuri yemidziyo. Dhizaini yereferensi yakavakirwa paArducam's V3Link Kamera Solution Kit uye AM62A SK EVM inopihwa mumushumo, ine akati wandei kamera maapplication anoshandisa ina IMX219 kamera, senge kutenderera uye kuona chinhu. Vashandisi vanokurudzirwa kuti vatore V3Link Kamera Solution Kit kubva kuArducam uye dzokorora izvi zvekareamples. Chirevo ichi chinopawo kuongororwa kwakadzama kwekuita kwe AM62A uchishandisa makamera mana pasi pemagadzirirwo akasiyana, kusanganisira kuratidza kuchiratidziro, kutenderera pamusoro peEthernet, uye kurekodha kune. files. Inoratidza zvakareAM62A'sA kugona kwekuita zvakadzika kudzidza inference pamakamera mana akaparadzana hova dzakafanana. Kana paine mibvunzo yekumhanyisa ma ex ayaampse, tumira kubvunza paTI E2E foramu.

References

AM62A Starter Kit EVM Quick Start Guide

ArduCam V3Link Kamera Solution Yekukurumidza Kutanga Gwaro
Edge AI SDK zvinyorwa zve AM62A
Edge AI Smart Makamera Achishandisa Simba-Inoshanda AM62A processor

Kamera Mirror Systems pa AM62A
Mutyairi uye Occupancy Monitoring Systems paAM62A
Quad Channel Kamera Chikumbiro chekutenderera View uye CMS Camera Systems

AM62Ax Linux Academy paKugonesa CIS-2 Sensor
Edge AI ModelZoo
Edge AI Studio

Perf_stats chishandiso

TI Zvikamu Zvinotaurwa mune Ichi Chikumbiro Cherechedzo:

https://www.ti.com/product/AM62A7

CHIZIVISO CHAKAKOSHA UYE KUTAURA

TI INOPA ZVINOTAURWA NEKUVIMBIKA DHATA (KUSIKIRA MAPEPA EDATA), ZVINHU ZVAKAITIKA (KUsanganisira REFERENCE DESIGNS), APPLICATION KANA MAMWE MAZANO EKUGADZIRA, WEB MATUrusi, RUZIVO RWEKUCHENGETEKA, UYE ZVIMWE ZVIMWE ZVINHU “SEZVIRI” UYE NEZVIKANGANISO ZOSE, UYE ZVINOZVINHU ZVINHU ZVOSE, ZVINOTAURWA UYE ZVINOREVA, zvinosanganisira PASINA KUDZIDZWA CHECHITATU INOPIWA WARANTIS YEKUTENGWA, KUKONZERA CHINHU CHINHU CHINHU CHINHU CHOKUITA. .

Izvi zviwanikwa zvakagadzirirwa vagadziri vane hunyanzvi vanogadzira neTI zvigadzirwa. Iwe ndiwe wega une mhosva

kusarudza yakakodzera TI zvigadzirwa zvekushandisa kwako,

kugadzira, kusimbisa, uye kuyedza application yako, uye
kuve nechokwadi chekuti application yako inosangana nezviyero zvinoshanda, uye chero imwe chengetedzo, chengetedzo, zvinodzora, kana zvimwe zvinodiwa.

Zviwanikwa izvi zvinogona kuchinja pasina chiziviso. TI inokubvumidza kuti ushandise zviwanikwa izvi chete pakuvandudza application inoshandisa iyo TI zvigadzirwa zvinotsanangurwa mune sosi. Kumwe kubereka nekuratidzwa kwezviwanikwa izvi kunorambidzwa. Hapana rezinesi rinopihwa kune chero imwe kodzero yeTI yepfuma yekuziva kana kune chero yechitatu bato kodzero yekuziva pfuma. TI hairevi mutoro, uye iwe ucharegedzera zvizere TI nevamiriri vayo kupokana, chero zvichemo, kukuvadzwa, mari, kurasikirwa, uye zvikwereti zvinobva mukushandisa kwako zviwanikwa.

Zvigadzirwa zveTI zvinopihwa zvichienderana neTI's Mitemo Yekutengesa kana mamwe mazwi anoshanda aripo angave pa ti.com kana kupihwa pamwe chete neakadaro zvigadzirwa zveTI. Kupihwa kweTI kwezviwanikwa izvi hakuwedzere kana kusandura waranti inoshanda yeTI kana waranti yekuzvidzikira yezvigadzirwa zveTI.

TI inoramba uye inoramba chero mamwe mazwi ekuwedzera kana akasiyana aungave wafunga.

CHIZIVISO CHINOKOSHA

Kero Yetsamba: Texas Instruments, Post Office Box 655303, Dallas, Texas 75265

Mibvunzo Inowanzo bvunzwa

Mubvunzo: Ndingashandisa chero mhando yekamera ine AM6x mhuri yemidziyo?

Iyo AM6x mhuri inotsigira akasiyana makamera marudzi, kusanganisira ayo ane kana asina akavakirwa-mukati ISP. Tarisa kune zvakatemwa kuti uwane rumwe ruzivo nezve akatsigirwa mhando dzekamera.

: Ndeupi misiyano mikuru pakati pe AM62A ne AM62P mukugadzirisa mifananidzo?

Misiyano yakakosha inosanganisira mhando dzekamera dzinotsigirwa, kamera inobuda data, kuvapo kweISP HWA, Kudzidza Kwakadzika HWA, uye 3-D Graphics HWA. Tarisa kune iyo yakatarwa chikamu chekuenzanisa kwakadzama.

Zvinyorwa / Zvishandiso

Texas Zvishandiso AM6x Kugadzira Yakawanda Kamera [pdf] Bhuku reMushandisi
AM62A, AM62P, AM6x Kugadzira Multiple Camera, AM6x, Kugadzira Multiple Camera, Multiple Camera, Camera

References

User Manual

Texas Zvishandiso AM6x Kugadzira akawanda Makamera

Zvinotsanangurwa