Qualcomm TensorFlow Lite SDK Software User Guide

Qualcomm TensorFlow Lite SDK Software User Guide

Mataupu lalafi

1 Toe iloilo tala'aga

2 Folasaga i meafaigaluega Qualcomm TFLite SDK

3 Seti le siosiomaga faufale mo meafaigaluega Qualcomm TFLite SDK

4 Fausia tulaga SDK

5 Fausia mea faigaluega Qualcomm TFLite SDK - faʻaleleia galuega

6 Fo'i fa'afitauli le fa'atulagaina o le fa'ailoga

7 Fausia Qualcomm TFLite SDK faʻatuputeleina

8 Galulue ma le QNN fafo TFLite Delegate

9 Su'ega Qualcomm TFLite SDK

10 FAAMATALAGA TULAFONO

11 Pepa / Punaoa

11.1 Fa'asinomaga

12 Fa'amatalaga Fa'atatau

Toe iloilo tala'aga

Toe Iloiloga	Aso	Fa'amatalaga
AA	Setema 2023	Fa'asalalauga muamua
AB	Oketopa 2023	In Fausia tulaga SDK, fa'afouina tulafono e fausia ai ata avanoa fa'aoga ma fa'avae SDK Faaopoopo Fausia TFLite SDK faʻatasi ma Linux workstation Faaopoopo Galulue ma le QNN fafo TFLite Delegate In Fa'ailoga, fa'afouina tusitusiga mo le Fa'atonu Fafo

Folasaga i meafaigaluega Qualcomm TFLite SDK

O le Qualcomm TensorFlow Lite software development kit (Qualcomm TFLite SDK) meafaigaluega e maua ai le TensorFlow Lite framework mo le faʻaogaina o le atamai faʻapitoa (AI) i luga ole masini, lea e faʻafaigofie ai le au atiaʻe talosaga e atiaʻe pe faʻagaoioia AI talosaga talafeagai.
O lenei pepa o loʻo tuʻuina atu ai faʻatonuga taʻitasi e tuʻufaʻatasia se Qualcomm TFLite SDK tutoʻatasi ma faʻatulagaina le siosiomaga atinaʻe. O lenei mea e mafai ai e le atinaʻe galuega, lea e aofia ai:

fa'atūina le si'osi'omaga faufale lea e mafai ai e le fa'atupuina ona tu'ufa'atasia le Qualcomm TFLite SDK

atina'eina tuto'atasi Qualcomm TFLite SDK talosaga

Mo le lagolago, taga'i https://www.qualcomm.com/lagolago. O le ata o loʻo i lalo o loʻo tuʻuina mai ai se aotelega o le Qualcomm TFLite SDK workflow: ”
Ata 1-1 Qualcomm TFLite SDK fa'asologa o galuega
O le meafaigaluega e manaʻomia se SDK faʻavae ma se faʻatulagaga file (JSON format) e gaosia ai le Qualcomm TFLite SDK artifacts.

Ina ia fausia se talosaga fa'ai'u i le fa'aogaina o fa'asalalauga fa'asalalau, AI, ma le komepiuta va'ai (CV), va'ai Qualcomm Intelligent Multimedia SDK (QIM SDK) Quick Start Guide (80-50450-51).
O le laulau o loʻo faʻaalia ai le faʻafanua Qualcomm TFLite SDK faʻafanua faʻatasi ma CodeLinaro faʻamalolo tag:
Laulau 1-1 Fa'amatalaga tu'u

Qualcomm TFLite SDK version	CodeLinaro tatala tag
V1.0	Qualcomm TFLITE.SDK.1.0.r1-00200-TFLITE.0
V1.0	TFLITE.SDK.1.0.r1-00500-TFLITE.0.xml

Laulau 1-2 Lagolago Qualcomm TFLite SDK versions

Qualcomm TFLite SDK version	Fa'akomepiuta oloa lagolago	Lagolagoina TFLite version
V1.0	QCS8550.LE.1.0	2.6.0
		2.8.0
		2.10.1
		2.11.1
		2.12.1
		2.13.0

Fa'asinomaga
Laulau 1-3 Pepa fa'atatau

Ulutala	Numera
Qualcomm
00067.1 Fa'amatalaga Fa'amatalaga mo QCS8550.LE.1.0	RNO-230830225415
Qualcomm Intelligent Multimedia SDK (QIM SDK) Taʻiala Amata vave	80-50450-51
Qualcomm Intelligent Multimedia SDK (QIM SDK) Faʻamatalaga	80-50450-50
Punaoa
https://source.android.com/docs/setup/start/initializing	–

Laulau 1-4 Acronyms ma fa'amatalaga

Acronym poo upu	Uiga
AI	Fa'amatalaga fa'apitoa
BIOS	Faiga fa'aoga/tuuina atu
CV	Va'aiga komepiuta
IPK	Itsy afifi file
QIM SDK	Qualcomm Intelligent multimedia software development kit
SDK	Pusa atina'e polokalame
TFLite	TensorFlow Lite
XNN	X_th tuaoi lata ane

Seti le siosiomaga faufale mo meafaigaluega Qualcomm TFLite SDK

O meafaigaluega Qualcomm TFLite SDK o loʻo tuʻuina atu i le puna puna; o le mea lea, o le faʻavaeina o le siosiomaga faufale e tuʻufaʻatasia o se faʻatonuga ae tasi le taimi.

Mea e mana'omia muamua

Ia mautinoa e iai sau sudoaccess i le masini talimalo Linux.
Ia mautinoa o le Linux host version o le Ubuntu 18.04 poʻo le Ubuntu 20.04.

Fa'ateleina mata'i mata'utia fa'aoga ma fa'aoga maualuga fa'aoga i luga ole faiga talimalo.
Fa'aopoopo laina fa'atonu nei i/etc/sysctl.confand toe fa'aola le talimalo: fs.inotify.max_user_instances=8192 fs.inotify.max_user_watches=542288

Fa'apipi'i pusa talimalo mana'omia

O pusa talimalo o loʻo faʻapipiʻiina i luga o le masini talimalo Linux.
Faʻatonu tulafono e faʻapipiʻi ai pusa talimalo: $ sudo apt install -y jq $ sudo apt install -y texinfo chrpath libxml-simple-perl openjdk-8-jdkheadless
Mo Ubuntu 18.04 ma maualuga atu:
$ sudo apt-mau faʻapipiʻi git-core gnupg flex bison fausia-taua zip curl zlib1g-dev gcc-multilib g++-multilib libc6-dev-i386 libncurses5 lib32ncurses5- dev x11proto-core-dev libx11-dev lib32z1-dev libgl1-mesa-dev libxml2-utils font xsltproc unzi
Mo nisi fa'amatalaga, va'ai https://source.android.com/docs/setup/start/initializing.

Seti le si'osi'omaga o lo'o taulamua

O le Docker o se faʻavae e faʻaaogaina e fausia ai, atiaʻe, suʻega, ma tuʻuina atu polokalama. Ina ia faʻapipiʻi le SDK, e tatau ona faʻapipiʻi le faʻailoga i luga o le masini talimalo Linux.
Ia mautinoa o loʻo faʻaogaina le CPU virtualization i luga o le masini talimalo Linux. Afai e le mafai, fai mea nei ina ia mafai ai mai le faʻaogaina o le faʻaogaina / faʻapipiʻi (BIOS):

Fa'amalo le virtualization mai le BIOS:
a. Oomi le F1 poʻo le F2 pe a faʻaoso le polokalama e laa i totonu o le BIOS. O loʻo faʻaalia le faamalama BIOS.
b. Su'e ile Advanced tab.
c. I le vaega o le CPU Configuration, seti le Virtualization Technology i le Enabled.
a. Oomi le F12 e teu ma alu ese, ona toe amata lea o le polokalama.
Afai e le aoga nei laasaga, mulimuli i faʻatonuga faʻapitoa mai le kamupani e tuʻuina atu e mafai ai le virtualization
Aveese soʻo se taimi tuai o le docker:
$ sudo apt aveese docker-desktop
$ rm -r $HOME/.docker/desktop
$ sudo rm /usr/local/bin/com.docker.cli
$ sudo apt purge docker-desktop

Seti le fale teu oloa mamao:
$ sudo apt-get update $ sudo apt-get install ca-certificates curl gnupg lsb-release $ sudo mkdir -p /etc/apt/keyrings $ curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg - dearmor -o /etc/apt/keyrings/docker.gpg $ echo “deb [arch=$(dpkg –print-architecture) saini-e=/etc/apt/keyrings/docker.gpg] https:// download.docker.com/linux/ubuntu $ (lsb_release -cs) mautu” | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
Fa'apipi'i le masini fa'atauta'i:
$ sudo apt-get update $ sudo apt-get install docker-ce docker-ce-cli

Faʻaopoopo le tagata faʻaoga i le vaega faʻapipiʻi:
$ sudo groupadd docker $ sudo usermod -aG docker $USER
Toe fa'afou le faiga.

Fausia tulaga SDK

O le faʻavae SDK o se manaʻoga faʻatulafonoina e tuʻufaʻatasia meafaigaluega Qualcomm TFLite SDK. O lo'o tu'uina atu uma fa'alagolago i luga ole laiga e mana'omia e le Qualcomm TFLite SDK.
Fai mea nei e fa'atupu ai le fa'avae SDK:

Fausia se fau mo le oloa polokalama fa'apitoa.
O faʻatonuga mo le fausiaina o le QCS8550.LE.1.0release o loʻo tuʻuina atu i faʻamatalaga faʻasalalauga. Ina ia maua le fa'amatalaga tu'u mai, va'ai Fa'asinomaga.
Afai na fausia muamua ata, fai le Laasaga 2, ona fai lea o se fale mama.

Faʻataʻitaʻi le faʻatonuga o loʻo i lalo e fausia ai ata avanoa faʻaoga ma tulaga SDK:
Mo QCS8550.LE.1.0, fa'aopoopo i ai le vaega ole masini qti-tflite-delegate ile MACHINE_FEATURES ile kalama.conf file ma maua mai le siosiomaga fausia e tusa ai ma faatonuga mai faʻamatalaga faʻasalalau.
A maeʻa ona faʻatupuina ata avanoa faʻaoga mai le fausiaina, faʻataʻitaʻi le faʻatonuga o loʻo i lalo e faʻatupu ai le tulaga SDK.
$ bitbake -fc populate_sdk qti-robotics-image

Fausia mea faigaluega Qualcomm TFLite SDK - faʻaleleia galuega

Ole Qualcomm TFLite SDK meafaigaluega faigaluega e manaʻomia ai le faʻatupuina e tuʻuina atu le faʻatulagaga file fa'atasi ai ma fa'amaumauga aoga. O tusitusiga atigi fesoasoani mai le tflite-tools project (o loʻo iai i le Qualcomm TFLite SDK source tree) e tuʻuina atu ai galuega faʻaoga fesoasoani e faʻatulaga ai le siosiomaga atigi, lea e mafai ona faʻaogaina mo le Qualcomm TFLite SDK workflow.
O loʻo fausia e le tagata faʻapipiʻi le Qualcomm TFLite SDK poloketi i totonu o le koneteina ma faʻatupuina mea faʻaoga e faʻaaoga ai mea aoga na saunia e tflite-tools.
A maeʻa ona fausia se koneteina Qualcomm TFLite SDK, e mafai e le tagata atiaʻe ona faʻapipiʻi i le koneteina ma faʻaoga fesoasoani fesoasoani i totonu o le atigi atigi pusa mo le faʻaauauina o le atinaʻe.

O loʻo i ai se aiaiga e faʻapipiʻi ai le Qualcomm TFLite SDK artifacts i se masini Qualcomm e fesoʻotaʻi ma le Linux host e ala i le USB / adb.
O loʻo iai foʻi se aiaiga e kopi ai le Qualcomm TFLite SDK artifacts mai le koneteina i se isi masini talimalo e fesoʻotaʻi ai le masini Qualcomm.

O le ata o loʻo i lalo o loʻo lisiina ai le seti o mea aoga o loʻo avanoa pe a uma ona faʻatulagaina le atigipusa fau fale e faʻaaoga ai tusitusiga fesoasoani mo le fausiaina o le Qualcomm TFLite SDK.

O le ata o loʻo faʻaalia ai le faʻasologa o le faʻatinoina o mea aoga:
Ata 4-3 Fa'asologa o mea aoga ile talimalo

Fa'atasi ma fausia Qualcomm TFLite SDK
O le Qualcomm TFLite SDK e tuʻufaʻatasia pe a faia le ata o le docker. Ina ia faʻafetaui ma fausia le Qualcomm TFLite SDK, fai mea nei:

Fausia se lisi i luga o le talimalo file faiga e fa'amaopoopo le Qualcomm TFLite SDK avanoa faigaluega. Mo
exampLe: $mkdir $cd
Aumai le code source code Qualcomm TFLite SDK mai CodeLinaro:
$ repo init -u https://git.codelinaro.org/clo/le/sdktflite/tflite/ manifest.git –repo-branch=qc/stable –repo-url=git://git.quicinc.com/ tools/repo.git -m TFLITE.SDK.1.0.r1-00200-TFLITE.0.xml -b fa'asa'oloto && toe fa'asalaina -qc –no-tags -j
Fausia se lisi i luga o le talimalo file faiga e mafai ona faʻapipiʻi i le docker. Mo example: mkdir-p / O lenei lisi e mafai ona faia i soʻo se mea i luga o le masini talimalo Linux, ma e le faʻalagolago i le mea e faʻaogaina ai le Qualcomm TFLite SDK project. A maeʻa le faʻasologa o galuega i totonu o le koneteina, e mafai ona maua le Qualcomm TFLite SDK artifacts i le lisi na faia i lenei laasaga.
Fa'asa'o le fa'atulagaina o le JSON file o loʻo iai i /tflite-tools/ targets/le-tflite-tools-builder.json faʻatasi ai ma faʻamaumauga nei:
“Ata”: “tflite-tools-builder”, “Device_OS”: “le”, “Additional_tag”: “”, “TFLite_Version”: “2.11.1”, “Saufai”: { “Hexagon_delegate”: “OFF”, “Gpu_delegate”: “ON”, “Xnnpack_delegate”: “ON” }, “TFLite_rsync_destination”: “ //", “SDK_path”: “/build-qti-distro-fullstack-perf/tmpglibc/deploy/sdk>”, “SDK_shell_file”: “”, “Base_Dir_Location”: “” }
Mo nisi faʻamatalaga i faʻamatalaga o loʻo taʻua i le json configuration file, va'ai le Docker.md readme file i /tflite-tools/.
FAAMANATU Mo QCS8550, e le lagolagoina le sui o le Qualcomm® Hexagon™ DSP.
Fa'apogai le tusitusiga e fa'atulaga ai le si'osi'omaga:
$cd /tflite-tools $ puna ./scripts/host/docker_env_setup.sh
Fausia le Qualcomm TFLite SDK docker image: $ tflite-tools-host-build-image ./targets/le-tflite-tools-builder.json Afai e le manuia le seti faufale, vaai Troubleshoot docker setup. A maeʻa faʻamaeʻaina, o le feʻau lea e faʻaalia: "Tulaga: Fausia ata ua maeʻa manuia!!" O le tamoe i lenei laasaga e fausia ai foi le Qualcomm TFLite SDK.
Fa'asolo le koneteina ta'avale Qualcomm TFLite SDK. O le mea lea e amata ai le atigipusa i le tags tuʻuina atu i le faʻatulagaga JSON file. $tflite-tools-host-run-container ./targets/le-tflite-tools-builder.json
Fa'apipi'i i le koneteina na amata mai le laasaga muamua.
$ docker faapipii

O loʻo tuʻufaʻatasia le Qualcomm TFLite SDK, ma o mea taua ua sauni e faʻapipiʻi pe sili atu e mafai ona
fa'aaoga e fa'atupuina ai le QIM SDK TFLite plug-in.

Faʻafesoʻotaʻi le masini e faʻafeiloaʻi ma faʻapipiʻi mea taua]

A maeʻa le tuʻufaʻatasia, e lua auala e faʻafesoʻotaʻi ai le masini i se talimalo ma faʻapipiʻi le
Qualcomm TFLite SDK meafaitino.

O lo'o feso'ota'i le masini i se fa'alapotopotoga Linux fa'apitonu'u:
E faʻafesoʻotaʻi e se tagata faʻapipiʻi le masini i se fale faigaluega ma faʻapipiʻi le Qualcomm TFLite SDK mea mai le koneteina saʻo i luga o le masini (QCS8550).
O lo'o feso'ota'i le masini i se nofoaga mamao:
E fa'afeso'ota'i e se tagata e fa'atupuina le masini i se fale faigaluega mamao, ma e mafai ona latou fa'aogaina le fa'atonu o le fa'apipi'iina o fa'atonuga i luga o fa'atonuga o Windows ma Linux e fa'apipi'i ai mea tau Qualcomm TFLite SDK i le masini (QCS8550)

Ata 4-4 Feso'ota'iga o le laupapa masini i le atina'e ma fale faigaluega mamao

Fa'afeso'ota'i le masini ile fale faigaluega

O loʻo fesoʻotaʻi le masini i le fale faigaluega ma e mafai e le pusa atinaʻe ona maua le masini i luga ole USB / adb.
O le ata o loʻo faʻaalia ai le stago loʻo i le faʻasologa o le Qualcomm TFLite SDK faʻasologa o galuega:

Faʻatonu tulafono nei e faʻapipiʻi ai mea taua i le masini:
$ tflite-meafaigaluega-masini-sauni
$ tflite-tools-device-deploy

Ina ia aveese mea faʻapitoa, faʻataʻitaʻi le poloaiga lenei:
$ tflite-tools-device-packages-aveese

Faʻafesoʻotaʻi le masini i le masini mamao

E feso'ota'i le masini i se masini mamao, ma e le mafai e le koneteina Qualcomm TFLite SDK ona maua le masini i luga ole USB/ad b.
O le ata o loʻo faʻaalia ai le stago loʻo i le faʻasologa o le Qualcomm TFLite SDK faʻasologa o galuega:

Fa'ata'ita'i tulafono nei i totonu o le tflite-tools container e kopi ai mea i se masini mamao
fa'alagolago ile pule ole pusa ile masini:
$ tflite-mea faigaluega-mamao-sync-ipk-rel-pkg
FAAMANATU O faʻamatalaga masini mamao o loʻo tuʻuina atu i le JSON configuration file.
Fa'apipi'i mea fa'apitoa mo Windows platform
E mafai ona faʻapipiʻi le Qualcomm TFLite SDK artifacts i luga o le masini e faʻavae i luga o le faʻaogaina o le masini mamao.

Mo le Windows platform, fai mea nei:
I luga o le PowerShell, fa'aoga le fa'amatalaga lea: PS C:
> adb root PS C:> adb disable-verity PS C:> adb reboot PS C:> adb faatalitali-mo-masini PS C:> adb root PS C:> adb remount PS C:> adb shell mount -o remount, rw / PS C:> adb shell "mkdir -p /tmp" PS C:> adb push /tmp Afai o le afifi o se ipk (mo QCS8550.LE.1.0), faʻaaoga tulafono nei: PS C:> adb shell " opkg -faʻamalosi-faʻalagolago -faʻamalosi-toe faʻapipiʻi -faʻamalosi-toe tusi faʻapipiʻi /tmp/"

Faʻapipiʻi mea faʻapitoa mo Linux platform
Fa'aaoga tulafono nei:
$ adb root $ adb disable-verity $ adb reboot $ adb faatalitali-mo-masini $ adb root $ adb remount $ adb shell mount -o remount,rw / $ adb shell “mkdir -p /tmp” $ adb push /tmp Afai o le afifi o se ipk (mo QCS8550.LE.1.0): $ adb atigi "opkg -faʻamalosi-faʻalagolago -faʻamalosi-toe faʻapipiʻi -faʻamalosi-overwrite faʻapipiʻi /tmp/"

Fa'amama le ata faifa'ato'aga
A maeʻa le faʻaogaina o galuega, e tatau ona faʻamama le siosiomaga o le docker e faʻasaʻoloto ai le teuina i luga o le disk. O le fa'amamāina o le fa'ailoga e aveese ai atigipusa ma ata e le'i fa'aaogaina, ma fa'asa'oloto ai le avanoa o le disk.
Fa'aoga tulafono nei e fa'amamā ai le ata o le fa'ailoga:

Faʻatonu le faʻatonuga lea i luga o le Linux workstation:
$cd /tflite-mea faigaluega
Taofi le koneteina:
$ tflite-tools-host-stop-container ./targets/ le-tflite-tools-builder.json

Aveese le koneteina:
$ tflite-tools-host-rm-container ./targets/ le-tflite-tools-builder.json
Ave'ese ata tuai o lo'o fa'atauina:
$ tflite-tools-host-images-cleanup

Fo'i fa'afitauli le fa'atulagaina o le fa'ailoga

Afai o le tflite-tools-host-build-image e toe faʻafoʻi mai ai le Nospace o loʻo tuʻua i luga o le feʻau masini, ona faʻanofo lea o le lisi o le docker i / local / mnt. Fai mea nei e foia ai le fa'afitauli:

Toe fa'afo'i le fa'ailoga o lo'o iai files:
$ tar -zcC /var/lib docker > /mnt/pd0/var_lib_docker-backup-$(aso + %s).tar.gz
Taofi le faufale:
$ tu'u fa'atauva'a tautua
Faʻamaonia e leai se faʻagasologa o le docker o loʻo taʻavale:
$ ps faux | grep docker

Siaki le fausaga o le fa'atonuga o fa'ailoga:
$ sudo ls /var/lib/docker/
Fa'asolo le fa'ailoga fa'ailoga i se vaeluaga fou:
$ mv /var/lib/docker /local/mnt/docker
Fai se symlink i le docker directory i le vaeluaga fou:
$ ln -s /local/mnt/docker /var/lib/docker

Ia mautinoa o lo'o tumau pea le le suia o le fausaga o le fa'atonuga o fa'ailoga:
$ sudo ls /var/lib/docker/
Amata le faufale:
$ tautua failele amata
Toe amata uma koneteina pe a uma ona faʻanofo le lisi o le docker.

Fausia TFLite SDK faʻatasi ma Linux workstation

E mafai ona fa'aogaina le TFLite SDK e aunoa ma ni koneteina e fa'aoga ai le fale faigaluega Linux. O lenei faiga o se isi mea nai lo le fa'aogaina o koneteina.
Ina ia faʻafetaui ma fausia le Qualcomm TFLite SDK, fai mea nei:

Fausia se lisi i luga o le talimalo file faiga e fa'amaopoopo le Qualcomm TFLite SDK avanoa faigaluega. Mo exampLe:
$mkdir
$cd

Aumai le code source code Qualcomm TFLite SDK mai CodeLinaro:
$ repo init -u https://git.codelinaro.org/clo/le/sdktflite/tflite/ manifest.git –repo-branch=qc/stable –repo-url=git://git.quicinc.com/ tools/repo.git -m TFLITE.SDK.1.0.r1-00200-TFLITE.0.xml -b fa'asa'oloto && toe fa'asalaina -qc –no-tags -j8 && toe tu'u fa'atasi -qc –leai-tags -j8
3. Fa'asa'o le fa'atulagaina o le JSON file o iai i totonu /tflite-tools/ targets/le-tflite-tools-builder.json faʻatasi ai ma faʻamaumauga nei
“Ata”: “tflite-tools-builder”, “Device_OS”: “le”, “Additional_tag”: “”, “TFLite_Version”: “2.11.1”, “Saufai”: { “Hexagon_delegate”: “OFF”, “Gpu_delegate”: “ON”, “Xnnpack_delegate”: “ON” }, “TFLite_rsync_destination”: “ ”, “SDK_path”: “/build-qti-distro-fullstack-perf/tmpglibc/deploy/sdk>”, “SDK_shell_file”: “”, “Base_Dir_Location”: “”
Mo nisi faʻamatalaga i faʻamatalaga o loʻo taʻua i le json configuration file, va'ai le Docker.md readme file i /tflite-tools/.
FAAMANATU Mo QCS8550, e le lagolagoina le sui o le Hexagon DSP
Fa'apogai le tusitusiga e fa'atulaga ai le si'osi'omaga:
$cd /tflite-mea faigaluega
$ puna ./scripts/host/host_env_setup.sh

Fausia le Qualcomm TFLite SDK.
$ tflite-tools-setup targets/le-tflite-tools-builder.json
Faʻatonu tulafono faʻaoga nei i totonu o le atigi Linux tutusa e aoina mai ai le TFLite SDK mea mai
TFLite_rsync_destination.
$ tflite-tools-host-get-rel-package targets/le-tflite-tools-builder.json
$ tflite-tools-host-get-dev-package targets/le-tflite-tools-builder.json
Fa'apipi'i mea fa'apitoa e fa'atatau i le faiga fa'aoga
- Mo le Windows platform, i luga o le PowerShell, fa'aoga le tusitusiga lea
  PS C:> adb root PS C:> adb disable-verity PS C:> adb reboot PS C:> adb faʻatali-mo-masini PS C:> adb root PS C:> adb remount PS C:> adb shell mount - o toe tu'u, rw / PS C:> adb atigi "mkdir -p / tmp" PS C:> adb tulei / tmp
  Afai o le afifi o se ipk (mo QCS8550.LE.1.0), fa'aoga tulafono nei:
  PS C:> adb atigi "opkg -faʻamalosi-faʻalagolago -faʻamalosi-toe faʻapipiʻi -faʻamalosia faʻapipiʻi /tmp/
  Mo le Linux platform, faʻaaoga le faʻamatalaga nei:
  $ adb root $ adb disable-verity $ adb reboot $ adb faatalitali-mo-masini $ adb root $ adb remount $ adb shell mount -o remount,rw / $ adb shell “mkdir -p /tmp” $ adb push /tmp Afai o le afifi o se ipk (mo QCS8550.LE.1.0):
  $ adb atigi "opkg -faʻamalosi-faʻalagolago -faʻamalosi-toe faʻapipiʻi -faʻamalosi-sui faʻapipiʻi /tmp/"

Fausia Qualcomm TFLite SDK meafaitino mo QIM SDK fausia

Ina ia faʻaogaina mea faʻapitoa na gaosia e mafai ai le Qualcomm TFLite SDK GStreamer plug-in i QIM SDK, fai mea nei:

Fa'auma le fa'agasologa i le Sync ma fausia le Qualcomm TFLite SDK, ona ta'e lea o le poloaiga lenei: $ tflite-tools-host-get-dev-tar-package ./targets/le-tflite-toolsbuilder.json
O se ta file ua gaosia. O loʻo i ai le Qualcomm TFLite SDK i le ala o loʻo tuʻuina atu i “TFLite_rsync_destination”
Ina ia mafai ai le Qualcomm TFLite SDK GStreamer plug-in, faʻaaoga le ta file e fai ma finauga i le JSON configuration file mo le fausiaina o le QIM SDK.
Mo fa'amatalaga i le tu'ufa'atasia o le QIM SDK, va'ai Qualcomm Intelligent Multimedia SDK (QIM SDK) Quick Start Guide (80-50450-51).

Fausia Qualcomm TFLite SDK faʻatuputeleina

Afai o loʻo e fausiaina le Qualcomm TFLite SDK mo le taimi muamua, vaʻai Fausia Qualcomm TFLite SDK meafaigaluega - faʻaleleia galuega. Ole si'osi'omaga faufale lava e tasi e mafai ona toe fa'aogaina mo le fa'atupuina fa'aopoopo.
O mea faigaluega fesoasoani (i totonu o le atigipusa) o loʻo taʻua i le ata o loʻo avanoa mo tagata atiaʻe e tuʻufaʻatasia faʻaoga suiga ma faʻapipiʻi.
Ata 5-1 Galulue i totonu o se koneteina

A maeʻa suiga code i le code directory, fai mea nei:

Fa'aopoopo le fa'ailoga ua suia:
$ tflite-tools-incremental-build-install

Fa'ailoga tu'ufa'atasia:
$ tflite-tools-ipk-rel-pkg poʻo le $ tflite-tools-deb-rel-pkg
Fa'atasi afifi fa'amatu'u ma le 'au file faiga:
$ tflite-mea faigaluega-mamao-sync-ipk-rel-pkg
Or
$ tflite-mea faigaluega-mamao-sync-deb-rel-pkg
Saunia se paketi dev:
$ tflite-mea faigaluega-ipk-dev-pkg
O mea faʻapipiʻi tuʻufaʻatasia o loʻo maua i le TFLite_rsync_destination folder o loʻo taʻua i le JSON file, lea e mafai ona kopiina i so'o se lisi.

Galulue ma le QNN fafo TFLite Delegate

O le TFLite External Delegate e mafai ai e oe ona faʻataʻitaʻiina au faʻataʻitaʻiga (vaega poʻo le atoa) i luga o se isi faʻatonu e faʻaaoga ai faletusi e tuʻuina atu e se isi vaega faʻalagolago e pei o QNN e Qualcomm. O lenei masini e mafai ona faʻaogaina le tele o faʻavavevave i luga o masini e pei o le GPU poʻo le Hexagon Tensor Processor (HTP) mo le faʻaogaina. O lenei mea e maua ai e le au atinaʻe se auala faʻafesoʻotaʻi ma vavae ese mai le TFLite faaletonu e faʻavave ai faʻamatalaga.

Mana'omia muamua:

Ia mautinoa o loʻo e faʻaogaina se fale faigaluega Ubuntu e aveese ai QNN AI stack.

Ia mautinoa e te faʻaogaina se QNN version 2.14 e faʻatasi ma Qualcomm TFLite SDK

O le Qualcomm TFLite SDK e mafai ona faʻatautaia faʻamatalaga i luga o le tele o QNN pito i tua e ala i le TFLite fafo Delegate mo QNN. O faʻataʻitaʻiga TFLite faʻatasi ai ma se faʻataʻitaʻiga masani flatbuffer e mafai ona faʻatautaia ile GPU ma le HTP.
A maeʻa ona faʻapipiʻi pusa Qualcomm TFLite SDK i luga o le masini, fai mea nei e faʻapipiʻi ai faletusi QNN i luga o le masini.

Sii mai le Qualcomm Package Manager 3 mo Ubuntu.
a. Kilikihttps://qpm.qualcomm.com/, ma kiliki Meafaigaluega.
b. I le itu tauagavale, i le Su'esu'ega Meafaigaluega fanua, fa'aoga QPM. Mai le System OS lisi, filifili Linux.
O fa'ai'uga su'esu'e o lo'o fa'aalia ai se lisi o Pule Fa'apipi'i Qualcomm.
c. Filifili Qualcomm Package Manager 3 ma download le Linux debian package.

Faʻapipiʻi le Qualcomm Package Manager 3 mo Linux. Fa'aaoga le poloaiga lenei:
$ dpkg -i –faamalosia-sui /path/to/
QualcommPackageManager3.3.0.83.1.Linux-x86.deb
Sii mai le Qualcomm®
AI Engine Direct SDK i luga o le fale faigaluega Ubuntu.
a. Kiliki https://qpm.qualcomm.com/ ma kiliki Meafaigaluega.
b. I le itu agavale, i le fanua Search Tools, fa'apipi'i AI stack. Mai le System OS lisi, filifili Linux.
A o lo'o fa'aalia le lisi fa'alalo o lo'o iai masini fa'apipi'i AI.
c. Kiliki Qualcomm® AI Engine Direct SDK ma la'u i lalo le pusa Linux v2.14.0.
Faʻapipiʻi Qualcomm® AI Engine Direct SDK i luga o le fale faigaluega Ubuntu.
a. Fa'agaoioia le laisene:
qpm-cli –license-activate qualcomm_ai_engine_direct
b Fa'apipi'i AI Engine Direct SDK:
$ qpm-cli –extract /path/to/ qualcomm_ai_engine_direct.2.14.0.230828.Linux-AnyCPU.qik

Tuli faletusi i le masini mai le fale faigaluega Ubuntu ma adb push.
$ cd /opt/qcom/aistack/qnn/2.14.0.230828 $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnDsp.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnDspV66Stub.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnGpu.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnHtpPrepare.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnHtp.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnHtpV68Stub.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnSaver.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnSystem.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnTFLiteDelegate.so /usr/lib/ $ adb push ./lib/hexagon-v65/ unsigned/ libQnnDspV65Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-v66/unsigned/ libQnnDspV66Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-v68/unsigned/ libQnnHtpV68Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-v69/unsigned/ libQnnHtpV69Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-v73/unsigned/libQnnHt. o lea /usr/lib/rfsa/adsp

Su'ega Qualcomm TFLite SDK

O le Qualcomm TFLite SDK o loʻo tuʻuina atu nisi faʻamatalagaample talosaga, lea e mafai ona faʻaaogaina e faʻamaonia ai, faʻailoga, ma maua le saʻo o faʻataʻitaʻiga e manaʻo se tagata faʻapipiʻi e iloilo.
A maeʻa ona faʻapipiʻi faʻapipiʻi Qualcomm TFLite SDK i luga o le masini, o loʻo avanoa le taʻavale i luga o le masini e taʻavale ai nei mea.ample talosaga.
Manaomia muamua
Fausia lisi nei i luga o le masini:
$ adb atigi "mkdir / data / Faʻataʻitaʻiga"
$ adb shell "mkdir / data / Lables"
$ adb shell "mkdir / faʻamatalaga / faʻamatalaga"

Fa'ailoga ata

O se ata fa'ailoga o se fa'aoga e saunia e le Qualcomm TFLite SDK e fa'aalia ai le auala e mafai ai ona e utaina se fa'ata'ita'iga TensorFlow Lite ua uma ona a'oa'oina ma fa'aliliu ma fa'aoga e iloa ai mea i ata. Manaomia muamua:
La'u mai sample faʻataʻitaʻiga ma ata:
E mafai ona e fa'aogaina so'o se fa'ata'ita'iga fetaui, ae o le fa'ata'ita'iga MobileNet v1 o lo'o tu'uina mai ai se fa'ata'ita'iga lelei o se fa'ata'ita'iga ua a'oa'oina e iloa ai se mea 'ese'ese e 1000.

Maua le fa'ata'ita'iga
$curl https://storage.googleapis.com/download.tensorflow.org/models/ mobilenet_v1_2018_02_22/mobilenet_v1_1.0_224.tgz | tar xzv -C /data $ mv /data/mobilenet_v1_1.0_224.tflite /data/Models/
Maua igoa
$curl https://storage.googleapis.com/download.tensorflow.org/models/ mobilenet_v1_1.0_224_frozen.tgz | tar xzv -C /data mobilenet_v1_1.0_224/ labels.txt
$ mv /data/mobilenet_v1_1.0_224/labels.txt /data/Labels/
A maeʻa ona e faʻafesoʻotaʻi i le Qualcomm TFLite SDK docker container, e mafai ona maua le ata ile:
“/mnt/tflite/src/tensorflow/tensorflow/lite/examples/label_image/ testdata/grace_hopper.bmp”
a. Uunaia lenei file i/fa'amaumauga/Lapea/
b. Fa'atonu le fa'atonuga:
$ adb shell “label_image -l /data/Labels/labels.txt -i /data/Labels/ grace_hopper.bmp -m /data/Models/mobilenet_v1_1.0_224.tflite -c 10 -j 1 -p 1”

Fa'ailoga

O le Qualcomm TFLite SDK o loʻo tuʻuina atu le meafaigaluega faʻavasega e fuafua ai le faʻatinoga o taimi eseese.
O mea faigaluega fa'ailoga nei o lo'o fua ma fa'atatau fuainumera mo fua fa'atatau taua nei:

Taimi amata

Taimi fa'ai'uga o le tulaga mafanafana
Taimi fa'ai'uga o le tulaga tumau
Fa'aoga manatua ile taimi amata

Fa'aoga atoa manatua

Mea e mana'omia muamua

Oomi fa'ata'ita'iga e fa'ata'ita'i mai le TFLite Model Zoo (https://tfhub.dev/) i/fa'amatalaga/Fa'ata'ita'iga/. Tamomoe le fa'amaumauga nei:

XNN Pack
$ adb atigi "benchmark_model -kalafa = / faʻamatalaga / Faʻataʻitaʻiga / - enable_op_profiling = moni -use_xnnpack = moni -num_threads = 4 -max_secs = 300 -profiling_output_csv_file=/fa'amatalaga/fa'ailoga/"
GPU Sui
$ adb atigi “benchmark_model –kalafa=/data/Models/ — enable_op_profiling=true –use_gpu=true –num_runs=100 –warmup_runs=10 — max_secs=300 –profiling_output_csv_file=/fa'amatalaga/fa'ailoga/"
Sui Fafo
QNN Fa'atufoai Atu GPU:
Fa'ata'ita'i fa'ai'uga fa'atasi ma le fa'ata'ita'iga fa'afefete:
$ adb shell-command “benchmark_model –graph=/data/Models/ .tflite –external_delegate_path=libQnnTFLiteDelegate.so — external_delegate_options='backend_type:gpu;library_path:/usr/lib/ libQnnGpu.so;skel_library/libr: /adsp'”
QNN Fa'atufo'i Fafo HTP:
Fa'atino fa'ai'uga fa'atasi ma fa'ata'ita'iga quant:
$ adb shell-command “benchmark_model –graph=/data/Models/ .tflite –external_delegate_path=libQnnTFLiteDelegate.so — external_delegate_options='backend_type:htp;library_path:/usr/lib/ libQnnHtp.so;skel_librrary/libdir: /adsp'”

Mea faigaluega sa'o

O le Qualcomm TFLite SDK o loʻo tuʻuina atu se meafaigaluega saʻo e fuafua ai le saʻo o faʻataʻitaʻiga ma taimi eseese.

Fa'avasegaina ma le sui GPU
Laasaga e sii mai ai mea e manaʻomia files e su'e e mafai ona maua i: "/mnt/tflite/src/tensorflow/tensorflow/lite/tools/evaluation/tasks/ imagenet_image_classificatio/README.md"
O le binary mo le faʻaogaina o lenei meafaigaluega ua uma ona avea ma vaega o le SDK, o lea e le manaʻomia ai e le tagata atiaʻe ona toe fausia.
$ adb atigi "image_classify_run_eval - model_file=/fa'amatalaga/Fa'ata'ita'iga/ –ground_truth_images_path=/data/ — ground_truth_labels=/data/ –model_output_labels=/ data/ –delegate=gpu”

Su'esu'eina o mea i le pusa XNN
$ adb atigi “inf_diff_run_eval –model_file=/fa'amatalaga/Fa'ata'ita'iga/ –delegate=xnnpac

FAAMATALAGA TULAFONO

O lou avanoa ma le fa'aogaina o lenei pepa, fa'atasi ai ma so'o se fa'amatalaga, laupapa fa'asinomaga files, ata tusi, diagnostics ma isi faʻamatalaga o loʻo i totonu (faʻatasia lenei “Pepa”), e fa'atatau i lau (e aofia ai le fa'apotopotoga po'o isi vaega fa'aletulafono o lo'o e fai ma sui, fa'atasi “Oe” po o “O oe”) taliaina o tuutuuga ma aiaiga (“Tuutuuga o le Faaaogaina”) o loʻo tuʻuina atu i lalo. Afai e te le malie i nei Tuutuuga o le Faʻaaogaina, e te le faʻaaogaina lenei Faʻamaumauga ma e tatau ona vave faʻaumatia soʻo se kopi.

Faasilasilaga Faaletulafono.
O lenei Fa'amaumauga o lo'o fa'aavanoaina mo oe na'o lou fa'aogaina i totonu ma na oloa ma auaunaga a le Qualcomm Technologies, Inc. (“Qualcomm Technologies”) ma ana paaga o lo'o fa'amatalaina i totonu o lenei Fa'amaumauga, ma e le tatau ona fa'aogaina mo so'o se isi lava fa'amoemoega. O lenei Fa'amaumauga e le mafai ona suia, fa'asa'o, pe fa'aleleia i so'o se auala e aunoa ma se fa'atagaga tusitusia muamua a Qualcomm Technologies. Le fa'aogaina po'o le fa'ailoaina o lenei mea
O faʻamaumauga poʻo faʻamatalaga o loʻo i totonu e matua faʻasaina, ma E te malilie e faʻasala Qualcomm Technologies, ona soʻotaga ma laisene mo soʻo se mea faʻaleagaina poʻo gau na mafatia ai Qualcomm Technologies, ona soʻotaga ma laiseneina mo soʻo se faʻaoga le faʻatagaina poʻo le faʻaalia o lenei Faʻamaumauga, atoa pe vaega. Qualcomm Technologies, o ana paaga ma laiseneina o loʻo taofia uma aia tatau ma pule i totonu ma i lenei Faʻamaumauga. E leai se laisene i soʻo se faʻailoga, pateni, puletaofia, aia tatau e puipuia ai le ufiufi poʻo soʻo se isi lava aia tatau tau le mafaufau e tuʻuina atu pe faʻaalia e lenei Pepa poʻo soʻo se faʻamatalaga o loʻo faʻaalia i totonu, e aofia ai, ae le gata i, soʻo se laisene e fai, faʻaoga, faʻaulufale mai poʻo fa'atau atu so'o se oloa, auaunaga po'o tekinolosi e ofoina atu e fa'atusaina so'o se fa'amatalaga i totonu o lenei Fa'amaumauga.
O LENEI FA'AMATALAGA O LO'O TUUINA "E PEI AI" E aunoa ma se fa'amaoniga o so'o se ituaiga, pe fa'aalia, fa'auiga, fa'aletulafono po'o se isi. I LE TULAFONO FA'AVAE E FA'AVAE E LE TULAFONO, QUALCOMM TECHNOLOGIES, O ONA FA'AIGA MA LAISENESO FA'AMATALAGA FA'AVAE FA'AVAE FA'AVAE UMA O IGOA, FA'A'OA'OGA, LE'I SULAGA, FA'AVAE MO SE FA'AMATALAGA MA LE FA'AMATALAGA FA'A'OA'OGA FA'AVAE PE IA I SE KOSI FA'A'OGA PO'O LE VASEGA O FA'ATA'IGA. E LE'A ISI, E LE'I FA'ATAITA'I QUALCOMM, POO SO'O SE ONA FA'AIGA PO'O LISISENSOR, O LE A FA'AALIGA IA OE PO'O SO'O SE ITU TOLU MO SO'O se tupe fa'aalu, gau, fa'aoga, po'o se gaioiga so'o se mea e fa'atupuina pe fa'atino e oe i le fa'alagolago.
O nisi pusa oloa, mea faigaluega ma meafaitino o lo'o fa'asino i totonu o lenei Fa'amaumauga e ono mana'omia ai oe e talia fa'aopoopo aiaiga ma aiaiga a'o le'i mauaina pe fa'aogaina na mea.
O fa'amatalaga fa'apitoa o lo'o fa'amaoti mai i totonu o lenei Fa'amaumauga e mafai ona fa'atatau i le US ma isi tulafono fa'atatau mo le fa'atauina atu i fafo. Fa'asalalauina e fa'afeagai ma le US ma so'o se isi lava tulafono fa'atatau e matua fa'asāina.
E leai se mea i totonu o lenei Fa'amaumauga o se ofo e fa'atau atu so'o se vaega po'o masini o lo'o ta'ua i totonu.
O lenei Fa'amaumauga e mafai ona suia e aunoa ma se fa'asilasilaga. I le tulaga o se feteenaiga i le va o nei Tuutuuga o le Faʻaaogaina ma le WebSite Tuutuuga o Fa'aoga ile www.qualcomm.com po'o le Qualcomm Privacy Policy o lo'o ta'ua i luga www.qualcomm.com, o nei Tuutuuga o le Fa'aoga o le a pulea. I le tulaga o se feteenaiga i le va o nei Tuutuuga o le Faʻaaogaina ma soʻo se isi maliega (tusia pe kiliki-i luga) faia e Oe ma Qualcomm Technologies poʻo se Qualcomm Technologies soʻotaga e faʻatatau i lou avanoa ma faʻaogaina lenei Faʻamaumauga, o le isi maliega o le a pulea. .
O nei Tu'utu'uga o Fa'aoga e tatau ona pulea ma fa'auigaina ma fa'amalosia e tusa ai ma tulafono a le Setete o Kalefonia, e le aofia ai le Feagaiga a Malo Aufaatasi i Fa'atauga Fa'ava-o-malo o Oloa, e aunoa ma le manatu i feteenaiga o tulafono faavae. So'o se fe'ese'esea'iga, tagi po'o fete'ena'iga e tula'i mai pe feso'ota'i ma nei Tu'utu'uga o le Fa'aaogāina, po'o le soli po'o le fa'amaoniaina, e tatau ona fa'amasinoina e na'o le fa'amasinoga fa'afa'afa'afa'afa'afa'afa'afa'aiga i le itumalo o San Diego, Setete o Kalefonia, ma e te fa'atagaina nei le puleaga patino a ia faamasinoga mo lea faamoemoe.

Fa'ailoga Fa'ailoga ma Fa'amatalaga Fa'atauga o Oloa.
Qualcomm o se fa'ailoga fa'ailoga po'o se fa'ailoga fa'amaufa'ailoga a Qualcomm Incorporated. O le Arm o se fa'ailoga fa'amaufa'ailoga a le Arm Limited (po'o ona lala) i le US ma/po'o se isi nofoaga. O le upu fa'ailoga Bluetooth® o se fa'ailoga fa'amaufa'ailoga e umia e le Bluetooth SIG, Inc. O isi oloa ma igoa fa'ailoga o lo'o ta'ua i totonu o lenei Fa'amaumauga atonu o fa'ailoga tau fefa'ataua'iga po'o fa'ailoga fa'amaufa'ailoga a latou tagata.
Snapdragon ma Qualcomm oloa fa'ailoga o lo'o fa'asino i totonu o lenei Fa'amaumauga o oloa ia a Qualcomm Technologies, Inc. ma/po'o ona lala. Qualcomm pateni tekinolosi ua laiseneina e Qualcomm Incorporated.

Pepa / Punaoa

Qualcomm TensorFlow Lite SDK Software [pdf] Taiala mo Tagata Fa'aoga
TensorFlow Lite SDK Software, Lite SDK Software, SDK Software, Software

Fa'asinomaga

Tusi Taiala