Intel AI Analytics Toolkit ya Linux

Zambiri Zamalonda

AI Kit ndi chida chomwe chimaphatikizapo malo angapo ophunzirira makina ndi mapulojekiti ophunzirira mwakuya. Zimaphatikizapo madera a TensorFlow, PyTorch, ndi Intel oneCCL Bindings. Amalola ogwiritsa ntchito kukonza dongosolo lawo pokhazikitsa zosintha zachilengedwe, pogwiritsa ntchito Conda kuwonjezera mapaketi, kukhazikitsa madalaivala azithunzi, ndikuletsa hangcheck. Zidazi zitha kugwiritsidwa ntchito pa Command Line Interface (CLI) ndipo zitha kuphatikizidwa mosavuta mumapulojekiti omwe alipo popanda kusinthidwa mwapadera.

Kugwiritsa Ntchito Mankhwala

1. Konzani dongosolo lanu pokhazikitsa zosintha zachilengedwe musanapitirize.
2. Kuti mugwire ntchito pa Command Line Interface (CLI), gwiritsani ntchito setvars.sh script kuti mukonze zida zomwe zili mu zida za OneAPI kudzera pazosintha zachilengedwe. Mutha kupeza zolemba za setvars.sh kamodzi pa gawo lililonse kapena nthawi iliyonse mukatsegula zenera latsopano. Zolemba za setvars.sh zitha kupezeka mufoda yakukhazikitsa kwanu kwa oneAPI.
3. Yambitsani malo osiyanasiyana a conda ngati pakufunika kudzera pa lamulo la "conda activate ”. AI Kit imaphatikizapo malo a conda a TensorFlow (CPU), TensorFlow ndi Intel Extension for S.ample TensorFlow (GPU), PyTorch yokhala ndi Intel Extension ya PyTorch (XPU), ndi Intel oneCCL Bindings for PyTorch (CPU).
4. Onani zokhudzana ndi chilengedwe chilichonse poyambira Sample yolumikizidwa mu tebulo lomwe laperekedwa mu bukhu la ogwiritsa ntchito kuti mudziwe zambiri za momwe mungagwiritsire ntchito chilengedwe chilichonse.

Malangizo otsatirawa akuganiza kuti mwayika pulogalamu ya Intel® oneAPI. Chonde onani tsamba la Intel AI Analytics Toolkit kuti musankhe zosankha. Tsatirani izi kuti mupange ndikuyendetsa ngatiampndi Intel® AI Analytics Toolkit (AI Kit):

1. Konzani dongosolo lanu.
2. Pangani ndi Kuyendetsa Sample.

ZINDIKIRANI: Kuyika kokhazikika kwa Python kumagwirizana kwathunthu ndi AI Kit, koma Intel® Distribution ya Python * ndiyomwe imakonda.
Palibe kusintha kwapadera kumapulojekiti anu omwe alipo kale omwe akufunika kuti muyambe kuwagwiritsa ntchito ndi bukuli.

Zigawo za Zida Izi

AI Kit imaphatikizapo

• Intel® Optimization for PyTorch*: Intel® oneAPI Deep Neural Network Library (oneDNN) ikuphatikizidwa mu PyTorch monga laibulale ya masamu yokhazikika yophunzirira mozama.
• Intel® Extension for PyTorch:Intel® Extension for PyTorch* imakulitsa luso la PyTorch* ndi zida zaposachedwa komanso kukhathamiritsa kuti muwonjezere magwiridwe antchito pa zida za Intel.
• Intel® Optimization for TensorFlow*: Mtunduwu umaphatikiza zoyambira kuchokera ku oneDNN kupita ku TensorFlow runtime kuti igwire ntchito mwachangu.
• Intel® Extension for TensorFlow: Intel® Extension for TensorFlow* ndi pulogalamu yowonjezera yophunzirira mozama kwambiri yotengera mawonekedwe a TensorFlow PluggableDevice. Pulagi yowonjezera iyi imabweretsa zida za Intel XPU (GPU, CPU, ndi zina) mgulu la TensorFlow lotseguka kuti AI awonjezere ntchito.
• Intel® Distribution for Python*: Pezani mwachangu magwiridwe antchito a Python kunja kwa bokosilo, osasintha pang'ono kapena osasintha pamakhodi anu. Kugawa kumeneku kumaphatikizidwa ndi Intel® Performance Libraries monga Intel® oneAPI Math Kernel Library ndi Intel®oneAPI Data Analytics Library.
• Intel® Distribution of Modin* (yomwe imapezeka kudzera ku Anaconda kokha), yomwe imakuthandizani kuti muzitha kuwongolera mosadukiza m'malo osiyanasiyana pogwiritsa ntchito laibulale yanzeru, yogawidwa ya dataframe yokhala ndi API yofanana ndi pandas. Kugawa uku kumangopezeka pokhazikitsa Intel® AI Analytics Toolkit ndi Conda* Package Manager.
• Intel® Neural Compressor : tumizani mwachangu mayankho olondola otsika pamafungo otchuka ophunzirira mwakuya monga TensorFlow*, PyTorch*, MXNet*, ndi ONNX* (Open Neural Network Exchange) nthawi yothamanga.
• Intel® Extension for Scikit-learn*: Njira yopanda msoko yofulumizitsa ntchito yanu yophunzirira Scikit pogwiritsa ntchito Intel® oneAPI Data Analytics Library (oneDAL).
  Patching scikit-lern imapangitsa kukhala makina ophunzirira makina oyenera kuthana ndi zovuta zenizeni.
• XGBoost Optimized by Intel: Phukusi lodziwika bwino la makina ophunzirira mitengo yamitengo yolimbikitsidwa ndi gradient limaphatikizapo kuthamangitsa kosasunthika, kutsika pang'ono kwa zomangamanga za Intel® kuti zifulumizitse kwambiri maphunziro achitsanzo ndikuwongolera zolosera bwino.

Konzani Dongosolo Lanu - Intel® AI Analytics Toolkit

Ngati simunayikepo kale AI Analytics Toolkit, onetsani Kukhazikitsa Intel® AI Analytics Toolkit. Kuti mukonze dongosolo lanu, ikani zosintha zachilengedwe musanapitilize.

 

Khazikitsani Zosintha Zachilengedwe Zachitukuko cha CLI
Pogwira ntchito pa Command Line Interface (CLI), zida zomwe zili mu zida za OneAPI zimakonzedwa kudzera
zosintha zachilengedwe. Kukhazikitsa zosintha zachilengedwe poyambitsa sevars script:

Njira 1: Gwero la setvars.sh kamodzi pa gawo lililonse
Gwero la setvars.sh nthawi iliyonse mukatsegula zenera latsopano:

Mutha kupeza zolemba za setvars.sh mufoda ya mizu ya kukhazikitsa kwanu kwa oneAPI, yomwe nthawi zambiri imakhala /opt/intel/oneapi/ pakuyika kwamakina ambiri ndi ~/intel/oneapi/ pakuyika kwachinsinsi.

Pamakhazikitsidwe ambiri pamakina (amafunika mizu kapena sudo mwayi):

• . /opt/intel/oneapi/setvars.sh

Kwa makhazikitsidwe achinsinsi:

• . ~/intel/oneapi/setvars.sh

Njira 2: Kukhazikitsa nthawi imodzi kwa setvars.sh
Kuti chilengedwe chikhazikitsidwe zokha pamapulojekiti anu, phatikizani gwero la malamulo
/setvars.sh muzolemba zoyambira pomwe zidzafunsidwa zokha (m'malo
ndi njira yopita kumalo anu oyika oneAPI). Malo osakhazikika oyika ndi / opt/
intel/oneapi/ pakuyika makina ambiri (imafuna mizu kapena mwayi wa sudo) ndi ~/intel/oneapi/ pakukhazikitsa mwachinsinsi.
Za example, mukhoza kuwonjezera gwero /setvars.sh lamula ku ~/.bashrc kapena ~/.bashrc_profile kapena ~/.profile file. Kuti mupangitse zosintha kukhala zamuyaya pamaakaunti onse pakompyuta yanu, pangani mzere umodzi .sh script mu /etc/profile.d yomwe imachokera setvars.sh (kuti mumve zambiri, onani zolemba za Ubuntu pa Zosintha Zachilengedwe).

ZINDIKIRANI
Setvars.sh script ikhoza kuyendetsedwa pogwiritsa ntchito kasinthidwe file, zomwe zimakhala zothandiza makamaka ngati mukufuna kuyambitsa mitundu ina ya malaibulale kapena ophatikiza, m'malo mosintha ku "mawonekedwe atsopano". Kuti mudziwe zambiri, onani Kugwiritsa Ntchito Configuration File kuti Muyang'anire Setvars.sh.. Ngati mukufuna kukhazikitsa chilengedwe mu chipolopolo chosakhala cha POSIX, seeoneAPI Development Environment Setup kuti musankhe zina.

Masitepe Otsatira

• Ngati simukugwiritsa ntchito Conda, kapena kupanga GPU, Pangani ndi Kuthamanga Sampndi Project.
• Kwa ogwiritsa ntchito Conda, pitilizani kugawo lotsatira.
• Kuti mupange GPU, pitilizani ku Ogwiritsa Ntchito a GPU

Malo a Conda mu Toolkit iyi
Pali malo angapo a conda omwe akuphatikizidwa mu AI Kit. Malo aliwonse akufotokozedwa mu tebulo ili m'munsimu. Mukakhazikitsa zosintha zachilengedwe ku CLI monga mwalangizidwa kale, mutha kuyambitsa madera osiyanasiyana a conda ngati pakufunika kudzera pa lamulo ili:

• conda activate

Kuti mudziwe zambiri, chonde onani malo aliwonse okhudzana ndi Getting Started Sample yolumikizidwa mu tebulo ili m'munsimu.

Gwiritsani Ntchito Ntchito ya Conda Clone Kuti Muwonjezere Phukusi ngati Wopanda Mizu
Intel AI Analytics toolkit imayikidwa mufoda ya oneapi, yomwe imafunikira mwayi wowongolera. Mungafune kuwonjezera ndi kukonza phukusi latsopano pogwiritsa ntchito Conda*, koma simungathe kutero popanda mizu. Kapena, mutha kukhala ndi mizu koma simukufuna kuyika mawu achinsinsi nthawi zonse mukayambitsa Conda.

Kuti muyang'anire malo anu osagwiritsa ntchito mizu, gwiritsani ntchito mawonekedwe a Conda clone kuti muphatikize phukusi lomwe mukufuna kufoda kunja kwa / opt/intel/oneapi/ foda:

1. Kuchokera pazenera lomwelo pomwe mudathamangira setvars.sh, zindikirani malo a Conda pamakina anu:
   • conda env list
     Mudzawona zotsatira zofanana ndi izi:
2. Gwiritsani ntchito clone kufananiza chilengedwe kufoda yatsopano. Mu exampm'munsimu, malo atsopanowa amatchedwa usr_intelpython ndipo chilengedwe chomwe chikupangidwa chimatchedwa maziko (monga momwe tawonetsera pachithunzi pamwambapa).
   • conda pangani -name usr_intelpython -clone base
     Tsatanetsatane wa clone adzawonekera:

1. Yambitsani chilengedwe chatsopano kuti muthe kuwonjezera paketi. conda yambitsani usr_intelpython
2. Tsimikizirani kuti malo atsopano akugwira ntchito. conda env list
   Tsopano mutha kupanga pogwiritsa ntchito chilengedwe cha Conda cha Intel Distribution ya Python.
3. Kuti muyambitse chilengedwe cha TensorFlow* kapena PyTorch*:

TensorFlow

• conda activate tensorflow

PyTorch

• conda yambitsa pytorch

Masitepe Otsatira

• Ngati simukupanga GPU, Pangani ndi Kuthamanga Sampndi Project.
• Kuti mupange GPU, pitilizani ku Ogwiritsa Ntchito a GPU.

Ogwiritsa GPU
Kwa iwo omwe akupanga GPU, tsatirani izi:

Ikani madalaivala a GPU
Ngati mutatsatira malangizo mu Maupangiri Oyika kuti muyike Madalaivala a GPU, mutha kudumpha izi. Ngati simunayike madalaivala, tsatirani malangizo omwe ali mu Bukhu lokhazikitsa.

Onjezani Wosuta ku Gulu la Video
Kwa kuchuluka kwa ntchito za GPU, ogwiritsa ntchito omwe si a mizu (wamba) sakhala ndi mwayi wogwiritsa ntchito chipangizo cha GPU. Onetsetsani kuti mwawonjezera owerenga anu abwinobwino pagulu lamavidiyo; Kupanda kutero, ma binaries omwe adapangidwa pa chipangizo cha GPU adzalephera akaphedwa ndi wogwiritsa ntchito wamba. Kuti mukonze vutoli, onjezani wogwiritsa ntchito yemwe si wa mizu ku gulu la kanema:

• sudo usermod -a -G kanema

Letsani Hangcheck
Pamapulogalamu omwe ali ndi GPU yayitali yowerengera ntchito m'malo omwe amakhala, zimitsani hangcheck. Izi ndizosavomerezeka pazowoneka bwino kapena kugwiritsa ntchito mokhazikika kwa GPU, monga masewera.

Ntchito yomwe imatenga masekondi opitilira anayi kuti zida za GPU zigwire ndi ntchito yayitali. Mwachikhazikitso, ulusi womwe umayenera kukhala wolemetsa wanthawi yayitali umaganiziridwa kuti wapachikidwa ndipo umathetsedwa. Mwa kuletsa nthawi yopuma, mutha kupewa vutoli.

ZINDIKIRANI: Ngati kernel yasinthidwa, hangcheck imayatsidwa yokha. Tsatirani njira ili pansipa mukangosintha kernel kuti muwonetsetse kuti hangcheck yazimitsidwa.

1. Tsegulani potherapo.
2. Tsegulani grub file mu /etc/default.
3. Mu grub file, pezani mzere GRUB_CMDLINE_LINUX_DEFAULT=”” .
4. Lowetsani mawu awa pakati pa mawu (“”):
5. Yendetsani lamulo ili:
   sudo update-grub
6. Yambitsaninso dongosolo. Hangcheck imakhala yoyimitsidwa.

Gawo Lotsatira
Tsopano popeza mwakonza dongosolo lanu, pitilizani Kumanga ndi Kuthamanga Sampndi Project.

Pangani ndi Kuyendetsa Sampndi Kugwiritsa Ntchito Command Line

Intel® AI Analytics Toolkit
Mu gawoli, muyendetsa pulojekiti yosavuta ya "Moni Padziko Lonse" kuti mudziwe bwino za ntchito yomanga, ndikumanganso polojekiti yanu.

ZINDIKIRANI: Ngati simunakonzenso malo anu otukuka, pitani ku Konzani dongosolo lanu ndikubwerera patsamba lino. Ngati mwamaliza kale masitepe kuti mukonze dongosolo lanu, pitilizani ndi masitepe omwe ali pansipa.

Mutha kugwiritsa ntchito zenera la terminal kapena Visual Studio Code * mukamagwira ntchito kuchokera pamzere wolamula. Kuti mumve zambiri zamomwe mungagwiritsire ntchito VS Code kwanuko, onani Kugwiritsa Ntchito Kwambiri kwa Visual Studio Code ndi oneAPI pa Linux*. Kuti mugwiritse ntchito VS Code kutali, onani Remote Visual Studio Code Development ndi oneAPI pa Linux*.

Pangani ndi Kuyendetsa Sampndi Project
AampLes m'munsimu ayenera kupangidwa kwa dongosolo lanu musanapange sampndi polojekiti:

Kuti muwone mndandanda wazinthu zomwe zimathandizira CMake, onani Gwiritsani ntchito CMake to with oneAPI Applications.

Pangani Ntchito Yanu Yekha
Palibe zosintha zapadera pama projekiti anu a Python omwe akufunika kuti muyambe kuwagwiritsa ntchito ndi chida ichi. Kwa mapulojekiti atsopano, ndondomekoyi ikutsatira ndondomeko yomwe imagwiritsidwa ntchito popanga sample Hello World project. Onani za Hello World README files malangizo.

Kukulitsa Magwiridwe
Mutha kupeza zolemba kuti zikuthandizeni kukulitsa magwiridwe antchito a TensorFlow kapena PyTorch.

Konzani Malo Anu

ZINDIKIRANI: Ngati malo anu enieni sakupezeka, kapena ngati mukufuna kuwonjezera ma phukusi kumalo omwe muli, onetsetsani kuti mwamaliza masitepe mu Gwiritsani Ntchito Ntchito ya Conda Clone Kuti Muwonjezere Phukusi Monga Wopanda Mizu.

Ngati mukupanga kunja kwa chidebe, perekani zotsatirazi kuti mugwiritse ntchito Intel® Distribution for Python*:

• • /setvars.sh
• ku ndipamene mudayika zida izi. Mwachikhazikitso, instalar directory ndi:
• Kuyika kwa mizu kapena sudo: /opt/intel/oneapi
• Kuyika kwa ogwiritsa ntchito kwanuko: ~/intel/oneapi

ZINDIKIRANI: Sevars.sh script ikhoza kuyendetsedwa pogwiritsa ntchito kasinthidwe file, zomwe zimakhala zothandiza makamaka ngati mukufuna kuyambitsa mitundu ina ya malaibulale kapena ophatikiza, m'malo mosintha ku "mawonekedwe atsopano". Kuti mudziwe zambiri, onani Kugwiritsa Ntchito Configuration File kuwongolera Setvars.sh. Ngati mukufuna kukhazikitsa chilengedwe mu chipolopolo chosakhala cha POSIX, onani OneAPI Development Environment Setup kuti musankhe zina.

Kuti musinthe madera, choyamba muyenera kuyimitsa chilengedwe.
Example akuwonetsa kukonza chilengedwe, kuyambitsa TensorFlow *, ndikubwerera ku Intel Distribution ya Python:

Tsitsani Container

Intel® AI Analytics Toolkit
Zotengera zimakupatsani mwayi wokhazikitsa ndikusintha malo omangira, kuyendetsa ndi kuyika mbiri ya pulogalamu ya OneAPI ndikugawa pogwiritsa ntchito zithunzi:

• Mutha kukhazikitsa chithunzi chomwe chili ndi chilengedwe chomwe chidakonzedweratu ndi zida zonse zomwe mukufuna, kenako ndikukulitsa mkati mwa malowo.
• Mutha kusunga chilengedwe ndikugwiritsa ntchito chithunzicho kuti musunthire malowo kupita ku makina ena popanda kuyika kwina.
• Mutha kukonza zotengera zomwe zili ndi zilankhulo zosiyanasiyana ndi nthawi yothamanga, zida zowunikira, kapena zida zina, ngati pakufunika.

Tsitsani Chithunzi cha Docker*
Mutha kutsitsa chithunzi cha Docker * kuchokera ku Containers Repository.

ZINDIKIRANI: Chithunzi cha Docker ndi ~ 5 GB ndipo chingatenge ~ mphindi 15 kutsitsa. Idzafunika 25 GB ya disk space.

1. Tanthauzoni chithunzi:
   chithunzi=intel/oneapi-aikit docker kukoka “$chithunzi”
2. Kokani chithunzi.
   docker kukoka "$ chithunzi"

Chithunzi chanu chikatsitsidwa, pitani ku Kugwiritsa Ntchito Containers ndi Command Line.

Kugwiritsa ntchito Containers ndi Command Line
Intel® AI Analytics Toolkit Tsitsani zotengera zomwe zidamangidwa kale mwachindunji. Lamulo lomwe lili pansipa la CPU lidzakusiyani mwachangu, mkati mwa chidebe, munjira yolumikizirana.

CPU
image=intel/oneapi-aikit docker run -it "$ image"

Kugwiritsa ntchito Intel® Advisor, Intel® Inspector kapena VTune™ yokhala ndi Containers
Mukamagwiritsa ntchito zida izi, zowonjezera ziyenera kuperekedwa ku chidebecho: -cap-add=SYS_ADMIN -cap-add=SYS_PTRACE

• docker run -cap-add=SYS_ADMIN -cap-add=SYS_PTRACE \ -device=/dev/dri -it "$ image"

Kugwiritsa ntchito Cloud CI Systems

Makina a Cloud CI amakulolani kuti mupange ndikuyesa pulogalamu yanu zokha. Onani repo mu github exampza kasinthidwe files omwe amagwiritsa ntchito oneAPI pamakina otchuka amtambo CI.

Kuthetsa mavuto pa Intel® AI Analytics Toolkit

Zidziwitso ndi Zodzikanira

Matekinoloje a Intel angafunike ma hardware, mapulogalamu kapena ntchito. Palibe mankhwala kapena chigawo chimodzi chomwe chingakhale chotetezeka mwamtheradi.
Mtengo wanu ndi zotsatira zitha kusiyanasiyana.

Chithunzi © Intel Corporation Intel, logo ya Intel, ndi zizindikiro zina za Intel ndi zizindikiro za Intel Corporation kapena mabungwe ake. Mayina ena ndi mtundu zitha kunenedwa kuti ndi za ena.

Zambiri Zogulitsa ndi Ntchito

Magwiridwe amasiyanasiyana ndi kagwiritsidwe ntchito, kasinthidwe ndi zina. Dziwani zambiri pa www.Intel.com/PerformanceIndex.
Kusintha kwa chidziwitso #20201201

Palibe chilolezo (chofotokoza kapena kutanthauza, mwa estoppel kapena mwanjira ina) yaufulu uliwonse waukadaulo womwe waperekedwa ndi chikalatachi. Zogulitsa zomwe zafotokozedwa zitha kukhala ndi zolakwika zamapangidwe kapena zolakwika zomwe zimadziwika kuti errata zomwe zingapangitse kuti chinthucho chichoke pa zomwe zasindikizidwa. Zolakwika zamakono zilipo popempha.

Intel imakana zitsimikizo zonse zodziwika bwino, kuphatikiza popanda malire, zitsimikizo zogulitsira, kulimba pazifukwa zinazake, komanso kusaphwanya malamulo, komanso chitsimikizo chilichonse chobwera chifukwa chakuchita, kachitidwe, kapena kugwiritsa ntchito malonda.

Zolemba / Zothandizira

Intel AI Analytics Toolkit ya Linux [pdf] Buku Logwiritsa Ntchito AI Analytics Toolkit ya Linux, AI Analytics Toolkit, Analytics Toolkit ya Linux, Analytics Toolkit, Toolkit

Maumboni

• Buku Logwiritsa Ntchito