Intel ® Ethernet 700 Series
Tataiso ea Tokiso ea Ts'ebetso ea Linux
Sehlopha sa marang-rang sa NEX Cloud (NCNG)
Tšen. 1.2
Tšitoe 2024

Nalane ea Phetoho

Khatiso	Letsatsi	Maikutlo
1.2	Tšitoe 2024	· Tataiso e Ekelitsoeng ea Tsamaiso ea Matla. · E kentse Intel * Turbo Boost. · Ekelitsoeng Network Device Backlog. · Litlhophiso le Tokiso e Ikemetseng ea Sethala. · E kentse 4th Generation Intel*%eon* Scalable processors. · E kentse AMD EPYC. · Updated Check System Hardware bokgoni. · IPerf2 e ntlafalitsoeng. · IPerf3 e ntlafalitsoeng. · Mela e ntlafalitsoeng ea Tx/Rx. · Phahamiso e ntlafalitsoeng ea Khatiso. · Phatlalatso ea boholo ba selikalikoe. · Tokiso e ntlafalitsoeng ea Platform (i40e Non-Specific). · Litlhophiso tsa BIOS tse ntlafalitsoeng. · Taolo ea C-State e ntlafalitsoeng. · Keletso e ntlafalitsoeng ea CPU Frequency Scaling. · Litlhophiso tse ntlafalitsoeng tsa ts'ebeliso. · Litlhophiso tse ntlafalitsoeng tsa Sistimi ea Ts'ebetso / Kernel. · Phetiso ea IP e ntlafalitsoeng. · Phahamiso ea nako e tlase e ntlafalitsoeng.
	Phato 2023	Liphetoho tokomaneng ena li kenyelletsa: · Ekelitsoe Litšupiso Tse Amanang. · E Ekelitsoe Netefatsa hore Sephutheloana sa DDP se Laola Hantle. · Ekelitsoe iPerf2. · Ekelitsoe iPerf3. · Netperf e ekelitsoeng. · E ntlafalitsoe IRQ Affinity. · Mela e ekelitsoeng ea Tx/Rx. · Phatlalatso ea boholo ba selikalikoe. · Liforeimi tsa Jumbo tse kentsoeng. · Kenyellelitsoe ho Adapter Bonding. · E kentse Intel svr-info Tool.
1.0	Hlakubele 2016	Phatlalatso ea Pele (Intel Public).

Selelekela

Tataiso ena e reretsoe ho fana ka tataiso bakeng sa tikoloho ea tokiso bakeng sa ts'ebetso e nepahetseng ea marang-rang ho sebelisoa Intel ® Ethernet 700 Series NICs libakeng tsa Linux. E tsepamisitse maikutlo ho Hardware, mokhanni, le maemo a sistimi ea ts'ebetso le litlhophiso tse ka ntlafatsang ts'ebetso ea marang-rang. Hoa lokela ho hlokomeloa hore ts'ebetso ea marang-rang e ka angoa ke palo leha e le efe ea litšusumetso tse ka ntle, feela tse tloaelehileng le tse tsotehang tsa tsena li koahetsoe ke tataiso ena.
1.1 Litšupiso tse Amanang

• Tataiso ea mosebelisi bakeng sa li-adapter tsohle tsa Intel ® Ethernet le lisebelisoa, tse tšehetsang Windows le Linux:
  Intel ® Ethernet Adapters le Devices User Guide
• Lethathamo la lintlha tsa tekheniki:
  Lethathamo la lintlha tsa Intel ® Ethernet Controller X710/XXV710/XL710
• Tlatsa sephutheloana sa SW bakeng sa lihlahisoa tsohle tsa Intel ® Ethernet (jarolla bakhanni bohle, li-NVM, lisebelisoa, joalo-joalo):
  Intel ® Ethernet Adapter Complete Driver Pack
• Sephutheloana sa ntlafatso sa NVM (Non-Volatile Memory):
  Non-Volatile Memory (NVM) Update Utility bakeng sa Intel® Ethernet Network Adapter 700 Series
• Sesebelisoa sa svr-info bakeng sa Linux se nkang lintlha tse nepahetseng tsa Hardware le software ho tsoa ho seva: https://github.com/intel/svr-info
• Tataiso ea Theknoloji ea DDP:
  Intel ® Ethernet 700 Series Dynamic Device Personalization (DDP) Tataiso ea Theknoloji

Lethathamo la Pele la Tlhahlobo

2.1 Liphetolelo tsa ntlafatso ea Driver/Firmware
Sheba liphetolelo tsa mokhanni / firmware o sebelisa ethtool -i ethx.
Ntlafatsa tse latelang ha ho hlokahala:

• Ntlafatsa mokhanni oa i40e
  http://sourceforge.net/projects/e1000/files/i40e%20stable/ or https:// downloadcenter.intel.com/ download/24411/Network-Adapter-Driver-for-PCI-E-40- Gigabit-Network-Connections-under-Linux
• Ntlafatsa firmware
  https://downloadcenter.intel.com/download/24769/NVM-Update-Utility-for-Intel- Ethernet-ConvergedNetwork-Adapter-XL710-X710-Series

2.2 Bala BALA
Sheba lintlha tse tsebahalang 'me u fumane litaelo tsa morao-rao tsa tlhophiso ho tsoa ho README file e kenyelelitsoe ka har'a sephutheloana sa mohloli oa i40e.
2.3 Sheba Hore Slot ea Hao ea PCI Express (PCIe) ke x8
Li-slots tse ling tsa PCIe x8 li hlile li hlophisitsoe joalo ka x4 slots. Li-slots tsena ha li na bandwidth e lekaneng bakeng sa sekhahla se felletseng sa line e nang le lisebelisoa tse peli tsa port le quad port. Ho phaella moo, haeba u kenya adaptara e nang le PCIe v3.0 ho PCIe v2.x slot, u ke ke ua fumana bandwidth e feletseng. Mokhanni oa sesebelisoa sa software o lemoha boemo bona mme o ngola molaetsa o latelang ho log log:
PCI-Express bandwidth e fumanehang bakeng sa karete ena ha ea lekana bakeng sa ts'ebetso e nepahetseng. Bakeng sa ts'ebetso e nepahetseng ho hlokahala slot ea x8 PCI-Express.
Haeba phoso ena e etsahala, isa adaptara ea hau sebakeng sa 'nete sa PCIe v3.0 x8 ho rarolla bothata.
2.4 Hlahloba Bokhoni ba Hardware ea Sisteme
Ho 10 Gbps, 25 Gbps, le 40 Gbps Ethernet, ho na le bonyane ba CPU le litlhoko tsa tsamaiso. Ka kakaretso, processor ea sejoale-joale ea sehlopha sa seva le tlhophiso e nepahetseng ea memori bakeng sa sethala sa hau e lokela ho lekana, empa litlhoko li fapana ho latela mosebetsi oa hau. Likanale tsohle tsa memori li lokela ho tlatsoa 'me mokhoa oa ts'ebetso ea memori o kenngoe ho BIOS. Netefatsa hore CPU ea hau le tlhophiso ea memori li khona ho ts'ehetsa boemo ba ts'ebetso ea marang-rang eo u e hlokang bakeng sa mosebetsi oa hau.
HLOKOMELA
XL710 ke molaoli oa 40 GbE. Adapter ea 2 x 40 GbE e sebelisang molaoli ona ha ea rereloa ho ba 2 x 40 GbE empa e le 1 x 40 GbE e nang le boema-kepe bo sebetsang bo sebetsang. Ha u leka ho sebelisa sephethephethe sa li-line-rate se amang likou ka bobeli, sesebelisoa sa ka hare se tletse 'me sekhahla se kopantsoeng pakeng tsa likou tse peli se lekanyelitsoe ho kakaretso ea SO Gbps.
2.4.1 Kernel Boot Parameters
Haeba Intel® Virtualization Technology bakeng sa Directed I/O (Intel® VT-d) e lumelletsoe ho BIOS, Intel e khothaletsa hore IOMMU e be maemong a ho feta bakeng sa ts'ebetso e nepahetseng ea netweke ea moamoheli. Sena se felisa DMA holim'a sephethephethe sa baeti ha se ntse se nolofalletsa Virtual Machines (VMs) hore e ntse e na le melemo ea Intel® VT-d. Sena se finyelloa ka ho kenyelletsa mohala o latelang ho li-parameter tsa kernel boot: fommu-pt.
2.5 Netefatsa hore Sephutheloana sa DDP se Laola Hantle
Bakhanni ba 140ea le 140eb ha ba na tšehetso e tobileng bakeng sa Dynamic Device Personalization (DDP). Ho sebelisa DDP ka lisebelisoa tsa 700 Series, DDP profile e ka sebelisoa ka kopo ea testpmd.
Bakeng sa lintlha tse mabapi le DDP profiles, le mokhoa oa ho sebelisa DDP profile ka testpmd ho lisebelisoa tsa 700 Series, bua ka Intel® Ethernet 700 Series Dynamic Device Personalization (DDP) Technology Guide.
Ho netefatsa hore na ke setsebi sa DDPfile e kentsoe ka katleho:
testpmd> ddp fumana lenane 0 Profile nomoro ke: 1
HLOKOMELA
Haeba profile nomoro ke 0, ha ho sephutheloana sa DDP se kentsoeng. Ha ho e-na le phoso ea mojaro oa sephutheloana sa DDP, sesebelisoa se fetoha mokhoa o sireletsehileng 'me likarolo tse ngata tsa ts'ebetso ha li fumanehe. Haeba ho na le liphoso tse amanang le ho kenya sephutheloana sa DDP, se tla baka mathata a tshebetso. Bakeng sa mehato ea ho rarolla mathata, sheba Tataiso ea Theknoloji ea Inte/* Ethernet 700 Series Dynamic Device Personalization (DDP).

Litekanyo tsa Ts'ebetso ea Baseline le Mokhoa oa Tokiso

3.1 Litekanyetso tsa Ts'ebetso ea Marang-rang
Pele o qala boikoetliso ba ho lokisa, ho bohlokoa ho ba le tekanyo e ntle ea motheo ea ts'ebetso ea marang-rang ea hau. Hangata, ntle le ho fumana tekanyo ea pele ea ts'ebetso ea ts'ebetso ea ts'ebetso ea hau / mosebetsi, ke mohopolo o motle ho sebelisa leano le tloaelehileng la ts'ebetso ea marang-rang ho netefatsa hore sesebelisoa sa hau sa marang-rang se maemong a matle.
Bakeng sa ts'ebeliso ea sistimi e le 'ngoe, netperf kapa iperf le NetPIPE kaofela ke lisebelisoa tsa mahala tse bulehileng tse u thusang ho hatella khokahano le ho hlahloba mathata a ts'ebetso.
Netperf e matla bakeng sa liteko tsa throughput le latency. NetPIPE ke sesebelisoa se ikhethileng sa latency empa se ka bokelloa bakeng sa tikoloho ea mofuta ofe kapa ofe.
HLOKOMELA
Teko ea TCP_RR ho netperf e khutlisa latency ka boleng ba transactions/sec. Ena ke nomoro ea ho ea le ho khutla. Mokhoa o le mong oa latency o ka baloa ho sebelisoa equation e latelang:
Latency(usec) = (1⁄2) / [Transactions/sec] * 1,000,000
3.1.1 iPerf2
Intel e khothalletsa iperf2 holim'a iperf3 bakeng sa maemo a mangata a benchmarking ka lebaka la boiketlo ba tšebeliso le tšehetso ea likhoele tse ngata ketsahalong e le 'ngoe ea kopo. Intel e khothaletsa ho sebetsa ka khetho ea -P ka likhoele tsa 2-4 bakeng sa likhokahano tsa 25G le likhoele tse ka bang 4-6 bakeng sa likhokahano tsa 40G.

• Ho tsamaisa sephethephethe se fapaneng ho tloha ho moreki ho isa ho seva: Taelo ea seva example: iperf2 -s
  Taelo ya moreki example: iperf2 -c -P
• Ho tsamaisa sephethephethe sa mahlakore a mabeli ho tloha ho moreki ho ea ho seva (le ka tsela e fapaneng): Taelo ea seva example: iperf2 –s –leq
  Taelo ya moreki exampLe:
  iperf2 -c -leq -P -–full-duplex KAPA
  iperf2 -c -leq -P –d

HLOKOMELA
Likhetho ka bobeli -full-duplex le -d ho iperf2 li lumella mosebelisi ho etsa tlhahlobo ea mahlakore a mabeli. Leha ho le joalo, khetho ea -full-duplex e shebane haholo le tlhahlobo e felletseng ea duplex.
HLOKOMELA
Ha u leka iperf2 ho pholletsa le likou tse ngata tsa li-server, -d folakha e ka ekeletsoa ho taelo ea seva ho tsamaisa linako tsohle tsa seva ka morao ho tloha fensetereng e le 'ngoe ea terminal. Letšoao la -d le ka boela la sebelisoa ha taelo ea seva e kenngoa ka har'a for-loop ho script.
HLOKOMELA
Ha o etsa teko ea ho sebelisa marang-rang ka molapo o le mong / khoele (mohlalaample: P1), li-processor tsa AMD li kanna tsa se fane ka tlhahiso e lebelletsoeng, haholo-holo li-NIC tsa bandwidth (haeba lebelo ke> = 25G bandwidth). Ka lebaka leo, ho kenya kopo ho li-cores tse itseng hoa hlokahala ho fihlela katleho e phahameng. Sheba Litlhophiso tsa Ts'ebeliso leqepheng la 22.
3.1.2 iPerf3
Haeba iperf3 e sebelisoa, makhetlo a mangata a kopo a hlokahala ho nka advantage ea likhoele tse ngata, RSS, le queue ea hardware. Intel e khothaletsa ho sebetsa le linako tsa kopo tsa 2-4 bakeng sa likhokahano tsa 25G le linako tse 4-6 bakeng sa likhokahano tsa 40G. Seboka se seng le se seng se lokela ho hlakisa boleng bo ikhethang ba boema-kepe ba TCP ho sebelisa khetho ea -p.

• Ho tsamaisa sephethephethe sa uni-directional ho tloha ho moreki ho ea ho seva:
  Taelo ea seva exampLe:
  iperf3 -s -p
  Taelo ya moreki exampLe:
  iperf3 -c -leq
• Ho tsamaisa sephethephethe sa mahlakore a mabeli ho tloha ho moreki ho ea ho seva (le ka tsela e fapaneng):
  Taelo ea seva exampLe:
  iperf3 –ts –leq
  Taelo ya moreki example: iperf3 -c -leq -P –-bidir
• Ho qala makhetlo a mangata (likhoele) tsa iperf3, khothaletso ke ho sebelisa for-loop ho etsa 'mapa likhoele ho likoung tsa TCP le ho tsamaisa iperf3 ka morao u sebelisa le ho theha lits'ebetso tse ngata ka ho ts'oana.
  Taelo ea seva example, qala likhoele tse 4: port=””; bakeng sa 'na ka {0..3}; etsa port=520$i; bash -c "iperf3 -s -p $ port &"; etsoa; Taelo ya moreki example, qala likhoele tse 4 - Transmit test port=""; bakeng sa nna ka {0..3}; etsa port=520$i; bash -c "iperf3 -c $serverIP -p $ port &"; etsoa; Taelo ya moreki example, qala likhoele tse 4 - Fumana port port = ""; bakeng sa nna ka {0..3}; etsa port=520$i; bash -c "iperf3 -R -c $serverIP -p $ port &"; etsoa; Bakeng sa likhokahano tsa 40G, eketsa for-loop ho theha maemo a fihlang ho 6 / likhoele.

HLOKOMELA
Ha o etsa teko ea ho sebelisa marang-rang ka molapo o le mong / khoele (mohlalaample: P1), li-processor tsa AMD li kanna tsa se fane ka tlhahiso e lebelletsoeng, haholo-holo bandwidth e phahameng
Li-NIC (haeba lebelo ke> = 25G bandwidth). Ka lebaka leo, ho kenya kopo ho li-cores tse itseng hoa hlokahala ho fihlela katleho e phahameng. Sheba Litlhophiso tsa Likopo leqepheng la 22 le AMD EPYC leqepheng la 26.
3.1.3 netperf
Sesebelisoa sa netperf ke khetho e matla bakeng sa tlhahlobo ea throughput le latency.

• Teko ea TCP_STREAM ho netperf e lekanya bokhoni ba sesebelisoa. Taelo ea seva example: netserver Client taelo example: netperf -t TCP_STREAM -l 30 -H
• Teko ea TCP_RR ho netperf e khutlisa latency ka boleng ba transactions/ea bobeli. Ena ke nomoro ea ho ea le ho khutla. Ho khothaletsoa ho sebelisa khetho ea -T x,x, e neng e le x ke CPU sebakeng sa sesebelisoa. Nako ea tsela e le 'ngoe e ka baloa ka ho sebelisa: Latency(usec)=(1⁄2)/ [Transactions/sec]*1,000,\ Server command example: netserver
  Taelo ya moreki example: netperf -t TCP_RR -l 30 -H -T x,x
• Ho qala makhetlo a mangata (likhoele) tsa netperf, khothaletso ke ho sebelisa for-loop ho etsa 'mapa likhoele ho likoung tsa TCP le ho tsamaisa netperf ka morao u sebelisa le ho theha lits'ebetso tse ngata ka ho ts'oana.
  Taelo ea seva example, qala likhoele tse 8:
  boema-kepe=””; bakeng sa nna ka {0..7}; etsa port=520$i; bash -c "netserver -L $serverIP -p $ port &"; etsoa;
  Taelo ya moreki example, qala likhoele tse 8: port=””; bakeng sa nna ka {0..7}; etsa port=520$i; bash -c "netperf -H $serverIP -p $ port -t TCP_STREAM -l 30 &"; etsoa;

3.2 Mokhoa oa Tokiso
Tsepamisa maikutlo phetohong e le 'ngoe ea tokiso ka nako e le hore u tsebe hore na phetoho e' ngoe le e 'ngoe e na le tšusumetso efe tekong ea hau. Ha u ntse u sebetsa ka mokhoa o hlophisehileng haholoanyane, ho tla ba bonolo ho tseba le ho rarolla lisosa tsa mathata a ts'ebetso.

Tokiso ea i40e Driver Settings

4.1 Tšebelisano ea IRQ
Ho lokisa kamano ea IRQ e le hore litšitiso tsa mela e fapaneng ea marang-rang li hokahane le li-cores tse fapaneng tsa CPU li ka ba le tšusumetso e kholo ts'ebetsong, haholo litekong tsa multithread throughput.
Ho lokisa IRQ affinity, emisa irqbalance ebe u sebelisa set_irq_affinity script ho tsoa mohloling oa mohloli oa i40e kapa mela ea pin ka letsoho. Thibela sekala sa IRQ sa mosebedisi ho etsa hore tatellano ya mela:

• systemctl thibela irqbalance
• systemctl emisa irqbalance
  U sebelisa set_irq_affinity script ho tsoa mohloling oa mohloli oa i40e (o khothalelitsoe):
• Ho sebelisa li-cores tsohle:
  [path-to-i40epackage]/scripts/set_irq_affinity -X all ethX
• Ho sebelisa li-cores feela ho sokete ea NUMA ea lehae: [path-to-i40epackage]/scripts/set_irq_affinity -X local ethX
• U ka boela ua khetha mefuta e mengata ea li-cores. Qoba ho sebelisa cpu0 hobane e tsamaisa mesebetsi ea nako. [path-to-i40epackage]/scripts/set_irq_affinity 1-2 ethX

HLOKOMELA
Affinity script e thusa Transmit Packet Steering (XPS) e le karolo ea ts'ebetso ea pinning ha khetho ea -x e hlalosoa. Ha XPS e nolofalitsoe, Intel e khothaletsa hore o thibele irqbalance, kaha kernel balancer e nang le XPS e ka baka ts'ebetso e sa lebelloang. Affinity script e tima XPS ha khetho ea -X e hlalosoa. Ho thibela XPS le ho lumella mela e 'meli ho na le molemo bakeng sa mesebetsi e mengata moo tšebetso e ntle ka ho fetisisa e fihlellehang ha sephethephethe sa Tx le Rx se fumana litšebeletso ka li-para tse tšoanang.
Ho lokisa mela ea li-symmetric ho Linux ho kenyelletsa ho lokisa liparamente tsa sehokelo sa marang-rang ho nolofalletsa li-symmetric receive queues (Rx) le symmetric transmit queues (Tx) bakeng sa li-adapter tsa marang-rang tse tšehetsoeng.
HLOKOMELA

• Li-queue tsa Symmetric ke karolo e tsoetseng pele ea marang-rang, 'me ha se li-adapter tsohle tsa marang-rang tse 700 kapa bakhanni ba li tšehetsang.
• Netefatsa hore o na le ts'ehetso e hlokahalang ea mokhanni le hardware pele o leka ho lokisa mela ea symmetric.

Ho lokisa mela ea symmetric, latela mehato ena e akaretsang:

1. Fetola Sebopeho sa Network Interface File: Sebelisa mohlophisi oa mongolo (mohlalaample, vi, nano, kapa gedit) ho hlophisa tlhophiso ea sebopeho sa marang-rang file. The file hangata e fumaneha tlasa /etc/sysconfig/network-scripts/ directory mme e na le lebitso le kang ifcfg-ethX, moo ethX e leng lebitso la sebopeho sa marang-rang sa hau.
2. Kenya liparamente tsa Symmetric Queue. Kenya mela e latelang ho tlhophiso ea sebopeho sa marang-rang file: ETHTOOL_OPTS=”rx-queues 8 tx-queues 8″
3. Qala hape Tšebeletso ea Marang-rang.
   Ka mor'a ho etsa liphetoho, qala hape tšebeletso ea marang-rang ho sebelisa tlhophiso e ncha. sudo systemctl qala marang-rang hape

Ka letsoho:

• Fumana li-processor tse hoketsoeng sebakeng se seng le se seng u sebelisa: numactl -hardware lscpu
• Fumana limaske tse nyane bakeng sa processor e 'ngoe le e' ngoe:
• Ho nka li-cores 0-11 bakeng sa node 0: [1,2,4,8,10,20,40,80,100,200,400,800]
• Fumana li-IRQ tse abetsoeng boema-kepe bo abetsoeng: grep ethX /proc/interrupts 'me u hlokomele boleng ba IRQ Bakeng sa ex.ample, 181-192 bakeng sa li-vector tse 12 tse laetsoeng.
• Echo boleng ba kamano ea SMP ho kenyelletso e tšoanang ea IRQ. Hlokomela hore sena se lokela ho etsoa bakeng sa keno e 'ngoe le e' ngoe ea IRQ: echo 1 > /proc/irq/181/smp_affinity echo 2 > /proc/irq/182/smp_affinity echo 4 > /proc/irq/183/smp_affinity Show IRQ affinity:
• Ho bonts'a kamano ea IRQ bakeng sa li-cores tsohle: /scripts/set_irq_affinity -s ethX
• Ho bontša li-cores feela ho sokete ea NUMA ea lehae: /scripts/set_irq_affinity -s local ethX
• U ka boela ua khetha mefuta e mengata ea li-cores: /scripts/set_irq_affinity -s 40-0-8,16 ethX

HLOKOMELA
Sengoloa sa set_irq_affinity se tšehetsa -s folakha ho i40e driver version 2.16.11 le hamorao.
4.2 Tx/Rx Mela
Palo ea kamehla ea mela e nolofalitsoeng bakeng sa boema-kepe bo bong le bo bong ba Ethernet ke mokhanni ha a qala e lekana le palo eohle ea li-CPU tse fumanehang sethaleng. Sena se sebetsa hantle bakeng sa li-platform tse ngata le litlhophiso tsa mosebetsi. Leha ho le joalo, li-platform tse nang le lipalo tse phahameng tsa mantlha le / kapa li-port density tse phahameng tsa Ethernet, tlhophiso ena e ka baka likhohlano tsa lisebelisoa. Ka hona, ho ka 'na ha hlokahala maemong a mang ho fetola maemo a sa feleng bakeng sa boema-kepe bo bong le bo bong ba sistimi.
Nomoro ea kamehla ea mela ea Tx/Rx e ka fapana ho latela mofuta o itseng le mofuta oa mokhanni. Palo ea mela e ka fetoloa ho sebelisoa taelo ea ethtool -L e thathamisitsoeng ka tlase.
HLOKOMELA
Maemong ana, Intel e khothaletsa hore o fokotse palo ea queue ea kamehla bakeng sa boema-kepe bo bong le bo bong hore e se fete palo ea li-CPU tse fumanehang node ea NUMA sebakeng sa boema-kepe ba adaptara. Maemong a mang, ha u leka ho leka-lekanya lisebelisoa mabapi le ts'ebetsong ea palo e phahameng ea boema-kepe, ho ka 'na ha hlokahala ho fokotsa palo ena le ho feta.
Ho fetola tlhophiso ea mela:
E latelang exampe beha boema-kepe ho mela e 32 ea Tx/Rx: ethtool -L ethX e kopantsoeng 32
Example output:
ethtool -l ethX
Litekanyetso tsa kanane bakeng sa ethX: Maemo a behiloeng esale pele:
RX:96
TX: 96
Ba bang: 1
E kopantsoe: 96
Litlhophiso tsa hajoale tsa Hardware:
RX:0
TX: 0
Ba bang: 1
E kopantsoe: 32
4.3 Thibela Tekanyetso
Tekanyetso ea tšitiso ea Adaptive e sebetsa ka mokhoa o ikhethileng, 'me e etselitsoe ho fana ka mokhoa o leka-lekaneng lipakeng tsa tšebeliso e tlase ea CPU le ts'ebetso e phahameng. Leha ho le joalo, u ka 'na ua leka ho lokisa litlhophiso tsa tšitiso ka letsoho hore li lekane kesi ea hau ea ts'ebeliso.
Mefuta e fapaneng ea 0-235 microseconds e fana ka mefuta e mengata e sebetsang ea 4,310 ho ea ho 250,000 e sitisoa ka motsotsoana. Boleng ba rx-μsecs-high bo ka behoa bo ikemetseng ho rx-μsecs le tx-μsecs ka taelo e tšoanang ea ethtool, 'me e boetse e ikemetse ho algorithm ea mokhoa oa ho lekanya tšitiso. Thepa e ka tlase e tšehetsa granularity ka linako tse 2microsecond, kahoo litekanyetso tse haufi li ka baka sekhahla se tšoanang sa tšitiso.

• Ho tima mokhoa o tsitsitseng oa tšitiso: ethtool -C ethX adaptive-rx tima adaptive-tx off
• Ho bulela mokhoa o feto-fetohang oa tšitiso: ethtool -C ethX adaptive-rx on adaptive-tx on

Sebaka se setle sa ho qala bakeng sa tokiso e akaretsang ke 84 μs, kapa ~12000 interrupts/s. Haeba u bona li-counter rx_dropped li ntse li sebetsa nakong ea sephethephethe (ho sebelisa ethtool -S ethX) mohlomong u na le CPU e liehang haholo, ha e na li-buffer tse lekaneng ho tloha saeseng ea adaptara (ethtool -G) ho tšoara lipakete bakeng sa 84 μs kapa ho ea tlase ho sekhahla sa tšitiso.

• Ho beha tekanyetso ea tšitiso ho sekhahla se tsitsitseng sa tšitiso ea 84 μs lipakeng tsa litšitiso (12000 li sitisa/s): ethtool -C ethX adaptive-rx off adaptive-tx off rx-usecs 84 tx-usecs 84 Boleng bo latelang boo u ka bo lekang, haeba u sa fetetsoe ka ts'ebeliso ea CPU62, ke. Sena se sebelisa CPU e ngata, empa se sebetsa ka potlako, 'me se hloka litlhaloso tse fokolang (saese ea selikalikoe, ethtool -G).
• Ho beha tekanyo ea tšitiso ho sekhahla se tsitsitseng sa tšitiso ea li-usecs tse 62 lipakeng tsa litšitiso (16000 interrupts/s). ethtool -C ethX adaptive-rx off adaptive-tx off rx-usecs 62 tx-usecs 62
  Haeba rx_dropped li-counters li eketseha nakong ea sephethephethe (ho sebelisa ethtool -S ethX), mohlomong u na le CPU e liehang haholo, ha ho na li-buffer tse lekaneng ho tloha saeseng ea adaptara (ethtool -G), kapa lebelo le tlase haholo la tšitiso. Haeba o sa felloe ke ts'ebeliso ea CPU, o ka eketsa sekhahla sa tšitiso ka ho theola boleng ba ITR. Sena se sebelisa CPU e ngata, empa litšebeletso li potlakile, 'me li hloka litlhaloso tse fokolang (saese ea selikalikoe, ethtool -G).
  Haeba CPU ea hau e le 100%, joale ho eketsa sekhahla sa tšitiso ha ho eletsoa. Maemong a mang joalo ka mosebetsi o tlanngoeng ke CPU, o kanna oa batla ho eketsa boleng ba μs ho nolofalletsa nako e ngata ea CPU bakeng sa lits'ebetso tse ling.
  Haeba o hloka ts'ebetso e tlase ea latency le / kapa u na le CPU e ngata eo u ka e sebelisang ts'ebetsong ea marang-rang, u ka thibela ho kena-kenana le ho lekanya ka botlalo, e leng se nolofalletsang litšitiso ho thunya kapele kamoo ho ka khonehang.
• Ho tima ethtool e sitisang -C ethX adaptive-rx off adaptive-tx off rx-usecs 0 tx-usecs 0

HLOKOMELA
Ha ts'ebetso e sebetsa 'me mokhoa oa litšitiso o koetsoe, sekhahla sa tšitiso moleng ka mong se ka ba holimo haholo. Nahana ka ho kenyelletsa paramethara ea rx-usec-high ho beha moeli o kaholimo ho sekhahla sa tšitiso. Taelo e latelang e thibela ho feto-fetoha ha tšitiso ea ho ikamahanya le maemo 'me e lumella boholo ba li-microseconds tse 5 pele e bontša hore ho amohela kapa ho fetisa ho felile. Sebakeng sa ho baka litšitiso tse ka bang 200,000 ka motsotsoana, e fokotsa litšitiso tse felletseng motsotsoana ho isa ho 50,000 ka rx-usec-high parameter. # ethtool -C ethX adaptive-rx off adaptive-tx off rx-usecs-high 20 rx-usecs 5 txusecs 5 Leka ho lokisa transmit/receive/high-priority coalescing timer hodimo (80/100/150/200) kapa theola (25/20/10/5 optimal value) ho fumana XNUMX.
4.4 Boholo ba selikalikoe
Haeba u bona rx_dropped counters ho ethtool -S ethX (rx_dropped, rx_dropped.nic), kapa khatello ea cache e belaelloang e nang le mela e mengata e sebetsang, u ka leka ho lokisa boholo ba selikalikoe ho tloha ho boleng ba kamehla. Boleng ba kamehla ke 512, max ke 4096.

• Ho hlahloba litekanyetso tsa hajoale: ethtool -g ethX
  Haeba ho belaelloa hore khaello ea buffering e baka marotholi ka sekhahla sa tšitiso ea hajoale, u ka leka boholo pele, ebe bonyane, ebe u tsoela pele ho batlisisa ka binary ho fihlela u bona ts'ebetso e nepahetseng.
  Haeba ho belaelloa khatello ea cache (methala e mengata e sebetsa) ho fokotsa li-buffer ho tloha ho ea kamehla ho ka thusa Intel ® Data Direct I/O (Intel ® DDIO) ho sebetsa ka mokhoa o atlehileng haholoanyane. Intel e khothaletsa ho leka 128 kapa 256 ka tatellano, ho tseba hore keketseho ea sekhahla sa tšitiso ka ethtool -C e kanna ea hlokahala ho qoba keketseho ea rx_dropped.
• Ho beha boholo ba selikalikoe ho boleng bo tsitsitseng: ethtool -G eth12 rx 256 tx 256

HLOKOMELA
Ho lokisa marotholi a pakete ea Rx e fumanoang ka ethtool -S ethX|grep drop, nahana ka ho eketsa boholo ba lesale ho 4096. Teko ea ho fumana maemo a molemo ka ho fetisisa bakeng sa mojaro oa mosebetsi empa hlokomela tšebeliso e feteletseng ea memori e nang le litekanyetso tse phahameng.
4.5 Taolo ea Phallo
Taolo ea phallo ea Layer 2 e ka ama ts'ebetso ea TCP haholo mme e khothaletsoa hore e holofatsoe bakeng sa meroalo e mengata ea mosebetsi. Mokhelo o ka bang teng ke sephethephethe se phatlohang moo ho phatloha ho seng nako e telele.
Taolo ya phallo e timilwe ka ho sa feleng.

• Ho nolofalletsa taolo ea phallo: ethtool -A ethX rx ho tx on
• Ho tima taolo ea phallo: ethtool -A ethX rx off tx off

HLOKOMELA
O tlameha ho ba le sehokelo sa phallo se nang le bokhoni ba sehokelo ho etsa hore taolo ea phallo e atlehe.
4.6 Liforeimi tsa Jumbo
Ha tikoloho e lebelletsoeng ea sephethephethe e na le li-blocks tse kholo tsa data tse fetisoang, ho ka ba molemo ho nolofalletsa sebopeho sa jumbo frame. Ts'ehetso ea Jumbo Frames e lumelloa ka ho fetola Maximum Transmission Unit (MTU) ho boleng bo boholo ho feta boleng ba kamehla ba 1500. Sena se lumella sesebelisoa ho fetisetsa data ka lipakete tse kholoanyane ka har'a tikoloho ea marang-rang. Tlhophiso ena e ka ntlafatsa ts'ebetso le ho fokotsa ts'ebeliso ea CPU bakeng sa mesebetsi e mengata ea I/O. Leha ho le joalo, e ka ama liphutheloana tse nyane kapa meroalo e boima ea latency.
HLOKOMELA
Liforeimi tsa Jumbo kapa litlhophiso tse kholoanyane tsa MTU li tlameha ho hlophisoa hantle tikolohong eohle ea netweke ea hau.
Sebelisa taelo ea ifconfig ho eketsa boholo ba MTU. Bakeng sa mohlalaample, kenya tse latelang, kae ke nomoro ea sebopeho: ifconfig motho 9000 holimo
Ntle le moo, o ka sebelisa taelo ea ip ka tsela e latelang: ip link set mtu 9000 dev ip link theha dev

Platform Tuning (i40e Non-Specific)

5.1 Litlhophiso tsa BIOS

• Numella Intel® VT-d bakeng sa mesebetsi e mengata ea virtualization.
• Hyper-threading (logical processors) e ka ama ts'ebetso. Leka ka eona ho bulela kapa ho tima bakeng sa mosebetsi oa hau.
• Intel® Turbo Boost e lumella li-cores tsa CPU ho sebetsa ka lebelo le holimo ho feta frequency ea CPU. Ho nolofalletsa Intel® Turbo Boost ho ka ntlafatsa ts'ebetso bakeng sa mesebetsi e mengata empa ho sebelisa matla a mangata ho boloka li-cores li le maemong a holimo. Leka ka Turbo Boost off / on bakeng sa mojaro oa hau oa mosebetsi.

HLOKOMELA
Maqhubu a Turbo ha a tiisetsoe haeba sethala se na le ts'ebeliso e phahameng ea CPU ka kakaretso. Maqhubu a phahameng a turbo a fokotseha ha ts'ebeliso ea CPU ka kakaretso e ntse e eketseha.
5.2 Tsamaiso ea Matla
Taolo ea matla e ka ama ts'ebetso, haholoholo mesebetsing e tlase ea latency. Haeba ts'ebetso e le eona e tlang pele ho feta ho theola tšebeliso ea matla, Intel e khothaletsa hore u leke ho fokotsa litlamorao tsa taolo ea matla. Ho na le mekhoa e mengata e fapaneng ea ho fokotsa taolo ea matla, ka lisebelisoa tsa sistimi e sebetsang, litlhophiso tsa BIOS, le li-parameter tsa kernel boot. Khetha mokhoa o motle le boemo bo lumellanang le tikoloho ea hau.
5.2.1 Taolo ea Naha ea C
Ho fokotsa C-state ho kena CO kapa C1 ho ntlafatsa ts'ebetso le ho eketsa tšebeliso ea matla.
Ho thibela ho kena ha boemo ba CPU Package C6 ho ka ntlafatsa ts'ebetso ea marang-rang. Leha ho le joalo, sena se eketsa tšebeliso ea matla.
Likhetho tse latelang lia fumaneha:

• Laola ho kena ha C-state ka matla:
  Bula
  /dev/cpu_dma_latency 'me u ngole latency e lumelletsoeng ho eona.

HLOKOMELA
Ho na le lenaneo le lenyenyane le bitsoang cpudmalatency.c le ka kopitsoang ho tsoa sechabeng sa mohloli o bulehileng, le bokelletsoeng, 'me le tsamae ho tloha molaong oa taelo ho etsa sena hantle.
E latelang example e lumella li-μs tse hlano tsa nako ea ho tsoha, kahoo e lumella ho kena ha C1: cpudmalatency 5 &

• Fokotsa boholo ba C-state ho litlhophiso tsa kernel boot:
  Bakeng sa li-CPU tsa Intel: intel_idle.max_cstates=1
  Bakeng sa li-CPU tseo e seng tsa Intel: processor.max_cstates=1
• Sebelisa taelo ea cpupower ho lekola le ho tima boemo ba CPU C6: Sheba: cpupower monitor kapa cpupower idle-info.
  Thibela C6: cpupower idle-set -d3 kapa
  Thibela C-States: cpupower idle-set -D0

Lintlha:

1. Tlosa C-states ho CPU haeba seva e na le Intel® 4th Gen Intel® Xeon® Scalable processor(s). Ha Hyper Threading e nolofalitsoe kapa e holofalitsoe, ho thibela libaka tse sa sebetseng (-D0) ho thibela li-cores ho kena libakeng tse nang le matla a tlase nakong ea nako e sa sebetseng le ho fokotsa latency ea CPU ho fetoha lipakeng tsa linaha tse sa sebetseng le tse sebetsang.
2. Taolo ea matla ea Intel® 4th Gen Intel® Xeon® Scalable Processor e mabifi haholo. Ho qoba li-cores hore li se ke tsa kena maemong a matla a tlase, leka ho fokotsa palo ea li-cores tse sebelisoang ho li boloka li falimehile nako e telele (ethtool -L kopanetsoe ). Hape, tlama litšitiso ho li-cores tse itseng u sebelisa sete ea irq affinity (hangata e nang le -x ea lehae kapa lethathamo la li-CPU cores), 'me u netefatse hore mosebetsi o sebetsa ho li-cores tse tšoanang ka taskset kapa numactl. Sena se ntlafatsa ts'ebetso ka ho boloka li-cores li sebetsa le ho ntlafatsa ts'ebetso ea tšitiso.

Numella C6:
cpupower idle-set -d3
Lumella C-States:
cpupower idle-set -E

• Mokhoa o mong ke ho sebelisa sesebelisoa se hlophisitsoeng (se kenyellelitsoeng le liphaello tse ngata tsa Linux) ho theha pro performance profile. Li-profiles fetola litlhophiso tse 'maloa tsa OS tse ka amang ts'ebetso lits'ebetsong tse ngata. Ho fumanoe hore marang-rang-phello ea profile e fana ka ntlafatso mesebetsing e mengata.
  Sheba:
  tuned-adm e sebetsang
  Hlophisa:
  tuned-adm profile marang-rang
  HLOKOMELA
  Litšebeletso tse hlophisitsoeng li tlameha ho sebetsa bakeng sa litaelo tse ka holimo. Ho hlahloba / ho qala bocha, ho hlophisoa: systemctl status tuned systemctl restart e hlophisitsoeng
  U ka boela ua hana ho kena ha C-state ka ho kenyelletsa tse latelang moleng oa boot kernel:
  e se nang letho=khetho
• Fokotsa C-state ka litlhophiso tsa tsamaiso ea matla ea BIOS ea sisteme, e ka bang le ts'ebetso ea profile fumaneha.
  Lisebelisoa tse kang turbostat kapa x86_energy_perf_policy li ka sebelisoa ho hlahloba kapa ho seta litlhophiso tsa taolo ea matla.

5.2.2 Tsamaiso ea Matla a PCIe
Active-State Power Management (ASPM) e nolofalletsa boemo bo tlase ba matla bakeng sa lihokelo tsa PCIe ha li sa sebelisoe. Sena se ka baka latency e phahameng ho lisebelisoa tsa marang-rang tsa PCIe, kahoo Intel e khothaletsa hore o thibele ASPM bakeng sa meroalo e boima ea latency. Tlosa ASPM ka ho kenyelletsa tse latelang moleng oa boot kernel: pcie_aspm=off
5.2.3 CPU Frequency Scaling
CPU frequency scaling (kapa CPU speed scaling) ke mokhoa oa taolo ea matla oa Linux moo lebelo la oache ea sistimi le fetoloang ho fofa ho boloka matla le mocheso. Joalo ka li-C-states, sena se ka baka latency e sa batleheng likhokahanong tsa marang-rang.
Sesebelisoa sa cpupower se ka boela sa sebelisoa ho lekola le ho fetola maemo le meeli ea ts'ebetso ea CPU:

• Hlahloba: cpupower monitor kapa
• Beha li-CPU ho mokhoa oa ts'ebetso: cpupower frequency-set -g performance

HLOKOMELA
Liphetoho ho meeli ea maqhubu a CPU li ka ama mesebetsi e mengata 'me li ka tima likarolo tse ling, joalo ka CPU turbo mode.
Ho tima CPU frequency scaling, tima ts'ebeletso ea matla ea CPU ka litaelo tse latelang:
systemctl emisa cpupower.service
systemctl thibela cpupower.service
5.2.4 Tataiso ea Tlatsetso ea Tsamaiso ea Matla
Lintlha tse ling li fanoe karolong ena ea boemo bo holimoview ea likarolo tse ngata tsa taolo ea matla ho 3rd Generation Intel® Xeon® Scalable processors, hammoho le tataiso ea hore na likarolo tsena li ka kopanngoa joang sethaleng: https://networkbuilders.intel.com/solutionslibrary/power-management-technologyoverview-technology-guide
5.3 Intel® Turbo Boost
Intel® Turbo Boost e etsa hore processor e potlake ha e hlokahala empa e ka sebelisa matla a eketsehileng. Ho tima Turbo Boost ho boloka processor e le lebelo le tsitsitseng, ho u fa boemo bo tsitsitseng ba ts'ebetso bakeng sa meroalo e itseng ea mosebetsi.
5.4 Li-firewall
Li-firewall li ka ama ts'ebetso, haholo ts'ebetso ea latency.
Tlosa li-iptables/firewalld haeba ho sa hlokahale.
5.5 Litlhophiso tsa Ts'ebeliso
Hangata khoele e le 'ngoe (e lumellanang le mokoloko o le mong oa marang-rang) ha e lekane ho finyella boholo ba bandwidth. Mehaho e meng ea sethala, joalo ka AMD, e tloaetse ho theola lipakete tse ngata tsa Rx ka khoele e le 'ngoe ha e bapisoa le sethala se nang le li-processor tse thehiloeng ho Intel.
Nahana ka ho sebelisa lisebelisoa tse kang taskset kapa numactl ho penya lits'ebetso ho node ea NUMA kapa CPU cores sebakeng sa sesebelisoa sa marang-rang. Bakeng sa meroalo e meng ea mosebetsi joalo ka polokelo ea I/O, ho tsamaisa sesebelisoa sebakeng se seng sa lehae ho fana ka molemo.
Leka ho eketsa palo ea likhoele tse sebelisoang ke kopo ea hau haeba ho khonahala.
5.6 Kernel Version
Li-kernel tse ngata tsa sejoale-joale li ntlafalitsoe hantle bakeng sa ts'ebetso empa, ho latela ts'ebeliso ea hau, ho nchafatsa kernel ho ka fana ka ts'ebetso e ntlafalitsoeng. Ho khoasolla mohloli ho boetse ho u thusa ho nolofalletsa / ho tima likarolo tse itseng pele u theha kernel.
5.7 Litlhophiso tsa Tsamaiso / Kernel
Sheba litataiso tsa ho lokisa sistimi ea ts'ebetso, joalo ka Red Hat Enterprise Linux Network Performance Tuning Guide, bakeng sa temohisiso e eketsehileng mabapi le tokiso ea sistimi e akaretsang ea ts'ebetso.
Lintlha tse ling tse tloaelehileng tsa ho bina li thathamisitsoe tafoleng e latelang. Hlokomela hore tsena ke lintlha tsa ho qala tse khothaletsoang feela, 'me ho li fetola ho tloha ho tse sa sebetseng ho ka eketsa lisebelisoa tse sebelisoang tsamaisong. Leha ho eketsa boleng ho ka thusa ho ntlafatsa ts'ebetso, hoa hlokahala ho leka ka litekanyetso tse fapaneng ho fumana hore na ke eng e sebetsang hantle bakeng sa sistimi e fanoeng, boima ba mosebetsi le mofuta oa sephethephethe.
Mekhahlelo ea kernel e ka lokisoa ho sebelisoa sesebelisoa sa sysctl ho Linux joalo ka ha ho bonts'itsoe ka tlase.
Ho view litekanyetso tsa kamehla tsa rmem le wmem tsamaisong:
sysctl net.core.rmem_default
sysctl net.core.wmem_default
Beha litekanyetso ho ba boholo (16 MB):
sysctl -w net.core.rmem_max=16777216
sysctl -w net.core.wmem_max=16777216
Li-socket buffer sizes, tse tsejoang hape ka hore ke receive buffer (rmem) le transmit buffer (wmem), ke liparamente tsa sistimi tse hlalosang palo ea memori e boloketsoeng sephethephethe sa marang-rang se kenang le se tsoang.
Ho matha sysctl ntle le -w khang e thathamisa paramente le maemo a eona a hajoale.

Litlhophiso tsa Stack	Tlhaloso
net.core.rmem_default	Ka ho feletseng Fumana Size ea Fesetere
net.core.wmem_default	Fesetere ea Fesetere ea kamehla
net.core.rmem_max	Boholo ba Fumana Fesetere Size
net.core.wmem_max	Boholo ba Fensetere ea Phetiso ea Fesetere
net.core.optmem_max	Maximum Option Memory Buffers
net.core.netdev_max_backlog	Tšimoloho ea lipakete tse sa sebetsoang pele kernel e qala ho theoha
net.ipv4.tcp_rmem	Memory reserver bakeng sa TCP bala buffers
net.ipv4.tcp_wmem	Sebapali sa memori bakeng sa TCP se romella li-buffers

Kernel, stack network, memory handler, lebelo la CPU, le liparamente tsa taolo ea matla li ka ba le tšusumetso e kholo ts'ebetsong ea marang-rang. Khothaletso e tloaelehileng ke ho etsa kopo ho netweke throughput profile ka ho sebelisa taelo e hlophisitsoeng. Sena se fetola litlhophiso tse 'maloa tsa OS ho fana ka khetho ho lits'ebetso tsa marang-rang.
Sheba:
tuned-adm e sebetsang
Hlophisa:
tuned-adm profile marang-rang
5.8 Tšebeliso ea morao-rao ea lisebelisoa tsa marang-rang
Sebopeho sena se thusa ho ntlafatsa ts'ebetso ea marang-rang ka ho laola sephethephethe se kenang ka katleho, ho fokotsa tahlehelo ea liphutheloana, ho fokotsa latency, le ho matlafatsa ts'ebetso. Sena se lebisa ho boiphihlelo bo betere ba mosebelisi le karabelo e potlakileng ea sistimi.
Ka ho sa feleng, e nolofalitsoe ho boholo ba lits'ebetso tsa Linux. Ho sheba boleng ba kamehla:
sysctl net.core.netdev_max_backlog
Boleng bo phahameng ba netdev_max_backlog bo ka fapana ho latela lintlha tse kang mofuta oa kernel, hardware, memori le boima ba mosebetsi. Maemong a mangata, 8192 e bonoa e le boleng bo botle. sysctl -w net.core.netdev_max_backlog=8192
5.9 Litlhophiso le Tokiso e Ikhethileng ka Sethala
5.9.1 4th Generation Intel® Xeon® Scalable Processors
Taolo ea matla ea processor ea Intel® 4th Generation Intel® Xeon® Scalable e mabifi haholo ha e bapisoa le 3rd Generation Intel® Xeon® Scalable processors. Ho qoba li-cores hore li se ke tsa kena maemong a matla a tlase, leka ho fokotsa palo ea li-cores tse sebelisoang ho li boloka li falimehile nako e telele.
Litlhophiso tsa Bios tse khothalelitsoeng bakeng sa Ts'ebetso e Phahameng ka ho Fetisisa

1. Hyper-threading e nolofalletsa / thibela (ho ipapisitse le tlhoko ea mosebetsi le lipheo tsa ts'ebetso) ho CPU.
2. Beha pro ea sistimifile ho Tshebetso bakeng sa tshebetso e phahameng ka ho fetisisa.
   HLOKOMELA
   Sena se fella ka tšebeliso e phahameng ea matla
3. Beha taolo ea matla a CPU ho Maximum Performance ho beha tšebetso ea CPU pele ho feta matla a matla.
4. Numella Turbo Boost. Ho thibela Turbo Boost ho sistimi ea BIOS hangata ho thibela CPU ho eketsa lebelo la oache ea eona ho feta maqhubu a eona a mantlha.
5. HLOKOMELA
   Disable Turbo Boost e kanna ea loketse maemo a mang a ts'ebeliso moo ts'ebetso e ts'oanang, ts'ebetso ea matla, kapa taolo ea mocheso e tlang pele ho ts'ebetso e phahameng.
6. Koala tšobotsi ea Single Root I/O Virtualization (SR-IOV), haeba sistimi e sa sebelise mahlale a ho iphelisa.
7. Tlosa li-C-states ho laela CPU ho lula e sebetsa le ho thibela ho kena maemong a tebileng a ho se sebetse.
8. Thibela C1E, ho etsa bonnete ba hore CPU e lula e sebetsa 'me ha e kene sebakeng sa ho se sebetse sa C1E.
9. Beha maqhubu a uncore ho bongata ho laela sistimi ho sebetsa ka lebelo le phahameng ka ho fetesisa le fumanehang.
10. Ho li-platform tsa Dell, seta Multiple APIC Description Table (MADT) emulation ea mantlha ho Linear (kapa Round-Robin ho latela BIOS) ho fana ka 'mapa o hlakileng le o ka lebelloang oa li-CPU cores.

Re khothalelitsoe OS Level Tunings bakeng sa Optimized Performance

1. Beha 'musi oa sekhahla sa CPU ho sebetsa. cpupower frequency-set -g tshebetso cpupower frequency-info
2. Tlosa C-States. cpupower idle-set -D0
3. Beha li-buffers tsa mantlha tsa Rx (rmem) le Tx (wmem) ho boleng bo phahameng. sysctl -w net.core.rmem_max=16777216 sysctl -w net.core.wmem_max=16777216
4. Seta morao-rao sesebelisoa sa marang-rang. sysctl -w net.core.netdev_max_backlog=8192
5. Beha pro e hlophisitsoengfile (mosebetsi o itšetlehile ka mosebetsi oa ho feta / latency).
   tuned-adm profile marang-rang

Litokiso tsa Boemo ba Adapter tse khothalelitsoeng bakeng sa Ts'ebetso e Atlehileng

1. Fokotsa palo ea mela e tla sebelisoa bakeng sa sephethephethe sa lits'ebetso. Sebelisa palo e fokolang ea mela e hlokoang ho boloka li-CPU tse amanang le tsona li sebetsa ho li thibela ho kena libakeng tse tebileng tse sa sebetseng (fetola mosebetsi): ethtool -L kopane 32
2. Beha likhatiso tsa litekanyetso tsa tekanyetso. ethtool -C adaptive-rx off adaptive-tx off rx-usecs-high 50 rx-usecs 50 tx-usecs 50
   Leka ho lokisa sebali sa transmit/receive/high-priority coalescing timer ho feta (80/100/150/200) kapa ka tlase (25/20/10/5) ho fumana boleng bo nepahetseng bakeng sa mosebetsi.
3. Beha boholo ba reng ea Rx/Tx. ethtool -G rx 4096 tx 4096
   HLOKOMELA
   Haeba u bona marotholi a pakete ea Rx ka ethtool -S| grep, leka ho fokotsa boholo ba reng ho <4096. Leka ho fumana boleng bo nepahetseng bakeng sa mojaro oa mosebetsi moo lipakete li sa theoheng.
4. Beha IRQ Affinity. Sebelisa li-cores sebakeng sa NIC, kapa 'mapa oa mantlha (moo # cores e lekanang le palo ea mela e behiloeng ho 1 leqepheng la 26. systemctl stop irqbalance set_irq_affinity -X local KAPA set_irq_affinity -X

5.9.2 AMD EPYC
Li-processor tsa AMD EPYC ke li-CPU tse matla tse etselitsoeng li-server le litsi tsa data, tse hahiloeng holim'a meralo ea Zen ea AMD. Litlhophiso tse ka tlase li tsoa letotong la 4th la EPYC la AMD.
Litlhophiso tsa BIOS tse khothalelitsoeng bakeng sa Ts'ebetso e Phahameng ka ho Fetisisa

1. Lumella mokhoa oa tloaelo ho lumella basebelisi ho fetola ts'ebetso ea CPU, tšebeliso ea matla, le litlhophiso tse ling. Sena se thusa ho lokisa tsamaiso hantle bakeng sa ho leka-lekana ho fetisisa pakeng tsa ts'ebetso le matla a matla.
2. Numella matla a mantlha a ts'ebetso ho lumella CPU ho eketsa lebelo la eona ho sebetsana le mesebetsi e matla, ho ntlafatsa ts'ebetso ka kakaretso.
3. Thibela taolo ea lefatše ea C-state, ho thibela CPU ho kena libakeng tse tebileng tsa ho boloka matla tse tsejoang ka hore ke C-states, tse ka bolokang karabelo.
   HLOKOMELA
   Ho thibela C-states ho ka baka tšebeliso e eketsehileng ea matla le ho eketsa mocheso oa mocheso. Beha leihlo ka bobeli bakeng sa mojaro oa mosebetsi.
4. Numella/thibela ho bala ka nako e le ’ngoe (SMT) ho CPU, ho ipapisitsoe le tlhoko ea mosebetsi le lipheo tsa tšebetso. SMT e lekana le Hyper Threading ho Intel CPUs.
   HLOKOMELA
   Bakeng sa ts'ebetso e ntlafalitsoeng, sheba ho Tuning i40e Driver Settings leqepheng la 13 le Platform Tuning (i40e Non-Specific) leqepheng la 19 bakeng sa tokiso e khothaletsoang ea OS le boemo ba adaptara.

Adapter Bonding

Linux bonding ke tšobotsi e matla e ka ntlafatsang haholo ts'ebetso ea marang-rang, bofokoli, le mamello ea liphoso libakeng tsa seva. Leha ho le joalo, ke habohlokoa ho hlokomela hore e hloka lisebelisoa tsa marang-rang tse lumellanang le tlhophiso e nepahetseng ho seva le sesebelisoa ho sebetsa hantle.
Mokhanni oa tlamahano ho Linux o u lumella ho kopanya marang-rang a mangata a marang-rang hore e be sehokelo se tlamiloeng. Sehokelo sena se tlanngoeng se hlaha e le sehokelo se le seng sa marang-rang ho sistimi e sebetsang le lits'ebetso.
HLOKOMELA
Bond ke sebopeho se utloahalang, kahoo ha ho khonehe ho beha kamano ea CPU ka kotloloho ho sebopeho sa bond (bakeng sa ex.ample, tlamo0). Ka mantsoe a mang, ha e na taolo e tobileng mabapi le ho ts'oaroa ha tšitiso kapa kamano ea CPU. CPU affinity e tlameha ho hlophisoa bakeng sa likhokahano tse ka tlase tseo e leng karolo ea bond.
Bonding e fana ka mekhoa e mengata ea ts'ebetso, e 'ngoe le e' ngoe e na le litšobotsi tsa eona.

Mokhoa	Mofuta
0	Round Robin
1	Backup e sebetsang
2	XOR
3	Phatlalatso
4	LACP
5	Fetisetsa Mojaro Tekano
6	Adaptive Mojaro Balance

Ho na le mekhoa e fapaneng ea ho theha bonding ho Linux. E 'ngoe ea mekhoa e tloaelehileng haholo ke ka ho sebelisa tlhophiso ea marang-rang files (bakeng sa mohlalaample, /etc/network/ interfaces kapa /etc/sysconfig/network-scripts/ifcfg-bondX).
Tlhophiso e Sebelisang Tlhophiso ea Marang-rang Files
Mehato e latelang e theha bonding ka har'a tlhophiso ea marang-rang files.

1. Khetha likou tse peli kapa ho feta tsa NIC bakeng sa bonding (bakeng sa mohlalaample, ethX le ethY)
2. Bula Tlhophiso ea NIC Files tlas'a /etc/sysconfig/network-scripts/ bakeng sa Sehokelo sa NIC se hlokahalang (bakeng sa mohlalaample, vi ifcfg-ethX le vi ifcfg-ethY) le ho hlomathisa mongolo o latelang:
   MASTER=bondN [Tlhokomeliso: N ke palo e felletseng ea ho bolela nomoro ea bonto.] LEkhoba=e
3. Etsa mongolo oa marang-rang oa bond file sebelisa vi /etc/sysconfig/networkscripts/ifcfg-bondN ebe u kenya mongolo o latelang:
   DEVICE=bondN [Hlokomela: N ke palo e felletseng ea ho bolela nomoro ea bonto] ONBOOT=e USERCTL=ha ho BOOTPROTO=dhcp (kapa) ha ho letho
   IPADDR=200.20.2.4 [e hlokeha haeba BOOTPROTO=ha ho letho] NETMASK=255.255.255.0 [e hlokehang haeba BOOTPROTO=ha ho letho] NETWORK=200.20.2.0 [e hlokeha haeba BOOTPROTO=ha ho letho] BROADCAST=200.20.2.255.OTTOne1 BOOTPROTO=100. BONDING_OPTS=”mokhoa=XNUMX miimon=XNUMX″
   HLOKOMELA
   Boemo e ka ba palo e felletseng ho tloha ho 0 ho isa ho 6 ho ipapisitsoe le tlhoko.
4. Qala hape lits'ebeletso tsa marang-rang u sebelisa ho qala marang-rang bocha kapa systemctl qala NetworkManager.service hape

Ho rarolla mathata a ts'ebetso

7.1 Tšebeliso ea CPU
Lekola ts'ebeliso ea CPU ho mantlha ha mosebetsi o ntse o sebetsa.
Hlokomela hore ts'ebeliso e 'ngoe le e 'ngoe e bohlokoa haholo ts'ebetsong ho feta ts'ebeliso ea CPU ka kakaretso kaha e fana ka mohopolo oa ts'ebeliso ea CPU ka tatellano ea marang-rang. Haeba u na le likhoele tse 'maloa tse tsamaisang sephethephethe sa marang-rang, joale u ka ba le li-cores tse seng kae feela tse sebelisoang. Leha ho le joalo, haeba li-cores li le ho 100%, joale ts'ebetso ea marang-rang ea hau e ka fokotsoa ke ts'ebeliso ea CPU mme ke nako ea ho etsa tse latelang:

1. Tobetsa tekanyo ea IRQ / boholo ba selikalikoe joalo ka ha ho hlalositsoe ho Tekanyetso ea Khatiso.
2. Eketsa palo ea likhoele tsa ts'ebeliso ho hasanya mojaro oa CPU holim'a li-cores tse ling. Haeba li-cores kaofela li sebetsa ho 100% kopo ea hau e kanna ea tlamahanngoa ke CPU ho fapana le marang-rang.

Lisebelisoa tse fumanehang hangata:

• holimo
  - Tobetsa 1 ho atolosa lenane la li-CPU le ho hlahloba hore na ho sebelisoa life.
  - Ela hloko boemo ba tšebeliso.
  - Hlokomela hore na ke lits'ebetso life tse thathamisitsoeng e le tse sebetsang haholo (ka holimo lethathamong).
• mpstat
  E latelang example mola oa taelo o ile oa lekoa ho Red Hat Enterprise Linux 7.x.
  E bonts'a ts'ebeliso ea CPU ho mantlha (ka ho fumana liperesente kaofela e sa sebetse le ho tlosa ho tloha ho 100) mme e totobatsa boleng bo kaholimo ho 80% ka bofubelu. mpstat -P TSOHLE 1 1 | grep -v Karolelano | mohatla -n +5 | hlooho -n -1 | awk '{ hatisa (100-$13)}' | egrep -color=kamehla '[^\.][8-9][0-9][\.]?.*|^[8-9][0-9][\.]?.*| 100|' | kholomo
• perf top Sheba moo lipotoloho li sebelisoang teng.

7.2 i40e Libali
Mokhanni oa i40e o fana ka lethathamo le lelelele la li-counter bakeng sa ho lokisa sebopeho le ho beha leihlo ka taelo ea ethtool -S ethX. Ho ka ba molemo ho shebella sephetho ha mosebetsi o ntse o sebetsa le / kapa ho bapisa litekanyetso tsa li-counter pele le ka mor'a mosebetsi o boima.

• Ho fumana thotobolo e felletseng ea li-counters tsa i40e: ethtool -S ethX
• Ho shebella feela li-counters tse seng zero: shebella -d (ethtool -S ethX) | egrep -v :\ 0 | kholomo
  Lintho tse ling tseo u ka li batlang:
• rx_dropped e bolela hore CPU ha e sebeletse li-buffer ka potlako e lekaneng.
• port.rx_dropped e bolela hore ho hong ho sa potlaka ka ho lekaneng sekoting/memori/ sistimi.

7.3 Libali tsa marang-rang
Sheba netstat -s pele / ka mor'a mosebetsi o boima.
Netstat e bokella lintlha tsa marang-rang ho tsoa ho lisebelisoa tsohle tsa marang-rang tsamaisong. Ka hona, liphetho li kanna tsa ameha ho tsoa ho marang-rang ntle le marang-rang a ntseng a lekoa. Sephetho se tsoang ho netstat -s e ka ba sesupo se setle sa litaba tsa ts'ebetso ho sistimi e sebetsang ea Linux kapa kernel. Sheba litataiso tsa ho lokisa sistimi ea ts'ebetso, joalo ka Red Hat Enterprise Linux Network Performance Tuning Guide, bakeng sa temohisiso e eketsehileng mabapi le tokiso ea sistimi e akaretsang ea ts'ebetso.
7.4 Litlaleho tsa Tsamaiso
Sheba lits'oants'o tsa sistimi bakeng sa liphoso le litemoso (/var/log/messages, dmesg).
7.5 Sesebelisoa sa Intel svr-info
Intel e fana ka sesebelisoa sa svr-info (bona https://github.com/intel/svr-info) bakeng sa Linux e nkang lintlha tse nepahetseng tsa hardware le software ho tsoa ho seva. tlhahiso ea svr-info e ka thusa haholo ho tseba libotlolo tsa sistimi kapa litlhophiso / litokiso tse sa ntlafatsoang bakeng sa mojaro oa mosebetsi. Ha u bula nyeoe ea tšehetso le Intel bakeng sa litaba tsa ts'ebetso tse amanang le Ethernet, etsa bonnete ba hore o kenyelletsa tlhahiso ea svr-info (mongolo file) bakeng sa seva e 'ngoe le e 'ngoe ea Linux ho tlhophiso ea liteko.

1. Khoasolla le ho kenya svr-info:
   wget -qO- https://github.com/intel/svr-info/releases/latest/download/svrinfo.tgz| tar xvz cd svr-info
   ./svr-info
   > lebitso la moemedi.txt
2. Bokella tlhahiso:
   ./svr-info > hostname.txt
3. Hokela mongolo o le mong (.txt) file bakeng sa seva ka seng ho nyeoe ea hau ea tšehetso ea Intel bakeng sa tlhahlobo.

Likhothaletso bakeng sa Maemo a Tšoanang a Ts'ebetso

8.1 IP Ho fetisa

• Ntlafatsa kernel.
  Tse ling tsa morao-rao tsa in-distro kernels li senyehile ts'ebetsong ea litsela ka lebaka la liphetoho tsa kernel khoutu ea ho tsamaisa ho qala ka ho tlosoa ha cache ea ho tsamaisa ka lebaka la tšireletso. Li-kernel tsa morao-rao tse tsoang kantle ho distro li tlameha ho ba le li-patches tse fokotsang tšusumetso ea ts'ebetso ea liphetoho tsena mme li ka fana ka ts'ebetso e ntlafalitsoeng.
• Thibela hyper-threading (logical cores).
• Fetola liparamente tsa kernel boot.
  - Qobella iommu ho tima (intel_iommu=off kapa iommu=off) ho tloha moleng oa boot kernel ntle le haeba ho hlokahala bakeng sa virtualization
  - Tima taolo ea matla: processor.max_cstates=1 idle=poll pcie_aspm=off
• Fokotsa palo ea mela ho lekana le palo ea li-cores ho sokete ea lehae (12 ho ex.ample). ethtool -L ethX e kopantsoe 12
• Pin e sitisa sokete ea lehae feela. set_irq_affinity -X local ethX KAPA set_irq_affinity -X local ethX
  HLOKOMELA
  -X kapa -x e ka sebelisoa ho latela boima ba mosebetsi.
• Fetola boholo ba reng ea Tx le Rx ha ho hlokahala. Theko e kholo e nka lisebelisoa tse ngata empa e ka fana ka litefiso tse ntle tsa ho fetisa. ethtool -G ethX rx 4096 tx 4096
• Tlosa GRO ha u tsamaisa.
  Ka lebaka la taba e tsebahalang ea kernel, GRO e tlameha ho tingoa ha e tsamaisa / e fetisa. ethtool -K ethX gro off moo ethX e leng sebopeho sa Ethernet se lokelang ho fetoloa.
• Tlosa mokhoa oa ho feto-fetoha oa litšitiso 'me u behe boleng bo sa fetoheng. ethtool -C ethX adaptive-rx off adaptive-tx off ethtool -C ethX rx-usecs 64 tx-usecs 64

HLOKOMELA
Ho latela mofuta oa processor le boima ba mosebetsi, liparamente tsa coalescing tsa RX le TX li ka fetoloa bakeng sa ts'ebetso e ntlafalitsoeng (kapa tahlehelo e nyane ea foreimi).

• Tlosa firewall. sudo systemctl thibela firewalld sudo systemctl emisa firewalld
• Lumella phetisetso ea IP. sysctl -w net.ipv4.ip_forward=1
• Beakanya maemo a holimo bakeng sa boholo ba buffer ea ho amohela le ho romela. sysctl -w net.core.rmem_max=16777216 sysctl -w net.core.wmem_max=16777216

HLOKOMELA
Ho itšetlehile ka boima ba mosebetsi kapa tlhokahalo, litekanyetso tsena li ka fetoloa ho tloha ho tsa kamehla.
8.2 Ho lieha ha nako e tlase

• Tlosa hyper-threading (logical cores) TIMA.
• Netefatsa hore sesebelisoa sa marang-rang se sebakeng sa hau ho numa core 0.
• Tobetsa benchmark ho core 0 u sebelisa taskset -c 0.
• Tlosa irqbalance u sebelisa systemctl stop irqbalance kapa systemctl tima irqbalance
• Matha affinity script ho hasana ho li-cores. Leka sebakeng sa heno kapa kaofela.
• Koala tšitiso ea ho laola. ethtool -C ethX rx-usecs 0 tx-usecs 0 adaptive-rx off adaptive-tx off rxusecs- high 0
• Fokotsa palo ea mela e lekanang le palo ea li-cores ho sokete ea lehae (32 ho ex enaample). ethtool -L ethX e kopantsoe 32
• Pin e sitisa sokete ea lehae feela (sengolo se pakiloeng ka mohloli oa mokhanni oa i40e). set_irq_affinity -X ethX ea lehae
• Sebelisa benchmark e thehiloeng joalo ka netperf -t TCP_RR, netperf -t UDP_RR, kapa NetPipe. netperf -t TCP_RR kapa netperf -t UDP_RR
• Penya benchmark ho ntlha e le 'ngoe sebakeng sa sebaka sa NUMA. setsi sa mosebetsi -c

Intel ® Ethernet 700 Series
Tataiso ea Tokiso ea Ts'ebetso ea Linux
Tšitoe 2024
Doc. No.: 334019, Rev.: 1.2

Litokomane / Lisebelisoa

Intel Ethernet 700 Series Linux Performance Tuning [pdf] Bukana ea Mosebelisi 334019, Ethernet 700 Series Linux Performance Tuning, Ethernet 700 Series, Linux Performance Tuning, Performance Tuning, Tuning

Litšupiso

• Bukana ea Mosebelisi