Intel LogoIntel ® Ethernet 700 Series
Linux Performance Tuning Guide
NEX Cloud Networking Group (NCNG)
Rev. 1.2
Zvita 2024

Revision History

Kudzokorora Date Comments
1.2 Zvita 2024 · Yakawedzera Kuwedzera Simba Management Guidance.
+ Yakawedzera Intel * Turbo Boost.
· Yakawedzera Network Device Backlog.
· Yakawedzera Platform-Yakajeka Configurations uye Tuning.
· Yakawedzera 4th Generation Intel*%eon* Scalable processors.
· Yakawedzera AMD EPYC.
· Yakagadziridzwa Tarisa System Hardware Kugona.
· Yakagadziridzwa iPerf2.
· Yakagadziridzwa iPerf3.
· Yakagadziridzwa Tx/Rx Mitsetse.
· Yakagadziridzwa Kuvhiringidza Moderation.
· Yakagadziridzwa Mhete Saizi.
· Yakagadziridzwa Platform Tuning (i40e Isiri Yakananga).
· Yakagadziridzwa BIOS Settings.
· Yakagadziridzwa C-State Control.
* Yakagadziridzwa CPU Frequency Kuyera.
· Yakagadziridzwa Zvishandiso Zvirongwa.
· Yakagadziridzwa Operating System / Kernel Settings.
· Yakagadziridzwa IP Forwarding.
· Yakagadziridzwa Low Latency.
Nyamavhuvhu 2023 Kuchinja kwegwaro iri kunosanganisira:
· Akawedzera References References.
· Yakawedzerwa Ita shuwa kuti DDP Package iri Kurongeka Zvakakodzera.
· Yakawedzera iPerf2.
· Yakawedzera iPerf3.
· Yakawedzerwa netperf.
· Yakagadziridzwa IRQ Affinity.
· Yakawedzerwa Tx/Rx Mitsetse.
· Yakagadziridzwa Mhete Saizi.
· Yakawedzera Jumbo Frames.
· Yakawedzera Adapter Bonding.
· Yakawedzera Intel svr-info Tool.
1.0 Kurume 2016 Kutanga Kuburitswa (Intel Public).

Nhanganyaya

Gwaro iri rinoitirwa kupa nhungamiro yetuning nharaunda kuitira kunyatsoita networking uchishandisa Intel ® Ethernet 700 Series NICs munzvimbo dzeLinux. Inotarisa pane Hardware, mutyairi, uye inoshanda sisitimu mamiriro uye zvigadziriso zvinogona kuvandudza mashandiro etiweki. Izvo zvinofanirwa kucherechedzwa kuti networking performance inogona kukanganiswa nechero nhamba yekunze pesvedzero, chete yakajairika uye inoshamisa yeiyi inofukidzwa mugwaro iri.
1.1 Zvinoenderana References

Chekutanga Chekutarisa

2.1 Gadziridza Mutyairi/ Firmware Versions
Tarisa mutyairi/firmware shanduro uchishandisa ethtool -i ethx.
Gadzirisa zvinotevera sezvinodiwa:

2.2 Verenga VERENGA
Tarisa kune dzinozivikanwa nyaya uye uwane yazvino mirairo yekumisikidza kubva kuREADME file inosanganisirwa mune i40e sosi package.
2.3 Tarisa Kuti Yako PCI Express (PCIe) Slot Is x8
Mamwe maPCIe x8 slots anogadziriswa se x4 slots. Aya ma slots haana kukwana bandwidth kune yakazara mutsara chiyero ine mbiri chiteshi uye quad port zvishandiso. Mukuwedzera, kana iwe ukaisa PCIe v3.0-inokwanisa adapta muPCIe v2.x slot, haugone kuwana bandwidth yakazara. Mutyairi wesoftware anoona mamiriro aya uye anonyora inotevera meseji mune system log:
PCI-Express bandwidth inowanikwa yekadhi rino haina kukwana kuita zvakakwana. Kuti uite zvakakwana panodiwa x8 PCI-Express slot.
Kana kukanganisa uku kukaitika, fambisa adapta yako kune yechokwadi PCIe v3.0 x8 slot kugadzirisa nyaya.
2.4 Tarisa System Hardware Kugona
Pa10 Gbps, 25 Gbps, uye 40 Gbps Ethernet, pane zvishoma zvishoma CPU uye system zvinodiwa. Kazhinji, yemazuva ano sevha kirasi processor uye yakakwana yekumisikidzwa kwekuyeuka kwepuratifomu yako inofanira kukwana, asi zvinodiwa zvinosiyana zvichienderana nebasa rako. Yese nzira dzekurangarira dzinofanirwa kuve nevanhu uye memory performance mode inofanirwa kugoneswa muBIOS. Tarisa kuti CPU yako uye ndangariro kumisikidzwa inokwanisa kutsigira mwero wekuita kwetiweki yaunoda kune basa rako.
CHERECHEDZA
Iyo XL710 ndeye 40 GbE controller. Iyo 2 x 40 GbE adapta uchishandisa controller iyi haina kuitirwa kuti ive 2 x 40 GbE asi 1 x 40 GbE ine inoshanda yekudzosera-up port. Paunenge uchiedza kushandisa mutsara-chiyero chetraffic chinosanganisira ese madoko, shanduko yemukati yakazara uye iyo yakasanganiswa bandwidth pakati pezviteshi zviviri inogumira kuhuwandu hweSO Gbps.
2.4.1 Kernel Boot Parameters
Kana Intel® Virtualization Technology yeDirected I/O (Intel® VT-d) ikagoneswa muBIOS, Intel inokurudzira kuti IOMMU ive mupass-through mode kuti optimal host network performance. Izvi zvinobvisa DMA pamusoro peiyo traffic traffic uku ichigonesa Virtual Machines (VMs) kuti irambe iine mabhenefiti eIntel® VT-d. Izvi zvinopedzwa nekuwedzera mutsara unotevera kune kernel boot paramita: fommu-pt.
2.5 Ita shuwa kuti DDP Package iri Kurodha nemazvo
140ea uye 140eb base vatyairi havana tsigiro yakananga yeDynamic Device Personalization (DDP). Kushandisa DDP ne700 Series zvishandiso, DDP profile inogona kuiswa neiyo testpmd application.
Kuti uwane ruzivo nezveDDP profiles, uye maitiro ekushandisa DDP profile ine testpmd pa700 Series zvishandiso, tarisa kuIntel® Ethernet 700 Series Dynamic Device Personalization (DDP) Technology Guide.
Kuti uone kana DDP profile yakaiswa zvinobudirira:
testpmd> ddp tora runyorwa 0 Profile nhamba: 1
CHERECHEDZA
Kana iyo profile nhamba ndeye 0, hapana DDP package yakarodha. Muchiitiko cheDDP pasuru yekuremerwa kukanganisa, mudziyo unoenda kune yakachengeteka modhi uye akawanda maficha ekuita haapo. Kana paine zvikanganiso zvine chekuita nekurodha iyo DDP package, zvinokonzeresa kuita nyaya. Kuti uwane matanho ekugadzirisa matambudziko, tarisa kuInte/* Ethernet 700 Series Dynamic Device Personalization (DDP) Technology Guide.

Baseline Performance Measurements uye Tuning Methodology

3.1 Network Performance Benchmarks
Usati watanga chiitwa chekugadzirisa, zvakakosha kuve neyakagadzika kuyerwa kwekuita kwetiweki yako. Kazhinji mukuwedzera pakuwana kuyerwa kwekutanga kwekuita kwako kwechishandiso / kuwanda kwebasa, ipfungwa yakanaka kushandisawo yakajairwa network performance benchmark kuratidza kuti network yako mudziyo uri muchimiro chakanaka.
Kune imwe chete system optimization, netperf kana iperf uye NetPIPE ese akasimba akavhurika emahara maturusi ayo anogonesa iwe kusimbisa kubatana uye kuongorora maitiro ekuita.
Netperf yakasimba kune ese ari maviri throughput uye latency bvunzo. NetPIPE ndeye latency-chaiyo chishandiso asi inogona kuunganidzwa kune chero mhando yenzvimbo.
CHERECHEDZA
Iyo TCP_RR bvunzo mu netperf inodzosa latency mukukosha kwekutengeserana/sec. Iyi inhamba yerwendo rwokudzoka. Iyo imwe-nzira latency inogona kuverengerwa uchishandisa inotevera equation:
Kunonoka(kushandisa) = (1⁄2) / [Kuitwa/sec] * 1,000,000
3.1.1 iPerf2
Intel inokurudzira iperf2 pamusoro pe iperf3 kune akawanda mabhenji emamiriro ezvinhu nekuda kwekureruka kwekushandisa uye kutsigirwa kwetambo dzakawanda mune imwechete application muenzaniso. Intel inokurudzira kumhanya ne -P sarudzo ine 2-4 tambo dze25G dzekubatanidza uye dzakatenderedza 4-6 tambo dze40G yekubatanidza.

  • Kumhanyisa uni-directional traffic kubva kune mutengi kuenda kune server: Server command example: iperf2 -s
    Client command example: iperf2 -c -P
  • Kumhanyisa bi-directional traffic kubva kune mutengi kuenda kune server (uye zvinopesana): Server command example: iperf2 –s –p
    Client command example:
    iperf2 -c -p -P -–full-duplex OR
    iperf2 -c -p -P -d

CHERECHEDZA
Ose ari maviri -full-duplex uye -d sarudzo mu iperf2 inobvumira mushandisi kuita bidirectional bvunzo. Nekudaro, -full-duplex sarudzo inonyanya kutarisisa pane yakazara duplex kuyedzwa.
CHERECHEDZA
Paunenge uchiyedza iperf2 pane akawanda sevha ports, iyo -d mureza inogona kuwedzerwa kune sevha yekuraira kuti imhanye ese maseva masevhisi kumashure kubva kune imwechete terminal hwindo. Iyo -d mureza inogonawo kushandiswa kana sevha yekuraira yakanyudzwa mukati me-loop mune script.
CHERECHEDZA
Paunenge uchimhanyisa network throughput bvunzo nerukova rwumwechete/shinda (example: P1), AMD processors inogona kusapa inotarisirwa kubuda, kunyanya yakakwirira bandwidth NICs (kana kumhanya kuri> = 25G bandwidth). Nekuda kweizvozvo, application pinning kune chaiyo cores inodiwa kuti uwane yakakwira throughput. Ona Zvirongwa Zvekushandisa papeji 22.
3.1.2 iPerf3
Kana iperf3 ikashandiswa, zviitiko zvakawanda zvekushandisa zvinodikanwa kutora advantage yeakawanda-shinda, RSS, uye mitsara yehardware. Intel inokurudzira kumhanya neiyo 2-4 application sesheni ye25G yekubatanidza uye yakatenderedza 4-6 zvikamu zve40G yekubatanidza. Chikamu chega chega chinofanira kutsanangura yakasarudzika TCP port kukosha uchishandisa iyo -p sarudzo.

  • Kumhanyisa uni-directional traffic kubva mutengi kuenda kune server:
    Server command example:
    iperf3 -s -p
    Client command example:
    iperf3 -c -p
  • Kumhanyisa bi-directional traffic kubva kune mutengi kuenda kune server (uye zvinopesana):
    Server command example:
    iperf3 –s –p
    Client command example: iperf3 -c -p -P --bidir
  • Kutanga akati wandei (tambo) ye iperf3, kurudziro ndeye kushandisa for-loop kumepu tambo kuTCP ports uye kumhanya iperf3 kumashure uchishandisa & kugadzira akawanda maitiro akafanana.
    Server command example, tanga 4 threads: port=””; for i in {0..3}; do port=520$i; bash -c "iperf3 -s -p $ port &"; done; Client command example, tanga tambo ina - Tumira bvunzo port = ""; for i in {4..0}; do port=3$i; bash -c "iperf520 -c $serverIP -p $ port &"; done; Client command example, tanga tambo ina - Gamuchira test port = ""; for i in {4..0}; kuita port=3$i; bash -c "iperf520 -R -c $serverIP -p $ port &"; done; Kune 3G yekubatanidza, wedzera iyo ye-loop kugadzira anosvika matanhatu zviitiko / shinda.

CHERECHEDZA
Paunenge uchimhanyisa network throughput bvunzo nerukova rwumwechete/shinda (example: P1), AMD processors inogona kusapa inotarisirwa kubuda, kunyanya yakakwira bandwidth
NICs (kana kumhanya kuri> = 25G bandwidth). Nekuda kweizvozvo, application pinning kune chaiyo cores inodiwa kuti uwane yakakwira throughput. Ona Zvishandiso Zvirongwa papeji 22 uye AMD EPYC papeji 26.
3.1.3 netperf
Iyo netperf chishandiso isarudzo yakasimba kune ese ari maviri throughput uye latency bvunzo.

  • Iyo TCP_STREAM bvunzo munetperf inoyera kugona kwekushandisa kwemudziyo. Server command example: netserver Client command example: netperf -t TCP_STREAM -l 30 -H
  • Iyo TCP_RR bvunzo mu netperf inodzosa latency mune kukosha kwekutengeserana/yechipiri. Iyi inhamba yerwendo rwokudzoka. Zvinokurudzirwa kushandisa iyo -T x,x sarudzo, yaive x iri CPU yemunharaunda kune mudziyo. Iyo yenzira imwe chete latency inogona kuverengerwa uchishandisa: Latency(usec)=(1⁄2)/ [Transaction/sec]*1,000,\ Server command ex.ample: netserver
    Client command example: netperf -t TCP_RR -l 30 -H -T x,x
  • Kutanga akati wandei (tambo) dze netperf, kurudziro ndeye kushandisa for-loop kumepu tambo kuTCP ports uye kumhanya netperf kumashure uchishandisa & kugadzira akawanda maitiro akafanana.
    Server command example, tanga 8 threads:
    port=””; for i in {0..7}; kuita port=520$i; bash -c "netserver -L $serverIP -p $ port &"; done;
    Client command example, tanga shinda 8: port=””; for i in {0..7}; do port=520$i; bash -c "netperf -H $serverIP -p $port -t TCP_STREAM -l 30 &"; done;

3.2 Tuning Nzira
Tarisa pane imwe tuning shanduko panguva kuti iwe uzive kuti shanduko yega yega inoita sei pabvunzo yako. Iyo yakanyanya methodical iwe uri mukugadzirisa maitiro, zvichave nyore kuziva uye kugadzirisa zvikonzero zvekuita mabhodhoro.

Tuning i40e Driver Settings

4.1 IRQ Affinity
Kugadzirisa IRQ affinity kuitira kuti kukanganisa kune akasiyana mitsara yetiweki inobatanidzwa kune akasiyana CPU cores inogona kuve nemhedzisiro yakakura pakuita, kunyanya multithread throughput bvunzo.
Kugadzirisa IRQ affinity, misa irqbalance uye wobva washandisa set_irq_affinity script kubva i40e source package kana pini mitsetse nemaoko. Dzima mushandisi-nzvimbo IRQ balancer kugonesa kupinza mutsara:

  • systemctl inodzima irqbalance
  • systemctl mira irqbalance
    Uchishandisa set_irq_affinity script kubva kune i40e source package (inokurudzirwa):
  • Kushandisa ese macores:
    [nzira-ku-i40epackage]/scripts/set_irq_affinity -X ese ethX
  • Kushandisa macores chete paNUMA socket: [path-to-i40epackage]/scripts/set_irq_affinity -X local ethX
  • Iwe unogona zvakare kusarudza huwandu hwemacores. Dzivisa kushandisa cpu0 nekuti inomhanyisa nguva mabasa. [nzira-ku-i40epackage]/scripts/set_irq_affinity 1-2 ethX

CHERECHEDZA
Iyo affinity script inogonesa Transmit Packet Steering (XPS) sechikamu chepinning process kana -x sarudzo yatsanangurwa. Kana XPS ikagoneswa, Intel inokurudzira kuti udzime irqbalance, sezvo kernel balancer neXPS inogona kukonzera kuita kusingafungidzirwe. Iyo affinity script inodzima XPS kana iyo -X sarudzo yatsanangurwa. Kudzima XPS uye kugonesa symmetric mitsara kunobatsira pakuremerwa kwebasa uko kuita kwakanyanya kunowanikwa kana Tx neRx traffic yawana masevhisi pamitsetse imwe chete.
Kugadzirisa mitsara yekuenzanisa muLinux kunosanganisira kugadzirisa network interface driver paramita kuti igone kugonesa symmetric kugamuchira mitsetse (Rx) uye symmetric transmit queues (Tx) yeanotsigira network adapter.
CHERECHEDZA

  • Symmetric queues chinhu chepamberi networking, uye kwete ese mazana manomwe akatevedzana network adapter kana vatyairi vanovatsigira.
  • Ita shuwa kuti une mutyairi anodiwa uye rutsigiro rwehardware usati waedza kugadzirisa symmetric queues.

Kuti ugadzire symmetric queues, tevera matanho akajairwa:

  1. Rongedza Network Interface Configuration File: Shandisa chinyorwa edhita (yeexample, vi, nano, kana gedit) kugadzirisa iyo network interface kumisikidza file. The file inowanzowanikwa pasi pe /etc/sysconfig/network-scripts/dhairekitori uye ine zita senge ifcfg-ethX, uko ethX ndiro zita retiweki yako interface.
  2. Wedzera Symmetric Queue Parameters. Wedzera mitsara inotevera kune network interface configuration file: ETHTOOL_OPTS=”rx-mitsetse 8 tx-mitsetse 8″
  3. Restart Network Service.
    Mushure mekuita shanduko, tangazve sevhisi yetiweki kuti uise iyo nyowani yekumisikidza. sudo systemctl restart network

Nemaoko:

  • Tsvaga ma processor akabatanidzwa kune imwe neimwe node uchishandisa: numactl -hardware lscpu
  • Tsvaga iyo bit masks kune yega yega processors:
  • Kutora macores 0-11 ye node 0: [1,2,4,8,10,20,40,80,100,200,400,800]
  • Tsvaga maIRQ akapihwa kuchiteshi chiri kupihwa: grep ethX / proc/inovhiringidza uye cherechedza iyo IRQ tsika dze ex.ample, 181-192 yemavheji gumi nemaviri akaiswa.
  • Echo iyo SMP affinity kukosha mune inoenderana IRQ yekupinda. Ziva kuti izvi zvinoda kuitwa kune yega yega IRQ yekupinda: echo 1> /proc/irq/181/smp_affinity echo 2> /proc/irq/182/smp_affinity echo 4> /proc/irq/183/smp_affinity Ratidza IRQ kuwirirana:
  • Kuratidza IRQ affinity kune ese macores: /scripts/set_irq_affinity -s ethX
  • Kuratidza chete macores pane yemuno NUMA socket: /scripts/set_irq_affinity -s local ethX
  • Iwe unogona zvakare kusarudza huwandu hwemacores: /scripts/set_irq_affinity -s 40-0-8,16 ethX

CHERECHEDZA
The set_irq_affinity script inotsigira -s mureza mu i40e mutyairi shanduro 2.16.11 uye gare gare.
4.2 Tx/Rx Mitsetse
Nhamba yekusarudzika yemitsara inogoneswa kune yega yega Ethernet port nemutyairi pakutanga yakaenzana nehuwandu hwehuwandu hweCPUs inowanikwa papuratifomu. Izvi zvinoshanda zvakanaka kune akawanda mapuratifomu uye basa rekugadzirisa. Nekudaro, mumapuratifomu ane yakakwira musimboti kuverenga uye / kana yakakwira Ethernet port density, iyi gadziriso inogona kukonzera kupokana kwezviwanikwa. Naizvozvo, zvingave zvakafanira mune dzimwe nguva kugadzirisa kusarudzika kune yega yega chiteshi muhurongwa.
Nhamba yekusarudzika yemitsara yeTx/Rx inogona kusiyana zvichienderana nemhando chaiyo uye vhezheni yemutyairi. Huwandu hwemitsara hunogona kugadziridzwa uchishandisa iyo ethtool -L command yakanyorwa pazasi.
CHERECHEDZA
Muzviitiko izvi, Intel inokurudzira kuti uderedze kuverengeka kwemutsetse weiyo chiteshi chega chega kusapfuudza huwandu hweCPUs inowanikwa muNUMA node yemuno kune adapta port. Mune zvimwe zviitiko, kana uchiedza kuenzanisa zviwanikwa pane yakakwira port count kuita, zvingave zvakafanira kuderedza iyi nhamba zvakatowedzera.
Kugadzirisa queue configuration:
Anotevera example inoisa chiteshi kune makumi matatu nemaviri Tx/Rx mitsetse: ethtool -L ethX yakasanganiswa 32
Example output:
ethtool -l ethX
Channel parameters ethX: Pre-set maximums:
RX: 96
TX: 96
Vamwe: 1
Yakasanganiswa: 96
Zvigadziriso zvehardware zvazvino:
RX: 0
TX: 0
Vamwe: 1
Yakasanganiswa: 32
4.3 Kukanganisa Moderation
Adaptive interrupt moderation inongogara iripo, uye yakagadzirirwa kupa nzira yakaenzana pakati pekushandiswa kweCPU uye kushanda kwepamusoro. Nekudaro, iwe unogona kuyedza kugadzirisa zvinokanganisa marongero nemaoko kuti ikwane yako yekushandisa kesi.
Huwandu hwe 0-235 microseconds inopa hunoshanda huwandu hwe4,310 kusvika 250,000 inovhiringidza pasekondi. Kukosha kwe rx-μsecs-yakakwirira kunogona kuiswa yakazvimiririra kubva kune rx-μsecs uye tx-μsecs mune imwecheteyo ethtool murairo, uye zvakare yakazvimiririra kubva kune adaptive interrupt moderation algorithm. Iyo yepasi Hardware inotsigira granularity mu 2microsecond kupindirana, saka hunhu hwepedyo hunogona kuguma neiyo yekukanganisa mwero.

  • Kudzima adaptive yekukanganisa moderation: ethtool -C ethX adaptive-rx off adaptive-tx off.
  • Kuti ubatidze kuchinjika kunokanganisa moderation: ethtool -C ethX adaptive-rx pane adaptive-tx pa

Nzvimbo yakanaka yekutanga tuning yakajairika ndeye 84 μs, kana ~12000 zvinokanganisa/s. Kana iwe ukaona rx_dropped counters ari kushanda panguva yetraffic (uchishandisa ethtool -S ethX) saka unenge uine yakanyanyisa kunonoka yeCPU, isina kukwana mabuffer kubva kune adapta's mhete saizi (ethtool -G) kubata mapaketi e84 μs kana kudzika kweyero yekukanganisa.

  • Kuisa kudzora mwero kune yakatarwa yekuvhiringidza mwero we84 μs pakati pekuvhiringidza (12000 inovhiringidza/s): ethtool -C ethX adaptive-rx off adaptive-tx off rx-usecs 84 tx-usecs 84 Ukoshi hunotevera kuedza, kana usiri maxed out paCPU62 μs, μs. Izvi zvinoshandisa yakawanda CPU, asi inobhura nekukurumidza, uye inoda mashoma anotsanangura (saizi yemhete, ethtool -G).
  • Kuisa kudzongonyedzwa kwekuenzanisa kune yakagadziriswa yekukanganisa mwero we62 usecs pakati pekukanganisa (16000 inovhiringidza / s). ethtool -C ethX adaptive-rx off adaptive-tx off rx-usecs 62 tx-usecs 62
    Kana rx_dropped counters ikawedzera panguva yetraffic (uchishandisa ethtool -S ethX), iwe unogona kunge wakanyanya kunonoka yeCPU, isina kukwana mabuffers kubva kune iyo adapta mhete saizi (ethtool -G), kana yakaderera zvakanyanya yeyero yekukanganisa. Kana iwe usiri maxed kunze kweCPU kushandiswa, unogona kuwedzera iyo yekukanganisa chiyero nekudzikisa iyo ITR kukosha. Izvi zvinoshandisa yakawanda CPU, asi masevhisi anovhara nekukurumidza, uye anoda mashoma anotsanangura (saizi yemhete, ethtool -G).
    Kana CPU yako iri pa100%, saka kuwedzera chiyero chekuvhiringidza hakukurudzirwe. Mune mamwe mamiriro akadai seCPU yakasungwa basa, ungangoda kuwedzera iyo μs kukosha kugonesa yakawanda CPU nguva yemamwe maapplication.
    Kana iwe uchida yakaderera latency performance uye / kana uine yakawanda yeCPU yekushandisa kunetiweki kugadzirisa, unogona kudzima kukanganisa moderation zvachose, izvo zvinoita kuti zvinokanganisa zviite nekukurumidza sezvinobvira.
  • Kudzima kukanganisa moderation ethtool -C ethX adaptive-rx off adaptive-tx off rx-usecs 0 tx-usecs 0

CHERECHEDZA
Paunenge uchimhanya nekukanganisa moderation yakadzimwa, mwero wekukanganisa pamutsara wega wega unogona kunge wakakwira zvakanyanya. Funga kusanganisira iyo rx-usec-yakakwirira paramende yekuseta muganho wepamusoro pane yekukanganisa chiyero. Murairo unotevera unodzima adaptive yekukanganisa modhiyo uye unobvumira huwandu hwe5 microseconds usati waratidza kugamuchira kana kutumira kwapera. Panzvimbo pekuita kuti 200,000 ivhiringike pasekondi imwe neimwe, inomisa kudzongonyedzwa kwesekondi kusvika zviuru makumi mashanu kuburikidza ne rx-usec-yakakwirira parameter. # ethtool -C ethX adaptive-rx off adaptive-tx off rx-usecs-high 50,000 rx-usecs 20 txusecs 5 Edza kugadzirisa transmit/receive/high-priority coalescing timer kumusoro (5/80/100/150) kana kudzika (200/25/ optimal value ye20.
4.4 Kukura kwemhete
Kana uri kuona rx_dropped counters mu ethtool -S ethX (rx_dropped, rx_dropped.nic), kana fungidziro yecache pressure ine mitsetse yakawanda inoshanda, unogona kuedza kugadzirisa saizi yering kubva paukoshi hwekutanga. Iyo yakasarudzika kukosha ndeye 512, iyo max ndeye 4096.

  • Kutarisa maitiro azvino: ethtool -g ethX
    Kana zvichifungidzirwa kuti kushaikwa kwebuffering kuri kukonzera kudonha pachiyero chazvino chekuvhiringidza, unogona kuedza yakakwira kutanga, wobva yaita shoma, woenderera mberi nekutsvaga kwebhinari kusvika waona kuita kwakakwana.
    Kana cache pressure ichifungidzirwa (mitsetse mizhinji ichishanda) kuderedza mabhafa kubva ku default kunogona kubatsira Intel ® Data Direct I/O (Intel ® DDIO) kushanda nemazvo. Intel inokurudzira kuedza 128 kana 256 pamutsetse, uchiziva kuti kuwedzera kwekukanganisa chiyero kuburikidza ne ethtool -C inogona kuve yakakosha kudzivirira kuwedzera kwe rx_dropped.
  • Kuisa saizi yemhete kune yakatarwa kukosha: ethtool -G eth12 rx 256 tx 256

CHERECHEDZA
Kugadzirisa madonhwe eRx packet anowanikwa ne ethtool -S ethX|grep kudonha, funga kuwedzera ring size kusvika 4096. Edza kuti uwane zvakanakisisa kugadzirisa kwebasa rekushanda asi chenjerera kushandiswa kwechiyeuchidzo chakanyanyisa nehupamhi hwepamusoro.
4.5 Kudzora Kuyerera
Layer 2 flow control inogona kukanganisa kuita kweTCP zvakanyanya uye inokurudzirwa kuti iregererwe kune akawanda mabasa. Chinhu chinogona kusarudzika ndeye kuputika kwetraffic uko kuputika hakurebe mukufamba kwenguva.
Flow control yakadzimwa nekusarudzika.

  • Kugonesa kuyerera kwekutonga: ethtool -A ethX rx pa tx pa
  • Kudzima kudzora kuyerera: ethtool -A ethX rx off tx off

CHERECHEDZA
Iwe unofanirwa kuve neinoyerera yekudzora inokwanisa yekubatanidza mudiwa kuti ubudirire kugonesa kuyerera kwekutonga.
4.6 Jumbo Frames
Kana iyo inotarisirwa nharaunda yetraffic iine mabhuroko makuru e data iri kutamiswa, zvingave zvinobatsira kugonesa iyo jumbo furemu chimiro. Jumbo Frames tsigiro inogoneswa nekushandura iyo Maximum Transmission Unit (MTU) kune kukosha kwakakura kudarika kukosha kweiyo 1500. Izvi zvinobvumira mudziyo kuendesa data mumapaketi makuru mukati metiweki nharaunda. Kuseta uku kunogona kuvandudza kufambisa uye kuderedza kushandiswa kweCPU kune yakakura I/O mitoro yebasa. Nekudaro, zvinogona kukanganisa pakiti diki kana latency-sensitive basa rekuita.
CHERECHEDZA
Mafuremu eJumbo kana hombe MTU kuseta inofanirwa kugadzirwa zvakanaka pane yako network nharaunda.
Shandisa iyo ifconfig murairo kuwedzera MTU saizi. For example, pinda zvinotevera, kupi ndiyo nhamba yekubatanidza: ifconfig mtu 9000 kumusoro
Neimwe nzira, unogona kushandisa iyo ip kuraira sezvinotevera: ip link set mtu 9000 dev ip link kumisikidza dev

Platform Tuning (i40e Non-Specific)

5.1 BIOS Settings

  • Gonesa Intel® VT-d kune virtualization basa rakawanda.
  • Hyper-threading (inonzwisisika processors) inogona kukanganisa kuita. Edza nayo pairi kana kudzima kuitira basa rako.
  • Intel® Turbo Boost inobvumira CPU cores kushanda pamwero wepamusoro kupfuura base frequency yeCPU. Kugonesa Intel® Turbo Boost kunogona kuvandudza mashandiro emabasa akawanda asi inoshandisa simba rakawanda kuchengetedza macores ari pakakwirira frequency. Edza neTurbo Boost off/on yebasa rako.

CHERECHEDZA
Turbo frequency haina kuvimbiswa kana chikuva chiri kusangana nepamusoro pese CPU kushandiswa. Yakakwira musimboti turbo frequency inoderedzwa sezvo yakazara CPU kushandiswa kunowedzera.
5.2 Power Management
Kutonga kwesimba kunogona kukanganisa kushanda, kunyanya mune yakaderera latency mabasa. Kana kuita kuri kwepamusoro pane kudzikisa simba rekushandisa, Intel inokurudzira kuti uedze nekudzikamisa mhedzisiro yesimba manejimendi. Kune nzira dzakawanda dzakasiyana dzekudzikamisa manejimendi emagetsi, kuburikidza nekushandisa sisitimu maturusi, BIOS marongero, uye kernel boot paramita. Sarudza yakanakisa nzira uye nhanho inoenderana nenzvimbo yako.
5.2.1 C-State Control
Kumisa C-state kupinda kuCO kana C1 inovandudza mashandiro uye inowedzera kushandiswa kwesimba.
Kudzima CPU Package C6 state kupinda kunogona kuvandudza mashandiro etiweki. Zvisinei, izvi zvinowedzera kushandiswa kwesimba.
Izvi zvinotevera zvingasarudzwa zviripo:

  • Nesimba dzora iyo C-state yekupinda:
    Vhura
    /dev/cpu_dma_latency uye nyora iyo yakanyanya kubvumidzwa latency kwairi.

CHERECHEDZA
Pane chirongwa chidiki chinodaidzwa kuti cpudmalatency.c chinogona kutorwa kubva kune yakavhurika sosi nharaunda, inounganidzwa, uye inomhanya kubva pamutsetse wekuraira kuita izvi chaizvo.
Anotevera example inobvumira mashanu μs yenguva yekumuka, uye nekudaro inobvumira C1 kupinda: cpudmalatency 5 &

  • Deredza huwandu hweC-state mune kernel boot marongero:
    YeIntel CPUs: intel_idle.max_cstates=1
    Kune asiri-Intel CPUs: processor.max_cstates=1
  • Shandisa iyo cpupower kuraira kutarisa uye kudzima CPU C6 mamiriro: Tarisa: cpupower monitor kana cpupower idle-info.
    Dzima C6: cpupower idle-set -d3 kana
    Dzima C-Nyika: cpupower idle-set -D0

Notes:

  1. Dzima C-nyika paCPU kana sevha iine Intel® 4th Gen Intel® Xeon® Scalable processor(s). Kana Hyper Threading ikagoneswa kana kuvharwa, kudzima nyika dzisina basa (-D0) inodzivirira macores kupinda munzvimbo dzine simba-shoma panguva dzekuita uye inoderedza latency yeCPU kuti ishanduke pakati pezvisina basa uye zvinoshanda.
  2. Iko kutonga kwesimba kweIntel® 4th Gen Intel® Xeon® Scalable processor ine hukasha. Kuti udzivise macores kuti apinde pasi-simba masimba, edza kudzikisa huwandu hwemacores ari kushandiswa kuti urambe wakamuka kwenguva yakareba (ethtool -L pamwe chete ) Zvakare, sunga zvinokanganisa kune chaiwo macores uchishandisa set irq affinity (kazhinji ne -x yemuno kana runyorwa rweCPU cores), uye ita chokwadi chekuti basa rinomhanya pane iwo macores akafanana ane taskset kana numactl. Izvi zvinovandudza mashandiro nekuchengetedza macores achishanda uye optimize kukanganisa kubata.

Gonesa C6:
cpupower idle-set -d3
Bvisa C-States:
cpupower idle-set -E

  • Imwe nzira ndeye kushandisa tuned chishandiso (inosanganisirwa neakawanda Linux kugovera) kuseta performance profile. Izvi profiles gadzirisa akati wandei maOS marongero anogona kukanganisa mashandiro pane akawanda maapplication. Zvakaonekwa kuti network-throughput profile inopa kuvandudzwa kune akawanda mabasa.
    Tarisa:
    tuned-adm inoshanda
    Set:
    tuned-adm profile network-throughput
    CHERECHEDZA
    Tuned sevhisi inofanirwa kunge ichishanda kune mirairo iri pamusoro. Kuti utarise / kutangazve, tuned: systemctl mamiriro tuned systemctl restart tuned
    Iwe unogona zvakare kusabvumidza chero C-state yekupinda nekuwedzera zvinotevera kune kernel boot mutsara:
    isina basa=sarudzo
  • Deredza iyo C-nyika kuburikidza neiyo system's BIOS simba manejimendi zvigadziriso, izvo zvinogona kunge zvine performance profile iripo.
    Zvishandiso zvakaita se turbostat kana x86_energy_perf_policy zvinogona kushandiswa kutarisa kana kuseta magadzirirwo emagetsi.

5.2.2 PCIe Power Management
Active-State Power Management (ASPM) inogonesa yakaderera simba renyika yePCIe zvinongedzo kana isiri mukushandisa. Izvi zvinogona kukonzera yakakwira latency paPCIe network zvishandiso, saka Intel inokurudzira kuti iwe uvhare ASPM ye latency-sensitive workloads. Dzima ASPM nekuwedzera zvinotevera kune kernel boot mutsara: pcie_aspm=off
5.2.3 CPU Frequency Kuyera
CPU frequency kuyera (kana CPU kumhanya kuyera) iLinux simba rekutonga maitiro umo iyo system wachi yekumhanyisa inogadziriswa panhunzi kuchengetedza simba uye kupisa. Kungofanana neC-states, izvi zvinogona kukonzera kusada latency pane network yekubatanidza.
Iyo cpupower chishandiso inogona zvakare kushandiswa kutarisa uye kugadzirisa CPU performance defaults uye miganhu:

  • Tarisa: cpupower monitor kana
  • Seta maCPU kune maitiro ekuita: cpupower frequency-set -g performance

CHERECHEDZA
Kugadziridzwa kuCPU frequency miganho inogona kuve nemhedzisiro kune akawanda mabasa uye inogona kudzima mamwe maficha, akadai seCPU turbo modhi.
Kudzima CPU frequency kuyera, dzima iyo CPU simba sevhisi nemirairo inotevera:
systemctl mira cpupower.service
systemctl disable cpupower.service
5.2.4 Yekuwedzera Simba Rekutungamira Guidance
Mamwe mashoko anopihwa mune ino yepamusoro-level pamusoroview yeakawanda emagetsi manejimendi maficha mune 3rd Generation Intel® Xeon® Scalable processors, pamwe negwaro rekuti zvinhu izvi zvinogona kubatanidzwa sei padanho repuratifomu: https://networkbuilders.intel.com/solutionslibrary/power-management-technologyoverview-technology-guide
5.3 Intel® Turbo Boost
Intel® Turbo Boost inoita kuti processor ikurumidze kana ichidiwa asi inogona kushandisa rimwe simba. Kudzima Turbo Boost kunoita kuti processor irambe ichimhanya zvakadzikama, zvichikupa nhanho yekuita inowirirana kune mamwe mabasa.
5.4 Firewalls
Firewalls inogona kukanganisa kushanda, kunyanya latency performance.
Dzima iptables/firewalld kana zvisingadiwe.
5.5 Zvishandiso Zvirongwa
Kazhinji tambo imwe chete (iyo inoenderana neinetiweki mutsara) haina kukwana kuti iwane yakanyanya bandwidth. Mamwe mapuratifomu ekuvaka, akadai se AMD, anowanzo kudonhedza mamwe maRx mapaketi ane tambo imwe chete kana ichienzaniswa nemapuratifomu ane Intel-based processors.
Funga kushandisa maturusi senge taskset kana numactl kubaya maapplication kuNUMA node kana CPU cores yemuno kunetiweki mudziyo. Kune mamwe mabasa akadai sekuchengetedza I / O, kufambisa iyo application kune isiri-yemunharaunda node inopa bhenefiti.
Edza nekuwedzera huwandu hwetambo dzinoshandiswa nechikumbiro chako kana zvichibvira.
5.6 Kernel Version
Mazhinji emazuva ano mu-bhokisi kernels akakwenenzverwa zvine mutsindo kuita asi, zvichienderana nekushandisa kwako kesi, kugadzirisa kernel kunogona kupa kuvandudzwa kwekuita. Kurodha sosi zvakare kunoita kuti iwe ugone kugonesa / kudzima zvimwe zvinhu usati wavaka kernel.
5.7 Operating System/Kernel Settings
Bvunza masisitimu ekushandisa tuning madhairekitori, akadai seRed Hat Enterprise Linux Network Performance Tuning Guide, kuti uwane rumwe ruzivo nezve general operating system tuning.
Mamwe maparameter akajairika ekuridza akanyorwa mutafura inotevera. Ziva kuti aya anongokurudzirwa mapoinzi ekutanga, uye kuashandura kubva kune zvisizvo zvinogona kuwedzera zviwanikwa zvinoshandiswa pahurongwa. Kunyangwe kuwedzera kukosha kunogona kubatsira kuvandudza mashandiro, zvinodikanwa kuti uedze nemhando dzakasiyana kuti uone kuti chii chinoshanda zvakanyanya kune yakapihwa sisitimu, mutoro webasa uye rudzi rwetraffic.
Iyo kernel paramita inogadziriswa uchishandisa iyo sysctl utility muLinux sezvakaratidzwa pazasi.
To view iwo default maitiro ermem uye wmem pane system:
sysctl net.core.rmem_default
sysctl net.core.wmem_default
Isa ma values ​​kuti ave max (16 MB):
sysctl -w net.core.rmem_max=16777216
sysctl -w net.core.wmem_max=16777216
Socket buffer saizi, inozivikanwawo sekugamuchira buffer (rmem) uye transmit buffer (wmem), ndiwo masisitimu ma paramita anotsanangura huwandu hwendangariro dzakachengeterwa inouya uye inobuda network traffic.
Kumhanya sysctl pasina iyo -w nharo inonyora parameter ine marongero ayo aripo.

Stack Setting Tsanangudzo
net.core.rmem_default Default Gamuchira Window size
net.core.wmem_default Default Transmit Window size
net.core.rmem_max Maximum Gamuchira Window Size
net.core.wmem_max Maximum Transmit Window size
net.core.optmem_max Maximum Option Memory Buffers
net.core.netdev_max_backlog Kumashure kwemapaketi asina kugadziriswa kernel isati yatanga kudonha
net.ipv4.tcp_rmem Memory reserver yeTCP kuverenga mabuffers
net.ipv4.tcp_wmem Memory reserver yeTCP tumira ma buffers

Kernel, network stack, memory handler, CPU kumhanya, uye simba manejimendi paramita zvinogona kuita hombe pakuita network. Kurudziro yakajairika ndeyekunyorera kune network throughput profile uchishandisa iyo tuned command. Izvi zvinogadzirisa mashoma OS marongero kuti ape zvaunofarira kune networking application.
Tarisa:
tuned-adm inoshanda
Set:
tuned-adm profile network-throughput
5.8 Network Device Backlog
Iyi ficha inobatsira kuvandudza mashandiro etiweki nekugadzirisa traffic inouya zvinobudirira, kuderedza kurasikirwa kwepaketi, kudzikisa latency, uye kuwedzera kuburitsa. Izvi zvinotungamira kune zvirinani mushandisi ruzivo uye nekukurumidza system mhinduro.
Nekusagadzikana, inogoneswa mune mazhinji eLinux masisitimu anoshanda. Kutarisa kukosha kwekutanga:
sysctl net.core.netdev_max_backlog
Huwandu hwepamusoro hwenetdev_max_backlog hunogona kusiyana zvichienderana nezvinhu zvakaita sekernel vhezheni, hardware, ndangariro, uye basa. Muzviitiko zvakawanda, 8192 inoonekwa seyakanaka kukosha. sysctl -w net.core.netdev_max_backlog=8192
5.9 Platform-Yakasiyana Magadzirirwo uye Tuning
5.9.1 4th Generation Intel® Xeon® Scalable Processors

Iko kutonga kwesimba kweIntel® 4th Generation Intel® Xeon® Scalable processor ine hukasha zvakanyanya kana ichienzaniswa neyechitatu Generation Intel® Xeon® Scalable processors. Kuti udzivise macores kubva pakupinda pasi-simba masimba, edza kudzikisa huwandu hwemacores ari kushandiswa kuti urambe wakamuka kwenguva yakareba.
Yakakurudzirwa maBios Settings eKunyanya Kuita

  1. Hyper-threading inogonesa / kudzima (zvichienderana nebasa rinodiwa uye kuita zvinangwa) paCPU.
  2. Seta iyo system profile kuPerformance yekunyanya kuita.
    CHERECHEDZA
    Izvi zvinokonzera kushandiswa kwesimba kwepamusoro
  3. Seta iyo CPU simba manejimendi kuMaximum Performance kuti uise pamberi pehukuru hweCPU kuita pamusoro pesimba remagetsi.
  4. Gonesa Turbo Boost. Kudzima Turbo Boost mugadziriro yeBIOS marongero anowanzo dzivirira iyo CPU kubva kune dynamically kuwedzera wachi yayo kumhanya kupfuura yayo base frequency.
  5. CHERECHEDZA
    Kudzima Turbo Boost inogona kunge yakakodzera kune mamwe makesi ekushandisa uko kunoenderana kuita, kugona kwesimba, kana kudziya kwekutonga kunoiswa pamberi pepamusoro pekuita.
  6. Dzima Single Root I/O Virtualization (SR-IOV) chimiro, kana sisitimu isiri kushandisa hunyanzvi hwekuita.
  7. Dzima C-nyika kuraira iyo CPU kuti irambe ichishanda uye kudzivirira kupinda munzvimbo dzakadzika dzisina basa.
  8. Dzima C1E, kuve nechokwadi chekuti CPU inoramba ichishanda uye haipinde muC1E isina basa.
  9. Seta iyo uncore frequency kusvika kune yakanyanya kuraira sisitimu kuti ishande pane yepamusoro inowanikwa frequency.
  10. PaDell mapuratifomu, isa Multiple APIC Tsanangudzo Tafura (MADT) musimboti emulation kune Linear (kana Round-Robin zvichienderana neBIOS) kuti ipe yakajeka uye inofanotaura mepu yeCPU cores.

Yakakurudzirwa OS Level Tunings yeOptimized Performance

  1. Seta CPU frequency kuyera gavhuna kuita. cpupower frequency-set -g performance cpupower frequency-info
  2. Dzima C-States. cpupower idle-set -D0
  3. Seta musimboti Rx (rmem) uye Tx (wmem) mabuffers kune yakanyanya kukosha. sysctl -w net.core.rmem_max=16777216 sysctl -w net.core.wmem_max=16777216
  4. Seta network backlog. sysctl -w net.core.netdev_max_backlog=8192
  5. Seta tuned profile (mutoro webasa unoenderana nekupfuura/latency).
    tuned-adm profile network-throughput

Inokurudzirwa Adapter Level Tunings yeOptimized Performance

  1. Dzimisa nhamba yemitsara yekushandisa kune application traffic. Shandisa iyo diki nhamba yemitsara inodiwa kuchengetedza inosanganisirwa CPU cores ichishanda kudzivirira kuti isapinda munzvimbo dzakadzika dzisina basa (gadzirisa basa): ethtool -L zvakasanganiswa 32
  2. Seta kudzongonyedzwa kwemitengo. ethtool -C adaptive-rx off adaptive-tx off rx-usecs-high 50 rx-usecs 50 tx-usecs 50
    Edza kugadzirisa kutapurirana/kugashira/yakakwirira-yakakosha coalescing timer kumusoro (80/100/150/200) kana kudzika (25/20/10/5) kuti uwane yakakwana kukosha kwebasa.
  3. Isa iyo Rx/Tx mhete saizi. ethtool -G rx 4096 tx 4096
    CHERECHEDZA
    Kana iwe ukaona Rx packet inodonha ne ethtool -S| grep kudonha, edza kudzikisa saizi yemhete kusvika <4096. Edza kutsvaga kukosha kwakaringana kwemutoro webasa uko mapaketi asina kudonhedzwa.
  4. Seta IRQ Affinity. Shandisa macores emunharaunda kuNIC, kana chaiyo core mepu (apo # cores yakaenzana nenhamba yemitsara yakaiswa mu1 papeji 26. systemctl stop irqbalance set_irq_affinity -X local KANA set_irq_affinity -X

5.9.2 AMD EPYC
AMD EPYC processors ane simba maCPU akagadzirirwa maseva uye data nzvimbo, akavakirwa pa AMD's Zen architecture. Iwo pazasi marongero anobva ku AMD's 4th chizvarwa EPYC akatevedzana.
Yakakurudzirwa BIOS Settings yeYakanyanya Kuita

  1. Gonesa tsika modhi kuti ubvumire vashandisi kugadzirisa CPU mashandiro, mashandisiro emagetsi, uye mamwe marongero. Izvi zvinobatsira mukugadzirisa zvakanaka sisitimu yechiyero chakanakisa pakati pekuita uye kushanda nesimba.
  2. Gonesa core performance boost kubvumira CPU kuti iwedzere otomatiki kumhanya kwayo kubata mamwe mabasa akasimba, kuvandudza kuita kwese.
  3. Bvisa pasi rose C-state control, kudzivirira iyo CPU kuti isapinda munzvimbo dzakadzika dzekuchengetedza simba dzinozivikanwa seC-states, iyo inogona kuchengetedza kuterera.
    CHERECHEDZA
    Kudzima C-states kunogona kukonzera mamwe mashandisirwo emagetsi uye kuwedzera tembiricha yekupisa. Monitor zvose zviri zviviri basa.
  4. Gonesa/dzima Simultaneous Multithreading (SMT) paCPU, zvichibva pane zvinodiwa nebasa uye zvinangwa zvekuita. SMT yakaenzana neHyper Threading paIntel CPUs.
    CHERECHEDZA
    Kuti ushande zvakanaka, tarisa kuTuning i40e Driver Settings papeji 13 uye Platform Tuning (i40e Non-Specific) papeji 19 yeiyo inokurudzirwa OS uye adapta level tuning.

Adapter Bonding

Linux bonding chinhu chine simba chinogona kuvandudza zvakanyanya network performance, redundancy, uye kukanganisa kushivirira munzvimbo dzeseva. Nekudaro, zvakakosha kuti uzive kuti inoda inoenderana network network uye kurongeka kwakaringana pane ese server uye switch kuti ishande nemazvo.
Iyo yekubatanidza mutyairi muLinux inokutendera iwe kuti uunganidze akawanda emuviri network network mune yakasungwa interface. Iyi yakasungirirwa interface inoratidzika senge imwe chete virtual network interface kune inoshanda sisitimu uye maapplication.
CHERECHEDZA
Iyo bond ndeye inonzwisisika interface, saka hazvigoneke kuseta CPU hukama zvakananga pane bond interface (ye ex.ample, chisungo0). Ndokunge, haina kutonga kwakananga pamusoro pekukanganisa kubata kana CPU hukama. CPU affinity inofanirwa kugadzirwa kune epasi mainterfaces ari chikamu chechisungo.
Bonding inopa akati wandei maitiro ekushanda, imwe neimwe iine maitiro ayo.

Mode  Type
0 Round Robin
1 Active Backup
2 XOR
3 Broadcast
4 LACP
5 Transmit Load Balance
6 Adaptive Load Balance

Pane nzira dzakasiyana dzekugadzira bonding muLinux. Imwe yenzira dzakajairika ndeyekushandisa network configuration files (semuenzanisoample, /etc/network/ interfaces kana /etc/sysconfig/network-scripts/ifcfg-bondX).
Kugadzirisa Kushandisa Network Configuration Files
Matanho anotevera anogadzira bonding kuburikidza neiyo network kumisikidza files.

  1. Sarudza maviri kana anopfuura NIC ports yekubatanidza (yeexample, ethX uye ethY)
  2. Vhura NIC Configuration Files pasi /etc/sysconfig/network-scripts/ yeNIC Interface inodiwa (yeexample, vi ifcfg-ethX uye vi ifcfg-ethY) uye wedzera zvinyorwa zvinotevera:
    MASTER=bondN [Cherechedza: N inhamba yekutaura nhamba yebhondi.] MURANDA=hongu
  3. Gadzira bond network script file uchishandisa vi /etc/sysconfig/networkscripts/ifcfg-bondN uye isa zvinyorwa zvinotevera:
    DEVICE=bondN [Cherechedza: N inhamba yekutaura nhamba yebhondi] ONBOOT=hongu USERCTL=kwete BOOTPROTO=dhcp (kana) hapana
    IPADDR=200.20.2.4 [inodiwa kana BOOTPROTO=hapana] NETMASK=255.255.255.0 [inodiwa kana BOOTPROTO=hapana] NETWORK=200.20.2.0 [inodiwa kana BOOTPROTO=hapana] BROADCAST=200.20.2.255.OTTOne1. BONDING_OPTS=”modhi=100 miimon=XNUMX″
    CHERECHEDZA
    Modhi inogona kuve chero nhamba kubva 0 kusvika 6 zvichienderana nezvinodiwa.
  4. Tangazve masevhisi etiweki uchishandisa sevhisi network restart kana systemctl restart NetworkManager.service

Performance Troubleshooting

7.1 CPU Kushandisa
Tarisa mashandisirwo eCPU pamusimboti apo basa riri kushanda.
Ziva kuti mashandisirwo ega ega akakosha pakuita pane kuzara kweCPU kushandiswa sezvo ichipa pfungwa yekushandiswa kweCPU pamutsetse wetiweki. Kana iwe uchingove netambo shoma dzinomhanya netiweki traffic, saka unogona kungoita mashoma macores ari kushandiswa. Nekudaro, kana iwo macores ari pa100%, saka network yako throughput inogona kuganhurwa neCPU kushandiswa uye yave nguva yekuita zvinotevera:

  1. Tune IRQ moderation / saizi yemhete sekutsanangurwa kwakadzama muKukanganisa Moderation.
  2. Wedzera huwandu hwetambo dzekushandisa kuparadzira iyo CPU mutoro pamusoro pemamwe macores. Kana ese macores ari kushanda pa100% saka application yako inogona kunge iri CPU yakasungwa kwete kusungwa netiweki.

Zvishandiso zvinowanzowanikwa:

  • pamusoro
    - Dzvanya 1 kuti uwedzere runyorwa rweCPU uye tarisa kuti ndeapi ari kushandiswa.
    - Cherekedza mwero wekushandiswa.
    - Cherechedza kuti ndeapi maitiro akanyorwa seanonyanya kushanda (pamusoro pechinyorwa).
  • mpstat
    Anotevera example command line yakaedzwa paRed Hat Enterprise Linux 7.x.
    Inoratidza kushandiswa kweCPU pamusimboti (nekuwana iyo yakazara muzana isina basa uye kubvisa kubva ku100) uye inosimbisa kukosha pamusoro pe80% mutsvuku. mpstat -P ALL 1 1 | grep -v Avhareji | muswe -n +5 | musoro -n -1 | awk '{ dhinda (100-$13)}' | egrep -color=nguva dzose '[^\.][8-9][0-9][\.]?.*|^[8-9][0-9][\.]?.*| 100|' | column
  • perf top Tarisa pari kushandisirwa ma cycles.

7.2 i40e Counters
Mutyairi wei40e anopa runyorwa rurefu rwemakaunda ekugadzirisa interface uye kutarisa kuburikidza neiyo ethtool -S ethX command. Zvinogona kubatsira kutarisa zvakabuda apo basa rekushanda riri kushanda uye / kana kuenzanisa maitiro ekupikisa pamberi uye mushure mekushanda kwebasa.

  • Kuti uwane yakazara yakazara i40e counters: ethtool -S ethX
  • Kungoona asiri-zero counters: tarisa -d (ethtool -S ethX) | egrep -v :\ 0 | column
    Zvimwe zvekutsvaga:
  • rx_dropped zvinoreva kuti CPU haisi kushandira mabhafa nekukurumidza zvakakwana.
  • port.rx_dropped zvinoreva kuti chimwe chinhu hachina kukurumidza mu slot/memory/ system.

7.3 Network Counters
Tarisa netstat -s pamberi / mushure mekuita basa rekuita.
Netstat inounganidza ruzivo rwenetiweki kubva kune ese network zvishandiso muhurongwa. Naizvozvo, mibairo inogona kukanganiswa kubva kunetiweki kunze kwenetiweki iri kuedzwa. Izvo zvinobuda kubva ku netstat -s inogona kuve chiratidzo chakanaka chekuita nyaya muLinux inoshanda sisitimu kana kernel. Bvunza masisitimu ekushandisa tuning madhairekitori, akadai seRed Hat Enterprise Linux Network Performance Tuning Guide, kuti uwane rumwe ruzivo nezve general operating system tuning.
7.4 System Logs
Tarisa system logs yezvikanganiso uye yambiro (/var/log/messages, dmesg).
7.5 Intel svr-info Tool
Intel inopa svr-info chishandiso (ona https://github.com/intel/svr-info) yeLinux inotora yakakodzera hardware uye software ruzivo kubva kune server. svr-info inobuda inogona kubatsira zvakanyanya kuona mabhodhoro ehurongwa kana marongero / tunings asina kugadziridzwa basa. Kana uchivhura kesi yekutsigira neIntel yeEthernet-inoenderana nekuita nyaya, ita shuwa kuti unosanganisira svr-info kubuda (zvinyorwa. file) kune yega yega Linux server muyedzo yekumisikidza.

  1. Dhawunirodha uye isa svr-info:
    wget -qO- https://github.com/intel/svr-info/releases/latest/download/svrinfo.tgz| tar xvz cd svr-ruzivo
    ./svr-info
    > hostname.txt
  2. Unganidza zvabuda:
    ./svr-info > hostname.txt
  3. Batanidza chinyorwa chimwe (.txt) file kune yega yega server kune yako Intel inotsigira kesi yekuongorora.

Recommendations for Common Performance Scenarios

8.1 IP Kutumira

  • Gadziridza kernel.
    Mamwe achangoburwa mu-distro kernels akashatisa routing performance nekuda kwekuchinja kwekernel mucode yekufambisa kutanga nekubviswa kweiyo cache yenzira nekuda kwekuchengetedza. Munguva pfupi yapfuura kunze-kwe-distro kernels dzinofanirwa kunge dziine zvigamba zvinorerutsa maitiro ekuchinja uku uye zvinogona kupa mashandiro akavandudzwa.
  • Dzima hyper-threading (logical cores).
  • Rongedza iyo kernel boot paramita.
    -Simbisa iommu kudzima (intel_iommu = kudzima kana iommu = kudzima) kubva kumutsara wekernel boot kunze kwekunge zvichidikanwa pakuona.
    - Dzima kutonga kwesimba: processor.max_cstates=1 idle=poll pcie_aspm=off
  • Deredza nhamba yemitsara kuti ienzane nenhamba yemacores pane socket yemuno (12 mune ino ex.ample). ethtool -L ethX yakasanganiswa 12
  • Pini inovhiringa kune socket yemuno chete. set_irq_affinity -X local ethX OR set_irq_affinity -X local ethX
    CHERECHEDZA
    -X kana -x inogona kushandiswa zvichienderana nehuwandu hwebasa.
  • Chinja Tx uye Rx ring size sezvinodiwa. Kukosha kukuru kunotora zvimwe zviwanikwa asi kunogona kupa zvirinani mareti ekutumira. ethtool -G ethX rx 4096 tx 4096
  • Dzima GRO paunenge uchifambisa.
    Nekuda kweinozivikanwa kernel nyaya, GRO inofanirwa kudzimwa kana uchifambisa/kutumira. ethtool -K ethX gro kure uko ethX ndiyo Ethernet interface inofanira kugadziriswa.
  • Dzima adaptive interrupt moderation uye isa static value. ethtool -C ethX adaptive-rx off adaptive-tx off ethtool -C ethX rx-usecs 64 tx-usecs 64

CHERECHEDZA
Zvichienderana nerudzi rwe processor uye mutoro webasa, iyo coalescing paramita yeRX neTX inogona kugadziridzwa kuti ivandudze mashandiro (kana kushoma furemu kurasikirwa).

  • Dzima firewall. sudo systemctl dzima firewalld sudo systemctl mira firewalld
  • Bvumira IP kutumira. sysctl -w net.ipv4.ip_forward=1
  • Rongedza huwandu hwakanyanya hwekugamuchira uye kutumira socket buffer saizi. sysctl -w net.core.rmem_max=16777216 sysctl -w net.core.wmem_max=16777216

CHERECHEDZA
Zvichienderana nehuwandu hwebasa kana chinodiwa, izvi zvakakosha zvinogona kuchinjwa kubva pane zvakasara.
8.2 Low Latency

  • Bvisa hyper-threading (logical cores) DZIMA.
  • Ita shuwa kuti mudziyo wetiweki uri munharaunda kune numa core 0.
  • Pina bhenji kune musimboti 0 uchishandisa taskset -c 0.
  • Dzima irqbalance uchishandisa systemctl mira irqbalance kana systemctl disable irqbalance
  • Mhanyai affinity script kuti ipararire pamacores. Edza zvingave zvemuno kana zvese.
  • Dzima kudzikamisa moderation. ethtool -C ethX rx-usecs 0 tx-usecs 0 adaptive-rx off adaptive-tx off rxusecs- yakakwirira 0
  • Dumisa nhamba yemitsara kuti ienzane nenhamba yemacores pasocket yenzvimbo (32 mune ino ex.ample). ethtool -L ethX yakasanganiswa 32
  • Pini inovhiringidza kune socket yemuno chete (script yakarongedzwa ne i40e driver source). set_irq_affinity -X local ethX
  • Shandisa bhenji rakamiswa senge netperf -t TCP_RR, netperf -t UDP_RR, kana NetPipe. netperf -t TCP_RR kana netperf -t UDP_RR
  • Pina bhenji kune imwechete core munharaunda yeNUMA node. basa -c

Intel ® Ethernet 700 Series
Linux Performance Tuning Guide
Zvita 2024
Doc. Kwete.: 334019, Rev.: 1.2

Zvinyorwa / Zvishandiso

Intel Ethernet 700 Series Linux Performance Tuning [pdf] Bhuku reMushandisi
334019, Ethernet 700 Series Linux Performance Tuning, Ethernet 700 Series, Linux Performance Tuning, Performance Tuning, Tuning

References

Siya mhinduro

Yako email kero haizoburitswa. Nzvimbo dzinodiwa dzakamakwa *