10G NICs General Optimization

Append the following in `kernel` entry of file /etc/grub.conf: CPUs should be isolated according to your case

intel_idle.max_cstate=0 processor.max_cstate=0 idle=poll pcie_aspm=performance mce=ignore_ce ipmi_si.force_kipmi=0 nmi_watchdog=0 noht nosoftlockup isolcpus=3,7

reboot the system. Optimizations to be performed:

    modprobe acpi-cpufreq 
    cpupower set -b 0 
    cpupower frequency-set --governor performance 
    tuned-adm profile latency-performance 

    service irqbalance stop
    service cpuspeed stop
    chkconfig irqbalance off
    chkconfig cpuspeed off

    ifconfig $eth mtu 9000 txqueuelen 1000 up  #changed the eth id based on your case

append the following in file: /etc/sysctl.conf

# -- tuning -- #
# Increase system file descriptor limit
fs.file-max = 65535

# Increase system IP port range to allow for more concurrent connections
net.ipv4.ip_local_port_range = 1024 65000

# -- 10gbe tuning from Intel ixgb driver README -- #

# turn off selective ACK and timestamps
net.ipv4.tcp_sack = 0
net.ipv4.tcp_timestamps = 0

# memory allocation min/pressure/max.
# read buffer, write buffer, and buffer space
net.ipv4.tcp_rmem = 10000000 10000000 10000000
net.ipv4.tcp_wmem = 10000000 10000000 10000000
net.ipv4.tcp_mem = 10000000 10000000 10000000

net.core.rmem_max = 524287
net.core.wmem_max = 524287
net.core.rmem_default = 524287
net.core.wmem_default = 524287
net.core.optmem_max = 524287
net.core.netdev_max_backlog = 300000