Solarflare Install

Kernel Version

Solarflare is only supported on the following Kernels and OSs

Kernels

• 2.6
• 3.x

OSs

• RHEL5
• RHEL6
• MRG
• SLES10
• SLES11
• SLERT

Dependencies

• Update to date kernel and matiching kernel-devel
• glibc.i686
• Development tools
• Python-devel / Python

• AOE card must have both ports connected

Verify Solar Flare Adapter Firmware and Driver Versions

ethtool -i ethX3
driver: sfc
version: 3.3.0.6246
firmware-version: 3.3.0.6247
bus-info: 0000:01:00.0

OpenOnload Install

unzip SF-109361-LS-1AOE_PTP_Onload.zip
tar -xvf openonload-201210-ptp.tgz
unzip SF-109362-LS-1AOE_Extension_Driver.zip
cd openonload-201210-ptp
scripts/onload_install
onload_tool reload

lsmod | grep sfc
lsmod | grep onload

WORK IN PROGRESS (all of the commands adam ran)

unzip SF-109373-LS-1AOE_Linux_Utils.zip unzip SF-109375-LS-3AOE_Image_Resilient_Eth.zip unzip SF-109376-LS-2AOE_Tools_Beta.zip unzip SF-109377-LS-1AOE_Tools_Debug.zip

tar -xvf sfnettest-1.5.0.gz tar -xvf sfaoefdk-internal-1.0.5.1011.tgz

rpm -i sfaoesw-1.0.5.1011-1.src.rpm

Update Adapter Firmware

rpm -i sfutils-3.3.0.6247-1.i586.rpm
sfupdate eth3
sfupdate eth3 --write
sfupdate --adapter=eth3 --write

More of Adams Instructions

modprobe -r sfc_aoe force_sienastats=1 debug=1 link_mode=1 modprobe -r sfc_aoe; modeprobe sfc_aoe force_sienastats=1 debug=1 link_mode=1 modprobe -r sfc_aoe; modprobe sfc_aoe force_sienastats=1 debug=1 link_mode=1

ethtool -S aoe_ext0 ethtool -S aoe_ext0 |more ethtool -S aoe_ext1 |more sfupdate --adapter=eth3 --image= --write sfupdate --adapter=eth3 --image=sfa6902f_a5_resilience_v0_25_2_0.dat --write

ifconfig eth2 10.1.1.2/24 ifconfig eth3 10.1.2.2/24

sfconfigd

unzip SF-109376-LS-2AOE_Tools_Beta.zip rpm -i sfaoesw-1.0.5.1011-1.src.rpm sfaoeconfigd rpmbuild ==rebuild sfaoesw-1.0.5.1011-1.src.rpm rpmbuild --rebuild sfaoesw-1.0.5.1011-1.src.rpm rpm -ihv ~/rpmbuild/RPMS/x86_64/sfaoesw-1.0.5.1011-1.x86_64.rpm sfaoeconfigd sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg

cd openonload-201210-ptp efreplay/efreplay eth2=CME-FixFast-GlobexEquityFutures-A.pcap efreplay/efreplay eth2=../CME-FixFast-GlobexEquityFutures-A.pcap efreplay/efreplay eth2=CME-FixFast-GlobexEquityFutures-A.pcap

cd openonload-201210-ptp cd build/ cp -r falcon_b0_gnu_x86_64/ gnu_x86_64 cd .. cd efreplay/ make

./efreplay eth2=./CME-FixFast-GlobexEquityFutures-A.pcap ./efreplay eth2=../CME-FixFast-GlobexEquityFutures-A.pcap sfupdate ./efreplay eth2=../CME-FixFast-GlobexEquityFutures-A.pcap

export ONLOAD_TREE=/opt/Solarflare/openonload-201210-ptp make

unzip SF-109377-LS-1AOE_Tools_Debug.zip cd sfaoefdk-internal-1.0.5.1011

cd bin/x86_64 ./stats_read eth2 >/tmp/stat1

sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg vi CME-FixFast-GlobexEquityFutures.cfg sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg echo "0" > /sys/devices/sfc_aoe/fpga0/reload sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg cat /tmp/statsdecode1.txt sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg vim CME-FixFast-GlobexEquityFutures.cfg sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg vim CME-FixFast-GlobexEquityFutures.cfg sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg

tcpdump -i eth2 tcpdump i eth3 tcpdump -i eth3 lscpu