Difference between revisions of "Solarflare Install"

Revision as of 11:44, 12 May 2013

Kernel Version

Solarflare is only supported on the following Kernels and OSs

Kernels

2.6
3.x

OSs

RHEL5
RHEL6
MRG
SLES10
SLES11
SLERT

Dependencies

Update to date kernel and matiching kernel-devel
glibc.i686
Development tools
Python-devel / Python

AOE card must have both ports connected

Verify Solar Flare Adapter Firmware and Driver Versions

ethtool -i ethX3
driver: sfc
version: 3.3.0.6246
firmware-version: 3.3.0.6247
bus-info: 0000:01:00.0

OpenOnload Install

unzip SF-109361-LS-1AOE_PTP_Onload.zip
tar -xvf openonload-201210-ptp.tgz
unzip SF-109362-LS-1AOE_Extension_Driver.zip
cd openonload-201210-ptp
scripts/onload_install
onload_tool reload

lsmod | grep sfc
lsmod | grep onload

WORK IN PROGRESS (all of the commands adam ran)

unzip SF-109373-LS-1AOE_Linux_Utils.zip unzip SF-109375-LS-3AOE_Image_Resilient_Eth.zip unzip SF-109376-LS-2AOE_Tools_Beta.zip unzip SF-109377-LS-1AOE_Tools_Debug.zip

tar -xvf sfnettest-1.5.0.gz tar -xvf sfaoefdk-internal-1.0.5.1011.tgz

rpm -i sfaoesw-1.0.5.1011-1.src.rpm

Update Adapter Firmware

rpm -i sfutils-3.3.0.6247-1.i586.rpm sfupdate eth3 sfupdate eth3 --write sfupdate --adapter=eth3 --write

More of Adams Instructions

modprobe -r sfc_aoe force_sienastats=1 debug=1 link_mode=1 modprobe -r sfc_aoe; modeprobe sfc_aoe force_sienastats=1 debug=1 link_mode=1 modprobe -r sfc_aoe; modprobe sfc_aoe force_sienastats=1 debug=1 link_mode=1

ethtool -S aoe_ext0 ethtool -S aoe_ext0 |more ethtool -S aoe_ext1 |more sfupdate --adapter=eth3 --image= --write sfupdate --adapter=eth3 --image=sfa6902f_a5_resilience_v0_25_2_0.dat --write

ifconfig eth2 10.1.1.2/24 ifconfig eth3 10.1.2.2/24

sfconfigd

unzip SF-109376-LS-2AOE_Tools_Beta.zip rpm -i sfaoesw-1.0.5.1011-1.src.rpm sfaoeconfigd rpmbuild ==rebuild sfaoesw-1.0.5.1011-1.src.rpm rpmbuild --rebuild sfaoesw-1.0.5.1011-1.src.rpm rpm -ihv ~/rpmbuild/RPMS/x86_64/sfaoesw-1.0.5.1011-1.x86_64.rpm sfaoeconfigd sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg

cd openonload-201210-ptp efreplay/efreplay eth2=CME-FixFast-GlobexEquityFutures-A.pcap efreplay/efreplay eth2=../CME-FixFast-GlobexEquityFutures-A.pcap efreplay/efreplay eth2=CME-FixFast-GlobexEquityFutures-A.pcap

cd openonload-201210-ptp cd build/ cp -r falcon_b0_gnu_x86_64/ gnu_x86_64 cd .. cd efreplay/ make

./efreplay eth2=./CME-FixFast-GlobexEquityFutures-A.pcap ./efreplay eth2=../CME-FixFast-GlobexEquityFutures-A.pcap sfupdate ./efreplay eth2=../CME-FixFast-GlobexEquityFutures-A.pcap

export ONLOAD_TREE=/opt/Solarflare/openonload-201210-ptp make

unzip SF-109377-LS-1AOE_Tools_Debug.zip cd sfaoefdk-internal-1.0.5.1011

cd bin/x86_64 ./stats_read eth2 >/tmp/stat1

sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg vi CME-FixFast-GlobexEquityFutures.cfg sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg echo "0" > /sys/devices/sfc_aoe/fpga0/reload sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg cat /tmp/statsdecode1.txt sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg vim CME-FixFast-GlobexEquityFutures.cfg sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg vim CME-FixFast-GlobexEquityFutures.cfg sfaoeconfigd --Config CME-FixFast-GlobexEquityFutures.cfg

tcpdump -i eth2 tcpdump i eth3 tcpdump -i eth3 lscpu