Difference between revisions of "Linux: Setting up RDMA over Ethernet"
Jump to navigation
Jump to search
(Created page with " == Download and install MLNX OFED drivers == Download the driver package from http://www.mellanox.com/page/products_dyn?product_family=26&mtag=linux_sw_drivers, after choosi...") |
|||
| (One intermediate revision by one other user not shown) | |||
| Line 1: | Line 1: | ||
| + | |||
| + | More detailed info can be found here : https://community.mellanox.com/docs/DOC-2086 | ||
== Download and install MLNX OFED drivers == | == Download and install MLNX OFED drivers == | ||
| Line 11: | Line 13: | ||
For a diskless installation like chroot | For a diskless installation like chroot | ||
<syntaxhighlight> | <syntaxhighlight> | ||
| + | # some other notes on installing in chroot for ohpc / openhpc | ||
| + | [root@head1 ~]# mount -o bind /proc/ /opt/ohpc/admin/images/centos7.2/proc/ | ||
| + | [root@head1 ~]# chroot /opt/ohpc/admin/images/centos7.2/ | ||
| + | # then install as usual | ||
# ./mlnxofedinstall --without-fw-update | # ./mlnxofedinstall --without-fw-update | ||
</syntaxhighlight> | </syntaxhighlight> | ||
Latest revision as of 14:22, 29 September 2016
More detailed info can be found here : https://community.mellanox.com/docs/DOC-2086
Download and install MLNX OFED drivers
Download the driver package from http://www.mellanox.com/page/products_dyn?product_family=26&mtag=linux_sw_drivers, after choosing appropriate platform and version of OS being used.
Install
# ./mlnxofedinstallFor a diskless installation like chroot
# some other notes on installing in chroot for ohpc / openhpc
[root@head1 ~]# mount -o bind /proc/ /opt/ohpc/admin/images/centos7.2/proc/
[root@head1 ~]# chroot /opt/ohpc/admin/images/centos7.2/
# then install as usual
# ./mlnxofedinstall --without-fw-updateInstall RDMA
# yum install rdma
# service rdma restart ; chkconfig rdma onPort verification
Make sure that the ports are configured properly for use as ethernet
# connectx_port_config
ConnectX PCI devices :
|----------------------------|
| 1 0000:02:00.0 |
|----------------------------|
Before port change:
eth
|----------------------------|
| Possible port modes: |
| 1: Infiniband |
| 2: Ethernet |
| 3: AutoSense |
|----------------------------|
Select mode for port 1 (1,2,3): 2
After port change:
ethRDMA Verification
On server, run
# udaddyOn client, run
# udaddy -s <server_ip>