Difference between revisions of "Linux: Setting up RDMA over Ethernet"

From Define Wiki
Jump to navigation Jump to search
(Created page with " == Download and install MLNX OFED drivers == Download the driver package from http://www.mellanox.com/page/products_dyn?product_family=26&mtag=linux_sw_drivers, after choosi...")
(No difference)

Revision as of 06:04, 12 September 2016

Download and install MLNX OFED drivers

Download the driver package from http://www.mellanox.com/page/products_dyn?product_family=26&mtag=linux_sw_drivers, after choosing appropriate platform and version of OS being used.

Install

# ./mlnxofedinstall

For a diskless installation like chroot

# ./mlnxofedinstall --without-fw-update

Install RDMA

# yum install rdma
# service rdma restart ; chkconfig rdma on

Port verification

Make sure that the ports are configured properly for use as ethernet

# connectx_port_config 

ConnectX PCI devices :
|----------------------------|
| 1             0000:02:00.0 |
|----------------------------|

Before port change:
eth

|----------------------------|
| Possible port modes:       |
| 1: Infiniband              |
| 2: Ethernet                |
| 3: AutoSense               |
|----------------------------|
Select mode for port 1 (1,2,3): 2

After port change:
eth

RDMA Verification

On server, run

# udaddy

On client, run

# udaddy -s <server_ip>