Linux: Setting up NFS over RDMA

• Below assumes you have a fully working IB fabric with ib0 configured with an IP address and DNS working for the IB fabric.

Setup the server

  yum install rdma; 
  chkconfig --level 2345 rdma on
  chkconfig --level 345 nfs-rdma on
  service rdma start 
  service nfs-rdma start

• Verify the port being used, we'll use this on the client (2050 is the standard):

[root@haswell5 ~]# grep -i port /etc/rdma/rdma.conf 
NFSoRDMA_PORT=2050

• Make sure the exports file includes the IP subnet for the ib0 subnet

[root@haswell5 ~]# cat /etc/exports 
/ramdisk				173.16.0.0/16(rw,no_root_squash,async)

Setup the client

  yum install rdma
  service rdma start
  chkconfig --level 2345 rdma on
  mount -t nfs -o rdma,port=2050 haswell5-ib:/ramdisk /ramdisk