http://wiki.define-technology.com/mediawiki-1.35.0/index.php?action=history&feed=atom&title=Linux%3A_Setting_up_RDMA_over_Ethernet 2026-05-04T20:37:36Z Revision history for this page on the wiki MediaWiki 1.35.0 http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Linux:_Setting_up_RDMA_over_Ethernet&diff=16971&oldid=prev 2016-09-29T14:22:18Z

<p></p> <table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 14:22, 29 September 2016</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l13" >Line 13:</td> <td colspan="2" class="diff-lineno">Line 13:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>For a diskless installation like chroot</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>For a diskless installation like chroot</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;syntaxhighlight&gt;</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;syntaxhighlight&gt;</div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"># some other notes on installing in chroot for ohpc / openhpc </ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">[root@head1 ~]# mount -o bind /proc/ /opt/ohpc/admin/images/centos7.2/proc/</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">[root@head1 ~]# chroot /opt/ohpc/admin/images/centos7.2/</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"># then install as usual </ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div># ./mlnxofedinstall --without-fw-update</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div># ./mlnxofedinstall --without-fw-update</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/syntaxhighlight&gt;</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/syntaxhighlight&gt;</div></td></tr> </table>

David http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Linux:_Setting_up_RDMA_over_Ethernet&diff=16771&oldid=prev 2016-09-12T06:05:59Z

<p></p> <table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 06:05, 12 September 2016</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l1" >Line 1:</td> <td colspan="2" class="diff-lineno">Line 1:</td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">More detailed info can be found here : https://community.mellanox.com/docs/DOC-2086</ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== Download and install MLNX OFED drivers ==</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== Download and install MLNX OFED drivers ==</div></td></tr> </table>

Vipul http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Linux:_Setting_up_RDMA_over_Ethernet&diff=16761&oldid=prev 2016-09-12T06:04:08Z

<p>Created page with &quot; == Download and install MLNX OFED drivers == Download the driver package from http://www.mellanox.com/page/products_dyn?product_family=26&amp;mtag=linux_sw_drivers, after choosi...&quot;</p> <p><b>New page</b></p><div><br /> == Download and install MLNX OFED drivers ==<br /> <br /> Download the driver package from http://www.mellanox.com/page/products_dyn?product_family=26&amp;mtag=linux_sw_drivers, after choosing appropriate platform and version of OS being used.<br /> <br /> Install<br /> &lt;syntaxhighlight&gt;<br /> # ./mlnxofedinstall<br /> &lt;/syntaxhighlight&gt;<br /> <br /> For a diskless installation like chroot<br /> &lt;syntaxhighlight&gt;<br /> # ./mlnxofedinstall --without-fw-update<br /> &lt;/syntaxhighlight&gt;<br /> <br /> Install RDMA<br /> &lt;syntaxhighlight&gt;<br /> # yum install rdma<br /> # service rdma restart ; chkconfig rdma on<br /> &lt;/syntaxhighlight&gt;<br /> <br /> == Port verification ==<br /> <br /> Make sure that the ports are configured properly for use as ethernet<br /> &lt;syntaxhighlight&gt;<br /> # connectx_port_config <br /> <br /> ConnectX PCI devices :<br /> |----------------------------|<br /> | 1 0000:02:00.0 |<br /> |----------------------------|<br /> <br /> Before port change:<br /> eth<br /> <br /> |----------------------------|<br /> | Possible port modes: |<br /> | 1: Infiniband |<br /> | 2: Ethernet |<br /> | 3: AutoSense |<br /> |----------------------------|<br /> Select mode for port 1 (1,2,3): 2<br /> <br /> After port change:<br /> eth <br /> <br /> &lt;/syntaxhighlight&gt;<br /> <br /> == RDMA Verification ==<br /> <br /> On server, run<br /> &lt;syntaxhighlight&gt;<br /> # udaddy<br /> &lt;/syntaxhighlight&gt;<br /> <br /> On client, run<br /> &lt;syntaxhighlight&gt;<br /> # udaddy -s &lt;server_ip&gt;<br /> &lt;/syntaxhighlight&gt;</div>

Vipul