http://wiki.define-technology.com/mediawiki-1.35.0/index.php?action=history&feed=atom&title=MPI%3A_Using_OpenMPI
MPI: Using OpenMPI - Revision history
2026-05-05T00:02:26Z
Revision history for this page on the wiki
MediaWiki 1.35.0
http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=MPI:_Using_OpenMPI&diff=6371&oldid=prev
David at 11:17, 15 April 2015
2015-04-15T11:17:11Z
<p></p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 11:17, 15 April 2015</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l48" >Line 48:</td>
<td colspan="2" class="diff-lineno">Line 48:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><syntaxhighlight></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><syntaxhighlight></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>mpirun -np 32 --mca btl_openib_if_include mlx4_0:1 -machinefile ./machines-32 ./imb-ompi -npmin 32 allgather</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>mpirun -np 32 --mca btl_openib_if_include mlx4_0:1 -machinefile ./machines-32 ./imb-ompi -npmin 32 allgather</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">OR Using multiple cards/ports in RR fashion</ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">mpirun -mca btl_openib_if_include “mlx4_0:1,mlx4_1:1”</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div></syntaxhighlight></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div></syntaxhighlight></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
</table>
David
http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=MPI:_Using_OpenMPI&diff=1132&oldid=prev
David: Created page with "Ignore the 'No IB Network Available Message' and run on eth0 <syntaxhighlight> mpirun --mca btl ^udapl,openib --mca btl_tcp_if_include eth0 </syntaxhighlight> Run 3 copies of program1 using the o..."
2012-10-15T11:01:02Z
<p>Created page with "Ignore the 'No IB Network Available Message' and run on eth0 <syntaxhighlight> mpirun --mca btl ^udapl,openib --mca btl_tcp_if_include eth0 </syntaxhighlight> Run 3 copies of program1 using the o..."</p>
<p><b>New page</b></p><div>Ignore the 'No IB Network Available Message' and run on eth0 <br />
<syntaxhighlight><br />
mpirun --mca btl ^udapl,openib --mca btl_tcp_if_include eth0<br />
</syntaxhighlight><br />
<br />
Run 3 copies of program1 using the openib, tcp and self BTLs for the transport of MPI messages<br />
with TCP using only the eth0 interface to communicate<br />
<syntaxhighlight><br />
mpirun -np 3 -mca btl openib,tcp,self -mca btl_tcp_if_include eth0 ./program1 <br />
</syntaxhighlight><br />
<br />
Run with some debugging info turned on<br />
<syntaxhighlight><br />
mpirun --mca btl_base_verbose 30 -np 2 -host NodeA,NodeB a.out<br />
</syntaxhighlight><br />
<br />
Run with CPU Binding enabled<br />
<syntaxhighlight><br />
mpirun --mca mpi_paffinity_alone 1 <br />
</syntaxhighlight><br />
<br />
MIMD: e.g. lauching a job on Liverpool Uni. x8 Intel (96-cores)nodes; binding to core ON and x8 AMD (128 cores) nodes<br />
<syntaxhighlight><br />
mpirun -H aa,bb,cc,dd -np 96 -report-bindings -bycore -bind-to-core ./xhpl : -H ee,ff,gg,ii -np 128 ./xhpl<br />
</syntaxhighlight><br />
<br />
Clean-up any stale processes and files left-over from Open MPI jobs on nodes in hostfile nodes_files<br />
<syntaxhighlight><br />
mpirun --pernode --hostfile nodes_files orte-clean<br />
</syntaxhighlight><br />
<br />
Redirecting standard IO<br />
<syntaxhighlight><br />
mpirun -H aa,bb,cc -np 2 my_app < my_imput > my_output<br />
</syntaxhighlight><br />
<br />
Passing hosts list from CLI<br />
<syntaxhighlight><br />
mpirun -np 3 --host a,b,c hostname<br />
</syntaxhighlight><br />
<br />
Strange one, but had a cluster with both neteffect 10GB and QDR IB, to ignore the 10GB and run on IB:<br />
<syntaxhighlight><br />
mpirun --mca btl ^nes0 --mca btl_openib_if_include mlx4_0 -np 2 ./IMB-MPI1 pingpong<br />
</syntaxhighlight><br />
<br />
Intel Cluster, FDR and 10GB on the same PCI card (Mellanox) use mlx4_0:1<br />
<syntaxhighlight><br />
mpirun -np 32 --mca btl_openib_if_include mlx4_0:1 -machinefile ./machines-32 ./imb-ompi -npmin 32 allgather<br />
</syntaxhighlight><br />
<br />
Running on chelsio cards with FDR QDR on the same system<br />
<syntaxhighlight><br />
mpirun -np 2 -machinefile ./machines-2c --mca mpi_paffinity_alone 1 --mca btl_openib_if_include cxgb4_0 ./imb-ompi<br />
</syntaxhighlight></div>
David