http://wiki.define-technology.com/mediawiki-1.35.0/index.php?action=history&feed=atom&title=MIG%3A_Multi-Instance_GPU 2026-05-04T22:48:00Z Revision history for this page on the wiki MediaWiki 1.35.0 http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=MIG:_Multi-Instance_GPU&diff=32354&oldid=prev 2020-11-03T16:41:30Z

<p></p> <table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 16:41, 3 November 2020</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l17" >Line 17:</td> <td colspan="2" class="diff-lineno">Line 17:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;syntaxhighlight&gt;</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;syntaxhighlight&gt;</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"></del></div></td><td colspan="2"> </td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>root@sdgx-server:~# nvidia-smi mig -i 4 -lgip</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>root@sdgx-server:~# nvidia-smi mig -i 4 -lgip</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td></tr> <tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l24" >Line 24:</td> <td colspan="2" class="diff-lineno">Line 23:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                          Free/Total  GiB              CE    JPEG  OFA  |</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                          Free/Total  GiB              CE    JPEG  OFA  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|==========================================================================|</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|==========================================================================|</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 1g.5gb    19    <del class="diffchange diffchange-inline">3</del>/7        4.75      No    14    0    0  |</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 1g.5gb    19    <ins class="diffchange diffchange-inline">7</ins>/7        4.75      No    14    0    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          1    0    0  |</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          1    0    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 2g.10gb    14    <del class="diffchange diffchange-inline">1</del>/3        9.75      No    28    1    0  |</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 2g.10gb    14    <ins class="diffchange diffchange-inline">3</ins>/3        9.75      No    28    1    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          2    0    0  |</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          2    0    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 3g.20gb    9    <del class="diffchange diffchange-inline">0</del>/2        19.62      No    42    2    0  |</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 3g.20gb    9    <ins class="diffchange diffchange-inline">2</ins>/2        19.62      No    42    2    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          3    0    0  |</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          3    0    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 4g.20gb    5    <del class="diffchange diffchange-inline">0</del>/1        19.62      No    56    2    0  |</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 4g.20gb    5    <ins class="diffchange diffchange-inline">1</ins>/1        19.62      No    56    2    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          4    0    0  |</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          4    0    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 7g.40gb    0    <del class="diffchange diffchange-inline">0</del>/1        39.50      No    98    5    0  |</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>|  4  MIG 7g.40gb    0    <ins class="diffchange diffchange-inline">1</ins>/1        39.50      No    98    5    0  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          7    1    1  |</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>|                                                          7    1    1  |</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>+--------------------------------------------------------------------------+</div></td></tr> <tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l46" >Line 46:</td> <td colspan="2" class="diff-lineno">Line 45:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>GPU  4 Profile ID  5 Placement : {0}:4</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>GPU  4 Profile ID  5 Placement : {0}:4</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>GPU  4 Profile ID  0 Placement : {0}:8</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>GPU  4 Profile ID  0 Placement : {0}:8</div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/syntaxhighlight&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">== Creating GPU Instances ==</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">GPU instances are created using the &#039;-cgi&#039; option. the syntax for the command is</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;syntaxhighlight&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">root@sdgx-server:~# nvidia-smi mig -i &lt;gpu_id&gt; -cgi profile_id,&lt;profile_id&gt;,...</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/syntaxhighlight&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">For example to create 4 GPU instances of the MIG 1g.5gb profile on GPU ID 4</ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;syntaxhighlight&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">root@sdgx-server:~# nvidia-smi mig -i 4 -cgi 19,19,19,19</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">Successfully created GPU instance on GPU  4 using profile ID 19</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">Successfully created GPU instance on GPU  4 using profile ID 19</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">Successfully created GPU instance on GPU  4 using profile ID 19</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">Successfully created GPU instance on GPU  4 using profile ID 19</ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/syntaxhighlight&gt;</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/syntaxhighlight&gt;</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr> </table>

Patrick http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=MIG:_Multi-Instance_GPU&diff=32344&oldid=prev 2020-11-03T16:35:32Z

<p>Created page with &quot;== Enabling MIG == MIG can be enabled on all GPUs or on a per GPU basis using the nvidia-smi tool. To enable on all GPUs &lt;syntaxhighlight&gt; root@sdgx-server:~# nvidia-smi -mig 1 &lt;/bash...&quot;</p> <p><b>New page</b></p><div>== Enabling MIG == <br /> <br /> MIG can be enabled on all GPUs or on a per GPU basis using the nvidia-smi tool.<br /> <br /> To enable on all GPUs<br /> &lt;syntaxhighlight&gt;<br /> root@sdgx-server:~# nvidia-smi -mig 1<br /> &lt;/syntaxhighlight&gt;<br /> <br /> Alternatively, MIG can be enabled on one GPU only<br /> <br /> &lt;syntaxhighlight&gt;<br /> root@sdgx-server:~# nvidia-smi -i 4 -mig 1<br /> &lt;/syntaxhighlight&gt;<br /> <br /> == Listing Available GPU Instance Profiles ==<br /> <br /> &lt;syntaxhighlight&gt;<br /> <br /> root@sdgx-server:~# nvidia-smi mig -i 4 -lgip<br /> +--------------------------------------------------------------------------+<br /> | GPU instance profiles: |<br /> | GPU Name ID Instances Memory P2P SM DEC ENC |<br /> | Free/Total GiB CE JPEG OFA |<br /> |==========================================================================|<br /> | 4 MIG 1g.5gb 19 3/7 4.75 No 14 0 0 |<br /> | 1 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 2g.10gb 14 1/3 9.75 No 28 1 0 |<br /> | 2 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 3g.20gb 9 0/2 19.62 No 42 2 0 |<br /> | 3 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 4g.20gb 5 0/1 19.62 No 56 2 0 |<br /> | 4 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 7g.40gb 0 0/1 39.50 No 98 5 0 |<br /> | 7 1 1 |<br /> +--------------------------------------------------------------------------+<br /> <br /> root@sdgx-server:~# nvidia-smi mig -i 4 -lgipp<br /> GPU 4 Profile ID 19 Placements: {0,1,2,3,4,5,6}:1<br /> GPU 4 Profile ID 14 Placements: {0,2,4}:2<br /> GPU 4 Profile ID 9 Placements: {0,4}:4<br /> GPU 4 Profile ID 5 Placement : {0}:4<br /> GPU 4 Profile ID 0 Placement : {0}:8<br /> <br /> &lt;/syntaxhighlight&gt;<br /> <br /> root@sdgx-server:~# nvidia-smi mig -i 4 -lgip<br /> +--------------------------------------------------------------------------+<br /> | GPU instance profiles: |<br /> | GPU Name ID Instances Memory P2P SM DEC ENC |<br /> | Free/Total GiB CE JPEG OFA |<br /> |==========================================================================|<br /> | 4 MIG 1g.5gb 19 3/7 4.75 No 14 0 0 |<br /> | 1 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 2g.10gb 14 1/3 9.75 No 28 1 0 |<br /> | 2 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 3g.20gb 9 0/2 19.62 No 42 2 0 |<br /> | 3 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 4g.20gb 5 0/1 19.62 No 56 2 0 |<br /> | 4 0 0 |<br /> +--------------------------------------------------------------------------+<br /> | 4 MIG 7g.40gb 0 0/1 39.50 No 98 5 0 |<br /> | 7 1 1 |<br /> +--------------------------------------------------------------------------+<br /> root@sdgx-server:~# nvidia-smi mig -i 4 -lgipp<br /> GPU 4 Profile ID 19 Placements: {0,1,2,3,4,5,6}:1<br /> GPU 4 Profile ID 14 Placements: {0,2,4}:2<br /> GPU 4 Profile ID 9 Placements: {0,4}:4<br /> GPU 4 Profile ID 5 Placement : {0}:4<br /> GPU 4 Profile ID 0 Placement : {0}:8<br /> <br /> root@sdgx-server:~# nvidia-smi mig -i 5 -cgi 19,19,19,19<br /> Successfully created GPU instance on GPU 5 using profile ID 19<br /> Successfully created GPU instance on GPU 5 using profile ID 19<br /> Successfully created GPU instance on GPU 5 using profile ID 19<br /> Successfully created GPU instance on GPU 5 using profile ID 19<br /> <br /> root@sdgx-server:~# nvidia-smi mig -lgi<br /> +----------------------------------------------------+<br /> | GPU instances: |<br /> | GPU Name Profile Instance Placement |<br /> | ID ID Start:Size |<br /> |====================================================|<br /> | 4 MIG 1g.5gb 19 7 4:1 |<br /> +----------------------------------------------------+<br /> | 4 MIG 1g.5gb 19 8 5:1 |<br /> +----------------------------------------------------+<br /> | 4 MIG 1g.5gb 19 9 6:1 |<br /> +----------------------------------------------------+<br /> | 4 MIG 1g.5gb 19 11 0:1 |<br /> +----------------------------------------------------+<br /> | 5 MIG 1g.5gb 19 7 0:1 |<br /> +----------------------------------------------------+<br /> | 5 MIG 1g.5gb 19 11 4:1 |<br /> +----------------------------------------------------+<br /> | 5 MIG 1g.5gb 19 12 5:1 |<br /> +----------------------------------------------------+<br /> | 5 MIG 1g.5gb 19 13 6:1 |<br /> +----------------------------------------------------+<br /> | 6 MIG 1g.5gb 19 7 0:1 |<br /> +----------------------------------------------------+<br /> | 6 MIG 1g.5gb 19 11 4:1 |<br /> +----------------------------------------------------+<br /> | 6 MIG 1g.5gb 19 12 5:1 |<br /> +----------------------------------------------------+<br /> | 6 MIG 1g.5gb 19 13 6:1 |<br /> +----------------------------------------------------+<br /> | 7 MIG 1g.5gb 19 7 4:1 |<br /> +----------------------------------------------------+<br /> | 7 MIG 1g.5gb 19 8 5:1 |<br /> +----------------------------------------------------+<br /> | 7 MIG 1g.5gb 19 9 6:1 |<br /> +----------------------------------------------------+<br /> | 7 MIG 1g.5gb 19 11 0:1 |<br /> +----------------------------------------------------+<br /> root@sdgx-server:~# nvidia-smi mig -lci</div>

Patrick