http://wiki.define-technology.com/mediawiki-1.35.0/index.php?action=history&feed=atom&title=OSU_Benchmarking_with_Python_and_Pytorch 2026-05-04T17:18:30Z Revision history for this page on the wiki MediaWiki 1.35.0 http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=OSU_Benchmarking_with_Python_and_Pytorch&diff=32862&oldid=prev 2024-06-24T08:34:28Z

<p>Created page with &quot;Note; this is only for CPU benchmarks but still tests the python libs &lt;pre&gt; python3.9 -m venv ~/venvs/pytorch-osu-testing source ~/venvs/pytorch-osu-testing/bin/activate pip...&quot;</p> <p><b>New page</b></p><div>Note; this is only for CPU benchmarks but still tests the python libs<br /> <br /> &lt;pre&gt;<br /> <br /> python3.9 -m venv ~/venvs/pytorch-osu-testing<br /> source ~/venvs/pytorch-osu-testing/bin/activate<br /> pip install -U pip<br /> mkdir ~/scratch<br /> cd scratch<br /> git clone https://github.com/Algebraic-Programming/pytorch-hccl-tests.git<br /> cd pytorch-hccl-tests<br /> pip install -r requirements_dev.txt<br /> make install<br /> <br /> # should this this at the end<br /> Successfully installed pandas-1.3.5 python-dateutil-2.9.0.post0 pytorch-hccl-tests-0.1.15 pytz-2024.1 six-1.16.0<br /> <br /> # installed a pretty old pytorch, updating<br /> pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm6.0<br /> <br /> &lt;/pre&gt;<br /> <br /> &lt;pre&gt;<br /> # on one node (only node_rank differs); <br /> torchrun --master_addr=172.16.16.42 --master_port=29500 --node_rank 0 --nnodes 2 --nproc_per_node 1 pytorch_hccl_tests/cli.py --benchmark latency --device cpu<br /> <br /> # then on node 2; <br /> torchrun --master_addr=172.16.16.42 --master_port=29500 --node_rank 1 --nnodes 2 --nproc_per_node 1 pytorch_hccl_tests/cli.py --benchmark latency --device cpu<br /> <br /> <br /> (pytorch-osu-testing) [antony@gpu5 pytorch-hccl-tests]$ torchrun --master_addr=172.16.16.42 --master_port=29500 --node_rank 0 --nnodes 2 --nproc_per_node 1 pytorch_hccl_tests/cli.py --benchmark latency --device cpu<br /> [2024-06-20 16:18:47,241] {cli.py:67} INFO - ******************************<br /> [2024-06-20 16:18:47,241] {cli.py:68} INFO - Selected benchmark : latency<br /> [2024-06-20 16:18:47,241] {cli.py:69} INFO - Input device param : cpu<br /> [2024-06-20 16:18:47,241] {cli.py:70} INFO - Input dtype param : float<br /> [2024-06-20 16:18:47,241] {cli.py:71} INFO - Global rank : 0<br /> [2024-06-20 16:18:47,241] {cli.py:72} INFO - Local rank : 0<br /> [2024-06-20 16:18:47,241] {cli.py:73} INFO - ******************************<br /> [2024-06-20 16:18:47,241] {commons.py:108} INFO - Init distributed env device: cpu / local_rank 0<br /> [2024-06-20 16:18:47,289] {commons.py:162} INFO - Python version: 3.9.18<br /> [2024-06-20 16:18:47,289] {commons.py:163} INFO - PyTorch version: 2.3.1+rocm6.0<br /> [2024-06-20 16:18:47,290] {commons.py:164} INFO - PyTorch MPI enabled?: False<br /> [2024-06-20 16:18:47,290] {commons.py:165} INFO - PyTorch CUDA enabled?: True<br /> [2024-06-20 16:18:47,290] {commons.py:166} INFO - PyTorch NCCL enabled?: True<br /> [2024-06-20 16:18:47,290] {commons.py:167} INFO - PyTorch Gloo enabled?: True<br /> [2024-06-20 16:18:47,290] {commons.py:174} WARNING - ********************************************************************************<br /> [2024-06-20 16:18:47,290] {commons.py:175} WARNING - * PyTorch Ascend (NPU) is NOT installed.<br /> [2024-06-20 16:18:47,290] {commons.py:176} WARNING - * You must install PyTorch Ascend Adaptor from https://gitee.com/ascend/pytorch. *<br /> [2024-06-20 16:18:47,290] {commons.py:179} WARNING - ********************************************************************************<br /> [2024-06-20 16:18:47,290] {commons.py:181} INFO - Using device *cpu* with *gloo* backend<br /> [2024-06-20 16:18:47,290] {commons.py:182} INFO - World size: 2<br /> [2024-06-20 16:18:47,290] {osu_util_mpi.py:32} INFO - # PyTorch Benchmark Latency Test<br /> [2024-06-20 16:18:47,290] {osu_util_mpi.py:33} INFO - # Size (B) Elapsed Time (ms)<br /> [2024-06-20 16:18:48,455] {osu_latency.py:72} INFO - 0 52.13<br /> [2024-06-20 16:18:49,650] {osu_latency.py:72} INFO - 4 54.28</div>

David