Difference between revisions of "Pamcrash: Benchmark with Pamcrash"
Jump to navigation
Jump to search
(Created page with "== Running Pamcrash with platform mpi== * Pamcrash comes precomplied with platform mpi , Though other mpi could be used as well == To run license server == # copy the...") |
|||
| Line 9: | Line 9: | ||
== To run license server == | == To run license server == | ||
| − | # | + | # Copy the binaries lmgrd, pam_lmd and lmuti from ESI ftp folder. |
| − | + | # Copy the content of license file provides by ESI in 160708.flx | |
<nowiki> | <nowiki> | ||
../lmgrd -c 160708.flx > flexlm.log | ../lmgrd -c 160708.flx > flexlm.log | ||
| Line 24: | Line 24: | ||
== Running PAMCRASH over OPA with platform mpi== | == Running PAMCRASH over OPA with platform mpi== | ||
| − | * | + | * As of Feb 2016, Platform MPI (pmpi) does not yet support psm2. To run pmpi on an OPA system we need to use psm2-compat. Furthermore, when PSM is selected, pmpi checks that the system has a True Scale HCA. So, we have to modify lspci to report a True Scale HCA. |
| − | * /root/pamcrash/vpsolver/2015.01/pamworld -np 24 -arch em64t test.pc | + | * |
| + | |||
| + | <nowiki> | ||
| + | mv /usr/sbin/lspci /usr/sbin/lspci_orig | ||
| + | cat > /usr/sbin/lspci | ||
| + | #!/bin/sh /usr/sbin/lspci_orig | ||
| + | $@ echo "81:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02)" | ||
| + | ^D | ||
| + | </nowiki> | ||
| + | <nowiki> | ||
| + | |||
| + | pmpi.conf should contain: | ||
| + | |||
| + | MPI_ICLIB_PSM__PSM_MAIN = /usr/lib64/psm2-compat/libpsm_infinipath.so.1 | ||
| + | MPI_ICMOD_PSM__PSM_MAIN = "hfi1" | ||
| + | MPI_ICLIB_PSM__PSM_PATH = /usr/lib64/psm2-compat/libpsm_infinipath.so.1 | ||
| + | MPI_ICMOD_PSM__PSM_PATH = "hfi1" | ||
| + | </nowiki> | ||
| + | <nowiki> | ||
| + | /root/pamcrash/vpsolver/2015.01/pamworld -np 24 -arch em64t -PSM test.pc | ||
| + | </nowiki> | ||
* Replace test.pc with appropriate file from VW | * Replace test.pc with appropriate file from VW | ||
Revision as of 11:47, 27 July 2016
Running Pamcrash with platform mpi
- Pamcrash comes precomplied with platform mpi , Though other mpi could be used as well
To run license server
- Copy the binaries lmgrd, pam_lmd and lmuti from ESI ftp folder.
- Copy the content of license file provides by ESI in 160708.flx
../lmgrd -c 160708.flx > flexlm.log
- .Check in flexlm.log if server is started and note if the port number
Set Licence server
export PAMLIC=CRASHSAF export PAM_LMD_LICENSE_FILE=34506@eno1 (portnumber@hostname)
Running PAMCRASH over OPA with platform mpi
- As of Feb 2016, Platform MPI (pmpi) does not yet support psm2. To run pmpi on an OPA system we need to use psm2-compat. Furthermore, when PSM is selected, pmpi checks that the system has a True Scale HCA. So, we have to modify lspci to report a True Scale HCA.
mv /usr/sbin/lspci /usr/sbin/lspci_orig cat > /usr/sbin/lspci #!/bin/sh /usr/sbin/lspci_orig $@ echo "81:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02)" ^D pmpi.conf should contain: MPI_ICLIB_PSM__PSM_MAIN = /usr/lib64/psm2-compat/libpsm_infinipath.so.1 MPI_ICMOD_PSM__PSM_MAIN = "hfi1" MPI_ICLIB_PSM__PSM_PATH = /usr/lib64/psm2-compat/libpsm_infinipath.so.1 MPI_ICMOD_PSM__PSM_PATH = "hfi1" /root/pamcrash/vpsolver/2015.01/pamworld -np 24 -arch em64t -PSM test.pc
- Replace test.pc with appropriate file from VW