View topic | Edit | WYSIWYGAttachPrintable
r4 - 07 Jan 2011 - 16:17:05 - DavidAcremanYou are here: Astrophysics Wiki >  Zen Web  >  RunningJobs > CombiningOpenmpAndMpi

Combining OpenMP and MPI

Some jobs will run efficiently using a combination of OpenMP and MPI, but care needs to be taken to make sure that OpenMP threads are correctly placed onto the CPU cores. Intel MPI provides a mechanism to do this using the I_MPI_PIN_DOMAIN environment variable, as described in section 3.2.3 of the Intel MPI Reference manual for more details (this can be found at /sw/sdev/impi/3.2/doc/Reference_Manual.pdf on zen). For example adding -genv I_MPI_PIN_DOMAIN omp to the mpiexec command should ensure correct placement when running a hybrid code.

Note on dplace

An alternative mechanism for controlling affinity is dplace. If you are using dplace to control placement then you will need to disable Intel's affinity mechanism by setting the environment variable KMP_AFFINITY to disable e.g. setenv KMP_AFFINITY disable for C-shell type shells.

-- DavidAcreman - 17 Oct 2008

View topic | Edit |  | WYSIWYG | Attach | Printable | Raw View | Backlinks: Web, All Webs | History: r5 < r4 < r3 < r2 < r1 | More topic actions...

key Log In or Register
Information

Main Web Users Groups Index Search Changes Notifications Statistics Preferences


Webs Main Sandbox TWiki Zen Information

Main Web Users Groups Index Search Changes Notifications Statistics Preferences


Webs Main Sandbox TWiki Zen


 
Astrophysics Wiki


Edit Wysiwyg Attach Printable
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Astrophysics Wiki? Send feedback