Skip to content
e4_gpu.rst 1.87 KiB
Newer Older
Power8 + GPU
^^^^^^^^^^^^

Victor's avatar
Victor committed
D.A.V.I.D.E has been designed by `E4 computer engineering`_ and is hosted at CINECA_ in Bologna, Italy. It totals a theoritical peak performance of 990 TFlop/s (double precision) and an estimated power consumption of less than 100kW. A more detailed description can be found on the `E4 dedicated webpage`_.
Victor's avatar
Victor committed
.. note:: In order to access the machine BCO should send an email to `Victor Cameo Ponz`_ so that.

Compute technology
""""""""""""""""""

Hardware features fat-nodes with the following design:
Victor's avatar
Victor committed
 * 45 nodes with
   * x2 IBM POWER8+ processors, ie 8x2 cores with Simultaneous Multi-Threading (SMT) 8
Victor's avatar
Victor committed
   * x4 NVIDIA P100 GPU with 16GB High Bandwidth Memory 2 (HBM2)
 * intranode comunications integrated using NVLink
Victor's avatar
Victor committed
 * extranode comunications integrated using Infiniband ERD interconnect in fat-tree with no oversubscription topology
 * CPU and GPU direct hot water (~27°C) cooling, removing 75-80% of the total heat
Victor's avatar
Victor committed
 * remaining 20-25% heat is air-cooled
Victor's avatar
Victor committed

Victor's avatar
Victor committed
Each compute node has a theoritical peak performance of 22 Tflop/s (double precision) and a power consumption of less than 2kW.

Energy sampling technology
""""""""""""""""""""""""""

Victor's avatar
Victor committed
Information is collected from processors, memory, GPUs and fans exploiting Analig-to-Digital Converter in the embedded SoC. It provides sampling up to 800 kHz lowered to 50kHz on power measuring sensor outputs.


The technology has been developed in collaboration with the University of Bologna which developed the :code:`get_job_energy <job_id>` program. Usage is straight forward and has the following verbose output:

.. literalinclude:: /output_get_job_energy
   :emphasize-lines: 1


.. _E4 computer engineering: https://www.e4company.com
Victor's avatar
Victor committed
.. _E4 dedicated webpage: https://www.e4company.com/en/?id=press&section=1&page=&new=davide_supercomputer
.. _CINECA: http://hpc.cineca.it/
.. _Victor Cameo Ponz: cameo+4ip-extension@cines.fr