HybriLIT cluster (hydra.jinr.ru)


 The HybriLIT heterogeneous cluster is a computation component of the Multifunctional center for data storage processing and analysis of LIT JINR, which contains a multicore component and computation accelerators: NVIDIA graphic processors and Intel Xeon Phi coprocessors. The detailed information on the heterogeneous cluster, rules and registration form can be found on the JINR HybriLIT Web-site.
With the HybriLIT team an agreement was reached on using the heterogeneous cluster for the NICA tasks. Once you have registered in the HybriLIT complex, you can login with your account:

ssh [username]@hydra.jinr.ru

Please, carefully read the important notes after login.

 The required software for MpdRoot was installed at the HybriLIT cluster, and you can use it by loading the corresponding module:

module load MPDSOFT/v18.02.22-hlit-2

Compilation of the MpdRoot software can be performed in the following way:

  • Clone MpdRoot as described in the instruction, e.g. to the $HOME directory.
  • MpdRoot is compiled faster in the local /run/user/$UID directory:
    cd /run/user/$UID
    mkdir build
    cd build
    cmake -DCMAKE_CXX_FLAGS="-std=c++11" CMAKE_INSTALL_PREFIX="$HOME/mpdroot/install" -DALIBUILD=ON $HOME/mpdroot
    make
    make install

 If you have time-consuming tasks, many simple tasks or a lot of files to process, you can use batch system SLURM of the HybriLIT heterogeneous cluster. If you know how to work with SLURM (SLURM on HybriLIT), you can use sbatch command on the cluster to distribute data processing. Simple example of user job for SLURM can be found in ‘macro/mpd_scheduler/examples/batch’ directory in our software.
Also, MPD-Scheduler was developed to simplify running of user tasks without knowledge of SLURM. You can find how to use it here.

 The data of the NICA experiments are located at the EOS distributed storage system of the HybriLIT cluster: /eos/hybrilit.jinr.ru/. Eperimental and model data you can find at ‘/eos/hybrilit.jinr.ru/nica’ directory. To work with EOS data, you should use XRootD or ROOT protocol, e.g. xrdcp command – to copy EOS files or root:// prefix – to open EOS files in the ROOT environment.