Download PDFOpen PDF in browser

Bringing HPC clusters into Science Mesh

8 pagesPublished: August 9, 2023

Abstract

Data transfers to and from High Performance Computing (HPC) clusters are a rather well established mechanism since standard Linux file transfer tools like scp and rsync can be used. Nowadays, users are not always familiar with these command-line based mechanisms and prefer more user friendly, and web based solutions. In this article we present a system to use the protocols of enterprise file sync and share systems (EFSS) for data transfers utilizing components of Science Mesh. In addition, this offers a technique to transfer data between different HPC sites without the need for commercial software or exposing the rather vulnerable port 22 to the outside world.

Keyphrases: Cloud, enterprise file sync and share, High Perfromance Computing, science mesh

In: Jean-François Desnos and Martín López Nores (editors). Proceedings of European University Information Systems Congress 2023, vol 95, pages 249--256

Links:
BibTeX entry
@inproceedings{EUNIS2023:Bringing_HPC_clusters_into,
  author    = {Holger Angenent and Daniel M\textbackslash{}"uller and Raimund Vogl},
  title     = {Bringing HPC clusters into Science Mesh},
  booktitle = {Proceedings of European University Information Systems Congress 2023},
  editor    = {Jean-Fran\textbackslash{}c\{c\}ois Desnos and Mart\textbackslash{}'in L\textbackslash{}'opez Nores},
  series    = {EPiC Series in Computing},
  volume    = {95},
  pages     = {249--256},
  year      = {2023},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {https://easychair.org/publications/paper/2PHk},
  doi       = {10.29007/gfjd}}
Download PDFOpen PDF in browser