I current working in a HPC lab, we have a very old computing cluster, with RHEL 6.2~6.4 OS system, the default GLIBC version is 2.12, which is to low for running applications, I wondering that is possible to compile a newer glibc and configure it to a glibc modulefile and then load/switch. submitted by /u/chaoslee21 [visit reddit] [comments ..read more

Dear all, I am reaching out to seek your advices and recommendations on a challenge we are facing in our team. We have a Kubernetes cluster for AI/HPC tasks that consists of 4 compute nodes, the Nvidia DGXA100 servers with 8 GPU each. Our team consists of 15-30 researchers, and we have encountered issues with GPU availability due to the complexity of projects and insufficient GPU resources. Some team members require more GPUs than others, but decreasing the number of GPUs available can lead to longer training times. Additionally, others simply require interactive jobs via Jupyter notebooks. I ..read more

I’m working on a research paper where in I’m texting the performance penalties in nested docker containers for HPC and also comparing bare metal performance with the docker and nested docker performance. I’m looking for HPC tasks that I can test this system with. If y’all know any HPC programs/projects which are open source or if u r willing to lemme run your projects/programs as a test, pls write it down in the comments Here’s a SS of the tasks im planning to run so far. Yes, not all of these are “true HPC” but would still give good information about the penalties and have been chosen diver ..read more

For those of you interested in the Chapel parallel programming language, consider filling out our community survey. Other ways to learn more about Chapel include attending tutorials, coding help sessions, and/or talks for free at ChapelCon this coming June 5-7. submitted by /u/MichelleStroutHPE [visit reddit] [comments ..read more

After many attempts at running DMTCP and MPI on a cluster, I've managed to run it on a single node. This is the script I'm using to install it. After finishing the installation, I set a dmtcp_coordinator on a terminal and run dmtcp_launch --join-coordinator -i 360 mpirun -np 4 ./application on another terminal (I'm using screen to launch both terminals because I'm working with Ubuntu Server). I'm using MPICH (3.3a2), DMTCP (2.5.2) on Ubuntu Server 18.04.6. I've also managed to make MVAPICH to work with it (but had to force it to use TCP over Infiniband on the ./configure process). Now I'm try ..read more

root@localhost:~/capstone/mpi# mpirun --allow-run-as-root -np 1 python3 index.py [localhost:18945] opal_ifinit: ioctl(SIOCGIFHWADDR) failed with errno=13 [localhost:18945] pmix_ifinit: ioctl(SIOCGIFHWADDR) failed with errno=13 [localhost:18945] ptl_tool: problems getting address for index 122 (kernel index -1) -------------------------------------------------------------------------- The PMIx server's listener thread failed to start. We cannot continue. -------------------------------------------------------------------------- I am using termux with ubuntu. I need to run a python program. How ..read more

Rescale is hiring for a few roles right now. Mostly in Japan/Korea right now, but you can fill out a General Interest Form to be considered for future openings in other teams/locations. #HPC #CFD #CAE submitted by /u/GrittyHPC [visit reddit] [comments ..read more

Hey folks, I have a BS in computer science and recently completed a PhD in astrophysics. I've decided that I'm done with the academia and have been trying to figure out what my next step should be. My thesis work involved running and analyzing large-scale simulations on HPC machines, and I've spent the last year as a postdoc rewriting and optimizing the simulation software we used to take advantage of the latest GPU hardware. I also have a little bit of experience playing with PyTorch to build initial conditions for our simulations using generative AI. I'm most interested in transitioning to ..read more

Hi, I was looking to use TBB concurrent_vector I am running C++ library Pagmo2 and would like to pass a vector or array between threads with thread safety. While one could use mutixes and/or locks, the data will be passed frequently and locks would really slow things down. I suspect and hope that TBB concurrent_vector could allow multiple threads to modify without delays associated with locks provided I set the concurrent_vector size and not change it - just read and write values from a fixed size array e.g. concurrent_vector no growth or shrink operations will be performed after the initial ..read more

I have experience with compute clusters used for research purposes. Soon, we might need a GPU cluster for Machine Learning purposes. I’m interested in getting involved. I think it’s good for my career too, since this use case is becoming a huge part of the economy. Can anyone point me to some online material for administering GPU clusters? Specifically, I’m looking learn enough in the near future to decide whether we should buy GPUs or do this in the cloud. submitted by /u/bigtablebacc [visit reddit] [comments ..read more