ALCF Incite Hackathon 2025 2025 ALCF INCITE GPU Hackathon (20-May 22, 2025) LLMs on Aurora1: 🍋 Hands-On: ezpz 🌌 Overview: AuroraGPT 🎯 AuroraGPT: Goals AuroraGPT: General purpose scientific LLM Broadly trained on a general corpora plus scientific {papers, texts, data} Explore pathways towards a “Scientific Assistant”...

📍 Currently Figure 1: Current state of LLM Pretraining. [Source] 💬 LLMs on Aurora 🍋 ezpz 🤗 transformers 🏎️ Megatron-DeepSpeed 🍋 ezpz Write once, run anywhere 🐣 Getting Started Submit interactive job: qsub -I -l select=2 -l walltime=01:00:00 \ -l filesystems=home:flare \ -A gpu_hack \ -q gpu_hack_prio Source1 the...

Something I just learned The TensorFlow that is included in the new frameworks module (aurora_nre_models_frameworks-2025.0.0) was built with numpy==1.26.4 (< 2). Unfortunately, if you then (for whatever reason) then tries to install / upgrade a package1 that has numpy in its dependencies, e.g.: python3 -m pip...

PyTorch 2.6 on Aurora ; source <(curl -L https://bit.ly/ezpz-utils) && ezpz_setup_env ; export CXX=$(which g++) ; export CC=$(which gcc) ; export REL_WITH_DEB_INFO=1 ; export USE_CUDA=0 ; export USE_ROCM=0 ; export USE_MKLDNN=1 ; export USE_MKL=1 ; export USE_ROCM=0 ; export USE_CUDNN=0 ; export USE_FBGEMM=0 ;...