Sam Foreman
Sam Foreman
Sam Foreman
Computational Scientist @ Argonne National Laboratory. AI Group @ Leadership Computing Facility (ALCF)
Latest Posts
๐๏ธ Shell Environment Helper function to get timestamp: tstamp() { date +"%Y-%m-%d-%H%M%S" } Load frameworks module: module load frameworks Deactivate conda environment: conda deactivate Create new conda environment:...
What When ๐จ Mixing Between Distributions While Training 2025-10-06 ๐ pbs-tui: TUI for PBS Job Scheduler Monitoring 2025-09-17 ๐น BlendCorpus + TorchTitan @ ALCF 2025-09-12 ๐๏ธ Building PyTorch 2.8 from Source on Aurora 2025-06-14 ๐งโโ๏ธ...
flowchart LR subgraph D["`Data`"] direction TB x("`xโ`") x1("`xโ`") x2("`xโ`") end direction LR subgraph G0["`GPU0`"] direction LR subgraph N0["`NN`"] end L0["`L0`"] end subgraph G1["`GPU1`"] direction LR subgraph N1["`NN`"] end...
What When ๐๏ธ Building PyTorch 2.8 from Source on Aurora 2025-06-14 ๐งโโ๏ธ Mermaid 2025-06-02 ๐ฐ Nice Headings 2025-06-01 No matching items CitationBibTeX citation:@online{foreman2025, author = {Foreman, Sam}, title = {06}, date =...
I like headings. They help organize content and make it easier to read. Inspired by my neovim config, I wanted to recreate a similar style for headings in my website. Light Theme Dark Theme Figure 1: My neovim headings in light and dark...
ALCF Incite Hackathon 2025 2025 ALCF INCITE GPU Hackathon (20-May 22, 2025) LLMs on Aurora1: ๐ Hands-On: ezpz ๐ Overview: AuroraGPT ๐ฏ AuroraGPT: Goals AuroraGPT: General purpose scientific LLM Broadly trained on a general corpora plus...
๐ Currently Figure 1: Current state of LLM Pretraining. [Source] ๐ฌ LLMs on Aurora ๐ ezpz ๐ค transformers ๐๏ธ Megatron-DeepSpeed ๐ ezpz Write once, run anywhere ๐ฃ Getting Started Submit interactive job: qsub -I -l select=2 -l...
Something I just learned The TensorFlow that is included in the new frameworks module (aurora_nre_models_frameworks-2025.0.0) was built with numpy==1.26.4 (< 2). Unfortunately, if you then (for whatever reason) then tries to install /...
PyTorch 2.6 on Aurora ; source <(curl -L https://bit.ly/ezpz-utils) && ezpz_setup_env ; export CXX=$(which g++) ; export CC=$(which gcc) ; export REL_WITH_DEB_INFO=1 ; export USE_CUDA=0 ; export USE_ROCM=0 ; export USE_MKLDNN=1 ; export...