- Mon 02 September 2024
- Neuron
Slurm Cluster usage tips for quick debug and testing
This post covers practical Slurm commands and best practices to help you reserve, access, and work cleanly on nodes.
- Sat 20 January 2024
- Neuron
Neuron - Handling NaNs
A runbook for triaging Neuron accuracy issues and means to verify the model accuracy
- Fri 29 December 2023
- Neuron
EFA and OpenFabrics
This post works through a high level overview of OpenMPI and EFA
- Fri 22 December 2023
- Neuron
AI Compilers - A Study guide
A growing list/study guide of AI compilers, from foundational concepts like graph lowering and systolic arrays to practical tools like TorchDynamo and Glow.
- Wed 20 December 2023
- Neuron
Aliasing on XLA
This post explores the concept of aliasing in XLA, its significance, the mechanisms through which it is implemented, and future directions for extending aliasing optimizations.
- Wed 20 December 2023
- Neuron
All Reduce Decomposition
This post works through the metrics that are critical for ML inference
- Wed 20 December 2023
- Neuron
Concept - Coalescing
This post works through the metrics that are critical for ML inference
- Wed 20 December 2023
- Neuron
What is Neuron SDK
This post introduces AWS Neuron SDK - an SDK that streamlines deep learning and generative AI workloads on AWS Inferentia and Trainium by integrating with frameworks like PyTorch and JAX.
- Wed 13 December 2023
- Neuron
Neuron Glossary
This post acts as a running glossary for Neuron and HPC related terms and technologies.