Senthilkumar Gopal

This post analyzes Hashcash as a defense against AI web crawlers, detailing its probabilistic proof-of-work model and operational viability. It includes a technical breakdown of token generation, expected runtime guarantees, and implementation strategy.

This post explains how Paged Attention and Chunked Prefill optimize memory and computation in vLLM by organizing key-value caches into dynamic blocks and processing input sequences in manageable chunks. It includes a simple walkthrough with tensor shapes and code to showcase their integration for LLM inference.

A quick clarification between the terms - Triton, TensorRT, and TensorRT-LLM

A runbook for triaging Neuron accuracy issues and means to verify the model accuracy

This post works through a high level overview of OpenMPI and EFA

A growing list/study guide of AI compilers, from foundational concepts like graph lowering and systolic arrays to practical tools like TorchDynamo and Glow.

This post introduces AWS Neuron SDK - an SDK that streamlines deep learning and generative AI workloads on AWS Inferentia and Trainium by integrating with frameworks like PyTorch and JAX.

This post acts as a running glossary for Neuron and HPC related terms and technologies.

A quick review of feature creation for time series data.

This post describes a typical machine learning project and ongoing documentation and tracking of its progress.