Inference on Sandeep Kumar

Inference on Sandeep Kumarhttps://sandeep007734.github.io/tags/inference/Recent content in Inference on Sandeep KumarHugoen-usFri, 07 Aug 2026 00:00:00 +0530FlashInfer: A Customizable Attention Engine for LLM Servinghttps://sandeep007734.github.io/posts/flashinfer/Fri, 07 Aug 2026 00:00:00 +0530https://sandeep007734.github.io/posts/flashinfer/How FlashInfer unifies heterogeneous KV-cache layouts, specialized attention kernels, and dynamic serving schedules in one inference-oriented engine.