Large Language Model Distributed Inference
Date:
A hands-on workshop on serving large language models across multiple GPUs and nodes with vLLM, covering PagedAttention, continuous batching, and tensor and pipeline parallelism, with labs on the Kempner HPC cluster.
A virtual Workshops @ Kempner session open to Harvard affiliates.