🎉 llm-d 0.2 is now released! Check out our first well-lit paths with better load balancing, lower latency, and native vLLM support. Read the announcement →