vLLM weight and kvcache offload for colocated-separated mode. #526

Open

opened

on Jan 29, 2026

https://docs.vllm.ai/en/latest/features/sleep_mode/#offline-inference

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests