Tools · Hugging Face Blog ·
Run a vLLM Server on HF Jobs in One Command
Hugging Face Jobs now supports launching a vLLM server with a single command. The post explains how to run the server on HF Jobs for serving models through vLLM.
Tools · Hugging Face Blog ·
Hugging Face Jobs now supports launching a vLLM server with a single command. The post explains how to run the server on HF Jobs for serving models through vLLM.