Skip to content

vllm.entrypoints.serve.profile.api_router

Classes:

StartProfileRequest

Bases: BaseModel

Optional overrides for one profiling session.

Values are validated by the engine client.

Source code in vllm/entrypoints/serve/profile/api_router.py 
18
19
20
21
22
23
24
25
26
27
28
class StartProfileRequest(BaseModel):
    """Optional overrides for one profiling session.

    Values are validated by the engine client.
    """

    model_config = ConfigDict(extra="ignore", strict=True)

    profile_prefix: str | None = None
    delay_iterations: int | None = None
    max_iterations: int | None = None