Skip to content

phsl / new-api

Go to a project
Commit 8f6961c6 by Seefs Committed by GitHub
Options

feat: vllm thinking_token_budget (#7027)

parent 8c25eee7
Showing with 2 additions and 0 deletions
relaykit/dto/openai_request.go
......@@ -106,6 +106,8 @@ type GeneralOpenAIRequest struct {
SearchMode json.RawMessage `json:"search_mode,omitempty"`
// Minimax
ReasoningSplit json.RawMessage `json:"reasoning_split,omitempty"`
// vLLM
ThinkingTokenBudget json.RawMessage `json:"thinking_token_budget,omitempty"`
}
func (r GeneralOpenAIRequest) MarshalJSON() ([]byte, error) {
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or sign in to comment