Skip to content

phsl / new-api

Go to a project
Commit cbca378e by e
Options

feat: add `Suffix` to GeneralOpenAIRequest in order to support FIM

parent 02bb1c65
Showing with 2 additions and 1 deletions
dto/openai_request.go
...@@ -17,7 +17,8 @@ type FormatJsonSchema struct { ...@@ -17,7 +17,8 @@ type FormatJsonSchema struct {
type GeneralOpenAIRequest struct { type GeneralOpenAIRequest struct {
Model string `json:"model,omitempty"` Model string `json:"model,omitempty"`
Messages []Message `json:"messages,omitempty"` Messages []Message `json:"messages,omitempty"`
Prompt any `json:"prompt,omitempty"` Prompt any `json:"suffix,omitempty"`
Suffix any `json:"prompt,omitempty"`
Stream bool `json:"stream,omitempty"` Stream bool `json:"stream,omitempty"`
StreamOptions *StreamOptions `json:"stream_options,omitempty"` StreamOptions *StreamOptions `json:"stream_options,omitempty"`
MaxTokens uint `json:"max_tokens,omitempty"` MaxTokens uint `json:"max_tokens,omitempty"`
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or sign in to comment