Skip to content
Toggle navigation
P
Projects
G
Groups
S
Snippets
Help
赵月辉
/
fastgpt-migrated
This project
Loading...
Sign in
Toggle navigation
Go to a project
Project
Repository
Issues
0
Merge Requests
0
Pipelines
Wiki
Snippets
Members
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Unverified
Commit
b74dd234
authored
Mar 06, 2024
by
John Chen
Committed by
GitHub
Mar 06, 2024
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
reranker.md优化docker启动命令,并增加docker-compose.yml示例 (#936)
原docker启动命令启动后的容器只能使用CPU运行。本次修改增加了GPU参数,并提供docker-compose.yml示例
parent
af581bc9
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
27 additions
and
1 deletions
+27
-1
docSite/content/docs/development/custom-models/reranker.md
+27
-1
No files found.
docSite/content/docs/development/custom-models/reranker.md
View file @
b74dd234
...
@@ -54,11 +54,37 @@ ACCESS_TOKEN=mytoken
...
@@ -54,11 +54,37 @@ ACCESS_TOKEN=mytoken
```
```
**运行命令示例**
**运行命令示例**
-
无需GPU环境,使用CPU运行
```
sh
```
sh
docker run
-d
--name
reranker
-p
6006:6006
-e
ACCESS_TOKEN
=
mytoken luanshaotong/reranker:v0.1
docker run
-d
--name
reranker
-p
6006:6006
-e
ACCESS_TOKEN
=
mytoken luanshaotong/reranker:v0.1
```
```
-
需要CUDA 11.7环境
```
sh
docker run
-d
--gpus
all
--name
reranker
-p
6006:6006
-e
ACCESS_TOKEN
=
mytoken luanshaotong/reranker:v0.1
```
**docker-compose.yml示例**
```
version: "3"
services:
reranker:
image: luanshaotong/reranker:v0.1
container_name: reranker
# GPU运行环境,如果宿主机未安装,将deploy配置隐藏即可
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: all
capabilities: [gpu]
ports:
- 6006:6006
environment:
- ACCESS_TOKEN=mytoken
```
## 接入 FastGPT
## 接入 FastGPT
参考
[
ReRank模型接入
](
/docs/development/configuration/#rerank-接入
)
,host 变量为部署的域名。
参考
[
ReRank模型接入
](
/docs/development/configuration/#rerank-接入
)
,host 变量为部署的域名。
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment