yumoqing/gpu-base-service
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

bugfix

Browse Source
This commit is contained in:
yumoqing 2026-04-20 17:08:58 +08:00
parent b8df855b65
commit 7c62107602
1 changed files with 40 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

42
README.md
View File

@ -18,6 +18,9 @@ SyslogIdentifier=clip
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
## http服务
https://embedding.opencomputing.net:1044/mme
### 模型 ### 模型
* 使用的模型名：laion/CLIP-ViT-B-32-laion2B-s34B-b79K * 使用的模型名：laion/CLIP-ViT-B-32-laion2B-s34B-b79K
* 模型路径 * 模型路径
@ -48,6 +51,9 @@ SyslogIdentifier=entities
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://entities.opencomputing.net:10443
### 模型 ### 模型
路径：/share/models/LTP/small 路径：/share/models/LTP/small
@ -78,6 +84,9 @@ SyslogIdentifier=f5tts
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://tts.opencomputing.net:10443
### 模型 ### 模型
* 模型路径 * 模型路径
/share/models/SWivid/F5-TTS/F5TTS_v1_Base/model_1250000.safetensors /share/models/SWivid/F5-TTS/F5TTS_v1_Base/model_1250000.safetensors
@ -97,7 +106,6 @@ CUDA_VISIBLE_DEVICES=6 ${rundir}/f5tts.env/bin/python ${rundir}/app/f5tts.py -w
CUDA_VISIBLE_DEVICES=6 ${rundir}/f5tts.env/bin/python ${rundir}/app/f5tts.py -w ${rundir} -p 9995 & CUDA_VISIBLE_DEVICES=6 ${rundir}/f5tts.env/bin/python ${rundir}/app/f5tts.py -w ${rundir} -p 9995 &
``` ```
f5tts.service
## fastwhisper.service ## fastwhisper.service
ASR模型 ASR模型
``` ```
@ -118,6 +126,9 @@ SyslogIdentifier=fastwhisper
[Install] [Install]
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://asr.opencomputing.net:10443/fw
### 模型 ### 模型
* 路径 * 路径
/data/ymq/models/deepdml/faster-whisper-large-v3-turbo-ct2 /data/ymq/models/deepdml/faster-whisper-large-v3-turbo-ct2
@ -153,6 +164,8 @@ SyslogIdentifier=fvlm
[Install] [Install]
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://fastvlm.opencomputing.net:10443
### 模型 ### 模型
* 路径 * 路径
@ -184,6 +197,9 @@ SyslogIdentifier=m2m
[Install] [Install]
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://t2t.opencomputing.net:10443/m2m
### 模型 ### 模型
* 路径 * 路径
/share/models/facebook/m2m100_1.2B /share/models/facebook/m2m100_1.2B
@ -213,11 +229,14 @@ TimeoutStartSec=300
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://graphdb.opencomputing.net:10443
### 模型路径 ### 模型路径
* 路径 * 路径
### 软件仓库 ### 软件仓库
https://git.kaiyuancloud.cn/yumoqing/llmengine https://git.opencomputing.cn/yumoqing/llmengine
### 运行脚本 ### 运行脚本
``` ```
#!/bin/bash #!/bin/bash
@ -242,6 +261,8 @@ SyslogIdentifier=asr
[Install] [Install]
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://asr.opencomputing.net:10443
### 模型 ### 模型
* 路径 * 路径
@ -280,6 +301,8 @@ in:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
[Install] [Install]
WantedBy=default.target WantedBy=default.target
``` ```
### http服务
https://ollama.opencomputing.net:10443
## qwen3.service ## qwen3.service
qwen3-0.6b模型 qwen3-0.6b模型
@ -298,6 +321,10 @@ SyslogIdentifier=qwen3
[Install] [Install]
``` ```
### http服务
https://t2t.opencomputing.net:10443/qwen3-6b
### 模型 ### 模型
* 路径 * 路径
/d/models/Qwen/Qwen3-0.6B /d/models/Qwen/Qwen3-0.6B
@ -329,6 +356,9 @@ SyslogIdentifier=qwen3coder
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://t2t.opencomputing.net:10443
### 模型 ### 模型
* 路径 * 路径
/d/models/Qwen/Qwen3-Coder-30B-A3B-Instruct /d/models/Qwen/Qwen3-Coder-30B-A3B-Instruct
@ -341,6 +371,7 @@ rundir=/share/run/qwen3coder
CUDA_VISIBLE_DEVICES=0 /share/vllm-0.8.5/bin/python -m llmengine.server -w ${rundir} -p 9088 /d/models/Qwen/Qwen3-Coder-30B-A3B-Instruct & CUDA_VISIBLE_DEVICES=0 /share/vllm-0.8.5/bin/python -m llmengine.server -w ${rundir} -p 9088 /d/models/Qwen/Qwen3-Coder-30B-A3B-Instruct &
exit 0 exit 0
``` ```
## reranker.service ## reranker.service
``` ```
[Unit] [Unit]
@ -389,6 +420,8 @@ SyslogIdentifier=rerank
[Install] [Install]
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://reranker.opencomputing.net:10443
### 模型 ### 模型
* 路径 * 路径
@ -454,6 +487,8 @@ SyslogIdentifier=/share/run/triples
[Install] [Install]
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://triples.opencomputing.net:10443
### 模型 ### 模型
* 路径 * 路径
@ -489,6 +524,9 @@ SyslogIdentifier=vdb
[Install] [Install]
WantedBy=multi-user.target WantedBy=multi-user.target
``` ```
### http服务
https://vectordb.opencomputing.net:10443/milvus
### 仓库 ### 仓库
https://git.opencomputing.cn/yumoqing/vdb https://git.opencomputing.cn/yumoqing/vdb
### 脚本 ### 脚本