We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
最新版本地加载Qwen无法并发,如果重新加载界面就会重新加载模型,爆显存
1.正常本地部署 2.使用Qwen模型 3.单独点开一个界面没有问题 4.重复再点开一个界面后模型重新加载,旧模型不清除,导致显存溢出
No response
The text was updated successfully, but these errors were encountered:
No branches or pull requests
这个bug是否已存在现有issue了?
错误表现
最新版本地加载Qwen无法并发,如果重新加载界面就会重新加载模型,爆显存
2024-04-03.13.40.36.mp4
复现操作
1.正常本地部署
2.使用Qwen模型
3.单独点开一个界面没有问题
4.重复再点开一个界面后模型重新加载,旧模型不清除,导致显存溢出
错误日志
No response
运行环境
帮助解决
补充说明
No response
The text was updated successfully, but these errors were encountered: