Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Skywork 团队有兴趣推出一个 7B 的蒸馏版本以支持推测采样和低资源设备推理吗？ #49

Open
tq-xyy opened this issue Nov 18, 2023 · 1 comment
Open

Skywork 团队有兴趣推出一个 7B 的蒸馏版本以支持推测采样和低资源设备推理吗？ #49

tq-xyy opened this issue Nov 18, 2023 · 1 comment

Comments

@tq-xyy
Copy link

tq-xyy commented Nov 18, 2023 •
edited
Loading

如题，据我所知，隔壁 CausalLM/7B 已经搞了，他们用的知识蒸馏的方法。
@TianwenWei
Copy link
Contributor

现在7B的开源模型已经很多了，我们在考虑出开源一个3B的版本。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@TianwenWei @tq-xyy