Urgent Query
no-issue-activity
I am confused about the MoE layer in Jamba block. There are many versions of MoE. The paper has not defined in detail the mathematics or diagrams to understand the expert system. Can you please guide or share exact paper which has been followed in jamba?
<!-- POLAR PLEDGE BADGE START -->
## Upvote & Fund
- We're using [Polar.sh](https://polar.sh/kyegomez) so you can upvote and help fund this issue.
- We receive the funding once the issue is completed & confirmed by you.
- Thank you in advance for helping prioritize & fund our backlog.
<a href="https://polar.sh/kyegomez/Jamba/issues/3">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="https://polar.sh/api/github/kyegomez/Jamba/issues/3/pledge.svg?darkmode=1">
<img alt="Fund with Polar" src="https://polar.sh/api/github/kyegomez/Jamba/issues/3/pledge.svg">
</picture>
</a>
<!-- POLAR PLEDGE BADGE END -->
4 条评论