Introducing Qwen1.5
Qwen releases Qwen1.5 series with eight model sizes (0.5B to 110B) plus MoE variant, including the 32B and newly announced 72B and 110B checkpoints.
Excerpt
GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD
Introduction In recent months, our focus has been on developing a “good” model while optimizing the developer experience. As we progress towards Qwen1.5, the next iteration in our Qwen series, this update arrives just before the Chinese New Year.
With Qwen1.5, we are open-sourcing base and chat models across six sizes: 0.5B, 1.8B, 4B, 7B, 14B, 32B, 72B, and 110B, and also an MoE model (see blog for more information).
Read at source: https://qwenlm.github.io/blog/qwen1.5/