Liquid AI reveals 8B-A1B MoE trained on 38T

· HN · LLMs ·

Liquid AI revealed an 8B MoE model trained on 38T tokens, signaling a substantial new small-model release.

Categories: Model Releases

Excerpt

HN · 101 points · 26 comments

Read at source: https://www.liquid.ai/blog/lfm2-5-8b-a1b

Discussions