AI
ZAYA1-8B Model Achieves GPT-4 Performance with 760M
Zyphra released ZAYA1-8B, an 8.2B parameter mixture-of-experts model using only 760M active parameters that matches GPT-4…
Tag: parameter efficiency
Zyphra released ZAYA1-8B, an 8.2B parameter mixture-of-experts model using only 760M active parameters that matches GPT-4…