AI
AI Architecture Advances: New Training Methods Cut GPU Waste
Enterprise GPU utilization averages just 5% despite $401 billion in AI spending, while new training techniques…
Tag: parameter efficiency
AI
ZAYA1-8B Model Achieves GPT-4 Performance with 760M
Zyphra released ZAYA1-8B, an 8.2B parameter mixture-of-experts model using only 760M active parameters that matches GPT-4…