Hmmm, I have a feeling this plot might need an overhaul rather soon🤣. I guess phi-2 was the lower left part of the triangle. I wonder what those guys have been up to in the last 6 months? 🤔
Hmmm, I have a feeling this plot might need an overhaul rather soon🤣. I guess phi-2 was the lower left part of the triangle. I wonder what those guys have been up to in the last 6 months? 🤔
@SebastienBubeck Looking forward! Cause not all of us can run a 8x22B 🥲
@SebastienBubeck Seems everyone is releasing their models this week, I'm sure they'll release something soon...
@SebastienBubeck A Phi-2 20B model would be amazing for PCs. A Phi-3 Bitnet 10B would be perfect for phones. AI will definitely push for Memory Bandwidth to increase in the next 2 years already. I mean, memory size is good and all, but if bandwidth sucks, you can't scale.
@SebastienBubeck I hope so! phi-3, anyone? I’ve always thought your team was pushing in the right direction
@SebastienBubeck Not just bigger, but smarter instead, you know? … if only there was a way of creating synthetic ‘textbooks’ with ever increasing compression of information density… 🤔
@SebastienBubeck phi-2 guys have been ignoring this, because it's still up, and embarassing
@SebastienBubeck We know: your are reviewing how your mighty little LLM is “toxic” :))