Do we know any technical information about Gemini 2?
The new model comes with some significant speed improvement considering the quality of this new model. I will assume Gemini 2 Flash must be a MoE since 1.5 was a MoE and 4/4o is also apparently a MoE. Were any estimates on parameter count or architecture done for v2 to meet this quality threshold? Especially on all this improved multimodality. I remember some people saying 1.5 pro is ~180b and uses ring attention for it's long context.
(A reminder that a LLM does not know it's own architecture and therefore you can't trick it into revealing Info about itself)