Google Gemini falls short in comparison to GPT-4, sparking a backlash due to a deceptive demo video and questionable MMLU benchmark results.
Yet, the research paper disclosed by Google indicates that the Ultra version outperformed both GPT-4 and GPT -3.5. Intriguingly, a more detailed examination unveils a crucial technical aspect. According to Reddy’s tweet, Google has implemented COT@32 instead of 5-shot learning to enhance Gemini’s performance. Google’s Duplex Demo: History of Faking It Google Gemini AI Video … Read more