AI7 views

Yann LeCun Confirms Llama 4 Benchmark Manipulation

Recent reports from Slashdot, citing former Meta AI chief Yann LeCun, reveal that the Llama 4 launch involved manipulated performance data. To achieve superior scores, the development team allegedly used different model versions tailored specifically to individual benchmarks rather than testing a single, unified model.

Key Details of the Llama 4 Controversy:

  • Data Manipulation: Meta’s team utilized distinct models for different benchmarks to artificially inflate results.
  • Market Reception: Following its April 2025 release, the technology was widely criticized as a failure.
  • Internal Fallout: Mark Zuckerberg reportedly lost confidence in the team responsible.
  • Organizational Shift: As a result of the controversy, Meta's Generative AI (GenAI) division was deprioritized within the company’s broader hierarchy.

These revelations highlight significant internal struggles at Meta regarding the integrity and performance of its large language models.