MLCommons

Trends

• Frontier launches come under outside review and independent verification

Items

1. Aug 27

   Google DeepMind pilots double-blind AI evaluations

   Using confidential-computing GPU enclaves, a Gemini Flash Lite model was tested so the evaluator never saw its weights and Google never saw the test prompts, cryptographically guarding against benchmark contamination, with Singapore AISI, OpenMined, AVERI, and MLCommons as partners.