Mariia Vladimirova

Mariia Vladimirova

Senior Research Scientist  ·  Criteo AI Lab, Paris
AI evaluation  ·  Fairness auditing  ·  Causal inference  ·  AI governance
News Publications Talks Map Media Supervision Recognition

About

I am a senior research scientist at Criteo AI Lab in Paris and a member of the Fairplay joint team (Inria). I work on the evaluation of AI systems: how we measure what a model does, how much the measurement depends on the protocol, and what a verdict is worth once it leaves the lab.

Most of my current work audits generative models for fairness. The same model receives opposite verdicts depending on the prompt family, decoding settings, and scorer used to test it, so I study these degrees of freedom directly and promote reproducible auditing through Fairness Cards. Earlier work built FairJob, a real-world benchmark for fairness in online advertising, and regularizers that give practitioners direct control over the fairness-utility trade-off. In causal inference, I use uplift modeling to learn and evaluate treatment policies offline for large-scale online systems, where a policy has to be judged before it can be deployed. Before joining Criteo, I did research on theoretical deep learning at Inria Grenoble 🚡🏔️. An overview of current and upcoming research directions is available on the research page.

Evaluation is also where research meets regulation. I provide technical and scientific inputs to policymakers on AI regulation, including contributions to CNIL consultations on GDPR and AI systems in the context of the EU AI Act. I also co-chair annual AI symposiums, give invited talks at universities and summer schools, and was recognized as a Rising Star in AI Ethics 2025.

Research Interests

Evaluation of AI systems Fairness auditing of generative models Benchmarks & datasets Behavioural evaluation of LLMs & agents Causal inference & off-policy evaluation AI governance & policy Theoretical deep learning

News

Selected Publications

View all publications

Talks & Tutorials

Where I’ve Spoken

Media & Press

Le Figaro
Une IA responsable : un enjeu stratégique pour un avenir éthique et inclusif
Horizont
Eine ethische KI hat höchste Priorität
MediaLeader.tech
IA agentique : quand l'autonomie oblige à réinventer le contrôle
Minted
Quels sont les travaux menés par Criteo dans son AI Lab ?
Criteo / CNIL
Réponse aux consultations de la CNIL sur le RGPD et les systèmes d'IA

Supervision

Service & Recognition