Evaluations support vision models with an image_data_urls dataset column

You can now evaluate vision-capable models on image datasets. Add an image_data_urls column to your evaluation dataset (a base64 image data URL, or a list of them) and the images are attached to the model and judge requests alongside the text prompt.

See Prepare a dataset for details.