Do LLMs identify fonts?

This is a live benchmark of various LLMs' ability to identify fonts from images. The latter are scraped from dafont.com. Each LLM is asked to identify the font whenever a new image is uploaded by a user. The guesses are compared against the actual font, once it has been identified by someone and confirmed. This process avoids benchmark contamination.

The source code for this benchmark is available on GitHub.

Updated at

gpt-4o-mini

Predictions

Top-1 accuracy

Top-2 accuracy

Top-3 accuracy

Top-4 accuracy

Top-5 accuracy

gemini-2.5-flash-preview-05-20

Predictions

Top-1 accuracy

Top-2 accuracy

Top-3 accuracy

Top-4 accuracy

Top-5 accuracy