AdvertBench, ranking the ability of LLMs to create image ads

Show HN: AdvertBench, ranking the ability of LLMs to create image ads

Operating in show hn launch, AdvertBench, ranking the ability of LLMs to create image ads operates.

Profile

Experiment that I've made. The models get access to an E2B sandbox and are instructed to create an ad according to the specifications (they can choose whatever tools they want to use for it, e.g. Pillow, Chromium) as a proxy for their ability to use tools, create other kinds of images, do complex layouts etc. Currently Opus 4.8 is on top (not surprising, but it did take 66 conversation turns to create the image) and GLM-5.2 is on fifth (which I do find surprising because it doesn't have image capabilty).

Its activity falls under show hn launch; the profile below is assembled from public directory data.

The company is listed at the Show HN launch stage of development.

Website: advertbench.com