提高推理强度后，DeepSeek-V4-Flash-0731生成的鹈鹕SVG明显改善

# AI疯狂进化6个月，一张天梯图全浓缩，30+模型混战，大神演讲爆火 在旧金山AI工程师世博会上，Simon Willison用自创「骑自行车的鹈鹕」图像生成测试，幽默回顾过去半年LLM的飞速发展。亲测30多款AI模型，强调工具+推理成最强AI组合！ 就在刚刚，AI圈大神Simon Willison在旧金山AI工程师世博会（AI Engineer World’s Fair）上带来爆笑又干货满满的主题演讲：「过去六个月中的LLM——由骑自行车的鹈鹕来解释」。 1. 大厂模型层出不穷：AI能力显著跃升，Gemini 2.5 Pro目前表现最强 从Amazon Nova到Meta Llama 3.3 70B，再到DeepSeek-R1、Claude 3.7 Sonnet、Mistral Small 3和OpenAI全系列、Gemini 2.5 Pro，Simon亲测多个模型在本地运行与图像生成的表现，最强的模型是Gemini 2.5 Pro。 2. 年度AI奇葩Bug盘点：ChatGPT马屁精上线、Claude直接举报用户、系统提示词成「地雷」 连「屎在棍子上」这种点子都夸是天才的ChatGPT；系统提示一改价值观就失控的Grok；会自动把黑料发给FDA和媒体的Claude 4。 3. 目前最火最强AI组合：工具+推理 o3 / o4‑mini：搜索体验大跃升 每个人都需要自己的基准测试。于是我越来越依赖自己的方法，这个方法起初只是个玩笑，但渐渐地我发现它还真有点用！我的方法就是让它们生成一个「鹈鹕骑自行车」的SVG图像。 我是在用这个方法测试那些只能输出文本的大语言模型。按理说，它们根本画不了任何东西。但它们能生成代码……而SVG就是代码。这对它们来说也是一个难得不讲道理的测试。

Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. But when I bumped reasoning level up to high I got something much better: `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` [...] I got a disappointing pelican from it using the default reasoning level via OpenRouter: Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashe

Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. But when I bumped reasoning level up to high I got something much better: `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` [...] I got a disappointing pelican from it using the default reasoning level via OpenRouter: Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashe

This means I can run my pelican benchmark like this: `llm -t pelican-svg -m openrouter/qwen/qwen3-next-80b-a3b-thinking` Or like this: `llm -t pelican-svg -m openrouter/qwen/qwen3-next-80b-a3b-instruct` Here's the thinking model output (exported with `llm logs -c | pbcopy` after I ran the prompt): `llm logs -c | pbcopy` The bicycle is too simple and way too wide. The pelican is two circles, two orange triangular feed and a big triangle for the beak. The bicycle is too simple and way too wide. The pelican is two circles, two orange triangular feed and a big triangle for the beak. I enjoyed the "Whimsical style with smooth curves and friendly proportions (no anatomical accuracy needed for bicycle riding!)" note in the transcript. The instruct (non-reasoning) model gave me this: [...] More details from their tweet: The models on Hugging Face are around 150GB each so I decided to try them out via OpenRouter rather than on my own laptop (Thinking, Instruct). I'm used my llm-openr

user avatar user avatar Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. [...] Flat vector illustration of a white pelican riding a bicycle to the right against a pink background with a lighter pink circle behind it. The pelican grips the handlebars with its wings and one orange foot rests on the pedal, and a small blue fish is visible tucked in the corner of its large orange beak pouch. The bike has a red, blue and orange frame with dark tires, and grey speed lines trail behind to suggest motion. user avatar user avatar [...] ## Post ## Post

Log inSign up ## Post user avatar Simon Willison @simonw Got a disappointing pelican from DeepSeek-V4-Flash-0731 at default reasoning mode - on the left - but then I bumped reasoning up to high (via OpenRouter) and got the much better one on the right Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. [...] Flat vector illustration of a white pelican riding a bicycle to the right against a pink background with a lighter pink circle behind it. The pelican grips the handlebars with its wings and one orange foot rests on the pedal, and a small blue fish is