Notice
数据公告

QQ群和tg群已经启用,欢迎加入。公开信息来源均审核后发布;请结合来源、库存和更新时间判断。

Community & contactTelegram 群点击加入Telegram 频道点击订阅联系我们tgAIPricedb交流群979789483
Back to news
Research

DeepSeek-V4-Flash-0731 Creates a Better Pelican SVG with More Reasoning

Simon Willison found that DeepSeek-V4-Flash-0731 produced a poor “pelican riding a bicycle” SVG at its default reasoning level, but generated a much more coherent result after reasoning effort was raised to high through OpenRouter. The comparison highlights the impact of inference settings without serving as a standalone measure of general intelligence.

86% VERIFIED

Simon Willison shared a side-by-side comparison of SVG illustrations generated by DeepSeek-V4-Flash-0731. In the default mode, the pelican and bicycle had broken connections and weak structural detail.

After increasing the reasoning effort to high via OpenRouter, the model produced a substantially more convincing composition, with clearer interaction between the bird and the bicycle. The test is useful for examining instruction following, spatial planning, and structured SVG generation, but it should not be treated as an independent benchmark of overall intelligence.

Source evidence

AI疯狂进化6个月,一张天梯图全浓缩,30+模型混战,大神演讲爆火h5.ifeng.com · supporting

# AI疯狂进化6个月,一张天梯图全浓缩,30+模型混战,大神演讲爆火 在旧金山AI工程师世博会上,Simon Willison用自创「骑自行车的鹈鹕」图像生成测试,幽默回顾过去半年LLM的飞速发展。亲测30多款AI模型,强调工具+推理成最强AI组合! 就在刚刚,AI圈大神Simon Willison在旧金山AI工程师世博会(AI Engineer World’s Fair)上带来爆笑又干货满满的主题演讲:「过去六个月中的LLM——由骑自行车的鹈鹕来解释」。 1. 大厂模型层出不穷:AI能力显著跃升,Gemini 2.5 Pro目前表现最强 从Amazon Nova到Meta Llama 3.3 70B,再到DeepSeek-R1、Claude 3.7 Sonnet、Mistral Small 3和OpenAI全系列、Gemini 2.5 Pro,Simon亲测多个模型在本地运行与图像生成的表现,最强的模型是Gemini 2.5 Pro。 2. 年度AI奇葩Bug盘点:ChatGPT马屁精上线、Claude直接举报用户、系统提示词成「地雷」 连「屎在棍子上」这种点子都夸是天才的ChatGPT;系统提示一改价值观就失控的Grok;会自动把黑料发给FDA和媒体的Claude 4。 3. 目前最火最强AI组合:工具+推理 o3 / o4‑mini:搜索体验大跃升 每个人都需要自己的基准测试。于是我越来越依赖自己的方法,这个方法起初只是个玩笑,但渐渐地我发现它还真有点用!我的方法就是让它们生成一个「鹈鹕骑自行车」的SVG图像。 我是在用这个方法测试那些只能输出文本的大语言模型。按理说,它们根本画不了任何东西。但它们能生成代码……而SVG就是代码。这对它们来说也是一个难得不讲道理的测试。

Simon Willison's Weblogsimonwillison.net · supporting

Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. But when I bumped reasoning level up to high I got something much better: `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` [...] I got a disappointing pelican from it using the default reasoning level via OpenRouter: Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashe

Simon Willison on deepseeksimonwillison.net · supporting

Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. But when I bumped reasoning level up to high I got something much better: `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` `llm -m openrouter/deepseek/deepseek-v4-flash-0731 -t pelican -o reasoning_effort high` [...] I got a disappointing pelican from it using the default reasoning level via OpenRouter: Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashe

Simon Willison on llm-reasoningsimonwillison.net · supporting

This means I can run my pelican benchmark like this: `llm -t pelican-svg -m openrouter/qwen/qwen3-next-80b-a3b-thinking` Or like this: `llm -t pelican-svg -m openrouter/qwen/qwen3-next-80b-a3b-instruct` Here's the thinking model output (exported with `llm logs -c | pbcopy` after I ran the prompt): `llm logs -c | pbcopy` The bicycle is too simple and way too wide. The pelican is two circles, two orange triangular feed and a big triangle for the beak. The bicycle is too simple and way too wide. The pelican is two circles, two orange triangular feed and a big triangle for the beak. I enjoyed the "Whimsical style with smooth curves and friendly proportions (no anatomical accuracy needed for bicycle riding!)" note in the transcript. The instruct (non-reasoning) model gave me this: [...] More details from their tweet: The models on Hugging Face are around 150GB each so I decided to try them out via OpenRouter rather than on my own laptop (Thinking, Instruct). I'm used my llm-openr

宝玉 on X: "我一直觉得这种测试只能测试 SVG 画图能力,并不太能体现智能水平,或者有什么理由通过这个测试能反映智能水平?" / Xx.com · supporting

user avatar user avatar Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. [...] Flat vector illustration of a white pelican riding a bicycle to the right against a pink background with a lighter pink circle behind it. The pelican grips the handlebars with its wings and one orange foot rests on the pedal, and a small blue fish is visible tucked in the corner of its large orange beak pouch. The bike has a red, blue and orange frame with dark tires, and grey speed lines trail behind to suggest motion. user avatar user avatar [...] ## Post ## Post

Simon Willison on X: "Got a disappointing pelican from DeepSeek-V4-Flash-0731 at default reasoning mode - on the left - but then I bumped reasoning up to high (via OpenRouter) and got the much better one on the right https://t.co/iBEov5peB6" / Xx.com · supporting

Log inSign up ## Post user avatar Simon Willison @simonw Got a disappointing pelican from DeepSeek-V4-Flash-0731 at default reasoning mode - on the left - but then I bumped reasoning up to high (via OpenRouter) and got the much better one on the right Flat vector illustration of a white pelican with a long neck and large orange beak pouch, hovering above a mangled blue and orange bicycle on a dark grey road with white dashed lane markings. The bike is drawn incorrectly: the wheels are just orange arcs with no rims or spokes, the frame tubes float apart and the handlebars connect to nothing. The background is pale blue with a yellow sun in the upper left, white clouds, and grey speed lines on the left suggesting motion. [...] Flat vector illustration of a white pelican riding a bicycle to the right against a pink background with a lighter pink circle behind it. The pelican grips the handlebars with its wings and one orange foot rests on the pedal, and a small blue fish is