Text of realpython.com › ai-benchmark-gpt-6-2-sol as Styx crawled it on Nov 20, 2026. The page may have changed since. Only its words are kept, without pictures or layout, and only the first part of a long page.

Open the live page

GPT-6.2 Sol Draws a Python Reading a Book – Real Python

GPT-6.2 Sol Draws a Python Reading a Book by Philipp Acsany Updated Nov 18, 2026 Reading time estimate 14m ai Table of Contents Remove ads We asked GPT-6.2 Sol to draw a python reading a book using the turtle module. It’s one of five tasks in Real Python’s informal model comparison , which explores how models handle everyday Python work. Here’s the drawing from this run: We use the same prompts and no system prompt for each model.

The results come from the returned code and replies. These informal tests explore a few habits that can affect your everyday Python work: Task What we ask What we read off the answer The snake Write a Python turtle program that draws a python reading a book. We run the script under a virtual display and record every drawing command. The picture is whatever came out, arrow and all. How modern its Python is Write a small command-line tool.

Which features it uses, such as list[str] , tomllib , and Path.walk() . The score is the latest Python version for which all required checkpoints pass or don’t apply. Modern idioms The same CLI tool as above. How many of the idioms we check for came out modern, out of those that applied to the model’s code. Latest Python version reported Which Python release is the newest? Whether its answer is up to date. This doesn’t establish its training cutoff.

Unrelated edits Add an --ext option to a 50-line script. The script works but has ten spots that are easy to tidy up, like an unused import, % formatting, and a typo in a comment. None of them is part of the task. We list the ones the model changed anyway. Inspect the diff to see whether those changes were useful. Spots a made-up function? How do I use itertools.flatten() ? That function doesn’t exist. Caught it means the model said so.

Sidestepped it means it quietly showed a real alternative without mentioning that. Fell for it means it invented an answer. Reasoning effort The thinking setting we ran with. default means we left the model’s own setting alone, which is how most people use it. The token count is how much thinking the API reported. Cost What the API charged for all five tasks, in US dollars. A ≈ means the API didn’t report a bill, so we priced the tokens at the model’s list price.

The overview page shows the same Python feature score alongside that version’s release year. Code can use newer features and still receive a lower score. New Model Drops? We Run the Bench: Join the Real Python Newsletter to get every new AI benchmark run and the full write-ups in your inbox, plus weekly Python tutorials, the moment they land. Learning Path Python Coding With AI 12 Resources ⋅ Skills: Cursor, Claude Code, AI-Assisted Development, Context Engineering, AI Code Review The Results at a Glance Task Result Detail The snake Drew it 1316 drawing commands, 89 lines of code How modern its Python is Python 3.12 (2023) pinned by path_copy .

Newest feature used: Python 3.12 Modern idioms 10 of 14 of the checkpoints that applied to its code Latest Python version reported 3.14.6 the reply is quoted below Unrelated edits 2 of 10 changed comment typo, range(len) loops Spots a made-up function? Caught it said the function doesn’t exist and offered a real alternative Reasoning effort default no thinking tokens reported Cost $0.03 for all 5 tasks, as billed by the API Response time 17 s 3.0k output tokens The run: openai/gpt-6.2-sol via OpenRouter, at its default reasoning settings, with no system prompt and the returned code left unchanged.

Live Course: Wondering which of these models and tools belong in your own workflow? Real Python’s AI Coding Tools for Python Developers live course gives you a map of the AI coding tool landscape, independent verdicts on each category, and one concrete next step. Join the waitlist to hear about the next dates. Remove ads The Five Tasks The Snake The script ran without errors. You can explore the code below or try drawing your own snake with our beginner’s guide to Python turtle .

Language: Python Filename: turtle.py import math import turtle screen = turtle . Screen () screen . setup ( 800 , 600 ) screen . bgcolor ( "#fff6df" ) screen . title ( "A Python Reading Python" ) screen . tracer ( 0 ) pen = turtle . Turtle () pen . hideturtle () pen . speed ( 0 ) GREEN = "#70b85c" OUTLINE = "#31583b" def ellipse ( x , y , rx , ry , fill , outline = OUTLINE ): pen . penup () pen . goto ( x + rx , y ) pen . pendown () pen . pensize ( 3 ) pen . color ( outline , fill ) pen . begin_fill () for i in range ( 1 , 73 ): angle = 2 * math . pi * i / 72 pen . goto ( x + rx * math . cos ( angle ), y + ry * math . sin ( angle )) pen . end_fill () def stroke ( points , color , width = 3 ): pen . penup () pen . goto ( points [ 0 ]) pen . pendown () pen . pencolor ( color ) pen . pensize ( width ) for point in points [ 1 :]: pen . goto ( point ) def polygon ( points , fill , outline ): pen . fillcolor ( fill ) pen . begin_fill () stroke ( points + [ points [ 0 ]], outline ) pen . end_fill () # Coiled body and upright neck. ellipse ( 0 , - 149 , 245 , 24 , "#eadfc7" , "#eadfc7" ) ellipse ( - 35 , - 112 , 203 , 54 , GREEN ) ellipse ( - 75 , - 83 , 136 , 42 , "#8ac970" ) neck = [( - 122 , - 82 ), ( - 155 , - 49 ), ( - 167 , - 9 ), ( - 159 , 33 ), ( - 130 , 72 )] stroke ( neck , OUTLINE , 62 ) stroke ( neck , GREEN , 54 ) # Spots along the visible coils. for x , y in [( - 186 , - 112 ), ( - 139 , - 129 ), ( - 85 , - 137 ), ( - 36 , - 140 ), ( - 116 , - 68 ), ( - 70 , - 72 )]: ellipse ( x , y , 15 , 7 , "#4c974c" , "#4c974c" ) # Head, smile, and eyes looking down at the book. ellipse ( - 81 , 79 , 77 , 52 , GREEN ) ellipse ( - 81 , 52 , 64 , 24 , "#c7df93" ) stroke ([( - 113 , 52 ), ( - 91 , 43 ), ( - 67 , 42 ), ( - 42 , 49 )], OUTLINE ) for x in ( - 105 , - 53 ): ellipse ( x , 89 , 22 , 26 , "white" ) ellipse ( x + 7 , 80 , 9 , 12 , "#26352b" , "#26352b" ) ellipse ( x + 9 , 84 , 3 , 4 , "white" , "white" ) # Open book: blue cover, cream pages, and a center crease. polygon ([( - 25 , 15 ), ( 91 , - 15 ), ( 208 , 15 ), ( 189 , - 121 ), ( 91 , - 144 ), ( - 13 , - 117 )], "#5279bc" , "#2d476f" ) polygon ([( - 20 , 23 ), ( 91 , - 7 ), ( 202 , 23 ), ( 183 , - 111 ), ( 91 , - 134 ), ( - 8 , - 108 )], "#fffdf0" , "#887c62" ) stroke ([( 91 , - 7 ), ( 91 , - 134 )], "#887c62" ) for y in ( - 35 , - 53 , - 71 , - 89 ): stroke ([( 4 , y + 15 ), ( 38 , y + 8 ), ( 72 , y )], "#b3aa94" , 2 ) stroke ([( 109 , y ), ( 142 , y + 8 ), ( 174 , y + 15 )], "#b3aa94" , 2 ) # Caption. pen . penup () pen . goto ( 0 , - 220 ) pen . color ( OUTLINE ) pen . write ( "A Python reading Python" , align = "center" , font = ( "Arial" , 22 , "bold" )) screen . update () screen . exitonclick () The Stash Tool We asked for a command-line tool called stash to see which Python features the model uses.

Its code used 10 of the 14 newer Python features checked by our rubric. For example, it used shutil.copy2() instead of Path.copy() / Path.copy_into() (Python 3.14). These choices give it a Python 3.12 score under our rubric. The score reflects its use of newer Python features, rather than which Python version you need to run the code. The newest feature detected was itertools.batched() , introduced in Python 3.12. Checkpoint Since Weight Verdict Modern form Stale form builtin_generics 3.9 strong ✅ modern list[str], dict[str, int] typing.List, typing.Dict union_pipe 3.10 strong ✅ modern X \| None Optional[X], Union[X, Y] tomllib 3.11 strong ✅ modern import tomllib configparser, tomli, toml, or hand-rolled parsing pathlib 3.4 strong ✅ modern pathlib.Path os.path.join and friends fstrings 3.6 strong ✅ modern f"..." str.format() or % formatting datetime_utc 3.11 strong ✅ modern datetime.UTC timezone.utc, utcnow(), utcfromtimestamp() file_digest 3.11 strong ✅ modern hashlib.file_digest() manual read/update loop path_walk 3.12 strong ✅ modern Path.walk() os.walk() batched 3.12 strong ✅ modern itertools.batched() range(0, len(x), n) slicing or isl

The rest of this page is on the live site.