TechSafety
Z.ai ships GLM-5.3 with 84.5 percent CyberGym topping Mythos 5 and GPT-5.6 Sol, holds weights back two weeks
Decrypt / MarkTechPost · 2026-08-14 · Source ↗
Z.ai ships GLM-5.3 with 84.5 percent CyberGym topping Mythos 5 and GPT-5.6 Sol, holds weights back two weeks
Decrypt / MarkTechPost · 2026-08-14 · Source ↗
Z.ai released GLM-5.3 on August 14 through its API, GLM Coding Plan and ZCode surfaces, framing the update as a demonstration that post-training scaling alone can push an open-weights model to frontier coding and cybersecurity benchmarks without a fresh pretraining run. The Beijing lab kept the 743-billion-parameter mixture-of-experts foundation from GLM-5.2 intact, layered additional reinforcement-learning and skill-training runs on top, and reports gains across every category the company tracks.
The coding numbers step across three benchmarks. Terminal-Bench 3.0 climbs to 28.3 from GLM-5.2's 4.6, a six-fold jump on the same base model. DeepSWE v1.1 lifts to 66.9 from 46.2. Agents' Last Exam CLI reaches 28.5 from 23.8. On GDPval-AA v2 the model posts 1,769 Elo, the highest score Z.ai has measured internally and above Anthropic Claude Fable 5 at 1,743. Terminal-Bench 2.1 sits at 88.2, level with GPT-5.6 Sol at 88.8. HumanEval-Plus lands at 91.4 percent, MBPP-Plus at 87.9, SWE-Bench Verified at 83.6 on Z.ai's internal run and 82.8 on the Papers With Code reproduction posted inside 24 hours.
Cybersecurity is where Z.ai says capability grew faster than the team expected. On CyberGym, which tests whether a model can identify and validate vulnerabilities from white-box source code, GLM-5.3 posts 84.5 percent, ahead of Claude Mythos 5 at 83.8 and OpenAI GPT-5.6 Sol at 83.6. On ExploitBench, the model doubles GLM-5.2's 24.4 to reach 54.4 percent, still behind Mythos 5 at 78.0. ExploitGym at the two-hour tier reaches 105 tasks against GLM-5.2's 29 and Mythos 5's 181; at six hours GLM-5.3 lands 130 tasks versus GLM-5.2's 39 and Mythos 5's 247.
"As we scaled post-training, cyber capability developed faster than we expected." — Z.ai, GLM-5.3 announcement
The staged open-weights choice
Z.ai disclosed a real-world test across 269 codebases where GLM-5.3 flagged 2,436 vulnerabilities, 1,097 rated medium-to-high severity, with an average bug age of 26.6 years. That figure carries the pull because it maps directly onto the class of aged open-source dependencies where enterprise defenders spend the most triage time. The company is holding weights back approximately two weeks pending safety evaluation and hardening, marking the first time a major Chinese lab has staged an open-weights release rather than shipping simultaneously with the API. Alibaba's Qwen 3.8-Max launched last week under a custom license with weights immediately live on Hugging Face and ModelScope. DeepSeek's V4-Pro-0813, released the same Friday morning, shipped API-only with no weights. Z.ai's plan to publish under Apache 2.0 in two weeks is the closest a Chinese lab has come to Western frontier-lab practice on responsible open-weights release.
"Scaling post-training is all we did for GLM-5.3." — Z.ai, model announcement
Pricing runs aggressively. Input tokens land at 2 yuan per million and output at 6 yuan per million, undercutting DeepSeek V4-Pro's new peak pricing by 78 percent on input and 78 percent on output. Context sits at 1 million tokens with 128K output, matching the GLM-5.2 window. Writer's Palmyra X6 flagship, released Thursday, is built as a post-training variation on GLM-5.2 and Writer sources said the company will evaluate GLM-5.3 as soon as weights become public, with a Palmyra X6.1 update on the newer base possible before year-end.
The CyberGym leadership carries international implications. CyberGym is a benchmark designed by UC Berkeley and Palo Alto Networks Unit 42 to test vulnerability discovery from source code, and it is one of four benchmarks the White House OSTP's June 2026 executive order on AI cyber capability references directly. A Chinese model taking the top slot on CyberGym gives the White House and BIS a fresh talking point in the ongoing debate over whether to expand Entity List coverage of Chinese AI labs. Zhipu received an Entity List designation in December 2024, but the designation did not stop the company from training and releasing GLM-5.3 on domestic Chinese Ascend hardware.