GPT 5.6 Sol: No-Hype Full Review & Testing

GPT 5.6 Sol: No-Hype Full Review & Testing

by Pat Simmons · View the channel on PSI

Applied Sciences & Engineering AI — Models & Research UYQArtificial intelligence (AI)UYQFGenerative artificial intelligence
🎙 Pat Simmons 👥 25K 📅 July 10, 2026 ⏱ 40 min 👁 55K 📄 expert opinion 🧭 2026-09-14
Available in: English (current) Français

Keywords

GPT-5.6SolClaudeFable 5AI benchmark

Summary

Pat Simmons presents a practical, blind-testing evaluation of OpenAI’s newly released GPT-5.6 Sol, comparing it against Anthropic’s Fable 5 and Opus 4.8, as well as GPT-5.5, across ten distinct builds. The tests range from coding tasks (a Rubik’s Cube solver, a 3D apartment recreation, an interactive Milky Way map, a Counter-Strike 2 clone, and a cinema knowledge graph) to knowledge-work tasks (an interactive graphic novel, a text-adventure dungeon, a voice-matched YouTube intro, a PowerPoint on the launch, and a Spirit Airlines rebrand). The video explains the three-tier model lineup (Sol, Terra, Luna), discusses reasoning effort levels including a new ‘ultra’ mode that coordinates parallel agents, and compares costs and benchmark scores. Through the blind testing, he reveals that Sol performs competitively but not always dominantly; it shines in fast, decisive tasks but trails in deep, long-context work. The conclusion offers practical guidance on when to use each model. The video is well-structured, engaging, and includes viewer-suggested challenges, making it a valuable resource for AI practitioners.

165 words

Critical Evaluation

Value of the Information & Strength of the Argument

The information is highly valuable for AI users, offering real-world performance data beyond official benchmarks. The blind-testing methodology is a strong point, reducing confirmation bias that often plagues model comparisons. The argumentation is solid: Pat Simmons clearly explains his test design, shows both successes and failures, and provides candid commentary on each output. He also contextualizes results with benchmark data, acknowledging discrepancies. The analysis is nuanced, recognizing that different models suit different tasks, and he avoids overhyping any single model. The inclusion of viewer-suggested tests adds practical relevance. The video’s structure—clearly segmenting coding vs. knowledge work—helps viewers understand the trade-offs. While not a controlled scientific experiment, the approach is transparent and the conclusions are reasoned, making the argumentation credible.

Scientific Rigor, Source Quality, Title Accuracy

The scientific rigor is commendable for a YouTube review: Pat Simmons conducts systematic testing with reproducible prompts (though not fully shared), uses blind conditions (though he later reveals which model he didn’t know for some tests, he sometimes guesses correctly, showing some awareness). The sources are primarily the models themselves and official documentation referenced indirectly; the video mentions benchmarks like Terminal Bench 2.1, Agent’s Last Exam, SweepBench Pro, and GDP Val, but specific source URLs are not provided, limiting verifiability. The description links only to his bootcamp and newsletter, which are commercial-oriented. The title is accurate, promising a ’no-hype’ review, which the content delivers. The video acknowledges potential tooling issues and invites correction, showing intellectual honesty. However, the lack of detailed citations for benchmark claims and the absence of a formal methodology appendix slightly reduce scientific rigor. Overall, it is a well-above-average technical review.

278 words

Title / Content Match

The title accurately reflects the content: a comprehensive, no-hype review and testing of GPT-5.6 Sol across multiple practical and knowledge-work tasks.

Quality & Reliability

8/10

The video provides extensive hands-on testing across 10 varied builds, with a clear blind-testing methodology and honest acknowledgment of limitations. While not a controlled scientific study, the approach reduces bias and offers practical insights, though reliance on personal observation and potential tooling issues tempers full reliability.

Chapters

Cited Sources

Contribution & Novelties

The video’s original contribution lies in its practical, blind-testing approach to evaluating a newly released AI model across diverse, complex tasks, providing insights that go beyond synthetic benchmarks. It also usefully explains the new multi-model release (Sol, Terra, Luna) and the ‘ultra’ reasoning mode with parallel agents. The interpretation of benchmark scores in the context of real-world performance is valuable.

60 words

Radar Profile

The scores indicate a well-rounded video with high information quantity and technical depth, but slightly lower reliability due to the informal, single-test nature. The quality of information is strong, reflecting thoughtful analysis and clear presentation, while the global reliability is moderately high, suggesting viewers can trust the general conclusions while remaining aware of the lack of controlled repetition.

Reliability 7/10

💬 positive - Sur les 30 commentaires analysés, l'accueil est très positif : les spectateurs saluent la méthodologie de test en aveugle, la qualité de l'analyse et la transparence, avec quelques demandes de tests supplémentaires et des corrections techniques mineures.