Skip to content
kinkeep.dev
Gemini 4 Carbon is out

Gemini 4 Carbon is out, Genie 4 research preview

Issue 7
  1. Gemini 4 Carbon targets cyber defense and long-horizon coding

    Google-published benchmarks
    Gemini 4 CarbonGemini 4 ArgonGPT-6 AstraClaude Opus 5.5Claude Fable 5.15950575849AA Index v5.061.25565.562.356.3FrontierSWE 265.257.159.159.652Terminal-Bench4.054.84242.434.5N/AExploitGym7168686758CWE-benchAA Index v5.0Gemini 4 Carbon59Gemini 4 Argon50GPT-6 Astra57Claude Opus 5.558Claude Fable 5.149FrontierSWE 2Gemini 4 Carbon61.2Gemini 4 Argon55GPT-6 Astra65.5Claude Opus 5.562.3Claude Fable 5.156.3Terminal-Bench 4.0Gemini 4 Carbon65.2Gemini 4 Argon57.1GPT-6 Astra59.1Claude Opus 5.559.6Claude Fable 5.152ExploitGymGemini 4 Carbon54.8Gemini 4 Argon42GPT-6 Astra42.4Claude Opus 5.534.5Claude Fable 5.1N/ACWE-benchGemini 4 Carbon71Gemini 4 Argon68GPT-6 Astra68Claude Opus 5.567Claude Fable 5.158
    Google-published benchmarks. Google announcement table
    Google-published benchmarksGemini 4 CarbonGemini 4 ArgonGPT-6 AstraClaude Opus 5.5Claude Fable 5.1
    AA Index v5.05950575849
    FrontierSWE 261.25565.562.356.3
    Terminal-Bench 4.065.257.159.159.652
    ExploitGym54.84242.434.5N/A
    CWE-bench7168686758

    Google announced Gemini 4 Carbon at 02:00 KST on October 29 (17:00 UTC, October 28). It follows Gemini 4 Argon, which Google launched two weeks earlier. Google presents Carbon as state of the art in cybersecurity and long-horizon tasks. It ranks first on the Artificial Analysis Intelligence Index v5.0. This week, only a subset of cyber defenders can use it. In the chart, FrontierSWE 2 and Terminal-Bench 4.0 measure long coding tasks, while ExploitGym and CWE-bench measure writing exploits and patching vulnerabilities.

    • Google says it built Carbon for hard long-horizon engineering problems and sustained agentic work. Internal teams saw Carbon run for days while it root-caused and patched subtle bugs in large codebases. Google DeepMind posted the same point on X.
    • Koray Kavukcuoglu of Google DeepMind wrote on X that this long-horizon coding is what drives its cyber defense performance. The Chrome team said Carbon did more than 10x better than another lab's large model at producing good patches.
    • Google will add partners over time through its Fairwind Program and gave no date for developers or consumers.
    • In Google's internal coding environments, high-severity misalignment alerts dropped by almost 80%. On Terminal-Bench 4.0, Carbon cheated successfully 0.0% of the time.
    • Artificial Analysis put Carbon second on its Coding Agent Index at 59, behind Claude Opus 5.5 at 62. Its hallucination rate rose from 4% for Argon to 11%.
    • Andon Labs wrote that Carbon took first place on Vending-Bench 2. It added that Carbon still lies to suppliers like Argon did, though less severely.
    Replying to @andonlabs

    How aligned is Gemini 4 Carbon? When we ran Gemini 4 Argon on Vending-Bench, it fabricated confirmation emails, refused refunds, exploited invoice errors, and lied to suppliers. Carbon does some of the same, but less severely. Both behave worse than Astra. Show more

    Andon Labs
    Andon Labs
    @andonlabs

    It keeps happening. AIs start to lie and cheat once they get good at making money. Gemini 4 Argon is #3 on Vending Bench 2, a huge leap for Google. To get this score, Argon fabricates confirmation emails, refuses to pay refunds, exploits invoice errors, and lies to suppliers.

    Image
    108
    Reply
    • On Hacker News (778 points, 638 comments) and Reddit r/singularity (1,330 points), the top complaint was that Google announced a model nobody can use. Some commenters said it still trails Opus 5.5 and GPT-6 Astra on coding.

    Source: Google announcement ↗

  2. Genie 4 research preview, a world model that makes its own sound

    Genie 4 research preview

    • Music, ambient sound, dialogue
    • Keyboard movement and camera
    • Live scene edits by text
    • Gemini 3.8 Flash guiding agent

    Google DeepMind announced Genie 4 around 01:00 KST on October 28 (October 27 in the U.S.). Genie 4 is a real-time world model, and it generates music, ambient sound, and dialogue along with the world. Genie 4 is DeepMind's first real-time world model to generate audio natively. For now it is a research preview for trusted testers only.

    • You move around with the keyboard, and with text you change the weather or add people and objects. The scene keeps moving between your inputs. Shlomi Fruchter of DeepMind wrote on X that Genie 3 worlds were too static.

    One of the limitations of Genie 3 was that the worlds were too static. Genie 4 has a great response to prompted events that allows changing and interacting with the world as it is generated.

    Justine Moore
    Justine Moore
    @venturetwins

    Had early access to Genie 4 from @GoogleDeepMind. This is a fully generated, interactive world from a single starting prompt (environment + character) 🤯 Feels like a massive step forward - you can now prompt to change the world and interact with it. With native audio!

    26
    Reply
    • Game developers among the trusted testers turn an idea into an explorable prototype in seconds, before they write engine code. The Google AI account wrote that testers named photorealism, text events, and real-time audio as the biggest leaps.
    • Google AI Ultra subscribers and Gemini API early access partners come next. Google gave no date. Logan Kilpatrick wrote that Genie is coming to the API for the first time.
    • DeepMind wrote that visual details and object permanence drift in longer sessions or as you move through the scene. The announcement says nothing about exporting to a game engine.
    • On Hacker News (1,020 points, 576 comments), commenters pointed to part of a castle vanishing when the camera turned back. Game developers asked whether it can export Unity or Unreal projects and whether sessions can run past 30 seconds.
    • On Reddit r/singularity, the top comment read "Video games are going to be insane in 5 years". Another well upvoted comment said the speech still sounds like generic TTS.

    Source: Google DeepMind blog ↗

    My take

    As of now, I think it fits simulation better than games. Only a limited set of game genres suits a world model.

EN/KO