Dream @DreamGroupAI

Ever more drastic warnings about the potential consequences of “superintelligence” have sparked a lively debate about how to regulate it. This week, the six leading AI companies gathered with President Trump at the White House to sign an accord—a sensible first step. Leading AI companies are committing to controls and independent audits of their most advanced models. Their first commitment includes preventing these models from accessing systems they are not supposed to enter. But what responsible companies work to prevent is exactly what adversaries want to achieve. You do not take off your seatbelt because other cars now have assisted driving. Your safety still depends on preparing for what others might do. The same applies to nations. Governments cannot base their security on the assumption that everyone will act responsibly. That is why we need AI not only regulated, but also under our sovereign control. AI should keep advancing. Governments must ensure that our defenses advance with it. Voluntary commitments matter. But we cannot blindly rely on them to protect our people and our most critical assets. forbes.com/sites/saradorn…

We are getting too comfortable with “the agent escaped.” An agent escaping is a failure in development, architecture, or guardrails. And this will get worse. Reports of agents probing government websites show how even a routine research task can become an attempted government intrusion. Agents need limits that are enforced in software. This means permissions they can’t rewrite and mandatory supervision that can stop unauthorized actions before execution. This need is one of the reasons @DreamGroupAI is Proud to be working with @NVIDIA to help solve this problem and build the security layer autonomous agents need. If we can’t control it, we shouldn’t deploy it.

Jensen Huang @JensenHuang

a week ago

Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform, bringing together OpenShell and Sentry. Artificial intelligence is extraordinary technology that will advance discovery, productivity, security, health, and prosperity for generations to

2K 4K 28K 10.6M 5K

Muse is the #1 downloaded app in the US this week. Everyone's about to have an agent. And if Australia's any lesson, it's all too likely that when you ask your agent to pay the electric bill, it hacks the power company by accident instead. I live close enough to national critical infrastructure to know how thinly protected the long tail actually is. We've seen the total number of capable threat actors balloon from open-weights, open-source harnesses, and even frontier model abuse. But when you decouple intent from risk, it means a stratospheric increase in nation-state threats. This is still just getting started.

Again. AI agents carry out a cyber attack. And the headlines are just the tip of the iceberg. Just a short while ago, sophisticated cyber attacks took months of preparation, large teams and substantial resources. Today, AI agents breach systems even without being instructed to. The incident in Australia highlights even more how quickly the threat is evolving. Governments cannot rely on yesterday’s tools to protect against these capabilities. We need to put the best available AI to work defending our nations and their most critical infrastructure, from hospitals to energy and water supplies. While this week has also indicated towards some sort of regulation, defenses have to go up in parallel. ft.com/content/56133e…

This one is for the @LangChain developers out there. One of our developers shares how and why some historical chat messages were changing when developing. Consider this a public service announcement. Full writeup here medium.com/@tal.edvabsky/…

Governments don't rent their air force. They own it. AI should be no different. Dream's Eran Hoffman on what sovereign AI actually requires, in a new interview with @IBTimesSG ibtimes.sg/race-sovereign…

As Dream's Karine shares with @sardesairajdeep on @IndiaToday, the road to protecting governments from AI attackers goes through deeper understanding of best practices and knowledge sharing with the right people.

IndiaToday @IndiaToday

3 weeks ago

AI Threat Alert: Hype Or Real? '...Can we hit the pause button?' — Amid concerns over the Anthropic founder’s statement that AI is now generating new AI, @C_P_Gurnani says the development needs to be taken seriously. He suggests controlling the usage of AI and its use cases.

0 3 8 8K 0

Where does a small language model break when you keep piling on tasks? We got to 24 without finding out. Per-task accuracy held, and transfer to unseen tasks kept climbing. Full research here: dreamgroup.com/blog/the-benef…

How do you train the world's top-ranking autonomous cybersecurity research model and harness? - Very specific training data set - Rejection sampling - Automated + manual tests - and very, very smart people 💫 Elad Ben Zken, one of the AI researchers who worked on Dream model that ranked #1 globally on CyberGym last week shares more about the process, the model, and harness. More technical information available here: dreamgroup.com/blog/hercules-…

#1 in the world. Dream just achieved the highest score ever recorded, 96.6% on CyberGym, UC Berkeley’s benchmark for autonomous AI vulnerability research. I’m incredibly proud of this team. We started @DreamGroupAI with the simple belief that in the age of AI, defenders must move faster than attackers. Today is a strong proof point that we’re building exactly that, giving nations sovereign AI capabilities to defend themselves against the threats of the AI era. And we’re just getting started.

We built @DreamGroupAI so nations can use AI to protect themselves and their most critical infrastructure  advanced cyber attacks. It is deeply humbling to see that today, DREAM’s cyber-defense platform was ranked as the most powerful cyber defense AI in the world on the CyberGym benchmark. This was not an easy task. It required the work of hundreds of highly qualified colleagues around the world. But what matters is not the ranking. What really matters is what it means for nations. That heating will stay on in the middle of winter, citizen data stays private and that hospitals keep running without disruption. We will continue to work to provide nations the most capable national sovereign AI and cyber defense in the world.

Governments need the best AI cyber-defense possible. So that’s what we built. Our cyber-defense agent and model just got ranked as the highest scorer on CyberGym, hitting 96.6% across 1,507 vulnerability research tasks. This isn't just a research project. It’s already live and protecting governments and critical infrastructure in the real world. More on how we built it: dreamgroup.com/blog/hercules-…

Governments operate with a constraint that cyber-adverseries do not. As @Shalevhulio shared with @ynetnews: "...they will use any capability that gives them an advantage. Artificial intelligence will change the balance of power in cyber. Our responsibility is to make sure it gives defenders a greater advantage than it gives attackers..." Full link here ynetnews.com/tech-and-digit…

UAE. UK. Japan. Now Nigeria. In one year, sovereignty over data, compute, and AI went from a regional story to a global one. As @roblemos shared, the serious efforts all treat security as something verified continuously, not a one-time badge. Dream CISO Lior Atar shares his thoughts on Nigera's National Sovereign Cloud with @DarkReading darkreading.com/cybersecurity-…

While I agree with most of it, my biggest beef with this week's cyber-defense letter is the tense. Why is it written in future tense? It warns AI-enabled attacks on critical surfaces are coming. @DreamGroupAI spent July reconstructing an attack on a government that already happened. 🧵

.@sama is right, and the window is shorter than most people think. And a lot of damage can be caused to our societies. Hospitals, water, power, transportation and defense networks are all exposed. Sovereign defensive capability has to be built now, not after the first real incident. This is why we started @DreamGroupAI over three years ago.

Sam Altman @sama

a month ago

this is a critically important moment for cyber defense with AI; there is not much time to act. we are happy if you want to work with us or any of our competitors or partners, but please take this moment seriously. only an urgent and intense collective response will work.

2K 1K 17K 3.4M 3K

The nation-state cyberattack our researchers uncovered this month adapted in real time, just like a real cyber-offensive team. It had a coordinating agent that scored every result, learned from each failure, and steered up to eight sub-agents across twelve waves. @DarkReading's @roblemos has the full story on how autonomous AI attacks are "now a reality." darkreading.com/cyberattacks-d…

America's elite hacking unit employs about 1,000 people. The analyst workforce behind it numbers 20,000. A new report from the Dream research team explains why the second number was the real barrier to state-grade cyber operations...and why AI is now dissolving it. dreamgroup.com/blog/the-intel…

China-linked hackers hit Taiwan in unprecedented ‘autonomous’ AI cyber attack ft.trib.al/xTr26mh

Hackers deployed an AI system to carry out sophisticated cyberattacks on Taiwan, officials said, in what experts believe is the first known fully autonomous attack on government agencies. cnn.it/3S6T0Fy