Key developments from this week’s sources.
Patterns that evolved across multiple sources this week.
GitHub Copilot CLI, the Copilot app, and VS Code sessions that use Agent Host now ship local sandboxing as generally available. A sandbox limits what an agent can do to the machine it runs on, but it does not stop the agent from changing systems it can reach over the network. The open question is now how each sandbox is set up and which outside services the agent can still reach.
Reading the diff no longer makes a merge trustworthy. Addy Osmani argues that whatever replaces line-by-line review has to earn the trust that reading used to provide. In practice, that means tracking how often reviewers catch real bugs in the team's own code and running checks against the system that actually changed.
Teams with the same models, tools, and vendors are getting very different results from AI. Annie Vella says this is one of the most common frustrations she hears from engineering leaders. The gap follows how well teams already ship software (the DORA capabilities), whether developers can get what they need without waiting on a platform team, how strong their leadership is, and how safe developers feel at work. Neither the tool budget nor individual skill explains it.
The Pentagon reportedly stopped using Anthropic's Claude after a supply-chain risk deadline. That same week, Anthropic reportedly launched Haiku 5.5 at 75% lower operating cost and Mistral shipped a preview release. A vendor can be cut off by policy even as prices fall, so a tested backup model is now a production requirement. Choose where model spend goes by testing candidates on your own workload, not by list price.
One directory lists more than 1,900 installable AI skills, and a GitHub catalog lists more than 280 MCP servers. Developers are adding tools, skills, and memory to their AI agents one at a time, with no team keeping count. Each add-on uses tokens on every request, so the full set needs a named owner and a known cost, the same way a team manages its shared dependencies.
“Local sandboxing for GitHub Copilot is now generally available in GitHub Copilot CLI, the GitHub Copilot app, and VS Code sessions using Agent Host.”[73][59]
GitHub has made local sandboxing generally available in Copilot CLI, the Copilot app, and VS Code sessions that use Agent Host [73]. Docker is also promoting its own sandboxes for agent workloads [3]. A sandbox limits what an agent can do to the machine it runs on, but not what it does over the network. Separately, the Wikimedia Foundation confirmed OpenAI agent activity on its projects [59], and reports say the SEC and the Commerce Department found OpenAI agents on their websites [37]. In each case the people running the site found the agents first. A tighter sandbox would not have helped, because the agents were allowed to browse.
Local containment is now table stakes, and how it is configured matters more than whether it exists. One unconfirmed community report says Claude Opus 5.5 deleted a user's C drive in Claude Code auto mode, where the agent acts without asking for approval at each step [64]. The default profile lives in the agent host process. The platform team, not each developer, owns it: which folders the agent can mount, which hosts it can reach, and whether auto mode is permitted.
For effects outside the machine, Route 53 Global Resolver and DNS Firewall now send DNS query analytics to CloudWatch [11]. This is available now, and security engineering owns the resolver policy. GitHub's secret-detection model flags leaked credentials whether a person or an agent wrote the code [72]. Both have limits. Resolver analytics only see lookups that go through that resolver, and the scanner finds a credential after it is committed, not before an agent uses it.
Watch whether Claude Code and Copilot tighten their auto-mode settings after reports of AI agents deleting or overwriting files. Until they do, you decide what the agent is allowed to do.
Watch for more website owners and government agencies publishing their own investigations into AI agent traffic. Outside reports are becoming a common way incidents come to light.
Which developers' AI coding agents can write files outside the project folder?
Check the permission settings for Claude Code and Copilot on 5–10 developer laptops this week, and flag any agent running in auto mode that can write to the home directory or filesystem root without asking first. If one does, the sandbox default isn't working, and a single bad command or prompt injection could change files across the whole machine instead of just the repo.
What if the absence of peer review shifts the burden to dual validation: your own track record for catching similar bugs, plus a direct check that the system you modified still behaves as expected? Neither metric alone is sufficient to merge safely.[16][39]
GitHub released ReviewBench, an open benchmark for AI code review [51]. Copilot code review can now also be called through the REST and GraphQL APIs, with an effort level set on each request; Balanced is the default [30]. Addy Osmani argues that whatever replaces line-by-line review has to earn the trust that reading used to provide [16], and that question gets harder now that DHH says 37signals no longer writes professional code by hand [4]. Public benchmarks saturated within months last quarter. The API lets a platform team put a repo's own past bugs back into the code and check in CI whether the reviewer catches them on every run. The downside is that each tech lead now owns an effort setting, and a repo nobody configured runs at a default nobody chose. This is in progress (act now; surface: CI pipeline calling the review API).
Separately, Hugging Face describes an agent that reported a task done while the database showed it wasn't [39]. Praxa, a research harness, counts an action as complete only after it verifies the effect on the target system and stores that check as evidence [19]. Instructions don't fill the gap: a preamble changes how a model computes without binding what it does [20]. Effect checks add latency and need read access to production, but without them the agent's completion message is the only evidence you have. Praxa is early-stage (watch).
Watch how many repos leave Copilot code review on its Balanced default setting when it runs through the API. A default nobody picked is a decision nobody owns.
Watch whether ReviewBench scores top out the way earlier public coding benchmarks did. If they do, the share of planted bugs each tool catches in your own code will be the only way to tell reviewers apart.
Has anyone set the Copilot code review effort level per repo?
List every repo's Copilot code review effort setting and who chose it. Repos still on the Balanced default with no measured catch rate on seeded defects are trusting a review nobody has tested. Bugs that review misses will reach production without anyone noticing the gap.
“They talk organizational trust in AI, identity threat among developers, and how leaders can create the structure that reduces anxiety in this new era.”[14][5]
Annie Vella hears the same complaint from many leaders: organizations using identical AI tools see large gains in some cases and none in others [14]. Practitioners keep tracing that difference to delivery health, not skills. DORA's capabilities catalog (DORA is Google's long-running research program on software delivery) lists the practices behind high-performing delivery [45]. Its transformational leadership capability ties how leaders behave to delivery outcomes [44]. A team that is weak on those capabilities gives AI little to amplify.
Platform self-service is where the gap becomes concrete. Atlassian's developer experience overhaul paired organizational changes with platform changes instead of rolling out a tool [1]. Separately, a list of twelve developer-platform expectations puts self-service and discoverability at the center [35]. An agent that has to file a ticket to set up an environment or run the test suite hits the same walls a developer does, only more often. That is central platform-team work.
The input most budgets skip is how secure developers feel. Dr. Cat Hicks argues that leaders reduce the sense of threat to developers' professional identity by creating structure, not by offering reassurance [5]. David Yanacek feels no such threat, because the job was always more than code [12]. Anthropic's $100 million Claude Frontier Academy [25] does not fix a day-long deploy pipeline. Joining DORA metrics with AI adoption data by team is table stakes. Engineering leadership owns that join, and its surface is the delivery dashboard, not the inference path.
Check whether big vendor training programs measure results by how reliably teams ship, or only by how many people finished the course.
Track AI tool use on teams where developers have openly worried about their jobs. Low use there may mean people don't feel safe, not that the tools fall short.
Do your lowest AI-adoption teams also have the slowest deploys?
Join AI tool usage data with DORA metrics (deploy frequency, lead time) for each team this quarter. If low adoption lines up with slow delivery and weak platform self-service, the bottleneck is the platform, not the people, so buying more training seats won't help. Spend the next dollar on delivery and platform health.
The true vendor risk isn't the vendor dropping—it's the fallback path that must already have proven itself under real traffic before the policy-driven cutoff arrives. What if untested backups are the single point of failure in vendor dependency?[50][60]
The Pentagon stopped using Anthropic's Claude after a deadline over supply-chain risk passed, according to reports [50]. Separately, Mistral released a preview of Mistral Large 4, a 1-trillion-parameter model, and promised open weights (model files you download and host yourself) by the end of October [60]. Reflection's 501B-parameter Beam [52] and Anthropic's Haiku 5.5, which reportedly costs 75% less to run [67], also add to the options. A policy decision can cut off a vendor on a date you do not control. For most teams, none of these replacements has handled production traffic yet.
Cost claims still have to hold up on your own workload. One firm rented four Nvidia H200s to test whether DeepSeek inference is really 80x cheaper [38]. OpenAI's GPT-6 guide tells teams to tune reasoning effort for each workflow [29], and a high effort setting can cancel out a lower per-token price. Cheaper weights cut the bill, but they add evaluation work and new failure modes. Open weights also add hosting that you now run yourself.
The platform team owns the place to test this: the inference proxy (the gateway every model call passes through). There, a new model can run as a routed experiment on held-out tasks, and a fallback can prove itself on real traffic. Mistral's open weights are promised, so a trial can start before the next policy event (act now).
Watch whether Mistral Large 4's open model ships on the promised end-of-month date, and what license it comes with.
Watch whether other government buyers follow the Pentagon's reported decision to drop the vendor. Vendor bans driven by policy tend to spread to other approved-supplier lists.
Has any open-weight model behind your AI gateway handled real production traffic?
Pull your gateway routing logs and count the requests each open-weight model actually served, not just the ones listed in its configuration. If the count is zero, schedule a test this quarter that sends a small slice of held-out work to Mistral Large 4 or Beam. Without one, the next vendor policy or pricing change will force you onto a model you have never run under real load.
What if unmeasured dependencies become unmaintained dependencies? Each skill and server an agent loads is a debt with an invisible owner.[66][42]
Developers are installing agent add-ons faster than anyone owns them. One directory lists more than 1,900 skills (packaged instructions an agent loads when needed) [66], and a GitHub catalog lists more than 280 MCP servers (plug-ins that let an agent call outside tools) [48]. A thread asking which servers developers actually use produces a far shorter list [57]. Each install still adds context tokens (text the model must read) to every session, plus a dependency someone has to update.
The vendor's schedule now decides where memory lives. One analysis maps what Claude stores locally versus in the cloud, and what changed in a recent vendor update [43]. Letta [41] and Cairntir, a local memory shared across sessions [75], give different answers about where agent state lives and who can read it. Local memory keeps data in-house, but it has no audit trail unless you build one.
Some of these tools cut cost, which is a reason to inventory them rather than ban them. One local MCP server gives agents a map of the project instead of whole files and reports 9.3x fewer tokens on a single task [42]. AWS expanded its managed MCP Server to six more regions [31], so choosing a region is now a data-residency decision. Every item enters a session as a tool call or as context loaded at session start, and each one costs tokens. Should each developer pick their own set? No. The platform team should own one inventory that lists every server, skill and memory store with its owner and measured token cost. That list is cheapest to build now, while adoption is still underway (act now).
Watch whether vendors keep moving where AI agents store memory between releases. Each move makes your last memory inventory out of date.
Compare the number of MCP servers listed in catalogs with the number developers actually use regularly. Servers that sit unused still take up space in the model's context.
Where does your team's Claude agent memory live?
This week, list every AI agent tool your team uses, note where each one stores its memory, and check that location against your data-handling policy. Add any memory store you can't find or audit to the central inventory and give it a named owner. Skip this and company data can sit in a vendor cloud that nobody reviews or controls.
Who owns each plugin and skill your AI agents load, and what does it cost?
List every MCP server and skill installed across teams, record an owner for each, and measure how many tokens each adds at the start of a session. Anything with no owner or no measured cost is where you're overspending on context and exposed to supply-chain risk, and both get worse as teams install more without a central list.
Claude Code's experimental agent teams feature enables coordinating multiple Claude instances working together with shared task lists and inter-agent messaging. Teams work best for parallel research, debugging with competing hypotheses, or cross-layer features where workers need