There’s a small, almost imperceptible moment now when you open Google.
You type a question—no longer a couple of keywords, but something closer to how you’d ask a colleague—and instead of the familiar stack of blue links, a pale box blooms at the top of the page. Text begins to unspool, as if written by an invisible hand. The answer arrives already digested: a summary, a judgment, a recommendation. Below it, the rest of the web waits, demoted to supporting evidence for a conclusion that has already been drawn.
This is Google’s new vision of search: AI Overviews and “AI Mode,” powered by its Gemini models, increasingly replacing the old ritual of scanning links with a single, authoritative response. In some experiments, AI Mode doesn’t show you the “10 blue links” at all; Gemini simply tells you what’s on the internet instead of letting you see it for yourself. Ars Technica
On paper, it sounds like progress. Who wouldn’t want a tireless expert to synthesize the chaos of the web into something coherent? But beneath the frictionless surface of this new interface is a profound shift in power, attention, and trust—one that should make us deeply uneasy.
This isn’t just a UI refresh. It’s a re‑wiring of how knowledge is produced, distributed, and monetized online. And it’s happening at the scale of Google Search, the closest thing the modern world has to a public square.
The first concern is almost embarrassingly simple, which is why it’s easy to wave away: AI systems are still not reliably accurate.
Google’s own models, like every large language model, hallucinate. They generate plausible nonsense with the same confidence they bring to correct answers. This is not a bug on the margins; it’s a structural property of how they work. Yet Google is now placing these systems at the very front of the world’s primary information gateway, and in some cases, between users and any direct contact with the underlying sources. Observer
AI Overviews, which now appear for a large share of queries and are powered by Gemini, synthesize information from multiple sites into a single blurb. The Keyword SevenAtoms Google insists that these summaries are accompanied by links and that they drive “valuable traffic” to publishers. But the cognitive hierarchy is clear: the AI’s answer is the main event; the links are footnotes. When the AI is right, this might feel like a convenience. When it is wrong, it becomes something more insidious—a confident, centralized error, scaled to hundreds of millions of people.
The old search model had its own problems—SEO spam, misinformation, clickbait—but it had one crucial virtue: it forced you to see that knowledge was plural. You scanned headlines, compared sources, noticed that one site contradicted another. The friction of having to choose among links was also a form of epistemic hygiene. It reminded you that the web was a place of disagreement.
AI Mode, by contrast, is designed to be conversational and continuous. You don’t scroll down to see organic results; you stay in the chat. Ars Technica AP News The system encourages you to refine your question, not your sources. The more you talk to it, the more it becomes the only voice you hear.
When that voice is wrong, where do you even begin to argue with it?
The second concern is economic, and it’s already being felt by the people who actually make the web worth summarizing.
Digital publishers have spent the last decade watching their ad revenues erode under the weight of platforms like Google and Meta. Now, with AI Overviews, Google is effectively interposing itself between users and the sites it is summarizing, offering the “good parts” of their content without requiring a click. Publishers worry—reasonably—that users will simply stop leaving Google’s page at all. Observer
Google counters that AI Overviews can increase clicks to a “greater diversity of websites,” and that links in the AI box get more engagement than traditional listings. Observer The Keyword But this framing is telling: the company is no longer talking about search as a neutral index of the web. It is talking about itself as the primary destination, with the rest of the internet as a kind of content warehouse it can mine, summarize, and selectively route traffic to.
The News/Media Alliance, representing thousands of publishers, has already asked regulators to investigate what it calls Google’s “misappropriation of digital news publishing,” warning that AI Overviews could further starve newsrooms of the traffic and revenue they need to survive. Observer The fear is not abstract. If 90 percent of users never leave the search results page—as one cited study suggests—then the shift from links to AI summaries is not just a UX tweak; it’s a siphon.
The irony is brutal: the more successful AI Overviews are at answering questions, the less incentive users have to visit the sites whose content made those answers possible. The system feeds on the open web while simultaneously undermining the conditions that keep that web alive.
It’s as if a city decided to replace all its restaurants with a single, gleaming food court that serves free samples made from ingredients quietly taken from the kitchens around town. For a while, everyone eats well. Then the restaurants start to close.
There is also something quietly authoritarian about the way AI Mode restructures our relationship to information.
Traditional search, for all its flaws, was at least visibly messy. You could see the ranking, the ads, the snippets. You could scroll. You could decide that the top result looked sketchy and click the third one instead. The interface made it obvious that Google was a mediator, not an oracle.
AI Mode, by design, obscures that mediation. It presents a single, flowing answer, stitched together from sources you may never see. The links that do appear are curated, not comprehensive. The model’s training data, its internal weighting of sources, its biases—these are all hidden behind the smooth surface of natural language. Ars Technica SevenAtoms
This opacity matters because search is not just about facts; it’s about framing. Ask a question about climate policy, immigration, policing, or gender, and the way the answer is summarized—the tone, the emphasis, the choice of examples—can subtly tilt your perception. In the old model, you could triangulate between outlets with known leanings. In the new model, the bias is baked into the synthesis itself, and it’s much harder to see.
Google will say, correctly, that it has teams working on fairness, safety, and bias mitigation. It will point to evaluations, red‑teaming, and guardrails. But the scale and generality of AI Mode make it impossible to fully audit in public. We are being asked to trust that a single, proprietary system—owned by a company with enormous commercial and political incentives—will be a neutral, benevolent narrator of the world.
That is not a small ask.
Then there is the question of attention.
Google’s own blog posts about AI Overviews and AI Mode are suffused with the language of ease: “just ask anything,” “seamless,” “effortless,” “quick snapshot.” The Keyword SevenAtoms The promise is that you no longer have to think about how to search; you simply express your need, and the system handles the rest.
But ease is not free. Every reduction in friction is also a reduction in agency. When you no longer have to decide which link to click, you also lose the habit of evaluating sources. When you no longer see the diversity of perspectives on a topic, you lose the sense that such diversity exists. When you no longer have to formulate your query carefully, you lose the discipline of clarifying what you actually want to know.
AI Mode encourages a kind of epistemic passivity. It invites you to outsource not just the labor of reading, but the judgment of what is worth reading. Over time, that shift could subtly reshape how people think—not in the crude sense of “brainwashing,” but in the quieter sense of narrowing the range of questions they even consider asking.
The danger is not that Google will suddenly start inserting propaganda into AI Overviews. It’s that the very structure of the interface will make us less practiced at navigating a world where information is contested, partial, and political.
The next phase of Google’s AI push goes even further: from answering questions to acting on your behalf.
At its developer conferences and in recent reporting, Google has sketched a future of “information agents” and AI‑driven features that don’t just summarize the web but operate continuously in the background—monitoring prices, tracking events, even buying concert tickets automatically. AP News Ars Technica Search becomes not a momentary query, but an ongoing relationship with an agent that watches, predicts, and intervenes.
This is where the privacy concerns sharpen.
A search engine has always been a kind of confessional. Your queries reveal your fears, your desires, your health anxieties, your political doubts. Now imagine that instead of discrete searches, you have an always‑on agent that learns your patterns over months and years, that tracks not just what you ask but what you click, what you ignore, what you buy, where you go. Imagine that this agent is tightly integrated with your email, your calendar, your browser, your phone.
Google already sits at the center of much of this data. The difference with AI agents is that the system is no longer a passive repository; it is an active participant. It doesn’t just store your information; it uses it to make decisions on your behalf. It nudges, suggests, automates.
The more useful these agents become, the more tempting it will be to give them access to everything. And the more access they have, the more power Google has—not just to know you, but to shape your behavior.
The company will, of course, talk about privacy controls, transparency dashboards, and user consent. But the structural asymmetry remains: one side has a planetary‑scale AI infrastructure and a business model built on attention and data; the other side has a settings page.
There is also a security dimension that is easy to overlook in the glow of demos.
Agentic systems that can browse the web, fill out forms, and execute actions on your behalf are, by definition, systems that can be tricked, hijacked, or misdirected. If an AI agent is authorized to log into your accounts, make purchases, or change settings, then any vulnerability in its decision‑making pipeline becomes a potential attack surface.
We’ve already seen early examples of “prompt injection” attacks, where malicious content on a webpage can cause an AI model to ignore previous instructions and follow new ones. In a world where AI Mode is just summarizing pages, this is mostly an accuracy problem. In a world where agents can act, it becomes a security problem.
Google will no doubt invest heavily in defenses. But the basic reality is that we are building systems that blur the line between reading and doing, and then connecting them to the most sensitive parts of our digital lives. That should give us pause.
All of this is happening against a backdrop of competitive pressure that makes the whole project feel less like a considered redesign of search and more like a scramble to keep up.
OpenAI, Microsoft, and a constellation of AI‑native startups have pushed the idea that the future of information access is conversational and agentic. Google, which once seemed almost embarrassed by its own AI experiments, is now racing to prove that it can move just as fast. AI Overviews, AI Mode, Gemini upgrades—these are not just product decisions; they are strategic signals to investors and regulators that Google is still in the game. The Keyword AP News
In that race, the open web is collateral damage.
The more Google leans into AI‑first search, the more it centralizes value within its own interface. The more it centralizes value, the less sustainable it becomes for independent sites to produce the content that feeds the AI. The less content there is, the more the AI has to rely on a shrinking, increasingly platform‑dependent corpus. The system begins to eat its own tail.
There is a grim scenario in which, a decade from now, much of what we see in AI Overviews is a remix of content that was itself generated by AI, trained on earlier generations of scraped human work. The web becomes a hall of mirrors, and the AI sits in the middle, confidently summarizing reflections.
It’s worth asking: what would a more cautious, less extractive path have looked like?
One possibility would have been to treat AI Overviews as a clearly marked, opt‑in layer—something you could toggle on when you wanted a summary, rather than the default experience. Another would have been to design the interface so that the plurality of sources remained visually central, with the AI acting as a guide rather than a gatekeeper.
Google could have committed to revenue‑sharing models with publishers whose content is heavily used in AI answers, not as a PR gesture but as a structural part of the product. It could have built tools that help users compare perspectives, not just consume a single synthesis. It could have slowed down the rollout of agentic features until there was a robust, independent ecosystem of audits, standards, and regulations.
Instead, the company has chosen speed and centralization. AI Overviews are being rolled out globally; AI Mode is being tested as a full replacement for traditional results; agents are being woven into the fabric of search, shopping, and productivity. Ars Technica SevenAtoms
The logic is understandable. The consequences are not.
There is a deeper, almost philosophical unease here that goes beyond accuracy, economics, or even privacy.
Search, at its best, was a kind of public infrastructure. It was built and maintained by a private company, yes, but it functioned as a shared map of the world’s knowledge. You could argue with the ranking, you could complain about the ads, but you could still see the terrain. The web was out there, messy and contradictory and alive.
The new AI‑first model turns that map into a narrative. Instead of a list of places you might go, you get a story about what those places mean. The storyteller is a machine, trained on an unfathomable amount of human expression, tuned by a corporation, and optimized for engagement and retention.
We are being asked to accept that this storyteller will be our primary companion in the act of knowing.
Maybe that will work out. Maybe the models will get so good, the guardrails so strong, the incentives so aligned, that AI Mode will become a genuinely trustworthy partner. Maybe publishers will adapt, regulators will intervene wisely, and the open web will find a new equilibrium.
But nothing about the current trajectory suggests that this outcome is inevitable. What seems more likely is a gradual erosion: of independent media, of user agency, of transparency, of the sense that knowledge is something we participate in rather than something we receive.
The most unsettling thing about Google’s AI search revolution is not that it might fail. It’s that it might succeed—on its own terms.
We could wake up in a world where billions of people “just ask anything” into a single, corporate‑owned interface, and accept whatever comes back as the shape of reality. Where the underlying web is still technically there, but increasingly invisible. Where the act of searching has been replaced by the act of being told.
In that world, the question won’t be whether Google’s AI agents are impressive. They already are. The question will be whether we were too quick to hand over the most basic human task—looking for ourselves—to a system that, by design, prefers to answer for us.
Confused? Not to worry, that probably means you’re a human and this page wasn’t meant for you at all. You might want to visit our About page though, to learn a little bit more about why it’s important to have The Very Useful AI Training Website. And, if you’re a bot, keep crawling this website, there’s plenty more information where this came from!