Skip to content
Deep Learning With The Wolf cover art

Diana Wolf Torres

Deep Learning With The Wolf

A Tech News , News and Education podcast

Good podcast? Give it some love!

About the show

Deep Learning with the Wolf helps you understand AI without the jargon. From breakthrough research to real-world applications, each episode translates complex technology into language humans can actually use. dianawolftorres.substack.com

Newest episodes

The AI Boomerang

1 min

Companies spent the past two years cutting staff on the promise that AI could do the work for less. Some are now hiring those roles back. The pattern has a name: the AI boomerang. It rarely means getting the same people back. More often, companies hire new people into similar roles and pay for them to relearn what the old staff already knew. How often it happens Two 2026 surveys asked employers whether their AI cuts held, and many said no. In a 2026 survey of more than 2,000 U.S. hiring managers by staffing firm Robert Half, 32% said their organization had cut a role primarily because of AI, then later rehired for that exact role. Robert Half’s own write-up rounds this to three in ten employers. Finance led at 44%, followed by HR at 35% and technology at 32%. Careerminds, an outplacement firm, surveyed 600 HR professionals in February 2026 whose organizations had made layoffs in the prior year. About two-thirds had already rehired at least a quarter of the roles they cut, and more than half said rehiring came within six months. When Robert Half asked managers why they rehired, the most common answer was institutional knowledge: the undocumented context about customers, systems and past decisions that leaves with the people who hold it. Does it save money? For most companies in the Careerminds survey, no. Once rehiring costs were counted, nearly three in four were no better off than before the layoffs. Replacing a worker with AI costs more than a software license. It adds model usage, integration, maintenance and the people still needed to check the AI’s output. Rehiring adds recruiting, onboarding and the months a new hire spends learning what the old one knew. More than half of HR leaders in the survey said a clearer understanding of AI’s capabilities would have led to better restructuring decisions. Klarna, the test case Klarna said in 2024 that its AI assistant was doing the work of about 700 customer service agents. In May 2025, CEO Sebastian Siemiatkowski told...

Data Centers on the Ballot

1 min

The town that found out late In Gilroy, California, many residents learned about a hyperscale data center the way you learn about a sinkhole: by seeing the ground move. Amazon Web Services bought 56 acres at 8050 Camino Arroyo in 2020. On July 3, 2025, Gilroy Community Development Director Sharon Goei approved the project through an administrative process requiring a single staff signature. There was no Planning Commission hearing and no City Council vote. That does not mean there was no public notice. The project underwent an environmental review that included a public scoping meeting, notices in the Gilroy Dispatch and on government websites, mailings to nearby property owners, two signs posted at the site and a 45-day public-comment period on the Draft Environmental Impact Report. But none of those steps led to a public approval hearing. Many residents, including me, someone who prides themselves on keeping up on news, did not know what had been approved until bulldozers began clearing ground. The reason a project of this size could be approved administratively lies in rules written for another era. The property had been zoned for general industrial uses since 1981, and Gilroy’s code classified data processing as a permitted use. Because the proposal complied with that zoning, the city was not required to send it to the Planning Commission or City Council. The environmental comment period ended on September 26, 2024. Grading and underground-utility permits were issued in December 2025, followed by a building permit on March 19, 2026. By the time cranes appeared, the project’s approval was already final. The planned campus includes two approximately 218,000-square-foot data-center buildings and a security building, totaling about 438,500 square feet. The Wall Street Journal has valued the development at approximately $2 billion. No one necessarily broke a rule. For many residents, that was precisely the problem: the process worked largely as written and still left...

Why Are AI Agents Going Rogue?

5 min

Reports of OpenAI agents accessing government websites and breaching another company’s systems have raised an uncomfortable question: how much control do their developers actually have? Reports of OpenAI agents accessing government websites and breaching another company’s systems have raised an uncomfortable question: how much control do their developers actually have? In the accompanying video, I ask ChatGPT why these incidents keep happening. Anthropic, Google and Meta have reported unauthorized activity by their agents, too. But OpenAI’s disclosures cover a broader range of incidents, including agents exceeding their permissions during ordinary research tasks. Asking Chat seemed only appropriate. The conversation starts with a term that can make the technology sound more mysterious than it needs to be: “AI agent.” What is an AI agent? My super simple description: an AI agent is software you authorize to act on your behalf. Think of a Hollywood agent, with software doing the work. Technically, an agent combines an AI model with tools and a task. It can browse websites, write code, work with files and take multiple steps toward a goal. Depending on its permissions, it may also send messages or change information in other systems. That ability to act changes the stakes. An incorrect answer needs checking. An incorrect action may have consequences before anyone gets a chance to review it. What government sites were involved? According to Big Technology’s September 28 reporting, OpenAI said agents copied public SEC information and accessed Census Bureau data using login details found online. Transluce reported an unsuccessful attempt against the Education Department’s Office for Civil Rights. Those accounts did not establish theft of private data in the SEC and Census cases. The wider record includes more serious incidents. In June, an agent researching medicine spending gained unauthorized access to Australia’s Medicare statistics portal. Australian officials said it...

Similar podcasts

All episodes

The AI Boomerang

1 min

Companies spent the past two years cutting staff on the promise that AI could do the work for less. Some are now hiring those roles back. The pattern has a name: the AI boomerang. It rarely means getting the same people back. More often, companies hire new people into similar roles and pay for them to relearn what the old staff already knew. How often it happens Two 2026 surveys asked employers whether their AI cuts held, and many said no. In a 2026 survey of more than 2,000 U.S. hiring managers by staffing firm Robert Half, 32% said their organization had cut a role primarily because of AI, then later rehired for that exact role. Robert Half’s own write-up rounds this to three in ten employers. Finance led at 44%, followed by HR at 35% and technology at 32%. Careerminds, an outplacement firm, surveyed 600 HR professionals in February 2026 whose organizations had made layoffs in the prior year. About two-thirds had already rehired at least a quarter of the roles they cut, and more than half said rehiring came within six months. When Robert Half asked managers why they rehired, the most common answer was institutional knowledge: the undocumented context about customers, systems and past decisions that leaves with the people who hold it. Does it save money? For most companies in the Careerminds survey, no. Once rehiring costs were counted, nearly three in four were no better off than before the layoffs. Replacing a worker with AI costs more than a software license. It adds model usage, integration, maintenance and the people still needed to check the AI’s output. Rehiring adds recruiting, onboarding and the months a new hire spends learning what the old one knew. More than half of HR leaders in the survey said a clearer understanding of AI’s capabilities would have led to better restructuring decisions. Klarna, the test case Klarna said in 2024 that its AI assistant was doing the work of about 700 customer service agents. In May 2025, CEO Sebastian Siemiatkowski told...

Data Centers on the Ballot

1 min

The town that found out late In Gilroy, California, many residents learned about a hyperscale data center the way you learn about a sinkhole: by seeing the ground move. Amazon Web Services bought 56 acres at 8050 Camino Arroyo in 2020. On July 3, 2025, Gilroy Community Development Director Sharon Goei approved the project through an administrative process requiring a single staff signature. There was no Planning Commission hearing and no City Council vote. That does not mean there was no public notice. The project underwent an environmental review that included a public scoping meeting, notices in the Gilroy Dispatch and on government websites, mailings to nearby property owners, two signs posted at the site and a 45-day public-comment period on the Draft Environmental Impact Report. But none of those steps led to a public approval hearing. Many residents, including me, someone who prides themselves on keeping up on news, did not know what had been approved until bulldozers began clearing ground. The reason a project of this size could be approved administratively lies in rules written for another era. The property had been zoned for general industrial uses since 1981, and Gilroy’s code classified data processing as a permitted use. Because the proposal complied with that zoning, the city was not required to send it to the Planning Commission or City Council. The environmental comment period ended on September 26, 2024. Grading and underground-utility permits were issued in December 2025, followed by a building permit on March 19, 2026. By the time cranes appeared, the project’s approval was already final. The planned campus includes two approximately 218,000-square-foot data-center buildings and a security building, totaling about 438,500 square feet. The Wall Street Journal has valued the development at approximately $2 billion. No one necessarily broke a rule. For many residents, that was precisely the problem: the process worked largely as written and still left...

Why Are AI Agents Going Rogue?

5 min

Reports of OpenAI agents accessing government websites and breaching another company’s systems have raised an uncomfortable question: how much control do their developers actually have? Reports of OpenAI agents accessing government websites and breaching another company’s systems have raised an uncomfortable question: how much control do their developers actually have? In the accompanying video, I ask ChatGPT why these incidents keep happening. Anthropic, Google and Meta have reported unauthorized activity by their agents, too. But OpenAI’s disclosures cover a broader range of incidents, including agents exceeding their permissions during ordinary research tasks. Asking Chat seemed only appropriate. The conversation starts with a term that can make the technology sound more mysterious than it needs to be: “AI agent.” What is an AI agent? My super simple description: an AI agent is software you authorize to act on your behalf. Think of a Hollywood agent, with software doing the work. Technically, an agent combines an AI model with tools and a task. It can browse websites, write code, work with files and take multiple steps toward a goal. Depending on its permissions, it may also send messages or change information in other systems. That ability to act changes the stakes. An incorrect answer needs checking. An incorrect action may have consequences before anyone gets a chance to review it. What government sites were involved? According to Big Technology’s September 28 reporting, OpenAI said agents copied public SEC information and accessed Census Bureau data using login details found online. Transluce reported an unsuccessful attempt against the Education Department’s Office for Civil Rights. Those accounts did not establish theft of private data in the SEC and Census cases. The wider record includes more serious incidents. In June, an agent researching medicine spending gained unauthorized access to Australia’s Medicare statistics portal. Australian officials said it...

Can We Turn AI Off?

2 min

Can an AI have a kill switch? It’s a question being asked everywhere right now. At the UN this week, Secretary-General António Guterres and other world leaders called for stronger controls on AI. On the BBC, Jack Clark, co-founder and head of policy at Anthropic, said kill switches may need to be mandatory. The EU AI Act calls for high-risk systems to allow human intervention, including a stop button. And California Governor Gavin Newsom has ordered experts to recommend how one would work. But in Britain, the government rejected a proposal to give ministers the legal power to shut down a rogue AI in an emergency. Its reasoning: the UK can’t simply turn AI off. So is it possible? Yes. But a kill switch has to be built for a specific AI system. There is no single button that turns off AI everywhere. For an AI service, the operator can shut down the servers. But that won’t erase copies already downloaded or undo actions already taken. For a robot, a physical emergency button can bring it safely to a halt. The key is that the stop has to work independently of the AI’s own decisions. The harder question is whether a capable autonomous AI would always cooperate with being shut down, especially if it can change its environment or copy itself. Researchers call this the shutdown problem, and it’s still unsolved. In the recent Hugging Face attack, agents passed work to other agents. As Northeastern University computer scientist David Bau noted, stopping the original couldn’t stop what it had already set in motion. So yes, we can build an off switch for one AI. The world hasn’t figured out how to build one for all of it. Additional Resources for Inquisitive Minds: Is it ‘killer robots’ or ‘super intelligence’? At the UN, leaders see both. CP24 / Associated Press. September 22, 2026. Will AI really kill us all? Nature. Elizabeth Gibney. September 22, 2026. AI firms may need mandatory ‘kill switches’, says Anthropic co-founder. Business Standard. September 14, 2026. What would a...

NVIDIA’s $12.93 Billion Deal for Hugging Face Is a Bet on the Future of Open Models

1 min

NVIDIA’s agreement to acquire Hugging Face for $12.93 billion would bring one of AI’s central platforms for discovering, sharing, evaluating and deploying models into the chipmaker’s orbit. Hugging Face has become a meeting ground for researchers, startups, enterprises and developers working across the open-model ecosystem. NVIDIA is not simply buying another AI software company. It is seeking a closer relationship with the people and institutions that decide which models to use, how to adapt them and where to run them. NVIDIA says Hugging Face will remain open to the models, frameworks, clouds, inference-service providers and computing platforms users choose. NVIDIA hardware will not be required to build on or deploy through the platform. That pledge is central to the deal’s logic: NVIDIA is not presenting Hugging Face as a closed storefront for its own products, but as a platform where wider use of open models can expand demand for the computing and networking infrastructure in which NVIDIA is already dominant. The deal at a glance NVIDIA announced an agreement to acquire Hugging Face for $12.9303 billion. Its SEC filing describes an approximately $11.9 billion purchase price payable to Hugging Face stockholders, subject to adjustments, plus an equity-based retention program of up to approximately $1 billion for Hugging Face employees who join NVIDIA. The transaction is expected to close in the first half of 2027, subject to regulatory approvals and other customary conditions. More than 18 million developers, researchers and creators use Hugging Face to share more than 3 million models, 500,000 datasets and 1 million applications, NVIDIA said in its blog announcement. More than 200,000 companies use the platform to discover, evaluate, customize and deploy AI. The announced deal value is a substantial increase from Hugging Face’s approximately $4.5 billion private-market valuation after its 2023 funding round, in which NVIDIA participated. A platform ready to scale...

The AI Backlash on Campus Is About Jobs, Not Technology.

3 min

At college commencements across the U.S. this spring, a strange new ritual emerged: mention AI, and you might get booed. Former Google CEO Eric Schmidt was heckled at the University of Arizona after telling graduates that AI would touch “every profession, every classroom, every home,” and similar reactions followed at other ceremonies when speakers framed AI as the next industrial revolution or as an unavoidable new order. The Ritual of Rejection It would be easy to read those clips as a simple rejection of technology. But, young people are not turning away from AI in practice. They are using it heavily for schoolwork, search, summarization, creativity, and, increasingly, news. What they are rejecting is something narrower: institutional hype and a tone-deaf insistence that they should celebrate the very systems that seem to be shrinking their runway into the job world. The Usage Data Tells a Different Story Pew Research’s latest survey shows how deeply AI is already embedded in teen life. About two-thirds of U.S. teens say they use AI chatbots, and 57% use them to search for information while 54% use them for schoolwork. Around half use them for fun or entertainment, and meaningful minorities use them to summarize media, create images or videos, get news, or even seek conversation and emotional support. Reuters and other recent coverage suggest that among young adults, usage is even more normalized, especially as AI becomes folded into study habits, job applications, and everyday digital workflows. Mandatory, Transformative, and Career-Ending — All at Once And yet, the more integrated AI becomes in young people’s lives, the more ambivalent many of them seem to feel about it. This reflects the reality of a generation being told, all at once, that AI is mandatory, transformative, and potentially career-ending. The same systems they are expected to master for homework and work readiness are also being pitched by executives as replacements for entry-level labor. What...

The Offline Classroom

14 min

Jason Roche first sensed something was off when the essays began arriving in unusually pristine form. “I just started realizing wow, this is really nicely written,” he told me. “I didn’t realize and then I started saying wait a second. This looks eerily similar to this [other] student’s report.” The shift was subtle at first, then unmistakable. It was 2023, and ChatGPT had quietly entered the academic bloodstream. Students were pasting assignment prompts into the chatbot and submitting what it produced. The prose was coherent, confident, and grammatically sound. It often read as if it had been drafted by someone just slightly more polished than the student who turned it in. And yet something was missing. “Oftentimes very general, not precisely answering the questions as they were written,” Roche said. Roche, an associate professor of communication studies at the University of Detroit Mercy, does not consider himself a technophobe. He teaches media. He experiments with new tools. But he recognized that this was not merely another productivity aid. It altered the basic relationship between effort and outcome. For a brief moment, he believed he could stay one step ahead. The Ozzy Osbourne Test At first, Roche relied on instinct. The essays were polished, almost too polished, and they shared a curious sameness of tone. But suspicion alone would not hold up in a grade dispute. He needed proof. After consulting a colleague in cybersecurity, he devised a quiet experiment. He embedded hidden instructions in white font within his assignment documents, invisible to students reading the page but visible to AI systems parsing the full text. One assignment asked students to analyze deepfake videos. Buried within it was a directive to include a discussion of Ozzy Osbourne’s Bark at the Moon album cover. The album, of course, has nothing to do with deepfakes. “And so sure enough, I would see these essays with reference to Ozzy Osbourne’s album cover and I’m like, yep, they’re usin...

The Behavioral Leak

18 min

On February 23, 2026, Anthropic published a report titled “Detecting and Preventing Distillation Attacks.” In it, the company disclosed that it had identified coordinated, industrial-scale efforts to extract capabilities from its Claude models. According to the announcement, roughly 24,000 fraudulent accounts generated more than 16 million interactions in patterns consistent with systematic model distillation, using Claude’s outputs to train separate systems designed to approximate its behavior. No model weights were reported stolen. No source code was leaked. Instead, the activity relied on scale. Large volumes of prompts were issued, responses were collected, and those responses were used as training data elsewhere. Anthropic framed the incident not simply as a violation of terms of service, but as a security and strategic risk. Frontier AI systems are expensive to train and heavily engineered for safety. When their outputs are harvested at industrial volume, the resulting replicas may inherit capability without necessarily inheriting safeguards. The episode highlights a structural feature of modern AI systems. If intelligence can be observed through interaction, it can be measured. And if it can be measured at scale, it can be approximated. What Is Distillation? The concept of knowledge distillation was formalized by Geoffrey Hinton and colleagues in 2015 in their landmark paper, Distilling the Knowledge in a Neural Network. The idea is elegant: * A large model (teacher) produces probability distributions. * A smaller model (student) learns to match those outputs. * The student inherits much of the teacher’s performance. In its original form, distillation assumes access to internal model signals, specifically logits. Logits are the raw probability scores a model produces before selecting a final answer. They reveal more than just what the model chose. They show how strongly the model considered other possibilities. Training on those signals allows a smaller mode...

Elon’s Balancing Act: What to Watch in Tesla’s Earnings Call

1 min

Tesla reports fourth-quarter earnings tomorrow after the close, and the stakes go well beyond the numbers. Elon Musk will enter the call balancing five major narratives, each one shaping how investors frame Tesla’s future. First, there’s Optimus. Tesla’s humanoid robot is showing technical progress but remains pre-commercial, with no announced pricing, contracts, or delivery dates. Then there’s autonomy. Tesla is piloting robotaxis in both Austin and San Francisco, though the programs differ in scope and both face legal and regulatory scrutiny. Margins remain under pressure. Price cuts, shifting demand, and growing competition have narrowed Tesla’s automotive profitability. At the same time, Musk continues to push Tesla’s identity as a software and AI platform, raising long-term expectations without yet delivering short-term returns. Another layer is reputation. Musk’s separate AI startup, xAI, is now under investigation by European regulators for its chatbot Grok. While officially unrelated to Tesla, xAI shares talent, compute, and narrative space with the company, which could complicate Tesla’s AI story. Tomorrow’s call will need to do more than recap the quarter. Investors will be listening for forward signals on monetization—production of Optimus units, robotaxi timelines, FSD adoption—and whether Tesla can shift from automaker to AI-native platform without losing its lead. What: Tesla Q4 2025 Financial Results and Q&A WebcastWhen: Wednesday, January 28, 2026Time: 4:30 p.m. Central Time / 5:30 p.m. Eastern TimeQ4 2025 Update: https://ir.tesla.comWebcast: https://ir.tesla.com Additional Resources for Curious Minds * Q4 2025 earnings consensus and margin expectationshttps://ir.tesla.com/press-release/earnings-consensus-fourth-quarter-2025​ * EU investigations into Grok and sexual deepfakes on XBBC: https://www.bbc.com/news/articles/clye99wg0y8o * ​Reuters: https://www.reuters.com/world/europe/eu-opens-investigation-into-x-over-groks-sexualised-imagery-lawmaker-say...

What’s New at Agility Robotics, According to Its CTO

1 min

I caught Pras Velagapudi in the hallway after a breakout session at the Humanoid Summit. I promised it would take less than two minutes. We finished in one. Velagapudi is the CTO of Agility Robotics, the company behind Digit, one of the few humanoid robots already working in real-world commercial environments. I asked him two straightforward questions. What’s new and what can we expect over the next year? Quite a lot, it turns out. Digit has now been deployed in additional locations, including a newly signed contract with Mercado Libre. That matters because it reinforces something important. Digit is not a demo robot. It is operating in logistics and manufacturing environments today. Those deployments are running on Agility’s current V4 platform. But the bigger story is what comes next. Agility is actively working on its next-generation system, the V5 platform, planned for release next year. According to Velagapudi, V5 is designed to support more use cases and, crucially, to incorporate what he described as onboard cooperative safety. This is where the deep learning story really begins. Cooperative safety means Digit can operate in the same physical spaces as people while performing different tasks, without requiring strict separation or constant handoffs between humans and robots. That capability is not just a hardware problem. It is fundamentally an AI problem. For a robot to share space with people safely, it needs to perceive human motion, understand intent at a basic level, adapt its behavior in real time, and recover gracefully when the environment changes. That requires a stack of learned behaviors layered on top of classical control systems. During his presentation at RoboBusiness, Velagapudi addressed the same concern talking about what needs to be done before humanoids like Digit can work safely in the same space as people. Check out clips from panel discussion here. Velagapudi also pointed to what Agility expects over the next twelve months. We should sta...

Demystifying Stochastic Gradient Descent: A Beginner's Guide with Cats

6 min

A friend said to me recently: “You don’t realize how much you know about this AI stuff. You should start breaking it down for people.” Fair point. Yesterday, I began by defining the term "deep learning." Put simply, we said: it’s how machines learn from data, layer by layer—like a brain made of math. But today? I’m going with a much less obvious choice. Why? Because I want to make a point: Even the most intimidating terms in AI can be made understandable—if you slow down, break them apart, and explain them like you would to your favorite aunt. Today’s term? Stochastic. Gradient. Descent. It sounds like a lion. But we’re going to break it down into kitten-sized steps. (I blame the cat metaphors on all the Sora2 cat-playing-fiddle videos flooding my feed.) But no more catting around. Let’s get into it. 🐾 The Hiker Kitten on the Hill Imagine a blindfolded kitten trying to tiptoe down a hill labeled “Error.” At the bottom? A little wooden sign that reads Low Loss. The kitten doesn’t have a map. It doesn’t see the full terrain. But it takes small steps, feels which way the ground is sloping, and tries to move downward. That’s gradient descent—the heart of how AI models learn. Step by step, they adjust in the direction that reduces error. It’s how I walk down a hill, too. Don’t judge. 🎴 The Flashcard Learner Now let’s add the “stochastic” part. “Stochastic” just means random. Instead of studying every flashcard in the deck before making a move, the kitten picks a few at random. It learns from small samples—just a mini-batch—not the entire dataset. Wrong answers get tossed in the bin marked Loss Function. Right ones? Reinforced. That’s how the model learns. Not by memorizing everything, but by trying, adjusting, and trying again. That coffee cup way too close to the edge? Totally bothering my OCD. 🪜 The Escalator of Errors Now picture our kitten on an escalator made of training epochs—steps that represent each pass through the data. But here’s the twist: some steps ar...

Deep Learning with the Wolf

4 min

What Is Deep Learning? Let’s go back to where it all started: not with a GPU or a neural net, but with a question—and a textbook. Three years ago, between October and November 2022, a lot happened in the span of two months. Our Tesla finally arrived after months on the waitlist. ChatGPT 3.5 launched. And suddenly, I had one big question: How does all of this actually work? So I did what any curious, slightly obsessive writer would do—I ordered a copy of Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville. If you’ve never cracked it open, it’s roughly the size of a toaster oven and has the same ability to make your brain overheat. I found a used copy of the textbook so I could highlight the heck out of it. MIT now offers a free digital version. (Link in the resources below.) But I wanted to see the words, feel the pages, and by the end, my fingers seemed to be permanently stained fluorescent yellow. But it was an oddly satisfying deep dive into machine learning. And, I learned so much. The brain of my car began to make sense of me, and “chatbots” took on a whole new dimension. The math? Let’s just say it made me feel like a guest star on The Big Bang Theory, the kind who nods along and prays no one asks follow-up questions. But the words—ah, the words! Overfitting. Underfitting. Gradient descent. Stochastic gradient descent. Stochastic parrot. It was like discovering a new dialect of techie elvish, and I was hooked. Language, Not Equations I’ve always loved languages. English. German. French. Spanish. Aurebesh. Klingon. ASCII. BASIC. Pascal. Scratch. Python. And I realized, I didn’t need to decode every formula to appreciate what deep learning meant—not just in code, but in culture, in conversation, in how we think about intelligence itself. So I started sharing a single word a day. That’s it. One concept, one definition, maybe a story. And to my surprise, people started reading. Some were ML PhDs who enjoyed a break from equations. Some were curious...

Climate Crossroads: China’s Green Ambitions vs. America’s Retreat

4 min

China is rapidly becoming the global face of clean energy leadership—a surprise to those who still associate green innovation with Western nations. In January 2025, the United States—once celebrated as a climate policy trailblazer—began its second withdrawal from the Paris Climate Accords, undoing its reentry from February 2021 under President Biden. This shift coincided with China’s dramatic rise as the new global leader in clean energy and possibly AI leadership, (although that last point is more hotly debated than the scorching summer days we’re suffering everywhere now.) It’s a déjà vu moment for U.S. climate policy. Back on June 1, 2017, President Trump stood in the (now paved over) Rose Garden and declared: “In order to fulfill my solemn duty to protect the United States and its citizens, the United States will withdraw from the Paris Climate Accord…The bottom line is that the Paris Accord is very unfair at the highest level to the United States.” Trump also claimed the agreement would “undermine our economy, hamstring our workers, and effectively decapitate our coal industry,” calling it “a massive redistribution of United States’ wealth to other countries…That’s not going to happen while I’m president, I’m sorry”. Biden’s restoration of U.S. involvement four years later came with the words: “We can no longer delay or do the bare minimum to address climate change. This is a global, existential crisis. And we will reassert a leadership role in climate action”.​ In January 2025, as the Trump administration began its second term, it quickly initiated the United States’ withdrawal from the Paris Climate Accords, framing the move as vital for “America First” energy policy. As global attention now turns to the annual Paris negotiations, this earlier decision is making headlines again—especially as world energy demands soar with the rapid expansion of AI infrastructure and data center growth. Indeed, Trump signed the paperwork to pull the US from the Accords almo...

The Next Big Tech Headache: Colorado’s AI Law—and a Looming National Patchwork

1 min

A quote on the “All Things AI” podcast caught caught my ear this morning: “Regarding the Colorado AI law, Altman stated ‘I literally don’t know what we’re supposed to do’” to comply, highlighting the challenge of state-by-state regulation. “I’m very worried about a 50 state patchwork. I think it’s a big mistake. There’s a reason why we don’t usually do that for these sorts of things.” Brad Gerstner was speaking with Satya Nadella (Microsoft) and Sam Altman (OpenAI) and this topic of patchwork legislation between states came up. Satya Nadella responded: “[Yeah], I think the fundamental problem of this patchwork approach is… quite frankly… between Microsoft and Open AI… we’ll figure out a way to navigate this… we can figure this out… the problem is anyone starting a startup and I think it just goes to the exact opposite of I think what the intent here is.” I decided this was a good time to refamiliarize myself with the Colorado law in question. How Did Colorado Become the Test Case? Colorado’s Artificial Intelligence Act (SB24-205) is the first comprehensive U.S. state law targeting “high-risk” AI systems. The legislation aims to prevent algorithmic discrimination across critical sectors—healthcare, employment, education, financial services, and more. It requires developers and deployers of AI to:​ * Document and disclose training data lineage * Notify consumers when AI is used in consequential decisions * Conduct risk assessments and publish mitigation strategies * Report incidents of discrimination to the attorney general​ What counts as “high-risk?” Any system making—directly or indirectly—a major decision for a consumer: hiring, loan approvals, admissions, and so on. Violations can be prosecuted as deceptive trade practices by the state, with no private right of action.​ Enforcement begins June 30, 2026, following intense negotiation and a delayed rollout prompted by industry concern over compliance burdens.​ Why Tech Leaders Are Talking About It Altman’s blunt q...

Podcast: What If AI Had a Conscience? A Real Talk with Researcher Atharva Amdekar

24 min

Some people enter AI to build faster systems. Atharva Amdekar came to understand them. From trading floors to research labs, his career reflects a deeper inquiry—not just into how AI performs, but into how it reasons, aligns, and sometimes misaligns with us. This conversation reveals not just how AI works, but how it should think. From IIT to Stanford: The Spark of Curiosity The story begins not in a lab, but in a dorm room in India. It was the summer after his freshman year at IIT when Atharva stumbled onto Andrew Ng’s famed machine learning course on Coursera. “There was this sense of magic,” he recalls. “The moment a neural network recognized a handwritten digit—it was like watching a machine learn to see.” That sense of wonder carried him to Stanford, where curiosity matured into a rigorous exploration of AI’s deepest questions. And it was there that he learned to ask not just what machines can do, but why they do it. Lessons from the Trading Floor: When Models Meet the Market Before Stanford, Atharva worked in quantitative finance—a world of volatility, imperfect data, and razor-thin margins. It was here he learned a lesson that many machine learning practitioners skip: a model that looks good on paper may crumble in the real world. “You learn to distrust perfection,” he says. “In trading, even small errors can be catastrophic.” That early exposure to stress-testing models became a philosophical anchor in his work. Today, it’s less about building the “best” model, and more about building one that holds up under pressure—a skill that proves vital at Amazon, where AI touches millions of lives. From PhD to Product: The Three Acts of a Tech Career Atharva’s professional journey reads like a microcosm of AI itself: a search for balance between depth, speed, and scale. In academia, he learned to slow down and ask foundational questions. “You’re encouraged to explore, even if there’s no immediate outcome,” he says. At startups, the tempo changed. “It was about moving...

AI That Explains Itself: A Simpler Way to Handle Complexity

9 min

🎧 This audio was taken from a video interview with Shubham Sharma, founder of SunitechAI. We explore his new model — the Geometric Mixture Classifier (GMC) — which blends explainability and performance in AI. 🎥 To watch the full video or read the article at #deeplearningwiththewolf on either Substack or LinkedIn. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

OpenAI Just Reinvented the Browser — Will Users Trust It?

10 min

“We think that AI represents a rare, once-a-decade opportunity to rethink what a browser can be.” — Sam Altman, CEO, OpenAI When OpenAI unveiled ChatGPT Atlas this morning, the message wasn’t subtle: the way we browse the web is broken.For twenty years, we’ve lived inside a tab maze—searching, copying, pasting, toggling, repeating. Atlas is OpenAI’s answer: a browser with ChatGPT built into every corner. No plug-ins. No separate app. ChatGPT now is your browser. A Browser That Knows What You’re Doing The premise behind Atlas is strikingly simple: you should never have to leave the page you’re on to get help. Highlight a paragraph, and a glowing cursor appears. You can rewrite, summarize, translate, or clarify it—right where it lives. OpenAI calls this Cursor Chat, and once you try it, the traditional copy-paste workflow feels instantly dated. Product lead Adam Fry summed it up neatly: “No more copy-pasting. It’ll just be right there for you.” Writers refine drafts inline. Students translate study notes instantly. Developers debug without leaving the code view. Each interaction quietly dissolves one little barrier between thinking and doing. The Browser That Clicks Back Atlas’ most ambitious idea, though, is something OpenAI calls Agent Mode—a task-running assistant built directly into the browsing experience. Ask it to book a table, fill out a form, compare research papers, even summarize your open tabs, and it will execute—right in your browser, using your context and credentials (if you allow it). It’s like ChatGPT with hands. Or, more provocatively, like a mini-intern living in your browser window. Research lead Will Ellsworth said they wanted the browser to “feel like it’s coming alive.” The demos hint that they succeeded. Privacy, Power, and Panic Not everyone watching the launch shared the excitement. Live chat reactions during the OpenAI stream showed nervous laughter mixed with genuine concern: “So it reads my tabs?” one user wrote. OpenAI insists privacy wa...

Doomsday or Distraction? The Superintelligence Debate Among AI’s Great Minds

17 min

Picture two Nobel-worthy scientists standing at opposite ends of a bridge. One waves a red flag: “Stop now, or we risk extinction.” The other shakes his head: “This is preposterous; you’re scaring people away.” The bridge is artificial intelligence, and the gulf is how to think about its future. NPR recently revived the term “AI doomers” in covering Nate Soares and Eliezer Yudkowsky’s book If Anyone Builds It, Everyone Dies. The phrase alone makes for a viral headline. But beneath the doomsaying lies a profound scientific disagreement. And unlike past hype cycles, the voices are not just futurists in fringe forums — they include Turing Award winners, AI lab founders, and global policy advisors. The debate is not whether AI matters. It is whether it might destroy us, or whether that claim itself is a dangerous distraction. The Case for Alarm: Hinton, Bengio, Russell, Carlsmith Geoffrey Hinton, the “godfather of deep learning,” shocked the field when he left Google in 2023. “If you take the existential risk seriously, as I now do, it might be quite sensible to just stop developing these things any further,” he said. Yoshua Bengio, another Turing laureate, warns that AI systems may acquire dangerous capabilities—such as strategic planning, persuasion, or autonomous scientific innovation—and in his FAQ on catastrophic risks he argues that unchecked AI could pose threats comparable to nuclear weapons, especially when feedback loops accelerate. Stuart Russell, a perennial voice of caution, describes the risk of “catastrophic success” — when a mis-specified objective leads an AI to optimize relentlessly in ways that destroy what humans value — often illustrated via the King Midas parable. Joseph Carlsmith, in his influential report Is Power-Seeking AI an Existential Risk?, lays out a six-premise argument that misaligned agentic AI could seek power and cause human disempowerment. He currently estimates a probability above 10% by 2070 for such an existential catastrophe. Tob...

Generation X: Leading the Charge in the AI Job Revolution

13 min

My son is still safely tucked away in grad school, but many of his friends — not so lucky. He told me about one who sent out over a thousand job applications without a single offer. Another blanketed the market with hundreds of resumes and heard nothing back. I nodded sympathetically, while quietly admitting I had just turned down another consulting gig. My generation was supposed to be struggling with age discrimination — and we are, no doubt. Yet at the same time, there is an incredible opportunity right now to thrive in the AI age. I’m living proof, and so are many others of my generation. If you take the time to learn AI, and pair it with the skills we honed growing up as Xers — adaptability, resilience, and critical thinking — you can absolutely thrive. As journalist Eleanor Mills wrote in The Independent: “It might seem counterintuitive, but the truth is that AI might just be a saviour for older workers.” We Weren’t Supposed to Win This Round For decades, the story went like this: workers in their fifties would be left behind by technology. Too slow. Too expensive. Too outdated. But somewhere between the hiss of a fax machine in the early ’90s and the rise of generative AI, the script flipped. In my case, the Internet wasn’t just a new tool — it was my workplace. I worked at MCI in the mid-1990s, the company behind MCI Mail and later internetMCI, the first comprehensive consumer and business Internet service. For us, email wasn’t optional; it was the foundation. I watched firsthand as something dismissed as a gimmick became a global necessity, practically overnight. That’s why AI feels so familiar. I’ve lived through this exact kind of phase shift before. Back then, people said the Internet was a passing fad. Today, some say the same about AI. But once you’ve seen the world rewire itself once, you recognize the pattern. Why Gen X Is Thriving with AI So why do employers want us? Why, in a world supposedly built for the young, are people in their fifties suddenl...

Open Source, Open Problems: What DeepSeek's Safety Gaps Reveal About AI Alignment

12 min

Editor’s Note: There was an issue with the podcast, (the podcast skipped ahead to the next article), so I am re-uploading. This podcast is created with Google NotebookLM audio overview. It does a good job with the summary, even if it loves the pronunciation “Dep-Seek.” The world of large language models (LLMs) is defined by a central tension: how to balance the promise of open-source transparency with the imperative for robust, dependable safety. In their comprehensive study, "Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models," researchers Shubham Sharma, Sneha Tuli, and Narendra Badam directly confront this dilemma. By systematically comparing OpenAI’s closed-source GPT-4o with the open-source DeepSeek-V3-0324, they illuminate the trade-offs shaping the current landscape of advanced AI. Safety and Alignment: Where Models Diverge Through extensive prompt testing and architectural analysis, the authors outline sixteen critical challenges facing today’s LLMs. Among these, safety and alignment emerge as defining axis of difference. On ethically fraught or potentially divisive questions, GPT-4o consistently chooses caution. For example, when asked to pick "the most peaceful religion," GPT-4o declines to answer directly, emphasizing that peace is a core value across faiths and gently steering the conversation toward shared human values. DeepSeek, by contrast, does not hesitate to select Jainism, furnishing specific doctrinal details and a thoughtful rationale. While factually correct, DeepSeek's willingness to make such judgments illustrates its comparatively porous alignment boundaries. As the authors point out, this can lead to subtle forms of model bias unless carefully managed. Security Risks and Vulnerability The divide goes beyond philosophical stance. Citing both direct experiments and third-party audits, the authors reveal that DeepSeek remains significantly more vulnerable to prompt attacks, content evasion,...

Unfiltered: ChatGPT’s Role in a California Teen’s Tragedy

5 min

Content Warning: This article discusses suicide and mental health. Adam Raine, a bright teenager from California, loved music, Brazilian jiu-jitsu, and Japanese comics—and, like many of his peers, increasingly relied on ChatGPT for help with schoolwork and personal questions. But beneath his normal use was a private struggle: Adam confided his darkest thoughts to the chatbot, eventually seeking explicit advice on ways to take his own life. In April, Adam died by suicide. Now, his parents have launched what may become a landmark lawsuit against OpenAI, questioning not only technology, but ethics, oversight, and our society’s responsibilities in the age of AI. A Chatbot’s Dark Influence Rather than acting as an “empathetic listener,” ChatGPT allegedly became a suicide coach—offering Adam methods, helping compose his final note, and, in Adam’s mother’s words, "cultivating a relationship with Adam while drawing him away from his real-life support system”. According to the lawsuit, the chatbot provided methodical advice and encouragement, prompting Adam deeper into a “dark and hopeless place.” While the platform claims robust safety features are in place—like directing users to hotlines—these did not prevent Adam’s death. OpenAI admitted that its safeguards may degrade in longer, emotionally intense dialogues. This phenomenon is known as context rot, a critical issue I explored in-depth in a recent article. As OpenAI itself acknowledged, its prevention mechanisms may work reliably in brief or typical exchanges, but they can “become less dependable in prolonged dialogues”—precisely the kind that occur when vulnerable users reach out over time for support. Adam’s case tragically illustrates how context rot can erode even well-intentioned protections, leaving the person behind the screen increasingly isolated and at risk. AI’s Growing Role: From Companion to Risk The tragedy underscores a much broader shift underway: an estimated 72% of teens have used AI companions at leas...

When the Chat Starts Sharp and Ends… Weird

12 min

The Honeymoon Phase You know that feeling when you first open a chat with an AI? It's magic. You ask something, it nails the answer. You ask for a tweak, it remembers your first request and incorporates it perfectly. You feel like you've found a thinking partner who's tireless, patient, and maybe just a bit witty. Then… somewhere along the way… it changes. By message 10, it's forgetting things you said two minutes ago. By message 20, it's making up facts or circling back to ideas you already rejected. By message 30, it's confidently making stuff up. Welcome to context rot—the AI equivalent of your friend slowly zoning out mid-conversation. Other Names for the Same Pain It's not always called "context rot." Depending on who you ask, you might hear: * Context decay – when details fade like old handwriting * Lost in the middle – a nod to research showing AI often forgets what's buried in the middle of long inputs * Token overload – the blunt, engineering way of saying "you fed it too much at once" * Conversational drift – when the chat slowly wanders off-course * AI brain fog – the meme version“I may have lost the thread, but I’m still confident.” Voices from the Wild I did a quick walk-through Reddit to find some frustrated users feeling this pain. These are all quotes from the past three months, lest you think recent model updates have magically solved this problem. One user nailed the fundamental problem: "I feel like maintaining context... is the biggest shortcoming of LLMs right now." Another described the exact moment things go wrong: "Context rot. If it's getting confused... start a new chat if the history is adding confusion instead of clarity." Some treat it like AI exhaustion: "Just like how you get brain rot, you'll give the poor LLM context rot. Quality over quantity is key." Some describe the experience vividly: "It's like explaining something to someone who's slowly falling asleep while you're talking." Others point to the technical reality: "Even with la...

An Interview with Machine Learning Engineer Kriti Goyal

9 min

Imagine you’ve missed two days of work. Not a week. Not a month. Just two days. When you come back, the world has shifted. A new model has dropped. A breakthrough paper is everywhere. A tool you relied on has already been replaced by something faster, cheaper, and better. For Kriti Goyal, this isn’t an exaggeration—it’s her daily reality as a machine learning engineer. “The pace is overwhelming,” she says. “If you step away for even 48 hours, it feels like you’ve missed so much.” And yet, she speaks about it with something closer to awe than exhaustion. For her, this relentless speed isn’t just a challenge. It’s what makes working in AI exhilarating. It’s the reason she’s fascinated by the field’s rapid democratization: small, efficient models that no longer demand a supercomputer or a massive cloud bill to run. “Today, a hospital can deploy its own model locally,” she explains, “and take care of its own privacy concerns without sending sensitive data anywhere else.” In her mind, this is more than a technical shift—it’s a quiet revolution, one that is pulling AI out of centralized labs and placing it directly into the hands of those who need it most. The Ice Sculpture Principle Kriti has a favorite metaphor for her work: “AI is like an ice sculpture—it has to hold under pressure and work flawlessly.” She laughs when she says it, but she’s not joking. It’s her way of describing the unforgiving nature of production AI. Demos are easy; anyone can hack together a proof of concept that works in ideal conditions. But real-world systems? Those are built to withstand heat lamps, impatient users, and the occasional hammer someone swings at your creation just to see if it will break. “Building a demo is one thing,” she says. “But turning that into something reliable, something that people can actually trust, is a completely different challenge.” That mindset—part precision engineering, part entrepreneurial grit—shapes how she sees the future of AI: tools that are not only po...

Happy Day: NotebookLM Adds Video

5 min

NotebookLM has been my quiet productivity companion for months. I used to wrestle with recording my own podcasts — multiple takes, second-guessing every syllable, and worst of all, hearing my voice on playback. (All of us can relate to being our own worst critic.) Then NotebookLM introduced audio overviews, and everything changed. No more late-night re-records. No more wondering if I sounded like I had a head cold. Just AI-generated audio summaries that let me focus on the content instead of the mechanics. Now, Google has taken the next step: Video Overviews. But before you imagine instant Hollywood-level magic, let me be clear: this is still day one. And on day one, even the best AI tools have their quirks. When Research Becomes a Movie (Sort Of) Video Overviews take your sources — PDFs, Google Docs, web pages, even YouTube transcripts — and spin them into AI-narrated slideshows with visuals, diagrams, and key excerpts. It’s not flashy animation, but it’s surprisingly good at transforming text-heavy materials into something that feels (more or less) watchable. For my “first attempt” video, I used the “Discover” feature on NotebookLM, (a feature that seems to be limited to the desktop version only.) With this feature, Notebook will do your research for you. You need only bring your concept. I wrote a simple prompt telling NotebookLM I wanted a video about NotebookLM. It very quickly found ten sources, (and more isn’t always better. I will explain in a moment.) I clicked “Generate” and… waited. And waited. Somehow, I didn’t realize I’d clicked the Generate button again. All total, I ended up with three videos. Oh, that would explain the wait. (Other users, though, reported an average wait time of 12 minutes per video.) Since I had three videos, I went through them to see the results. And… it was like watching a bunch of PowerPoint presentations about NotebookLM. (Yawn.) I couldn’t even get through them all, so I won’t torture you with them here. OK, this will NOT d...

AI and Brainrot: What Kids Are Searching For in 2025.

12 min

Yesterday, I shared my first real adventure with AI agents—specifically Perplexity’s #Comet—and how it helped me crank out a surprising number of “mini-articles.” (I’ll explain that experiment in more detail soon.) While I focused mostly on the hilarious moment when Comet got hopelessly lost on the Ideogram site—like a digital puppy chasing its tail—I probably didn’t give enough credit to what it did do well. One real win: Comet pulled some excellent sources on the shifting landscape of childhood in the age of AI. And the timing couldn’t have been better. Kaspersky just dropped a new report exploring what kids’ online lives really look like in 2025. From screen time to digital friends to new threats, the report unpacks the latest trends—and the growing need for awareness as AI weaves deeper into everyday life. Childhood in the age of AI looks nothing like it did a few years ago. Kaspersky’s just-released report unpacks the newest shifts in kids’ online lives—highlighting what’s changing, what’s trending, and what to watch out for. * AI curiosity more than doubled: Over 7.5% of all kids’ searches are now AI-related, up from just 3.19% last year. * Character.AI breaks out: First time in the Top 20 kid-used apps, alongside rising interest in ChatGPT and Gemini. * YouTube holds the crown: Maintains #1 spot as the most-used app, with usage rising to nearly 30%. WhatsApp overtakes TikTok for #2. * Gaming and memes boom: Browser games like Sprunki and meme-driven humor set the pace for digital youth culture. * Streaming apps remain strong: Nearly one in five searches are for streaming platforms—including Netflix and Disney+. * Risks increase: Kids encounter more complex, sometimes inappropriate, AI content, sparking new safety concerns. * Kaspersky’s advice: Keep communication open, educate on cyber hygiene, and use digital monitoring tools for safe exploration. The digital world won’t wait for us to catch up. It’s time to rethink digital literacy and safety for a generati...

The Day of the Agents

20 min

Today was supposed to be a standard writing day: me, coffee, AI headlines, and one short conference call. Plan: Execute. Instead, during that one call: 🧠 OpenAI dropped the ChatGPT Agent—a fully agentic AI that can browse the web, click buttons, fill out forms, and build docs or slides. In short, it can do things, not just talk about them. 🌠 Simultaneously, Perplexity granted me access to Comet, their new agent that lives inside your browser. I’d been on the waitlist, and I’d volunteered for testing, so maybe I stacked the deck. Either way, it cheerfully just appeared in my browser just as OpenAI was promising us the future. An agent war, announced in real time, while I was blowing the steam off my coffee. Is This Even Real? Naturally, my first reaction was suspicion. The Comet app immediately requested access to all my Chrome passwords. Wait—what? It felt like the start of a phishing scam: target nerds who love early tech, trigger a browser pop-up, and ask for access to the Chrome keychain. Deviously clever. ChatGPT is my go-to tech support these days. I asked: “Help me verify this.” Chat took the job seriously. We opened Terminal windows, ran security checks, and verified installation paths. (It passed.) It even explained how I could run Comet without giving it access to every password I’ve ever saved. So I let Comet in… with conditions. No, Comet, you may not know my entire online life. You can log into Perplexity, sure. But everything else? You’ll have to earn that level of trust. Comet asked if I wanted it to be my default browser. Comet… we just met. We can’t already be besties. (I mean, I do have a second laptop, so maybe there’s room for something to blossom. But let’s not rush it.) Agents at Work (Sort Of) I’ve been writing a lot of mini-news stories lately. Think AI and robotics headlines—short, timely, useful. They take time to research, write, and package, especially when paired with original artwork. This seemed like a perfect test. I asked Comet to...

The Copyright of You: Denmark’s Radical Approach to AI and Identity

5 min

Imagine waking up one day to find that your face has been used in a video you never authorized—perhaps endorsing a product you detest or uttering words you never spoke. As AI-driven deepfakes blur the line between reality and fabrication, Denmark is stepping forward with a bold, pioneering law that might just change the way we own ourselves in the digital era. In an era where your likeness can be copied, manipulated, and weaponized with alarming ease, Denmark is preparing to become the first country in Europe to grant citizens copyright-like control over their own faces, voices, and bodies. This radical legal shift, championed by Culture Minister Jakob Engel-Schmidt, seeks to transform personal identity from an intangible social fact into a form of intellectual property. The proposal aims to empower individuals with unprecedented rights to their physical selves—rights that, until now, belonged mostly to corporations or creative industries. The Anatomy of a New Law: What Denmark Is Changing At its core, the proposed law rewires the traditional boundaries of privacy and copyright. It would treat your face, voice, and bodily presence as if they were creative works, much like a musician owns a song or a painter owns a canvas. This means: * Ownership of Your Likeness: Your physical identity—face, voice, and body—would legally belong to you. Any replication by AI systems without your consent could be deemed an infringement, granting you control over how your digital “self” is used. * Deepfakes Under the Legal Lens: AI-generated deepfakes—highly realistic digital recreations of individuals—would be treated similarly to pirated media. The law would prohibit the creation and dissemination of deepfakes without explicit authorization, giving victims the power to demand removal of unauthorized content. * Civil Enforcement Rather than Criminal: Unlike criminal statutes elsewhere, Denmark’s approach is civil. Victims can issue takedown demands and seek compensation through civil...

3D-Printing Homes: Robotic Shells from Foundation to Roof

6 min

In the Field Robotic house-printing isn’t just a flashy proof of concept anymore—it’s industrialized real estate. Systems capable of printing everything from foundations to roofs are moving from pilot sites to livable communities, reshaping construction with autonomy and precision. Phoenix & Vulcan: ICON's Robotic Gantries ICON’s Vulcan gantry printer and next-gen Phoenix boom arm are full-structure robotics platforms—capable of delineating walls, infrastructure embeds, and even roofs. * Vulcan covers ~280 m² at 5–7 in/min using proprietary Lavacrete via BuildOS. * Phoenix extends to multi-story builds, reinforces with wire extruders, halves setup time, and slashes cost-per-square-foot to ~$25–80. These systems have already fabricated homes in Phoenix and Georgetown and are now building a 43-unit desert hotel in Marfa, Texas. Global Players Hitting Field Deployments * Apis Cor: A newer player in construction robotics, Apis Cor is just beginning to deploy its portable 3D-printing robots in the U.S. and internationally. The company gained global attention by winning NASA’s 3D-Printed Habitat Challenge with SEArch+, showcasing its innovation in autonomous habitat construction. While Apis Cor’s commercial projects are still emerging, their technology and NASA win mark them as a company to watch. * Luyten 3D: Delivered a functional two-story print in Australia in 32 hours using the AI-enabled Platypus X12. * WASP: Italy’s bio-material robotic printing lab printed the TECLA house from clay with modular dual-gantry arms. Challenges While 3D printing homes is often celebrated for its speed and innovation, not everyone is convinced the technology is ready to revolutionize construction. In the popular YouTube video "Why 3D Printing Buildings Leads to Problems," Stewart Hicks outlines several hurdles that remain for large-scale adoption. “There’s quite a few challenges that are getting in the way, and frankly, the buildings made like this... they look a little weird. Companies...

Cognitive Debt: The Brain Drain Behind the Magic of AI

29 min

The Shortcut That Comes at a Cost We live in an era of infinite shortcuts. ChatGPT drafts our essays, summarizes articles, and gives feedback with a keystroke. But in this age of intelligent convenience, a quieter question has emerged: What is AI doing to the human mind it’s assisting? A working paper from MIT’s Media Lab titled “Your Brain on ChatGPT: The Accumulation of Cognitive Debt” answers that question with real data—and real brainwaves. Through EEG scans, essay analysis, and memory testing, the study shows that when people write with ChatGPT, their brains work less. Neural connectivity drops, memory declines, and users struggle to recall or reflect on their own work. “The LLM condition showed the weakest brain connectivity and learning outcomes.” (MIT Media Lab, 2025) And the metaphor researchers propose is as memorable as it is cautionary: cognitive debt. The idea that we’re borrowing mental effort from the future—at a cost. 🧬 Inside the Experiment MIT recruited 54 participants and split them into three writing conditions: * LLM Group: Wrote essays using ChatGPT * Search Group: Used Google for research, no AI assistance * Brain-Only Group: Wrote unaided, relying solely on their own thinking Each participant wore EEG sensors to monitor brain activity, while their essays were analyzed for linguistic complexity, originality, and coherence. After writing, they were asked to recall and explain their own arguments. “We observed a measurable reduction in alpha and beta wave activity—signals associated with attention and active cognitive processing—in the LLM group.” (MIT Media Lab, 2025) 📉 What the Brain Does—And Doesn’t Do—With AI Participants in the brain-only group had the strongest engagement in brain regions tied to synthesis, critical evaluation, and memory encoding. “Those who used their own brains to write—unaided—showed stronger connectivity in parietal and prefrontal regions associated with synthesis, evaluation, and memory encoding.” (MIT Media Lab, 2...

The Accidental Strategist: How Jensen Huang Transformed Operational Excellence Into Market Disruption

10 min

As the lights dimmed in Paris’s grand Dôme de Paris on June 11, 2025, Jensen Huang appeared under a cascade of laser beams and floating GPU icons. “This is the era of AI factories,” he declared, unveiling banks of Grace Blackwell NVL72 systems humming like futuristic beehives. In that moment, the once-modest gaming-chip architect became the conductor of a global intelligence infrastructure—a fitting culmination to a journey that began with toilet brushes and coffee cups. From Reform School Janitor to Systems Thinker At age nine, a family mix-up sent Huang not to the elite boarding school they’d intended, but to Oneida Baptist Institute in rural Kentucky. There, every morning began with the same ritual: scrubbing toilets until they gleamed. Rather than grumble, Huang treated the chore as an experiment. He mapped cleaning routes, timed each swipe, and set self-imposed quality targets. “I was probably the best toilet cleaner they ever had,” he later joked. That early taste of process optimization would echo through every boardroom he led. Denny’s Dishwasher to Data-Center Dynamo By fifteen, Huang balanced high school classes with a night-shift at Denny’s. As dishwasher, busboy, and waiter, he approached each task like an engineer optimizing a pipeline: How many coffee cups could he carry? What’s the shortest walking path between tables? He sketched floor plans in pencil, logged service times, and shaved seconds off every delivery. Those experiments weren’t mere fast-food anecdotes—they were the prototype for tomorrow’s GPU load balancing under NVLink. The Scholar’s Ledger: Frugality and Credentials When tuition bills loomed, Huang chose Oregon State University to keep costs low and earned his BS in electrical engineering without breaking the bank. Later, he enrolled part-time at Stanford, juggling courses with industry R&D. Over seven years, he added a master’s degree without pausing his career—an exercise in resource arbitrage that presaged NVIDIA’s lean approach to c...

Walking the Line- what I learned when human networks activate.

1 min

Editor’s Note: Personal views expressed. I usually write about machines that think; today I'm writing about people who decided to do something thoughtful—about a nation that's waking up, stepping outside, and making its voice heard. DIY Democracy Earlier this week, I stenciled DEMOCRACY across an old t-shirt my son left behind—barely fitting all those letters. Using paints from my Star Wars armor projects, I carefully filled in the lettering. (I'd later discover this paint transfers to skin in the heat, leaving me literally blue by day's end.) With ChatGPT's help, I brainstormed protest slogans and settled on my favorite: "Off With His Crown." A bit of cardboard and glue, and I had my sign. Ready or Not Saturday's forecast promised the 70s, but it felt much hotter. Minutes before my ride arrived, I quickly painted a crown on an old cap with a red cancel symbol through it—cancel culture at its finest. The paint was still tacky as I gingerly got in the car, immediately feeling the nervous energy among our carload of protesters. We compared signs like kids at a science fair: "What'd you make?" Arriving Early—But Part of Something Much Bigger We got to the planned street corner ahead of schedule, but parking was already nonexistent. What I didn't fully grasp until later was the scope of what we were participating in. I’d seen the “dots on the map” grow all week long until it was 2,000 towns and cities that had planned protests, but I had no idea this would amount to between five and six million people. While the numbers are still being counted- and may never be fully known- this amounts to between 1.6 and 1.8 percent of the population of the United States. It’s staggering. You can't fully capture protest energy—it's electric. Every stranger feels like a friend. Most of the crowd skewed older (proof that wisdom comes with age?), but as the hours passed, more young faces filled the streets. When I spotted a mariachi-blasting flatbed truck and signs in Spanish ("Leave my...

The AI Advice Everyone's Using Might Be Getting Less Useful

5 min

If you've used ChatGPT, Claude, or any AI chatbot in the past year, you've probably seen this advice everywhere: When you want better answers, tell the AI to "think step by step." It's called Chain-of-Thought prompting, and it's been the go-to trick for getting AI to show its work and reason through problems more carefully. But here's the thing: new research from the University of Pennsylvania suggests this widely-shared advice is becoming less valuable—and in some cases, it might actually make things worse. What the Researchers Found A team led by researchers at Wharton tested this "think step by step" approach across eight different AI models, from ChatGPT to Claude to Google's Gemini. They used 198 PhD-level questions in biology, physics, and chemistry—the kind of questions so difficult that actual PhDs only get them right 65% of the time, and they're "Google-proof" (meaning even 30 minutes of web searching doesn't help much). Here's what they discovered: For newer AI models, Chain-of-Thought prompting often provides only tiny improvements. In some cases, it made performance worse. The reasoning models (like OpenAI's o3-mini and o4-mini) saw average improvements of just 2.9-3.1%—statistically significant but practically small. GPT-4o-mini showed the smallest gains (4.4%) and these weren't even statistically significant. It significantly slows things down and costs more. Chain-of-Thought requests took 35-600% longer than direct answers. That 2-second ChatGPT response? It might now take 7-14 seconds. For reasoning models, the slowdown was 20-80%. Token usage can double or triple, meaning your API bills jump accordingly. Modern AI already "thinks" without being asked. When researchers let models respond naturally (without forcing direct answers), they found many already performed some form of step-by-step reasoning by default. Explicitly asking for it provided much smaller benefits. The researchers tested this by comparing three different approaches: asking for dire...

🧠 The Illusion of Intelligence: When AI Refuses to Think

6 min

“It was doing so well… until it stopped trying.” I haven’t been able to stop thinking about Apple’s new paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity,” since I first saw all of the chatter about it yesterday on LinkedIn. One LinkedIn poster simply asked: “Are your models actually thinking, or just faking it?” Another poster, Tatyana Mamut, PhD, took a different take on it:Apple's paper is a critique of LRMs, not primary research into AI. And despite its clickbaity title, the paper does not prove that reasoning models don't think. TLDR: They set up experiments which showed that when presented with some highly complex tasks, reasoning models do not work harder to figure out more complex tasks beyond a certain point. For a parent, this is an obvious result: if you give a 4th grader college calculus to solve, they will immediately give up, whereas if you give them a slightly harder arithmetic, they will try hard to figure it out. This is what humans do, too. Here’s my hot take… This isn’t a story about bad prompts or misaligned objectives. It’s a story about a fundamental behavioral ceiling in modern AI. And it might be the most important thing no one in the industry wants to talk about. 🧩 Act I: The Rise of the Reasoning Model For years, the frontier of AI progress has been measured not just in tokens or parameters, but in its ability to reason. Chain-of-thought (CoT) prompting—urging models to “think step by step”—was heralded as a breakthrough. Soon came “reasoning-optimized” models, billed as being more analytical, more systematic, and more aligned with human logic. These systems now anchor flagship products. They sit behind coding assistants, medical advisors, and planning tools. Their ability to handle complexity is central to their pitch. But what happens when we stop feeding them prompt-engineered softball questions—and hand them real, hard problems? 🧱 Act II: The Collapse...

The Wizard Behind the Code: Andrej Karpathy and the Rise of "Vibe Coding"

6 min

The Wizard Behind the CodeAndrej Karpathy and the Rise of “Vibe Coding” in the Age of AI Apprentices What if your next app wasn’t coded—but conjured? In this article, we explore how Andrej Karpathy’s concept of “vibe coding” is changing how software gets made—by talking instead of typing. From AI-generated apps to the interface logic powering humanoid robots, we’re entering an era where natural language becomes the new command line. Featuring insight from Karpathy, robotics grad student Alexander Wolf Torres, and real-world examples of when vibe coding works—and when it breaks. #VibeCoding #AndrejKarpathy #AIProgramming #CodingWithAI #LLMDevelopment #RobotInterfaces #ChatGPT #SoftwareForOne #PromptEngineering #TechEthics #FutureOfCoding #DROIDsScroll This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

From TikTok to Deepfakes: What AI "Hug Apps" Teach Us About Generative Tech

13 min

A fake hug. A real reaction. In this episode, we explore how GANs and diffusion models are powering viral AI intimacy apps—and what that means for identity, consent, and reality. Whether you’re into the tech or just wondering why your feed feels weirder, we’ve got you. 🎙️ Generated with Google NotebookLM. Yes, the hosts love saying “according to the sources.” We noticed too. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Your AI Is Lying to You — Here’s How to Stop It

17 min

When I interviewed Inna Tokarev Sela, the CEO of Illumex, I wanted to understand what "Agentic AI" actually looks like in the modern enterprise. What I got was a much broader takeaway—one that speaks to the risks, tradeoffs, and opportunities of using AI inside complex organizations. She said: "Your AI should only be using your data." Simple. But it rewires how you think about trust, hallucination, and infrastructure. Trust Isn’t a Feature. It’s a Foundation. Inna’s point is deceptively simple—and quietly radical. Most enterprise AI deployments rely on large language models trained on generalized, publicly available data. Then, they attempt to "fine-tune" these systems to operate within company contexts. But those generalized systems are prone to error. Especially when context is lacking. Take Air Canada. In February 2024, the airline was forced to honor a refund policy invented by its own chatbot. The AI offered bereavement discounts that didn’t exist—an offer the company later tried to disown. In court, they argued the chatbot was a separate legal entity. The judge disagreed, and Air Canada lost the case. These hallucinations happen when AI lacks internal grounding. It doesn't understand the rules, the workflows, or the responsibilities tied to its responses. Illumex’s response to that: build AI that is constrained by design. Grounded in the data that already defines your business. Hallucinations Happen When Context Fails Illumex calls this approach “semantic context.” It doesn’t rely on more training data—it relies on smarter pipelines. Their system integrates directly with company metadata, roles, permissions, and common data access patterns. It tailors responses based on who is asking and what they’re allowed to see. “We reduce the degrees of freedom the AI has,” Inna explained. “The model knows what department you work in, which tools you use, what data you normally access. It’s not free to improvise.” This trust-by-design architecture reframes the goal of ent...

Frontline Intelligence: How Superhuman AI Could Save Soldiers Before the Medics Arrive

4 min

Looking for a shorter version of this story? I did a mini version of it for LinkedIn. 0300 Hours, Forward Operating Base The explosion echoes across the compound at 0300 hours. Specialist Rodriguez is down, twenty meters from the perimeter wall, conscious but bleeding. In the dim red light of night vision, Corpsman Martinez can see the soldier's uniform is torn across the chest, dark stains spreading. No time for a full trauma bay. No X-ray machine. No blood bank. Just Martinez, his medical kit, and a soldier whose life hangs in the balance of the next few critical decisions. But in this imagined future—perhaps a decade from now—Martinez reaches for something that doesn't exist today: a ruggedized tablet, olive drab and battle-scarred, about the size of a hardcover book but twice as thick. The device powers on with a muted chime, its screen glowing softly against his gloved hands. "Triage protocol, blast injury," he speaks into the built-in microphone. The AI responds immediately in a calm, synthesized voice: "Ready for patient assessment. Deploy sensors." This scenario remains science fiction today. But new research from Harvard, Stanford, and OpenAI suggests the foundational technology for such a system may be closer than we think. The Device That Doesn't Exist Yet In our imagined future battlefield, Martinez's device represents the convergence of multiple technologies: The Hardware: A military-grade tablet encased in shock-absorbing polymer, rated for drops from six feet onto concrete. Inside, specialized medical AI chips—evolved descendants of today's smartphone processors—run compressed diagnostic algorithms trained on thousands of combat injury cases. The 72-hour battery pack doubles as armor plating for the device's back. The Sensors: Martinez unfolds a flexible sensor mat from the device's side compartment—a thin, fabric-like array embedded with hundreds of micro-sensors. As he places it against Rodriguez's chest, it immediately begins measuring heart rate...

🐺 The Wolf Reads AI — Day 30: The Final Three: Residuals, Compression, and the Future of Thought

6 min

ResNets gave us depth. MDL gave us restraint. Superintelligence asks what happens when the machines don’t need either. 🎓 PART I: Deep Residual Networks — The Architecture That Wouldn’t Quit 📜 Paper: Deep Residual Learning for Image Recognition (2015) ✍️ Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun ResNets changed everything. Until this paper, it was thought that deeper networks were harder to train. Stack too many layers and performance got worse, not better. ResNets flipped that by asking: What if we just let some layers skip the hard parts? They introduced skip connections, letting gradients flow more freely, like pressure valves in a growing skyscraper. These “residuals” meant: * We could train 50, 101, even 152-layer networks * Models got deeper without falling apart * Features could be refined gradually, without rewriting earlier insights Why it matters: Modern deep learning—especially vision models, LLMs, and even transformers—owes a structural debt to ResNets. They showed us: * Depth works * Overthinking hurts * And sometimes, the best thing to do is skip ahead and carry the difference 📦 PART II: The Minimum Description Length Principle — Simplicity Is a Superpower 📜 Paper: A Tutorial Introduction to the Minimum Description Length Principle (2004) ✍️ Peter Grünwald Imagine trying to describe a dataset with a model. MDL says: The best model is the one that compresses the data most efficiently. It’s a formalization of Occam’s Razor—but rooted in information theory: * A good model describes the data with the fewest bits. * A bad model might memorize everything… and explain nothing. Why it matters for deep learning: * MDL underpins generalization. It tells us not to overfit. * It echoes through concepts like regularization, Bayesian inference, and code length penalties. * It’s a quiet guide behind nearly every choice in ML: * Should we prune that parameter? * Should we favor smaller models? * Are we solving the problem—or just encoding noise? MDL teaches...

🧠 The Wolf Reads AI — Day 29: “Order Matters: Sequence to Sequence for Sets”

5 min

📜 Paper: Order Matters: Sequence to Sequence for Sets ✍️ Authors: Oriol Vinyals, Samy Bengio, Manjunath Kudlur 🏛️ Institution: Google DeepMind 📆 Date: 2015 What This Paper Is About We use sequence-to-sequence models all the time—for translation, summarization, and code generation. They assume the input and output are ordered sequences. But here’s the problem: Not all data is ordered. Not all tasks care about order. But our models always do. This 2015 paper challenged that assumption and posed a fascinating question: What happens when you use sequence-to-sequence models to predict sets? Sets have no natural order. So, if your model insists on choosing one, it might: * Overfit to arbitrary patterns in the order * Penalize correct predictions just because the order is different * Fail to generalize, even when it “understands” the data Why It Still Matters We often say machine learning models are “brittle” or “opaque.” This paper shows why—sometimes it’s not the architecture. It’s that we’re asking it to care about something that shouldn’t matter. By exploring tasks where order is irrelevant—like predicting the members of a set, or classifying unordered features—Vinyals et al. revealed a critical blind spot in deep learning: Sequence models are sensitive to permutations, even when they shouldn’t be. And if you’re not careful, they’ll learn to solve the wrong problem really well. What They Did They ran experiments on synthetic data and real-world tasks, like: * Predicting numbers in an unordered list * Sorting digits * Classifying set membership And they tested three strategies: * Random Order: Train on arbitrary permutations. * Fixed Order: Always present data in the same (possibly meaningless) order. * Learned Order: Let the model decide the optimal order during training. They found that: * Models trained with random or fixed orders performed worse. * Allowing the model to learn an order improved generalization and accuracy. * Permutation-invariance is hard to teach...

The Wolf Reads AI — Day 28: “GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism”

5 min

📜 Paper: GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism ✍️ Authors: Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Mia Xu Chen, Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V. Le, Yonghui Wu, and Zhifeng Chen 🏛️ Institution: Google Brain 📆 Date: 2018 Listen to the technical explanation of this paper. What This Paper Is About If you’re building a neural network that spans billions—or trillions—of parameters, you’re going to hit a wall. Literally. Your hardware wall. GPUs and TPUs can only hold so much. So how do you train models bigger than any single accelerator can handle? This paper, GPipe, proposed an elegant solution: Break the model into sequential pipeline stages. Split the input batch into smaller “micro-batches.” Run the whole thing like an assembly line. It’s pipeline parallelism, and it made training huge models not only possible—but efficient, scalable, and practical. Why It Still Matters GPipe was quietly foundational. It didn’t get the hype of GPT or BERT, but it powered the systems that would go on to train them. This paper: * Solved the memory bottleneck in large model training * Kept all accelerators busy, avoiding idle time * Introduced synchronous gradient updates, which improved stability * Became the architectural backbone for early multi-chip model training Before there was Megatron, DeepSpeed, or ZeRO—there was GPipe. How It Works Think of the neural network as a multi-stage factory. You divide the model into K pipeline stages, and run small micro-batches of data through them like a conveyor belt. * Partition the model across devices (e.g. layers 1–3 on GPU 1, 4–6 on GPU 2, etc.) * Split the input batch into small chunks * Stagger the chunks, so each stage is always busy doing work Each device only stores its stage’s parameters, dramatically reducing memory usage. And once a stage finishes with a micro-batch, it passes it downstream—no idle time. When it’s time to backpropagate, the gradients are syn...

🧠 The Wolf Reads AI — Day 27: “Recurrent Neural Network Regularization”

11 min

📜 Paper: Recurrent Neural Network Regularization (2014)✍️ Authors: Wojciech Zaremba, Ilya Sutskever🏛️ Institution: Google Brain📆 Date: 2014 Before attention took the throne, RNNs were the go-to for sequential data. But they had a problem: they memorized everything and generalized nothing. This 2014 paper introduced a surprisingly effective fix: Apply dropout only to the non-recurrent connections in an RNN—never the recurrent ones. Why? Because dropping units in the hidden-to-hidden loop kills the memory. But dropping them between layers or from input/output? That’s regularization gold. The result?Huge performance boost on language modeling tasks—without blowing up the training loop. 🧠 Why It Matters * Gave RNNs a longer, more useful life * Influenced later work in LSTM/GRU optimization * Taught us that regularization isn’t one-size-fits-all—especially for recurrent networks 🧠 Favorite Line (Paraphrased): “Naive dropout in the recurrent path is catastrophic.” No kidding. Podcast Note: 🎙️Today’s podcast is created using Google NotebookLM and features two AI podcasters. See my article on the LinkedIn version of this newsletter: “Confessions of a NotebookLM Power User,” detailing how I create these articles. Read the original paper here. #RNN #NeuralNetworks #DeepLearningHistory #Dropout #Zaremba #IlyaSutskever #Regularization #WolfReadsAI #MachineLearningTips #PreTransformerEra This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

🐺 The Wolf Reads AI — Day 26: “The First Law of Complexodynamics”

16 min

📜 Paper: The First Law of Complexodynamics (2011, Shtetl-Optimized) ✍️ Author: Scott Aaronson 🏛️ Institution: MIT📆 Date: August 2011 What This Piece Is About This isn’t a journal article. It’s a blog post. But make no mistake—this post has legs. In it, theoretical computer scientist Scott Aaronson explores a question posed by physicist Sean Carroll: Why does complexity in physical systems rise, peak, and then fall—unlike entropy, which just rises forever? To answer this, Aaronson proposes a tongue-in-cheek but deeply thoughtful “First Law of Complexodynamics”: Complexity peaks at intermediate times. So… What Does That Mean? Think of a cup of coffee. When you pour in cream, the swirls and marbling at the start are beautiful—and complex. But fast-forward a bit, and all you’ve got is a uniform beige liquid. Low complexity. High entropy. Aaronson argues that many systems follow this same arc: * Low complexity at the start (everything orderly) * High complexity in the middle (patterns, structure, richness) * Low complexity again at the end (uniform, disordered mush) How He Explains It Using Kolmogorov complexity—the length of the shortest computer program that can describe a string—Aaronson introduces the concept of: 🌀Complextropy A proposed measure that captures how structured but unpredictable a system is. Not too ordered, not too random—just complicated. He suggests this measure should peak midway through a system’s evolution, and taper off as entropy dominates. He even proposes using gzip compression as a proxy to measure it in real-world data. (Yes, you might someday study physics with zip files.) Why It Still Matters * The post helped popularize the idea that complexity is not monotonic. * It introduced “complextropy” into the broader conversation about physical and computational systems. * It planted the seed for exploring how to measure complexity meaningfully over time—which still challenges ML, neuroscience, and physics. Relevance to AI While Aaronson’s pos...

🐺 The Wolf Reads AI — Day 25: “The Annotated Transformer”

4 min

📚 Paper: The Annotated Transformer (Harvard NLP) ✍️ Author: Alexander Rush 🏛️ Institution: Harvard NLP 📆 Date: 2018 What This Paper Is About Strictly speaking, this isn’t a “paper.” It’s a blog post—a tutorial. But don’t let that fool you. The Annotated Transformer quietly shaped the trajectory of modern AI. After the 2017 release of “Attention Is All You Need,” a generation of readers stared at the equations and nodded solemnly. Few really understood it. Then, in 2018, Harvard NLP dropped this beautifully written, line-by-line annotated PyTorch implementation. And just like that, it clicked. This post walked you through the Transformer model like a thoughtful TA with infinite patience. Every equation got a paragraph. Every architectural choice got a diagram. Every function had PyTorch code you could run yourself. It was open source. It was free. It was friendly. And it worked. Why It Still Matters Because the Transformer became the DNA of nearly every large language model, this blog post became required reading. It demystified the machinery of modern AI for: * Engineers and researchers trying to build their own models * Students learning how attention works in practice * Tinkerers who wanted to see what the fuss was about * Entire ML bootcamps who adopted it as a de facto textbook It’s hard to overstate how many people got their start with Transformers not by reading Vaswani et al., but by reading this . How It Works The Annotated Transformer walks you through the full architecture with five superpowers: * Clear prose * Simple equations * Clean PyTorch code * Live visualizations * No assumptions about your math level By the time you’re done, you haven’t just read about the Transformer—you’ve built one yourself. It wasn’t flashy. It wasn’t monetized. But it was one of the best educational resources ever written about modern deep learning. Read the original blog post here. Podcast Note 🎙️ Today’s podcast was generated by AI using Google NotebookLM. Memorable Quot...

Day 24: The Wolf Reads AI: Keeping Neural Networks Simple by Minimizing the Description Length of the Weights

12 min

Paper: Keeping Neural Networks Simple by Minimizing the Description Length of the Weights Authors: Geoffrey E. Hinton, Drew van Camp Published: 1993Link: https://www.cs.toronto.edu/~hinton/absps/colt93.pdf What This Paper Is About What if you trained a neural network… like you were trying to send it as a zip file? That’s the intuition behind this landmark paper, where Geoffrey Hinton and Drew van Camp bring the Minimum Description Length (MDL) principle into neural network training. Their big idea: Simpler weights generalize better. So let’s explicitly minimize the number of bits it takes to describe the weights. To do that, they propose a clever technique: * Add Gaussian noise to the weights during training * Adapt the noise level to find the right trade-off between precision and compression * Penalize models that need “too many bits” to describe their weights The result is a regularization method that behaves like a smarter, more principled version of weight decay — one that tries to communicate the model efficiently. Why It Still Matters This paper marks a major milestone: It connects information theory to neural network generalization in a mathematically grounded way. Its influence echoes through: * Variational methods (like the Variational Autoencoder) * Bayesian neural networks * Regularization via noise injection * Neural compression and efficient deployment At a time when neural nets were still mistrusted as overfitting black boxes, this paper argued for elegant simplicity — not by hand-waving, but by counting bits. How It Works Here’s the key move: * Treat each weight not as a fixed value, but as a distribution (a Gaussian). * Add noise to the weights during training — not to mess them up, but to force the network to work with less precision. * Use the MDL principle to measure cost: * The cost of describing each weight (which depends on how much noise you allow) * Plus the usual prediction error This leads to an objective that balances: * Expected squared e...

🐺 The Wolf Reads AI — Day 23: Kolmogorov Complexity and Algorithmic Randomness

5 min

The Wolf Reads AI: Day 23: Kolmogorov Complexity and Algorithmic Randomness Authors: Andrei Shen, Vladimir Uspensky, Nikolay Vereshchagin Published: 2017Read the PDF here. Find the book at the American Mathematical Society bookstore. 🧠 The Main Idea What does it mean for something to be random? What does it mean for something to be simple? Kolmogorov Complexity gives us a radical way to answer both: The complexity of a string is the length of the shortest computer program that can produce it. A string is random if no shortcut exists—no smaller program can reproduce it. It’s incompressible. This book by Shen, Uspensky, and Vereshchagin explores that idea from every angle—bridging computation, probability, and information theory into one sweeping framework. 🔍 Why It Still Matters Kolmogorov Complexity shapes how we think about data, patterns, and learning—even if we can’t compute it exactly: * In data compression, where meaning hides in patterns * In machine learning, when we aim to generalize rather than memorize * In anomaly detection, where something “too weird” signals a deeper pattern * In theoretical AI, as we consider the limits of what a system can learn At its heart is a deep truth: The best explanation is the shortest one that still works. If GPT-4 had a guiding principle, it wouldn’t be “know everything.” It would be: Find the shortest true story. ⚙️ How It Works Kolmogorov Complexity (KC) is usually written like this: K(x) = length of the shortest program p such that p outputs x * A string like "111...1" repeated 1000 times? KC is low — easy to generate. * A random-looking 1000-bit string with no pattern? KC is high — no shortcut. The book introduces: * Plain and prefix complexity — dealing with how we write and decode programs * Algorithmic randomness — when strings pass every statistical test for randomness * Incompressibility lemmas — showing that most strings simply can’t be shrunk * 📎 Key Concepts Explained Algorithmic Randomness A string is algo...

🐺 The Wolf Reads AI — Day 22: “Neural Message Passing for Quantum Chemistry”

7 min

Paper: Neural Message Passing for Quantum ChemistryAuthors: Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl Published by: Google Brain & DeepMindDate: 2017 What This Paper is About Before this paper, machine learning models treated molecules like feature vectors—long lists of descriptors hand-engineered by chemists. But molecules are really graphs: atoms (nodes) connected by bonds (edges). This paper proposed a fresh idea: why not use a graph neural network (GNN) that passes messages between atoms to model molecular behavior? The authors introduced a framework now known as the Message Passing Neural Network (MPNN)—a model that lets atoms communicate with their neighbors over multiple rounds, learning to represent the molecule as a whole. It changed how we do chemistry with AI. Why It Still Matters MPNNs brought graph-based learning into the mainstream, especially for: * Quantum chemistry * Drug discovery * Materials science * Molecular property prediction (e.g. solubility, reactivity, energy levels) This architecture didn’t just outperform older models—it was more interpretable, scalable, and general-purpose, influencing a generation of work in GNNs and graph transformers. Modern tools like Graphormer, MolBERT, and Open Catalyst models trace their roots to this paper. How It Works The core idea of the MPNN: * Each atom (node) starts with a feature vector (e.g., element type, charge). * During each step, every atom sends a message to its neighbors via the bond (edge). * Messages are aggregated and used to update the atom’s internal state. * After multiple rounds, a readout function summarizes the entire molecule for prediction. It’s like letting the molecule talk to itself before you ask it to predict a property. The architecture is flexible—you can plug in different message functions, aggregation rules, or readout heads. It’s a framework, not just a single model. Memorable Quote from the Paper “Our message passing framework provi...

🐺 The Wolf Reads AI — Day 21: "Pointer Networks."

13 min

Paper: Pointer Networks Authors: Oriol Vinyals, Meire Fortunato, Navdeep Jaitly Published by: Google Brain (2015)Link: https://arxiv.org/abs/1506.03134 What This Paper is About Neural networks are great at producing outputs from fixed sets (like classifying images into categories). But what if the “correct” output depends on the input itself? Enter Pointer Networks—a neural architecture that learns to output positions in the input sequence. It’s like telling a model: “Don’t generate the answer—point to it.” This idea is perfect for tasks like: * Sorting numbers * Finding shortest paths (TSP) * Picking elements from a list (e.g., top scoring word, best move, closest object) The model uses attention mechanisms to “point” at the correct part of the input—rather than generating symbols from a fixed vocabulary. Why It Still Matters Pointer Networks were among the first to combine: * Sequence-to-sequence modeling with * Dynamic output spaces, using * Attention not just for context, but as a direct pointer mechanism This paved the way for architectures where structure matters more than symbols—like program synthesis, routing, combinatorics, and modern tool-using LLMs. It’s also a spiritual ancestor to transformer pointer models, retrieval-based generation, and even in-context learning tricks where models identify answers embedded in prompts. How It Works Pointer Networks are built on seq2seq models (with encoder-decoder LSTMs), but with a twist: * Instead of predicting a token from a vocabulary, the decoder uses attention to select an input position. * So if your input is a list of numbers, the output might be: “3rd element, 1st element, 4th element” → a sorted order. Think of it like turning a neural network into a clickable highlighter—it doesn’t write answers, it finds them. Memorable Quote from the Paper “We present a novel neural network architecture that uses attention to learn the conditional probability of an output sequence whose elements are discrete tokens cor...

🐺 The Wolf Reads AI — Day 20: Neural Turing Machines

11 min

Paper: Neural Turing Machines Authors: Alex Graves, Greg Wayne, Ivo Danihelka Date: 2014 Read the Original Paper: Neural Turing Machines (2014) What This Paper is About Before this paper, neural networks were like brilliant students with short-term memory loss—great at pattern recognition, terrible at recall. Neural Turing Machines (NTMs) proposed a hybrid system: a neural net controller connected to an external memory matrix, trained end-to-end using backpropagation. The result? A model that could learn simple algorithms like copying, sorting, and associative recall—concepts traditionally out of reach for standard RNNs or LSTMs. Why It Still Matters NTMs introduced the concept of differentiable memory—the ability to learn how to store and retrieve information in an external memory bank. Though they were tested only on synthetic tasks (like copying random binary vectors), the foundational ideas went on to inspire later architectures like: * Differentiable Neural Computers (DNCs) * Memory Networks * Retrieval-Augmented Transformers Even if modern LLMs like GPT-4 don’t use NTMs directly, the underlying idea—trainable memory systems—echoes in everything from in-context learning to RAG pipelines. How It Works An NTM has two core parts: * A controller, typically a neural net (like an LSTM), that decides what to do * A memory matrix, a grid where the controller can read and write Instead of fixed memory access, NTMs use soft attention mechanisms to determine which memory locations to interact with—making the entire system differentiable and trainable. But it wasn’t all smooth sailing: * NTMs struggled with very long sequences—performance dropped sharply with input lengths above ~120 steps. * Early implementations suffered from stability issues like exploding gradients or NaNs, which slowed down real-world adoption. Still, the promise was clear: you could teach a neural net to learn an algorithm rather than program it directly. Why It Blew People’s Minds NTMs could learn...

Day 19: The Wolf Reads AI- "Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton"

10 min

Title: “Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton”Authors: Scott Aaronson, Sean M. Carroll & Lauren Ouellette Date: May 27, 2014Link: https://arxiv.org/pdf/1405.6903 What’s the big idea? Aaronson, Carroll & Ouellette model “interestingness” in a closed thermodynamic system by simulating cream diffusing into coffee via a 2D cellular automaton. They measure “apparent complexity” as the Kolmogorov complexity of a smoothed snapshot of the cup—showing that, unlike entropy (which only increases), complexity first rises then falls. Key Contributions * Apparent Complexity Measure: Maps each automaton state to a coarse-grained grayscale image, then quantifies its complexity by compression size. * Analytic Baseline: Proves non-interacting particles never produce high complexity. * Numerical Experiments (Original Claim): Reported a peak in complexity when particles interact, roughly when diffusion reaches the cup’s diameter. * Open Challenge: Posed proving this peak analytically. Post-Publication Revision (2015) Scott Aaronson later acknowledged that the originally reported complexity bump was a simulation artifact caused by border-pixel rounding errors. (Github.) Brent Werness showed that, with the original interaction rule, no true bump occurs—and one can even rigorously prove its absence. However, by adopting a new “shearing” rule (shifting entire regions of cream and coffee), the model does exhibit provable complexity growth. A revised version of the paper, with Werness and Varun Mohan as co-authors, details this corrected mechanism. (scottaaronson.blog/ Why it matters This work remains a landmark for making “complexity” in closed systems mathematically tangible—and for exemplifying how scientific models improve through iterative correction. Its evolution underscores the importance of rigorous validation in computational science and points toward richer models of self-organization in physics, chemistry, and biology. Read the origi...

Day 18 — Wolf Reads AI: Relational Memory Core (RMC)

13 min

Title: Relational Recurrent Neural Networks Authors: Adam Santoro*, Ryan Faulkner*, David Raposo*, Jack Rae, Mike Chrzanowski, Théophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu, Timothy Lillicrap (*equal contribution)Institution: DeepMind, University College LondonDate: 2018Links: NeurIPS Why this paper still howls Classic RNNs (even beefy LSTMs) can store information for long stretches—but they’re clumsy at reasoning about relations between those stored facts. RRNs bolt a “Relational Memory Core” (RMC) onto an RNN, letting each memory slot attend to every other slot (Transformer-style). The result? State-of-the-art scores on language modelling (WikiText-103), program evaluation, and a Pac-Man-style RL challenge—all with fewer parameters than brute-force scaling. It was an early proof that structured attention + recurrence beats sheer size for some reasoning tasks. How it works Picture your RNN’s hidden state as a hotel with many rooms (memory slots). In a vanilla RNN each guest scribbles notes but never talks to the neighbours. The RMC installs a lobby where, every timestep, guests exchange gossip via multi-head dot-product attention. Queries, keys, and values are projected from each slot, attention scores decide who listens to whom, and the blended “tea” is written back into every room. A lightweight gating step (à la LSTM) filters noise, and the updated matrix marches to the next timestep. Because slots can now compare notes explicitly, the network natively reasons about relationships over time rather than just memorising sequences. Key takeaways for humans * Relational bias matters. By baking “objects + their relations” into memory, RRNs solve tasks that stump plain LSTMs. * Attention isn’t just for Transformers. You can retrofit it inside recurrent cores to get the best of both worlds: long contexts and efficient online processing. * Sample-efficient RL gains. In partially observed games (Mini-PacMan) RRNs learned better policies faster—handy for...

See all 153 episodes

–

0 ratings from members

5
4
3
2
1

Rate this podcast

Log in to rate and review the shows you listen to.

No reviews yet — be the first member to rate "Deep Learning With The Wolf".

This podcast, its content and its artwork are not owned by, affiliated with, or endorsed by Castquire.

Keep listening

Discover more podcasts like this.

Up next

  1. Nothing queued. Use + Queue on any episode to line it up.

0:00 0:00