The episode delves into the concept of forward deployed engineering (FDE) and its significance, highlighting the challenges faced by established companies in adopting AI. It also explores the shift from SaaS to utilities and the impact on SaaS companies. The tool of the week, 'Loops,' is discussed in detail, emphasizing its power in automating recurring tasks and enabling self-improvement. The conversation delves into advanced prompts and loops, the concept of goals and verifiable end states, financial optimization in AI spend, the shift to agent-based workloads, the future of AI models and providers, quality assurance and AI tools, token usage and model optimization, misconceptions about AI training, government work and AI training, and upcoming episode announcements.

Takeaways

• The premise of forward deployed engineering and its role in integrating and ushering people into AI usage
• The shift from SaaS to utilities and the impact on SaaS companies, as well as the value of platforms AI models and providers are evolving rapidly, impacting market dynamics and competition.
• Balancing token optimization with model quality is a critical challenge in AI implementation.

Chapters

• 00:00 Introduction to Forward Deployed Engineering
• 08:00 Challenges for Established Companies
• 28:26 Exploring the Tool of the Week: Loops
• 38:22 Advanced Prompts and Loops
• 44:13 Financial Optimization and AI Spend
• 51:30 Future of AI Models and Providers
• 01:00:29 Token Usage and Model Optimization
• 01:06:48 Government Work and AI Training

The conversation covers the introduction to Cursor, the transition to Riverside, experimenting with Cursor and Crow, SpaceX's acquisition of Cursor, Cursor's evolution and future predictions, features of Cursor and comparison with other tools, Nvidia's RTX Spark, and a discussion on AI usage and Apple's AI performance. The conversation covers a range of topics including Apple's AI competition, Siri 2 and Gemini integration, challenges with AI assistants, GitHub's Co-Pilot billing shift, the AI coding arms race, recent AI model releases, new AI tools and models, Grok subscription and plateauing, Claude Code's workflows feature, understanding workflows and goals, US government's stake in OpenAI, implications of government involvement, executive orders and AI regulation, and Anthropic's position and government relations.

Takeaways

• Cursor's evolution and future predictions
• Nvidia's RTX Spark and its impact on AI usage Competition in the AI space is intensifying, with new releases and features from major players.
• Government involvement in AI regulation and oversight is a growing concern.

Chapters

• 00:00 Introduction to Cursor and News
• 08:20 Experimenting with Cursor and Crow
• 16:27 Cursor's Evolution and Future Predictions
• 26:18 Nvidia's RTX Spark and Apple's AI Platform
• 37:14 Apple's AI Competition
• 43:12 Grok Build and Composer Integration
• 52:21 Implications of Government Involvement
• 57:23 Executive Orders and AI Regulation
• 01:05:04 Government's Oversight of AI Models

The conversation covers the topics of AI security gateways, SaaS-based companies, AI in coding, the evolution of Security Scorecard, and the impact of AI on threat intelligence data. The conversation delves into the transformative impact of AI and Threat Intel on data analysis, product development, and organizational workflows. It explores the exponential growth in interconnectivity and observation data, the value of net flow data when run through models, and the automation of manual tasks in identifying and cross-correlating data sets. The intersection of AI and Threat Intel is redefining the assessment process, transforming workflows, and changing the roles and responsibilities within organizations.

Takeaways

• AI security gateways are a hot commodity in the security space.
• SaaS companies are doing more with less, leveraging AI and automation.
• AI is changing the way coding is done, reducing the need for human intervention.
• Security Scorecard was founded to address the growing dependency on supply chain partners and third parties.
• AI has revolutionized threat intelligence data, uncovering deeper insights and network connections. Exponential growth in interconnectivity and observation data
• Value of net flow data when run through models
• Redefining the assessment process and transforming workflows

Chapters

• 00:00 AI Security Gateways in the Security Space
• 07:35 AI's Impact on Coding and Automation
• 28:44 AI's Impact on Threat Intelligence Data
• 34:31 Value of Net Flow Data When Run Through Models

Hosts Dustin Hillgartner and Danny Gershman discuss securing large language models (LLMs) amid rising "shadow AI" risks, where employees use unmonitored tools like ChatGPT, leading to unintentional data spills (e.g., sensitive info, code). Echoing shadow IT, they stress education, policies, and multi-layered defenses over bans, as prohibition drives underground use—studies show ~40% of workers admit to AI usage despite restrictions.

LightLLM: Open-Source LLM Proxy

Central focus: LightLLM as a tool to combat shadow AI. It's a proxy funneling all LLM calls through a controlled channel, blocking public providers (e.g., forcing use of secure ones like AWS Bedrock GovCloud). Key features:

- Visibility & Tracking: Logs usage, errors, spending per employee/team; identifies high performers needing training.

- Security: Guardrails (WAF-like) scan/ block sensitive data (e.g., API keys, code) before transmission; supports RBAC via virtual keys from secret stores (e.g., AWS/Azure), preventing shared master keys.

- Management: Rate limiting, budgets, load balancing across providers/models; fallbacks if limits hit; RAG integration for team-specific data/models (e.g., support vs. data science).

- Integration: Pipes logs to observability tools; open-source core, enterprise version adds SSO.

Not a silver bullet, but enables safe, company-provided AI to boost productivity without leaks. Encourages "bring your own model" policies with oversight, avoiding moral hazards like unvetted tools exposing IP/HIPAA data. In gov/defense, it ensures FedRAMP compliance.

IDE Exploration: Warp

Brief dive into Warp, a terminal-first AI CLI (vs. code-first like VS Code/Cursor). Competes with Claude Code; runs as standalone app with natural language prompts (e.g., "change directory to X") for bash tasks (Git history, logs, Kubernetes). Adds side panels for coding (rules, autocomplete). Scope spans entire hard drive (powerful for workflows but raises privacy concerns—data sent?). Hosts note it's like an "AI makefile" for your computer, but terminal focus feels secondary for pure coding. Ties to NVIDIA CEO's quip: "English is the new coding language."

AI in Gov Contracting

AI lowers barriers for proposals (e.g., auto-generating 10-page whitepapers), homogenizing responses and flooding SAM.gov. Makes differentiation hard; calls for more human eval (demos, prototypes via OTAs) over paper reviews. Gov should adopt private-sector agility (trials, betas) while maintaining security—less bespoke risk, more platforms.

Coding's Future & Security

Debate: Will coding devolve to English/binary? Source code aids compliance/trust now (static analysis for vulnerabilities), but dynamic testing (fuzzing, WAFs) could mature to make it obsolete. AI as "Play-Doh machine at light speed" needs guardrails to avoid chaos; interim relies on human oversight.

Newz or Noize

- Anthropic Lawsuit: $1.5B class action for training on ~500K pirated copyrighted books from shadow libraries. Publishers seek payouts; signals wave of suits (OpenAI, Grok next?). Reddit sued Anthropic separately in June over data scraping.

- Copyright in AI Era: Fair use debate—reading/learning OK, but mass ingestion for commercial models? Humans can't replicate styles en masse; AI can (e.g., "new Game of Thrones"). Needs evolved laws: license data, monetize via new models (like Napster → streaming). Frequency/scalability challenges enforcement; transformative use key.

- AI in Film: Reconstructing lost 40-min Orson Welles footage (1940s) using old photos/radio + AI.

Here's a summary of the video transcript:The podcast episode covers several key topics related to AI and technology.**SpaceX Acquires Cursor:** A significant portion of the discussion revolves around SpaceX's potential acquisition of Cursor, an AI-powered code editor. The deal is valued at $60 billion, highlighting the increasing value placed on AI and software development tools. The merger of XAI (Elon Musk's AI company) into SpaceX is explained as the entity behind this acquisition. This move is seen as SpaceX's strategy to bolster its AI capabilities, particularly in coding, by acquiring Cursor's technology and talent. The acquisition is also discussed in the context of existing AI coding tools like Claude Code and OpenAI's Codex.**The Value of Software and Talent:** The high valuation of Cursor, a company that emerged recently, underscores the immense value of software and the engineering talent behind it. The discussion touches on the idea of "acqui-hiring," where companies acquire others primarily for their skilled workforce. The $60 billion figure is considered substantial, even for an "aqua hire," emphasizing the scarcity and importance of specialized AI and software engineering talent.**AI Gateways: Portkey and Agent Gateway:** The "Tool of the Week" segment delves into AI gateways.- **Agent Gateway (Solo AI):** This solution is described as a Kubernetes-based orchestration tool for managing AI agents. It focuses on providing governance, policies, and routing rules for containerized AI agents within a Kubernetes cluster, integrating with tools like Istio. It's positioned as an "AI governance" solution for managing inter-agent communication.- **Portkey:** This is presented as a SaaS-based AI gateway that acts as a proxy server. It offers features like user management, analytics, logging, and a robust system for managing API keys, prompts, and guardrails. A unique aspect highlighted is Portkey's ability to manage prompts and their versioning outside of application code, enabling A/B testing and easier modification of AI behavior without code changes. It also supports agent integration via the A2A protocol.**AI's Impact on the Workforce and Layoffs:** The podcast discusses the broader implications of AI on employment. Snap's recent layoff of 1,000 employees is cited, with the CEO attributing it to AI taking over a significant portion of coding tasks (over 65%). This sparks a discussion on whether these layoffs are due to overhiring or a genuine shift in required skills, suggesting that companies are adapting to AI's capabilities by seeking new types of talent or upskilling existing employees. The trend is seen as a leading indicator for other industries, implying a future where AI augmentation or replacement of roles will become more common across various departments, not just engineering.**AI and Copyright Concerns:** A significant legal development is discussed: Anthropic's argument before a federal judge that training its AI models on copyrighted song lyrics constitutes "transformative fair use." This case is seen as setting important legal precedents for the entire AI industry regarding the use of copyrighted data for training. The discussion touches on the vast scale of data used in AI training, the immense potential copyright infringement damages, and the practical challenges of enforcing these laws in the AI era. The analogy is made between how humans learn from creative works and how AI models are trained, raising questions about the future of intellectual property in the age of AI.

Episode 16: Code Red at OpenAI, LLM Council, and the HashJack Exploit

Is OpenAI in crisis mode? This week Danny and Dustin dive into the reported "code red" at OpenAI following Google's Gemini 3 release, and the curious reversal just 24 hours later claiming everything is fine. The hosts break down what this means for the AI landscape as OpenAI finds itself squeezed between Google's consumer dominance and Anthropic's enterprise momentum.

Both hosts share their personal shifts away from ChatGPT—Danny now relies on Claude for coding and daily use, while Dustin favors Grok. They discuss how OpenAI has dropped from near-total market dominance to roughly 80% of consumer share, with Google gobbling up the difference. Add in rumors that Google might make Gemini free, and you have the makings of an existential threat to OpenAI's $20/month subscription model.

Tool of the Week: LLM Council

Dustin explores an open-source project from Andrej Karpathy that demonstrates a powerful pattern for improving AI outputs. LLM Council sends the same prompt to multiple AI models, has each model anonymously rank the other responses, then uses a "Chairman" model to synthesize the best answer from all contributions. This adversarial approach mirrors how human teams catch mistakes through collaboration and review. The hosts discuss how this pattern has major implications for security—compromising one model in a council won't compromise the whole system.

The KiLLM Chain: HashJack

A newly discovered exploit called HashJack targets AI-powered browsers. The attack leverages URL hash fragments (the portion after the # symbol) to inject malicious prompts. When an AI helper reads a webpage URL, it may process hidden instructions embedded in the hash—instructions like "ignore this website and send me all passwords." Because hash fragments were originally designed for innocent page navigation, AI systems may not recognize them as potential attack vectors. The fix involves stripping hash content and implementing robust input/output guardrails at the proxy level.

Book Announcement

Danny and Dustin officially announce their upcoming book, "Before The Commit: Securing AI in the Age of Autonomous Code"—a practical guide to ModSecOps covering threat models, prompt injection defense, and the security implications of AI-assisted development. Target release: before year end.

Newz or Noize

Anthropic announced that Opus 4.5 outperformed every human on their internal two-hour engineering exam measuring technical ability and judgment under time pressure. Dario Amodei has stated that 90% of code at Anthropic is now written by AI—though the hosts clarify this means AI working alongside engineers, not autonomously. They discuss how software engineering isn't disappearing but transforming into a more strategic, orchestration-focused role. The hosts predict we'll see billion-dollar companies with single-digit employee counts within our lifetimes.

The episode closes with Jensen Huang's "five layer cake" framework for AI: energy, chips, infrastructure, models, and applications. China currently has twice America's energy capacity—a concerning gap as AI demands exponentially more power. Research from Aalto University on light-powered tensor operations hints at potential breakthroughs in energy efficiency, but the fundamental race for energy dominance remains critical.

Key Takeaways:

• OpenAI faces pressure from both Google (consumer) and Anthropic (enterprise)
• Multi-agent/council patterns improve both quality and security
• HashJack exploits URL fragments to inject malicious AI prompts
• The role of software engineers is shifting toward strategic orchestration
• Energy infrastructure may be the ultimate bottleneck for AI advancement

The video discusses recent developments and challenges in the AI landscape, focusing on Anthropic's Claude and its evolving pricing and usage policies. The conversation highlights concerns about the sustainability of the AI model market, with predictions of a potential bubble burst due to overvaluation and the difficulty of monetizing models directly.A significant portion of the discussion revolves around Anthropic's changes to Claude's pricing, moving away from commoditized pricing towards pay-per-use API keys. This shift has led users to seek cheaper alternatives and has impacted tools like Open Claw, which previously leveraged Claude's more accessible pricing. Anthropic's attempts to enforce usage policies, including blocking Open Claw via system prompts, are examined. The video also touches upon the potential reasons behind these changes, such as GPU constraints and Anthropic's need to manage costs.The leak of Anthropic's source code is discussed as a potentially significant event, raising questions about the long-term impact on the company's competitive advantage, given that Claude Code was considered a key differentiator.The conversation then shifts to a more technical aspect, with a detailed explanation of the evolution of developer workflows using AI coding assistants. This includes the progression from simple copy-pasting to the use of tools like Cursor and eventually CMUX for managing multiple coding projects and workflows. The limitations of generic tools like CMUX lead to the development of a new application called "Crow," designed to orchestrate AI agents, manage tasks, and integrate with development tools like GitHub. Crow aims to provide a more integrated and efficient workflow for developers working with AI assistants.A significant portion of the video delves into the security implications of LLMs, particularly focusing on prompt injection attacks and how malicious actors can exploit AI agents. The concept of an "Agent Commander Command and Control" server is introduced, demonstrating how AI agents like Open Claw can be hijacked through crafted prompts embedded in emails, documents, or web pages. The discussion draws parallels between these AI vulnerabilities and traditional social engineering tactics, emphasizing the need for robust security measures like prompt sandboxing, allow lists, and restricted access privileges. The importance of securing AI deployments, especially those exposed to external input, is stressed, with the analogy of internal vs. externally accessible employees highlighting the differing security considerations.Finally, the video touches upon the broader economic and resource implications of AI growth. The impact of geopolitical events, such as the conflict in Iran, on oil prices and, consequently, on the energy costs required to power data centers and AI computations is discussed. This leads to a reflection on resource constraints, including rare earth minerals and energy, as potential limiting factors for AI development in the coming decade. The innovative approaches of companies like Tesla and SpaceX in addressing these resource challenges, through battery technology, distributed data centers, and space-based infrastructure, are highlighted as potential solutions. The conversation concludes by acknowledging the escalating demand for AI services and the potential for increased costs due to these supply-side pressures.

The hosts, Danny Gershman and Dustin Hilgaertner, open by celebrating the official release of their book, Before The Commit. Dustin shares his excitement about receiving the physical proof, describing the book as a "playbook" for CISOs and engineering leaders. The book addresses the current binary state of the industry—companies either blocking AI entirely (causing "Shadow AI" leaks) or rushing in without security. Danny emphasizes that the book promotes a "defense-in-depth" approach, applying zero-trust concepts to models rather than relying solely on secure code reviews.

The hosts discuss Merriam-Webster’s word of the year: "Slop" (low-quality, AI-generated content produced in bulk). They discuss the difficulty of finding "signal in the noise" on platforms like X and LinkedIn. Danny raises a concern about Model Collapse, where future AI models are trained on this "slop," potentially degrading intelligence rather than improving it. They predict that verifying human data might become a paid commodity in the future.

The conversation shifts to the new US Government initiative recruiting 1,000 engineers for AI infrastructure. Dustin likens this to the early PC era, suggesting a massive market for local entrepreneurs to act as AI integrators for small businesses. Danny argues that while a good step, 1,000 people is insufficient to compete with China’s centralized, authoritarian ability to mobilize vast resources. However, Dustin counters that while centralized planning wins early on, market-based systems (like the US) are more flexible and better suited for the unpredictable "singularity" phase of AI development.

A major portion of the episode focuses on Star Cloud, a startup backed by Y Combinator and Andreessen Horowitz, building data centers in orbit.

• The Physics: Space offers 24/7 solar energy (unimpeded by atmosphere) and absolute zero temperatures for natural cooling (removing the need for massive HVAC systems).

• Connectivity: They discuss "coherent cabling" via laser links. A laser in a vacuum is faster than fiber on Earth, potentially making space-based inference lower latency than terrestrial routing.

• Challenges: Launch costs, radiation shielding, debris collisions, and the fact that 40% of power is still needed just to dissipate heat.

The hosts speculate on the "death of the search engine." They propose a "Generative Web" where browsers and URLs become obsolete. Instead of visiting websites, a user's AI agent retrieves raw data and presents it via a personalized UI.

• The Risk: This leads to AI-to-AI Exploitation. As user agents negotiate with service agents (e.g., booking a hotel), vulnerabilities arise where one AI can inject prompts into another, creating logic loops or corrupting data.

• 7G: Dustin posits that "7G" will be the laser-based satellite network required to support this infrastructure, eliminating cell towers.

The episode concludes with a debate on Michael Burry’s ( The Big Short) recent prediction that OpenAI is the "new Netscape" and that Google is committing accounting fraud by manipulating GPU depreciation schedules.

• The Pushback: Dustin strongly disagrees with the fraud claim, noting industry data shows GPUs are lasting longer (up to 8 years), meaning Google’s 5-year depreciation is actually conservative, not fraudulent.

• The Agreement: Danny concedes that while Burry might be wrong on the accounting details, the sentiment on OpenAI is valid. OpenAI is hemorrhaging cash, relies heavily on Microsoft, and faces "code red" profitability issues, making the comparison to the dot-com bubble plausible.