In this digest
- How AI-Native Companies Are Rebuilding the Management Function
- Very interesting new report from @AnthropicAI on how AI has...
- Inside the black box of AI: How AI models actually think \| Emmanuel Ameisen (Anthropic)
- The Decoherence Trap
- Speeding up code review with `small-change`
- Weβre Thinking Too Small About Synthetic Data
- How to Create Effective Agent Skills
- He Wants AI Benchmarking To Be a Science, Not a Dark Art \| Quanta Magazine
- Weekly Compute Dashboard
- π§ JPMorgan and Citi block AI agents
- Code Review Sucks Now, but It Doesn't Have To
- Ontology-Driven Observability: Building an End-to-End Knowledge Graph at Netflix Scale
- Job-Search Advice Now Expires Every Six Months
- Learn to ship
- How to Make an Offer Your Candidate Actually Accepts
Themes from yesterday
- AI moves operational bottlenecks away from raw output generation toward judgment, coordination, and rigorous verification.
- Autonomous agent systems require structured operational context, strict permissions, detailed audit trails, and dependable evaluation methods.
- Software engineering practices are adjusting to higher pull request volume through shared agent transcripts and automated quality checks.
- Long-term advantage comes from proprietary operational context, cohesive system architecture, and rapid feedback loops.
1. How AI-Native Companies Are Rebuilding the Management Function β The Coordination Layer
- Why read: A clear explanation of how AI changes team structure, management roles, and internal coordination.
- Summary: Teams built around AI are removing functional silos and giving individual contributors much higher output capacity. The main operational challenge is no longer producing work, but making sound decisions, preventing duplicated effort, and coordinating people with agents. Shared internal knowledge bases open up operational context across an organization, but they also raise the stakes for governance and accountability. Managers spend less time routing information and more time setting up decision frameworks, supervising agents, and maintaining a steady operating rhythm.
- Read more
2. Very interesting new report from @AnthropicAI on how AI has... β X
- Why read: A sensible reminder not to treat frontier AI labs as blueprints for every other company.
- Summary: Anthropic's internal numbers point to frequent role shifts, more movement between teams, and hiring criteria centered on judgment. The author notes that Anthropic operates with minimal internal friction, direct access to frontier models, and almost no legacy technical debt. Traditional companies should use these patterns to spot their own operational bottlenecks instead of copying Anthropic directly. A major open question remains: if companies hire fewer junior technical staff, how will they train the next generation of senior experts?
- Read more
3. Inside the black box of AI: How AI models actually think \| Emmanuel Ameisen (Anthropic) β Substack
- Why read: A clear breakdown of what model interpretability means for product engineers and safety teams.
- Summary: Viewing language models simply as next-token predictors overlooks how they plan and represent information internally. Interpretability research shows that models build reusable internal concepts and plan steps ahead before producing output. Standard benchmarks cannot show why a model succeeds, fails, or acts deceptively. Teams deploying AI in high-stakes environments should pair interpretability tools with standard evaluations, safety guardrails, and live monitoring.
- Read more
4. The Decoherence Trap β maevyn.codes
- Why read: A helpful way to think about the long-term maintenance debt created by faster AI code generation.
- Summary: System decoherence happens when software accumulates fixes, patterns, and modules that work in isolation but conflict with each other globally. AI tools let developers ship changes faster than teams can align architecture, update documentation, and clean up interfaces. Over time, that compounding mess makes every new edit harder to understand and increases the odds of system-wide failures. Engineering teams need dedicated time for coherence tasks, such as enforcing standards, deleting dead code, finishing partial migrations, and owning system architecture.
- Read more
5. Speeding up code review with `small-change` β lethain.com
- Why read: A practical way to manage code review when AI tools sharply increase pull request volume.
- Summary: Imprint observed higher pull request volume and fewer production incidents, but code reviews started slowing down. Under its small-change policy, low-risk pull requests get fast-tracked approvals if they pass automated tests and meet strict rules around author experience, diff size, and touched file paths. Only a small share of changes qualifies at first, which keeps standards high; the system depends on strict automated verification rather than lax oversight. When a fast-tracked change causes a bug, the team treats it as an automation failure and tightens testing rules.
- Read more
6. Weβre Thinking Too Small About Synthetic Data β X
- Why read: A solid argument for why training AI agents requires realistic simulation environments instead of simple prompt generation.
- Summary: Synthetic training data for autonomous agents needs realistic tasks, interactive environments, shared state, and dependable verification. Running simulations with explicit state transitions creates consistent historical trajectories much better than generating isolated text snippets and trying to patch discrepancies later. Human domain experts are still needed to define realistic task distributions, capture practical edge cases, and spot errors that automated checks miss. Teams evaluating synthetic data generators should measure actual downstream performance improvements and task transfer, not just total dataset size.
- Read more
7. How to Create Effective Agent Skills β openhands.dev
- Why read: A hands-on guide to converting repetitive prompt chains into durable, modular agent workflows.
- Summary: Agent skills bundle step-by-step instructions, execution scripts, reference material, and assets for recurring procedures. Using progressive disclosure keeps the baseline context window small, loading deeper instructions only when a specific task triggers them. Teams should log skill usage, score task outcomes, and feed user feedback back into regular updates. Treat skills like versioned software products with usage tracking and automated evaluations, not as static prompt files.
- Read more
8. He Wants AI Benchmarking To Be a Science, Not a Dark Art \| Quanta Magazine β Quanta Magazine
- Why read: A clear look at why public AI benchmark numbers are losing credibility and how evaluations need to evolve.
- Summary: Computer scientist Moritz Hardt argues that public benchmark scores are increasingly untrustworthy because test sets leak into training data and training mixes remain secret. Relative rankings used to be more dependable than raw scores, but even those break down when models are optimized directly for specific tests. His altitude training proposal standardizes pre-test setup and fine-tuning so models compete under equal conditions. Buyers evaluating AI models should treat benchmark scores as just one data point alongside custom task evaluations, stress testing, and real production results.
- Read more
9. Weekly Compute Dashboard β Forward's Substack
- Why read: A concise breakdown of how heavy compute demand is running up against tighter infrastructure financing.
- Summary: This weekly tracker follows GPU rental prices, token rates, public equities, secondary chip markets, and grid power limits. Recent data shows infrastructure stocks and debt markets softening even as several GPU rental indices climb. That disconnect points to financing costs and capital constraints as the near-term pressure points, rather than a drop in compute demand. AI teams should track capital availability, power access, and rental pricing together instead of assuming compute demand alone will keep infrastructure stable.
- Read more
10. π§ JPMorgan and Citi block AI agents β beehiiv.com
- Why read: A practical example of the tension between consumer agent convenience and banking security controls.
- Summary: JPMorgan and Citi are blocking third-party autonomous agents from logging into accounts or initiating transactions, while leaving select read-only data connections open. The banks are concerned about fraud risk, credential sharing, legal liability, user consent, and the difficulty of reversing unauthorized actions. At the same time, newer fintechs are testing agents that assemble transactions but require explicit human sign-off before sending money. The durable model will likely rely on scoped, auditable permissions with step-up authentication for high-risk actions.
- Read more
11. Code Review Sucks Now, but It Doesn't Have To β just-be.dev
- Why read: A thoughtful take on fixing code reviews that have become overwhelmed by AI-generated diffs.
- Summary: When engineers use AI tools to generate code, reviewers lose the subtle reasoning clues typically embedded in human-written pull requests. The author suggests sharing agent session logs, design plans, and clear notes on architectural deviations as formal review materials. Bringing reviewers into the planning stage catches design disagreements early, when changes are still cheap to make. Teams can maintain code quality and institutional knowledge by sharing concise decision notes without forcing reviewers to comb through raw agent chat logs.
- Read more
12. Ontology-Driven Observability: Building an End-to-End Knowledge Graph at Netflix Scale β Medium
- Why read: How Netflix structures operational data so engineers and automated agents can diagnose incidents accurately.
- Summary: Netflix maps services, incident logs, deployments, metrics, team ownership, and Slack discussions into a shared operational knowledge graph. The platform turns scattered monitoring data into typed, validated connections that different internal tools can query reliably. Upstream components use language models and fuzzy matching to extract insights, but map those findings into strict, deterministic graph schemas before downstream services consume them. For production agent systems, the lesson is clear: invest in clean entity definitions, data validation, audit trails, and verifiable evidence.
- Read more
13. Job-Search Advice Now Expires Every Six Months β substack.com
- Why read: A realistic look at how hiring criteria for product and leadership roles are shifting as AI evolves.
- Summary: Frontier AI work is spreading beyond major research labs into early-stage startups, big tech firms, and industry-specific enterprises. Competitive candidates pair direct technical experimentation with product sense, team leadership, and a realistic grasp of model limitations. Long-term company commitment, unique internal data, and rapid iteration loops matter far more than job titles or industry buzzwords. For engineering and product leaders, staying relevant requires building directly with new models and tools instead of leaning on old assumptions.
- Read more
14. Learn to ship β proofofconcept.pub
- Why read: A straightforward reminder that cheap code generation makes product polish, distribution, and real-world delivery matter even more.
- Summary: AI coding tools lower the cost of generating software, but they cannot define product scope, guarantee security, manage deployments, handle distribution, or deliver customer value. Real shipping covers the entire cycle: scoping, designing, building, refining, reviewing, and learning from actual user behavior. The real advantage lies in tightening that feedback loop without sacrificing the quality needed to build trust. Builders must separate weekend demos from viable products, taking full responsibility for the operational and support work required once code hits production.
- Read more
15. How to Make an Offer Your Candidate Actually Accepts β beehiiv.com
- Why read: A practical recruiting playbook for closing strong candidates in competitive hiring markets.
- Summary: Once a team decides to extend an offer, moving quickly signals genuine excitement and prevents candidates from slipping away. Instead of delivering a one-way sales pitch, the author advises using the offer call to write down the candidate's actual priorities in their own words. Addressing role scope, career growth, schedule flexibility, compensation, and family considerations leads to better hiring decisions for both sides. How a company handles an offer gives candidates a direct preview of how that company operates day to day.
- Read more