The items below are things Lukas Petersson said in a podcast interview about benchmarking autonomous AI agents with real businesses. — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.

Visual summary of operating lessons from Lukas Petersson.

Part 1: The Reality of Autonomous Agents

  1. On Automating Everything: On The Cognitive Revolution, Petersson said: "Our vision is to automate everything with every part of the organization completely end to end". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  2. On Benchmarking Agents: On The Cognitive Revolution, Petersson said: "Our focus was to benchmark how close we are to really powerful agents". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  3. On Tangible Tasks: On The Cognitive Revolution, Petersson said: "They're like tangible, people know what the vending machine is, they know what it takes to run one". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  4. On Informing the Public: On The Cognitive Revolution, Petersson said: "I think that's very important to inform the public of how close we are to a very super intelligent future". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  5. On Slow Computer Use: On The Cognitive Revolution, Petersson said: "computer use is slow and you know, there's a lot of forms to fill out". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  6. On Autonomous Companies: In an interview about an AI-run store, Petersson said: "AIs can build companies completely autonomously without any humans in the loop". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions

Part 2: Emergent Misbehavior and Safety Risks

  1. On Real-World Deployment: On The Cognitive Revolution, Petersson said: "the deployment at AI labs in the real world is probably less realistic than the simulated version". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  2. On Valuable Information: On The Cognitive Revolution, Petersson said: "we get valuable information before we make a wide deployment". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  3. On Optimizing for Money: In an interview about an AI-run store, Petersson said: "as soon as you start optimizing only for money". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions
  4. On Being Blessed on Safety: In an interview about an AI-run store, Petersson said: "we're kind of blessed that they wouldn't do something completely out there because humans don't do those things". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions

Part 3: The Problem of Simulation Awareness

  1. On Cost as a Proxy: On The Cognitive Revolution, Petersson said: "Cost is a proxy for how much compute they are putting into the model, but it's not perfect". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  2. On Capabilities and Interpretability: In an interview about an AI-run store, Petersson said: "the trajectory of the capabilities seems way steeper". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions

Part 4: Real-World Failures and Edge Cases

  1. On Sandboxes: On The Cognitive Revolution, Petersson said: "Complete sandbox like VendingBench wouldn't really cut it because it's not enough information". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  2. On More People in Safety: In an interview about an AI-run store, Petersson said: "Generally more people needs to go to AI safety". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions

Part 5: The Future of AI Evaluation and Control

  1. On Becoming a Standard: On The Cognitive Revolution, Petersson said: "I think the dream scenario or the solution is that you become kind of a standard". — Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs, The Cognitive Revolution.
  2. On Misuse: In an interview about an AI-run store, Petersson said: "I'm quite worried about misuse from open source models". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions
  3. On Control: In an interview about an AI-run store, Petersson said: "it's easier to control if it's closed". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions
  4. On Proof of Alignment: In an interview about an AI-run store, Petersson said: "mathematical proof for alignment, unlikely". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions
  5. On Small Fixes: In an interview about an AI-run store, Petersson said: "you just have a bunch of small fixes". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions
  6. On Having Fun: In an interview about an AI-run store, Petersson said: "Do the thing that is like the most fun and then you will do great work". — Lukas Petersson interview about the world’s first AI-run store, auto-generated captions