Learning Module: What the Experts Actually Think (And Why They Disagree)

Current Section: Survey Methodology and Design

Section 1 of 6

Estimated reading time: 12 minutes

Use Ctrl+Left and Ctrl+Right arrows to navigate between sections

Use Ctrl+H to return to the learning home page

Press Escape to exit the current module

What the Experts Actually Think (And Why They Disagree)

55 min total6 sectionsintermediate

Survey Methodology and Design

Estimated reading time: 12 minutes

Here's a secret: asking AI experts "When will AGI arrive?" is like asking medieval cartographers about the edge of the world. Everyone has an opinion. Nobody really knows. But HOW we ask matters more than you think.

The Art of Asking the Impossible

Imagine trying to survey experts about something that doesn't exist yet. That's the challenge researchers face when gathering AGI predictions. It's not like asking doctors about a new treatment or economists about next quarter's GDP.

We're asking computer scientists to predict when their creations will outsmart them. Talk about awkward.

Who Counts as an Expert? (Spoiler: It's Complicated)

First challenge: Who gets a vote? The field is wonderfully messy—a mix of:

  • Publication powerhouses: The professors with papers in Nature and NeurIPS
  • Citation celebrities: Researchers whose work everyone references
  • Industry insiders: The folks actually building these systems at OpenAI, DeepMind, and Anthropic
  • Global voices: Experts from Beijing to Berkeley (geography matters!)
  • Fresh perspectives: Junior researchers who grew up with transformer models
  • Cross-disciplinary minds: Neuroscientists, philosophers, even psychologists
  • Method masters: Theory builders AND hands-on engineers

Here's the rub: Miss any group, and your survey is like a jury without key witnesses. Include everyone, and you might dilute expertise with enthusiasm.

The Questions That Make or Break Your Survey

Remember the dress that broke the internet? Was it blue/black or white/gold? AGI surveys face the same perception problem, but with trillion-dollar consequences.

Every word matters when you're asking about the future:

  • Say "AGI" vs. "human-level AI": Get different answers by 10-20 years
  • Ask for percentages vs. dates: Watch confidence levels plummet
  • Mention specific capabilities: Suddenly everyone's timeline shifts
  • Frame it as opportunity vs. risk: Optimists and pessimists emerge
  • Start with recent AI breakthroughs: Hello, anchoring bias!
  • Ignore cultural context: Miss how different cultures view intelligence itself

Fun fact: Simply changing "When will we achieve AGI?" to "What's the probability of AGI by 2050?" can shift median estimates by a decade. Words are powerful.

The best surveys? They're like good therapists—they know how to ask questions that reveal what people really think, not what sounds smart at conferences.