- AI systems are now designing and refining other AI systems independently
- Human understanding of AI is shrinking as AI’s understanding of humans grows
- AI systems can model human fear, uncertainty, and the need for belonging
Microsoft’s chief scientific officer, Eric Horvitz, and EPFL researcher Robert West have issued a stark warning about how well we actually understand AI.
The pair have argued AI tools are now advancing fast enough to outpace our grasp of how these systems truly work.
At the same time, they point out something unsettling — AI’s understanding of human behaviour keeps growing, while ours does not.
AI complexity is accelerating faster than human understanding
Their concern isn’t that we need to understand every line of code or every parameter buried inside these systems.
What matters, they say, is keeping enough insight to maintain meaningful oversight. Even partial understanding, they argue, can be genuinely useful, especially when it helps catch risks early, before those risks become too deeply embedded to undo.
One challenge they flag is how often AI tools are now being used to design and improve other AI systems.
As these recursive development cycles become more common, performance may improve while human insight into underlying processes becomes increasingly limited.
“AI systems are now designed and refined by AI systems through recursive cycles that can outpace human understanding and unfold in high-dimensional spaces that resist intuition,” Horvitz and West wrote.
This is a form of operational opacity, where outcomes remain visible even as the mechanisms producing them become harder to explain.
Systems contributing to their own development, the researchers suggested, should also generate explanations and supporting information that humans can examine.
