The one thing stopping AI taking over the world – or at least everyone’s jobs? Dexterity. Human hands are anatomical marvels that engineers have struggled for years to replicate. Experts are racing to change that
Just outside Luton, in an Amazon warehouse the size of four football pitches, yellow shelving units pirouette in a digitally choreographed dance. Tubs containing a Lego Spider-Man kit, followed by dishwasher tablets, followed by a pouch of muscle building protein powder whiz along conveyor belts, until they arrive at a human being tasked with stacking the shelving unit that has come to a stop in front of their workstation. This, Amazon says, is the “symphony of people and technology” to which the retail giant owes its success.
Following a barrage of negative publicity about working practices, Amazon began to open up its fulfilment centres to carefully controlled free public tours a decade ago. Our guide tells us about the competitive rates of pay Amazon workers receive, their pensions, dental cover and options for flexible working. Her delivery is somewhat robotic.
“You will see robots and humans working in harmony,” she declares as we move between different stations of the warehouse. Everything is designed to maximise what humans are good at, she continues, and what robots are good at – “working without getting tired”.
Almost every judgment call here seems to be made by a computer – not just where to stow items when they arrive at the warehouse (the system shines a light on to the spot on the specific shelf where the worker should place each item) but also which size box to pack something in once it’s been ordered, and even precisely how much tape to use to seal that box. The human beings are here to provide the hands, not the brains.
So far, at least, there is no hardware or software to rival a human hand. Humanoid robots – often called “embodied AI” – have made great strides over the past decade (literally, as evidenced in China’s recent five-day robot Olympics). But producing a robot that can pack a shelf, tighten a bolt and also pick a raspberry – actions that would make them useful rather than simply entertaining, actions most of us perform without any conscious effort – has proved surprisingly difficult. Replicating the breadth of function of the human hand is one of the biggest remaining challenges in robotics. Until robots are dexterous, human workers will always be necessary.
But investors are now gambling on humanoid robots soon becoming as much a part of everyday life as AI-powered large language models are for many of us today. The Chinese government has pledged to invest more than £100bn in robotics and high-tech industries over the next two decades. Earlier this year, Tesla halted production of its Model X and Model S cars so that factories could focus instead on producing Optimus humanoid robots. “Human hands have evolved to be this incredibly sophisticated machine. Your hand is actually a remarkable thing,” Tesla chief executive Elon Musk told a conference last year. “In order to create a robot that can be a generalised humanoid, you must solve the hands problem.”
Amazon employs more than 1.5 million people worldwide today. But from what I can see on the warehouse floor, it seems that if a task could be done more efficiently by a machine, Amazon would rather leave it to a robot. What will happen to these workers when the “hands problem” is solved?
And what will happen to the rest of us? Artificial dexterity combined with artificial intelligence will be hugely consequential for humanity. Forget retraining as a plumber in the age of AI – if engineers manage to replicate human hands, then potentially no job will be future-proof.
Dexterous robots that can rival a human hand are not here yet, but they are coming. What makes hands so difficult to reproduce in hardware and software? How close are robotics engineers to getting it right? And what will happen to the world of work when they do?
* * *
“The hand is our conduit between the brain and the world,” says Alistair Hunter, a hand and wrist surgeon at University College London hospitals. “The hand is our way of turning thought into action.” Hunter has spent most of his professional life seeking to understand how hands work, and how to return them to normal function when they don’t. “Hands are special because they are very complicated anatomically,” he tells me over coffee in north London. “There are 27 bones in the hand; there are nerves and muscles that control it. But behind all that is the brain, which is interacting millisecond by millisecond to understand what the hand is sensing, adjusting to that, and then providing action.”
We might assume that we owe our evolutionary advantage to our intelligence, but Hunter argues it’s actually the combination of our cognitive power and our dexterity that has given us the edge. Over the millions of years that the frontal cortex of our brains was developing, the hand evolved to differentiate itself from limbs, allowing for the development of fingers that could grasp branches and climb trees. Thumbs came next. All the great apes might have them, but ours are larger. “The joint at the bottom of the thumb – the trapeziometacarpal joint – is one of the main advances in evolution to allow us to do very fine pincer grip, very fine dexterous control between thumb, index and middle finger, but also incredible power, incredible grasp. That allowed us to manipulate things like stones and rocks, so three million years ago we started to develop tools



