In the bustling tech hubs of Bengaluru and beyond, a peculiar industry is quietly thriving - one that blends the mundane with the futuristic.
Dubbed "hand movement farms" or data capture labs, these unassuming facilities employ hundreds of workers who strap cameras to their foreheads and spend hours meticulously folding towels, stacking boxes, and manipulating everyday objects. This isn't performance art or a quirky TikTok trend; it's the backbone of training humanoid robots to mimic human dexterity.
These videos, rich with granular details of finger flexes and arm reaches, are shipped off to AI labs in the United States, where neural networks dissect every nuance to teach machines how to grasp, fold, and interact with the world.
As the global race for intelligent robotics intensifies, India's low-cost labor is becoming an indispensable cog in the machine.
The Mechanics of Motion Capture
Picture this: A young worker in a dimly lit room, a GoPro strapped to their forehead like a miner's lamp, facing a cluttered desk. Today's task? Towel folding. They reach into a basket with their right hand only, shake the fabric straight using both hands, fold it precisely three times, and place it in the left corner - all within 60 seconds. Miss a step or exceed the time limit? Start over. The camera captures every twitch, every slide of cloth against skin, from a first-person perspective that robots can "learn" from.
This regimented routine is the hallmark of companies like Objectways, a Bengaluru-based data labeling firm founded by 20-year-old entrepreneur Dev Mandal. Mandal spotted an opportunity in the yawning gap between AI ambition and practical training data. Humanoid robots - from Tesla's Optimus to Figure AI's prototypes - need vast datasets of real-world movements to master tasks like cooking, cable plugging, or laundry. But collecting this data in high-wage countries like the US is prohibitively expensive.
Enter India, where Mandal's team of over 2,000 employees (half engineers, half annotators) produces hundreds of such videos daily. In one batch, they dispatched 200 towel-folding clips to a US client, each scrutinized for "silly errors" like improper grips that could confuse the algorithms.
The process extends far beyond towels. Workers might crumple paper, sort utensils, or simulate assembly-line tasks with cardboard mockups.
Smart glasses or motion sensors sometimes replace head cams, tracking subtle finger curls as someone pulls a zipper or threads a needle.
These aren't random acts; they're scripted to cover edge cases - left-handed vs. right-handed, varying speeds, or handling slippery fabrics. Errors are costly: Objectways once scrapped 150-200 videos due to inconsistent folds, forcing retraining and delays. The goal? Feed neural networks that analyze joint angles, torque applications, and tactile feedback, enabling robots to replicate actions without rigid programming.
From Indian Desks to Silicon Valley Servers
Once captured, these videos cross oceans via secure cloud uploads. In the US, companies like Scale AI (backed by Meta) ingest them into massive training pipelines. Scale has amassed over 100,000 hours of similar footage in its San Francisco lab, blending human demos with simulated data to fine-tune models.
Neural networks, often powered by deep learning frameworks like those from OpenAI or Google DeepMind, break down the footage frame by frame. They map how "leather" (human) hands - fleshy, imprecise, adaptive - differ from metal claws: the subtle drag of skin on fabric, the instinctive adjustment when a box slips, the micro-pauses for balance.
This data powers breakthroughs in robotics. Figure AI, for instance, partners with Brookfield to film movements in 100,000 real homes, teaching bots to navigate cluttered kitchens or bedrooms. Startups like Micro1 extend the model to emerging markets, paying locals in India, Brazil, and Argentina to wear AR glasses during daily chores. The result? Robots that don't just stack boxes but do so with human-like efficiency, reducing errors in warehouses or eldercare. Yet, the irony persists: Humanoid bots, promised as labor savers, rely on human labor that's anything but automated.
The Human Cost: Low Pay in a High-Tech Chain
For the workers powering this pipeline, the rewards are modest. In India's data farms, compensation hovers around $230-250 per month - roughly ₹19,000-21,000 - for full-time shifts of repetitive motion capture.
This aligns with broader industry averages for data labelers, where entry-level roles pay about ₹42,000 monthly, though specialized AI annotation can dip lower for volume-based gigs. Part-timers might earn just ₹10,000-20,000 ($120-240), piecing together freelance tasks on platforms like Toloka or Upwork.
It's grueling work: Eye strain from head-mounted cams, wrist fatigue from endless grips, and the mental toll of monotony. Many are engineering graduates moonlighting or pivoting from gig economy jobs, drawn by flexible hours but trapped by slim margins. Mandal's venture, for one, folded under client demands for hyper-specific protocols, underscoring the razor-thin profitability even with India's wage advantage.
Critics argue this offshoring exploits global inequalities - US firms reap billions in robot sales while Indian annotators subsidize the dream on poverty wages. Proponents counter that it creates jobs in a nation where youth unemployment tops 20%, injecting skills into the AI ecosystem.
Also read:
- Tesla's Optimus Robot Masters Household Tasks
- Robbyant R1: China’s Answer to Tesla Optimus in the Humanoid Robot Race
- Memes: The Best Thing About the 1X Neo Robot Launch
Ethical Quandaries and the Road Ahead
As investments flood humanoid robotics - $2.6 billion poured into startups last year alone - these hand farms raise thorny questions. Who owns the data from a worker's precise pinky curl? Does outsourcing deskill local talent, or empower them?
Privacy risks loom too: Videos might inadvertently capture faces or homes, feeding into unregulated AI troves. Initiatives like the EU's AI Act push for transparency, but enforcement in global supply chains lags.
Yet, the momentum is unstoppable. By 2030, the AI training data market could hit $8 billion, with India as a linchpin. Mandal's story, though a cautionary tale, hints at potential: Scaled up with better tools, these farms could upskill workers into AI oversight roles, boosting pay to $500+ monthly.
For now, they remain a stark reminder - in the quest for machines that move like us, it's still our hands that make it possible.

