Skip to content
Breaking
Latest technical intelligence from Northeast India • Infrastructure, AI, Cloud & Security Analysis • Precision Analysis | Raw Intelligence | Your North Star of Tech Latest technical intelligence from Northeast India • Infrastructure, AI, Cloud & Security Analysis • Precision Analysis | Raw Intelligence | Your North Star of Tech
TECHNOLOGY

Analysis: AI fails at freelancer tasks 97% of the time, new 'Remote Labor Index' shows

AI and Freelance Work: A Missed Connection in North East India

AI and Freelance Work: A Missed Connection in North East India

A recent study has shed light on the performance of Artificial Intelligence (AI) in freelance tasks, revealing that AI systems struggle to match human workers' efficiency and quality. This finding, while not directly affecting the North East region, has implications for the broader Indian workforce and the region's potential engagement with AI.

Assessing AI Capabilities

Researchers tested several AI models, including Manus, Grok 4, Sonnet 4.5, GPT-5, ChatGPT agent, and Gemini 2.5 Pro, on a series of projects in fields like game development, data analysis, and video animation. These tasks, completed by human remote freelancers at a cost of $10,000 and requiring more than 100 hours, served as benchmarks for the AI's ability to automate long, real-world, economically valuable projects.

The Performance Gap

The results were underwhelming. The best-performing AI model, Manus, managed to complete only 2.5% of the tasks at a quality level acceptable for commissioned work. The other models fared even worse, with performance rates ranging from 0.8% for Gemini to 1.3% for ChatGPT agent. This performance gap between AI and human workers underscores the current limitations of AI in handling complex, creative tasks.

Implications for the Indian Workforce

The study's findings have implications for the Indian workforce, including the North East region. While AI is expected to automate many tasks, the results suggest that creative, complex tasks may still require human involvement. This could create opportunities for freelancers in the region, as their skills in areas such as game development, data analysis, and video animation remain in demand.

The Future of AI and Work

Despite the current performance gap, researchers remain optimistic about AI's potential. They note that while absolute automation rates are low, AI is steadily improving, and progress on these complex tasks is measurable. This suggests that while workers in the North East region may not need to worry about AI replacing them in the near future, they should remain vigilant and prepared for the evolving landscape of work.

As AI continues to develop, it is essential for workers in the North East region to adapt and upskill to remain competitive. This could involve learning new technologies, expanding their skill sets, and staying informed about the latest developments in AI and automation. By doing so, they can seize opportunities in a changing job market and contribute to the region's economic growth.