DEV Community

Cover image for I Tested 5 AI Models on Hinglish — Here's Who Won
Arshad Ansari
Arshad Ansari

Posted on

I Tested 5 AI Models on Hinglish — Here's Who Won

This is a submission for the Kaggle Benchmarking Challenge

What I Benchmarked

How well AI models understand Hinglish — the natural mix of Hindi and English used by 600 million Indians — for real coding tasks including code debugging, context switching, and vague error descriptions.

Read the full article here: https://dev.to/05uniquedotcom/i-tested-5-ai-models-on-hinglish-heres-who-won-3b9e

Models Tested

Claude Sonnet 5, DeepSeek-R1, Gemini 3.5 Flash, GPT-5.4, Grok 4.5

Findings

All 4 tested models scored 100% on Hinglish code debugging. Hinglish is no longer a barrier for AI models!

My Benchmark

https://www.kaggle.com/benchmarks/arshadmohammadansari/hinglish-ai-benchmark

Top comments (1)