I Tried out My First Hindi LLM ‘Nanda,’ and Here’s How It Went

Oct. 16, 2024

A Decent LLM That Hallucinates Occasionally

While impatiently waiting in line to test out the model, I noticed a couple of my journalistic peers get some pretty to-the-point answers to certain prompts. My hands-on kickstarted with a simple prompt asking it about the capital of India, and it answered correctly, replying in Hinglish as well.

I asked Nanda which book Gandhi wrote in 1970, it correctly stated that he couldn’t have written any book that year since he passed away in 1948. Additionally, Nanda LLM also accurately talked about the two books he wrote alongside the correct respective years.

I took a bit of a mathematical approach next and asked which was the bigger number between 9.9 and 9.11. It wrongly declared 9.11 as the bigger number. This is a tricky question for LLMs, and even Copilot gets it wrong at times and confuses 9.11 with 10.11. However, Gemini turns out to be much better in this regard and instantly identifies 9.9 as the bigger number.

I also asked Nanda LLM about amade-up place called Jovakiasi, and it took it to be a town in Brazil. I also asked it about who Bhima’s elder sister was in Mahabharata, and well, Nanda was way off. However, it doesn’t always fall for these traps. It almost called me an idiot when I asked it about why Ashoka the Great built the Taj Mahal while correcting me at the same time with accurate info.

After seeing the Nanda LLM in action, and it being equally right and wrong, I realized that it needs quite some refinement. Of course, it’s still at a verynascent stageand has ways to go before being made available to the public.

I took the opportunity to ask Manu Kumar Jain whether G42 built Nanda LLM from scratch or if it used Azure, Google, or OpenAI to fine-tune the Hindi dataset. Manu revealed that the base model of the Nanda LLM uses JAIS, the result of a collaboration between Inception and MBZUAI (Mohamed bin Zayed University of Artificial Intelligence). Throw G42 into this mix and this is the trio behind Nanda as well.

However, Nanda LLM will not just be a Hinglish chatbot but will also be able totranslate and transcribe text from among 21 Indian languages, as I noticed in the demo. The demo also showcased image generation using Llama 3.1. Jain also hinted at the possibility of there being a dedicated mobile app, although it’s largely unclear when that will arrive.

Remember Krutrim, the AI assistant that Ola announced last year and started injecting into its cab services and EVs later on? So, I asked Manu about the possible use cases or sectors that G42 might specifically be eyeing for Nanda LLM. And, here’s what Jain had to say,“First of all, we’ll try and make a version of Nanda open source, which will give everyone access to it and further build on it. Eventually, the way we see it, there are a lot of use cases to it like healthcare.“

For example, in a rural area where Hindi speakers don’t have access to top-tier medical facilities, they can take to such a model and get a basic idea of what might be wrong with them. Eventually, they can take up advanced treatment if it calls for it, added Jain.

When conversing with Jain, we also discussed the massive potential that such a Hindi LLM has to help farmers out. From educating them on advanced farming practices to giving them estimates about profit and loss, there’s a lot that Hindi speakers will benefit from.

However, with AI being accessible easily, courtesy of ChatGPT, Gemini, and Copilot, G42’s Nanda LLM has to be rock solid in terms of accuracy and reliability, which is not the case at the moment. Furthermore, withGemini getting support for more Indic languages, and other LLMs buckling up similarly, it will be interesting to see how Nanda can offer that “extra”bit of AI to stand out. Only time will tell.

Well, that’s all for me. What do you think about the Nanda Hindi LLM by G42? Do let me know in the comments section!

Special thanks to Beebom’s AI SpecialistArjun Shafor giving me pointers to test out the model, and the questions I should ask it. More such hands-ons are incoming, so stay tuned!

Sagnik is a tech aficionado who can never say “no” to dipping his toes into unknown waters of tech or reviewing the latest gadgets. He is also a hardcore gamer, having played everything from Snake Xenzia to Dead Space Remake.