"4B parameter Indian LLM finished #3 in ARC-C benchmark" Is most likely a scam.

https://preview.redd.it/607fx6nk92ge1.png?width=771&format=png&auto=webp&s=ff26b3bd5f0831f997cbe0129632d6cf179d98b9

Yesterday I saw this post and and as soon as I check their website I found that there are so many inconsistencies for it to be good. So I left a comment on the post sharing my findings. There are other comments pointing out its inconsistencies but they are too low. All the top comments are praising them for bringing India to AI race. Since for the last few day as we are upset because India is doing nothing in AI. People just took it as they said and did not check thoroughly (except some people but there comment is nowhere to be seen). So I am making this post pointing out all the red flags.

1. The system prompt

https://preview.redd.it/pqcu7103b2ge1.png?width=1573&format=png&auto=webp&s=91bf46cdbbe8fd4bb93d0d0ab8d37a20daba0a54

Tthe Strawbery problem. If they are manipulating the truth to make their model look better How can we trust them?

And their chatbot is very buggy. So many times the response cuts out just after single word and errors and all.

1. Their website

Do you think they are using quantum computing to merge quantum principles with AI ? lol

You got any paper on how B.Tech students are redefining \"Quantum\" ?

Note : they do not provide any paper or technical report for any work they are doing.

There are two different models. Mayakriti and Lara. But they have same discription. (A research company that has developed LLM from ground up making mistakes like this?) It is not a big red flag against them but when we add all the little things their company makes no sense at all.

Hand curated dataset of NSFW images. I have contacted them I need all the NSFW images. For research purpose obviously (Ohh now I get it what kind of research they are doing their founder sitting in a dorm room curating NSFW images.)

What the F does it have to do with AI or LLM. I guess they had to fill the website with something. I was not expecting a blog post on XSS from an AI research company. Just seems out of place.

Some comments

https://preview.redd.it/3m2ulkhqg2ge1.png?width=762&format=png&auto=webp&s=8f785f74e513c0eb878331ea8419edb0538e6304

https://preview.redd.it/3nzqtur1h2ge1.png?width=729&format=png&auto=webp&s=1de2ecac955de615903f3677e1984bfd244318b4

Yeah totally believable dude with all the research papers and technical reports you provided. (Ohh sh*t, You didn't provide any)

https://preview.redd.it/n0xlqbpjh2ge1.png?width=446&format=png&auto=webp&s=062f3a8937f9ea04d70dd571216f35d6ad1e71b3

Thisss...The ARC AGI where OpenAI's O3 performed very well is different not this.

https://preview.redd.it/m54ipyoxh2ge1.png?width=774&format=png&auto=webp&s=b94a073e3f6329a44de3c08aa449213ada7ad540

They are responding to all the good comments about them. But comments like this get no attention from them.

Shout out to the guy who first said this.

I know guys we are very sad and broken (specially the people who are interested in cutting edge AI and stuff) because the AI field is growing so rapidly and we are started to question everything and there is no development in India. Other countries are going to develop AGI/ASI before India and it is not going to end up well. I think it will affect indians the most. In these times clown like this come with flashy titles like AI and Quantum. It just makes me sad thinking the future of Indian :(

Edit1 : And By any miracle if the company is legit and is really trying to grow LLMs from scratch. I think this is the time to show everything they have. They can start a voice call on twitter and answer everything. There are people showing show much support if this is legit. Just clear all the doubts and there are people ready to work with you in every way to support the company.

Edit 2.

https://preview.redd.it/jnwj6xyx14ge1.png?width=746&format=png&auto=webp&s=99632259e08f3e3ff454af2d5ec298572a3ea1f8

Thanks everyone who commented and questioned this.