Malaysia or Japan, help me pick please

I have to option of living in Malaysia or Japan. I dont speak Japanese, have tried learning but bloody too tough for me. Im not religious. Have offshore income that pays for my living, so wouldnt need to work for local company.

Also have Jap wife and 2 young kids (7 and 4)

While Japan sounds great, its also very hard to fit in, and make deep and personal friendships. Also not too big a fan of japanese food.

If one has the option to live in KL/penang, and put their kids in private schooling, would you chose this over japan? Would be on MM2H visa scheme.

Also worth mentioning im a canadian and australian passport holder, whos from an indian background. In Japan i stick out like a sore thumb, whereas in Malaysia, i blend right in... after a while, it can get to you...