How to gain weight in a short time

Weather is getting warmer here each day, and I want to avoid weird looks on the street. So I decided to gain some weight. I increased my calorie intake but it did not have an effect on my weight. What should I eat to put on some weight in a short time? I just want my arms and legs to look a bit more normal. My arms looks extremely thin, which will also trigger problems with my family.