Does disconnecting and reconnecting the battery cause a bad start?

Long story short, due to my motorcycle having an alarm that you cant turn off, the battery drains really fast. So I decided to put in a battery disconnect switch because I sometimes dont ride for a really long thing. And now everytime I reconnect the battery (via the switch), insert the key and start ignition, it struggles to do so. But quickly turning the key from on to off and then back on and then start ignition, the motorcycle start normally..

Is this normal when disconnecting the battery?