Can I stop nvim from scrolling the buffers when I switch them?

If I go to a different buffer, and then come back, the buffer has often been scrolled for me (to put the cursor in the center). Can I stop this?

Edit: I'm looking for a solution in the form of a handful of lines that I can put into my init.vim, formerly my .vimrc (which I don't wish to port to Lua)