Interesting! Thanks for flagging this. It seems that reordering pages via drag and drop was never fully functional in the sense that those changes were not persisted outside of the client session. In order to avoid future confusion, we've fully disabled drag and drop until it actually works. 
I've bumped the corresponding ticket internally and will provide an update here as soon as I can!