I've never actually toggled that particular option off, so this topic has been very enlightening! It does feel like that behavior should probably have more granular controls. I'll pass your feedback on to the team and provide an update here as soon as I have news to share