In edit mode, the visibility of components is 'always on' when you select that component. So, by testing Button A in edit mode you are selecting it, which makes it visible.
If you look at the component name tab (the little identifier widget found in the corner of selected components) when it is selected, there should be an eyeball with a line through it to denote that it would otherwise be hidden.
ETA: this thing
