Yes, Em. A button can be a pin worn on the clothing as in a political campaign. It is more commonly the clothing fastener. It can also be a switch which is activated by pressing, as in the Up button to call the elevator. By extension, a person can annoy you by 'pushing your buttons,', i.e. doing exactly the right things to get under your skin.
