Can I Delete or Remove a Bank Account From My Site?

No, bank accounts can not be removed from HQ. The best way to note that a bank account should not be used any longer is to Edit the Nickname of the account.

Adding in text such as "Do Not Use" or "Old Account" is helpful.