You can delete a Contact from the Address Book as follows:
Tap on the Settings icon from the bottom-right corner of the Portfolio. Then, tap on the Address book under Wallet section.
Select the blockchain, go under CONTACTS, and tap on the desired contact to delete. Then, tap on the DELETE icon.
Enter the PIN code to confirm.