You can perform Edit and Delete action on the contacts. Here is how you can do it.
Login to Backend
Navigate to Portal User Management ➤ Contacts, you will get the list of the Contacts.
Click on the Three Dots icon, you will get the Edit & Delete action to perform on the contacts.