Some Customers introduce a Custom Column on the Applicant and Client Contact records to identify that the record has access to the portal - if this is used, the custom column can be set to false to remove Access
If you don't have this, please access your Portal Account Manager App or Widget, and Disable the user record by Unticking Enabled, or deleting the account:

