we wanted dbadm to have accessctrl authority. So as to what you are saying, grant dbadm to a user and revoke the dataaccess authority and individually grant select, insert, update, delete to all the tables to that user except that specific table.
But the issue is dbadm can grant select, insert, update, delete to that table to himself.
The other Option would be Label Based Access Control (LBAC), but this Feature requires an additional License.
The User would be able to read the Table, but no data would be returned. Also some Queries might return different results, if they are run by different users.