I don't think that will work.

How about this model:
Fine Grained Role Based Access Control (RBAC) system - SQL Recipes a FREE cookbook of SQL queries and examples

I haven't built an RBAC system before (usually use simpler ACL system) but does the above model have any performance implications?