Individual forum access

I work for a professional organization and are very interested in incorporating a discussion forum into our web offerings.

We have been using many list serves for committee discussions, and would like to migrate to a forum.

The issue is we have many members that are on various committees, so we would need a way to be able to assign individual forums to individual members (instead of group assignments). 

For instance, one member might need access to forum 1,2,3,4, and 5, while member two would need access to 1 and 5, members three access to 1, 2, and 5. etc.  We would probably have close to 30 different forums spread across nearly 4000 individual members.

Is there a way to do this (and can it be implemented through code modifications).

I had looked at the group permissions, but had missed the individual permissions section... Thanks, that is exactly what I need.