It's very simple:
you just need to be sure that you have different Access Level for those groups, if you don't - go and make sure about it. (Manage Users - Access Levels)

Then go to your plugins settins and choose required Access Level for each plugin.