allow Contributors to label posts

I noticed in the settings for restricted users that labels aren't mentioned at all, and tied into publishing permissions. I'd love to be able to have restricted users (like my intern!) have the capability to edit labels without being able to publish. Basically, some more nuance to the options for user levels would be great.