Invite people as manager

It often happens that project managers want to invite new people. Unfortunately the “Users Management” seems to only show up in the admin role. Admins don’t want to get emails from a lot of managers to invite people, it would be the best if managers could invite new users themselves.
How can managers invite or add new Users to a project which are not in the system yet?