At the moment this isn’t possible. You could only restricted changes to own tasks.
see Restrict view feature/plugin