When Agents Need Permission