Restricted repo access for private organizations

Currently, we can restrict access to our private user repositories.
We have a private organization (for school), where each team has their own repository.
We’d like to add travis integrations, while disallowing teams from accessing each other’s repos & other solution repos.
Is that restriction there by default, or can we restrict access to certain repositories?