Private Channels should not create a site collection
Creation of site collection for private channels is not practical. Office 365 considers it as a new site and you came across to references of this new site everywhere. This was not the expectation. Private Channels should just be folders within the main group site as it used to be. You just created sub-groups, not private channels!