If you want to join a channel without your contacts knowing, consider disabling the “Who can see my groups and channels” option in Privacy & Security settings.