You can designate who can make access to specific Folders.

The users who are not joining a Folder cannot access, read or edit the data because they don’t even know the existence of the Folder.

Check this article about how to change users joining to a Folder.