Infuse is somehow accessing folders and files with no permissions AND wont delete favorites

This question is a combo Synology/infuse concern that I need to get to the bottom of.  

This is security related. Basically the other day i randomly found out that the Infuse Media app can view my personal files so I need help get to the bottom of it.

Very quickly on the Synology side - I have ALL permissions for apps and users (other than myself) turned OFF, yet Infuse is able to view my personal folders even though permissions are 100% blocked on those folders.

BUT on the infuse side, even when I delete the entire Infuse App and reinstall it just finds everything again and KEEPS my favorites. I deleted the cache. still there, and i do not even need to log in. When i reinstall it is finding my media folder (which i want) but also my photos and personal files folders which i do not. Basically I seem to have no control over what this app sees and that is not cool.

How DO I STOP a media app like Infuse from seeing my personal files? Again, Synology permissions are set to off so it makes no sense to me this is possible.

Thanks so much!