Access for not Administrator

My site manager needs to have access to use the cache clearing link on the admin toolbar, but unless I set their role as Administrator, they don’t see it. I tried using the Advanced Access Manager plugin to see if I could get finer grained control to explicitly grant the capability, but I see no capability settings in the system for your plugin at all. What am I missing?