Network Activate does pretty much what you thought it does: It activates the plugin on all sites in the network.
It also takes it out of the default Plugin view on the plugins screen for all those sites, so they no longer have the option to either activate it or deactivate it.
So if you’re still seeing it on one of those sites, then it’s either not network activated, or that particular site isn’t in the same network as the others.
