at that point you’re loading a static JS-file sostoss, autoptimize itself isn’t active any more. but 753ms for 7KB of static JS is a lot, could be a problem on webserver-level. can you share your URL so I could check a couple of things?
OK, did some tests on /wp-content/cache/autoptimize/js/autoptimize_79b682570ccd26c5d1f816881cf4ebf1.js (which is referred to in flak-2-0-xl-prizm-deep-water-polarized/) and the average download time on a cable-connection from Prague is 675ms (look at https://www.webpagetest.org/graph_page_data.php?tests=161121_HA_GZB&medianMetric=loadTime under “start to render” as at that point the file has downloaded and the rendering of a JS-file is not relevant).
taking into account this is a 742KB file sent over the wire gzipped to 257KB, this seems normal to me, really.
frank