Cacheing REST GET?

I’m using a maps plugin that recently changed the way they do map marker selections on the map. The selection used to be done in the browser, but now the selection is done via a REST call to the backend. The downside of this has been that the performance of the filtering has become quite terrible.

So I was wondering, should the Cache enabler be able to cache REST GET calls? The map plugin dev claims that this works on some other cache plugins which do not suffer from this issue? If yes, do I need to add something to the “Cache Inclusions” or some other setting? The call looks like this: https://site.test/wp-json/wpgmza/v1/markers/….