Slow page load with “wpdm-all-package”

Looking to use this plugin. It seemed to work well when I had a few documents. The page loaded really quickly. All plugins except the download manager have been disabled. Now that there are hundreds, it takes over 10-15 seconds for the page to load.

Here is the page in question: http://lajoiedeparler.ca/wp/espace-membres/documents-a-telecharger/

Is there something wrong with the plugin that is causing such a huge load time?