Performance & Best Practices

  • Resolved lynoo

    (@lynoo)


    3 years, 8 months ago

    Hi,
    I have noticed the bigger the data source file, the worse the performance of pages created in MPG becomes, I mainly mean page load speed here, I assume that when the file is big it will take time to search or sort.

    Unfortunately, I can’t find in the documentation or in here anything helpful regarding this, so here are my questions hoping to get some help.

    Let’s say the data source file contains in the range of 100k to 400K rows,

    1- What would be the better option, uploading the data file, or using google sheets?
    2- Which format is better and faster: .CSV or .xlsx?
    3- Does splitting the file into multiple files, each as a project, help with performance or makes it worse?
    4- If splitting helps, approximately, how many rows per file is optimal? 5k or 10k ..etc?
    5- caching to DB vs Disk? which is faster? I assume to disk since it will become like a static page, but I could be wrong!
    6- any other plugins, or ways that might help with performance?

    Thanks

Viewing 1 replies (of 1 total)
  • luciamarinescu

    (@luciamarinescu)

    3 years, 8 months ago

    Hi @lynoo,

    Thanks for choosing MPG and sorry for the delayed reply!

    I’ll answer your questions punctually.

    1 – Uploading the file would be a better option.
    2 – CSV is generally faster and less complicated when compared to xlsx.
    3 – File splitting is a good option and it helps fetch the data quicker.
    4 – From our experience, a number of rows around 5k-10k per file should be ok.
    5 – Caching to DB is generally faster.
    6 – As one example, we could point to the Redis plugin to help improve performance.

    Have a nice day ahead!

Viewing 1 replies (of 1 total)

The topic ‘Performance & Best Practices’ is closed to new replies.