I am wanting to know about what are best practices around dealing with a large dataset request in vue. To give you a scenario I am requesting data from graylog through their api. Normally I just use their paging features so as a person clicks next page, I gather the next pages data. However we had a feature request where vue has great search capabilities, and its super handy to query data from graylog then search within that data like a filter. As far as I can tell the best way to do this would be to grab all the necessary data. So I started to research what other people do in these types of situations and haven't really found much.
Currently when I query 7 days worth of data, the data amounts to around 27Mg. My app normally uses around 100-135Mg depending. I would like to be able to query more tho, say 30 days.
So my thought is maybe query the data, get the first page then concurrently get the next pieces of data in chunks? then using object.freeze to store the data and apply that to a table.
Does this seem like a good concept or am I completely off the mark? Thank you in advance.