Large Data Exceeds View Size Limit

[singjc]

In the view_spectrum (and other st.dataframe related calls), if the data to send is too large to render a streamlit error is thrown:

MessageSizeError: Data of size 1695.8 MB exceeds the message size limit of 200.0 MB.

This is often caused by a large chart or dataframe. Please decrease the amount of data sent to the browser, or increase the limit by setting the config option server.maxMessageSize. [Click here to learn more about config options](https://docs.streamlit.io/develop/api-reference/configuration/config.toml).

Note that increasing the limit may lead to long loading times and large memory consumption of the client's browser and the Streamlit server.

This occurred for an already filtered mzML file of 852Mb with ~ 14.5K spectra.

The one option that is mentioned in the error message is to increase the limit of the server.maxMessageSize. I was thinking, one other potential option is to render only a set number of rows of the dataframe, and add prev and next buttons to itterate through the rows.

This post might be useful: https://discuss.streamlit.io/t/scalabilty-of-streamlit-for-pandas/131/4

Screenshot of Error