You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now it seems the detector is only able to work with input arrays, it would be very useful to allow input streams as well. This makes sense when the input files are very large and it's not memory efficient to load them entirely into memory.
The text was updated successfully, but these errors were encountered:
Thanks for the input and sorry for belated response. Would appreciate your contribution to make it better. The way the detector works however doesn't require too much memory. It was mainly designed with web documents in mind, and first few KB will suffice to make a probabilistic decision. It also returns the # of bytes it consumed to do that. It rarely goes over 3~4 KB. The rest of the input is ignored.
Right now it seems the detector is only able to work with input arrays, it would be very useful to allow input streams as well. This makes sense when the input files are very large and it's not memory efficient to load them entirely into memory.
The text was updated successfully, but these errors were encountered: