Large zstd packets (those using multiple frames) fail to decompress

[CunningBaldrick]

The symptom:

.../site-packages/kafka/codec.py", line 315, in zstd_decode
return zstd.ZstdDecompressor().decompress(payload)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zstd.ZstdError: could not determine content size in frame header

This issue is discussed here: mitmproxy/mitmproxy#6914

A fix inspired by that discussion that works for me:

--- a/kafka/codec.py
+++ b/kafka/codec.py
@@ -311,7 +311,4 @@ def zstd_encode(payload):
def zstd_decode(payload):
if not zstd:
raise NotImplementedError("Zstd codec is not available")

• try:

•    return zstd.ZstdDecompressor().decompress(payload)
  

• except zstd.ZstdError:

•    return zstd.ZstdDecompressor().decompress(payload, max_output_size=ZSTD_MAX_OUTPUT_SIZE)
  

• return zstd.ZstdDecompressor().stream_reader(io.BytesIO(payload)).read()