delimiter
indicator
msg_length
size_limit
min_length
encoding
ASCII-8BIT
to avoid invalid characters when dealing with binary datatokenize indicator: "\x02", delimiter: "\x03"
"yu\x03\x02hello\x03\x02world\x03\x02how"
Would have the following result:yu\x03
would be discardedhello
would be returnedworld
would be returned\x02how
would be bufferedcallback
indicator
size_limit
encoding
ASCII-8BIT
to avoid invalid characters when dealing with binary data