-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[idea] compression with schema #2
Comments
This is for compression, not validation. So it will probably need to be able to integrate with external validators. The name json (with) schema is not appropriate because it is likely to be confused with the JSON Schema spec, which contains advanced features such as references or support for dynamic messages. Maybe a name like fixjson? or other ideas |
@cometkim or is this package's compression logic executed and then encoded like this according to the message pack specification?
|
The schema can be bound in constructors, so there is no need to pass it as an argument. And I don't think support for extensions will be needed as the schema user can make more assumptions about the message before using. A subset would be enough One common rule is that efficiency and flexibility are usually trade-offs. |
An interesting idea is that this also can flatten nested structures beyond simply mapping key names. Given that we currently have poor performance for complex structures, this could be a good breakthrough. |
Another idea: LZ-based compression for large strings (str8, str16, str32...) |
If the schema of the message is fixed, more efficient compression is possible.
Keep the msgpack and build a treemap for shorter key names. It will need the same schema to restore original message.
The text was updated successfully, but these errors were encountered: