You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Apr 2, 2024. It is now read-only.
If this is anything like fluentd, which uses msgpack, then small messages can blow ElasticSearch request limits if they pack very efficiently. In fluentd the message size limits are enforced after serialization to the transport format, which when unrolled at the other end can balloon to into huge HTTP POSTs, which are rejected. This is especially prevalent with JSON and logging information, which msgpack compresses very well.
The fluentd ecosystem is a tire fire, so don't be tempted to jump ship in that direction 😃
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
RT
need any other config items ?
follow is my part config
[hekad]
maxprocs = 16
base_dir = "/export/home/hekad"
max_message_size = 10485760
#attack log default
[nginx_udp_551]
type = "UdpInput"
address = "172.18.182.162:551"
decoder = "JsonDecoder"
send_decode_failures = true
log_decode_failures = true
[JsonDecoder]
type = "SandboxDecoder"
filename = "lua_decoders/json.lua"
[JsonDecoder.config]
payload_keep = false
map_fields = true
Timestamp = "time_stamp"
Type = "log_type"
#type = "ngx_log"
The text was updated successfully, but these errors were encountered: