[Question] 600ms latency when streaming MPEGTS/RTP?

[ben-xD]

Im trying to stream video from a Pi 5 to my mac laptop.

I tried to run the example: rpicam-vid -t 0 --codec libav --libav-format mpegts --libav-audio -o "tcp://<ip-addr>:<port>?listen=1" , but that error'd with libav: cannot open pulse input device default, so I removed the --libav-audio which fixed it.

This command works: rpicam-vid -t 0 --codec libav --libav-format mpegts -o "udp://192.168.1.82:11024"

However, when I play it on my mac with ffplay udp://192.168.1.82:11024 -fflags nobuffer -flags low_delay -framedrop, the latency is more than 600ms.

I've tried with 2 cameras: Raspberry Pi Camera 2.1 NoIR (Sony imx219 sensor) and OV5647

How can I reduce the latency further? I've used gstreamer with other cameras that have given me latencies of 250ms on the same network.

[naushir]

I wonder if this is because of b-frame encoding. Could you try disabling bframes by editing the following out:

rpicam-apps/encoder/libav_encoder.cpp

Line 83 in 2b61eca

codec->max_b_frames = 1;

and see if that helps?