forked from intel/gstreamer-media-SDK
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathREADME.USAGE
170 lines (122 loc) · 7.7 KB
/
README.USAGE
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
Introduction
============
This document serves as a starting guide on effectively using the GStreamer Media SDK plugins
for your custom GStreamer application, by demonstrating a considerable number of examples for common use cases.
Also, some useful command-line utilities will be shown facilitating the usage of these plugins.
Available GStreamer MSDK plugins
================================
Plugin name | Description
------------------------------------------------------------------------
mfxdecode | Generic Media SDK Decoder Plugin
mfxh264dec | Media SDK H264 Decoder Plugin
mfxhevcdec | Media SDK HEVC Decoder Plugin
mfxmpeg2dec | Media SDK MPEG2 Decoder Plugin
mfxjpegdec | Media SDK JPEG Decoder Plugin
mfxvc1dec | Media SDK VC1 Decoder Plugin
mfxvp8dec | Media SDK VP8 Decoder Plugin
mfxvp9dec | Media SDK VP9 Decoder Plugin
mfxvpp | Media SDK VPP Plugin
mfxh264enc | Media SDK H264 Encoder Plugin
mfxhevcenc | Media SDK H265 Encoder Plugin (supports HEVC Main Profile only)
mfxmpeg2enc | Media SDK MPEG2 Encoder Plugin
mfxjpegenc | Media SDK JPEG Encoder Plugin
mfxsink | X11 / Wayland / EGL Renderer Plugin (mfxvpp + mfxsinkelement GstBin element)
mfxsinkelement | Standalone X11 / EGL / Wayland Renderer Plugin
mfxvc1parse | Custom VC1 Parser Plugin for Media SDK VC1 decoding
GStreamer Debugging Tips
========================
To list the configurable properties of an MFX plugin listed above (in this case, mfxvpp):
gst-inspect-1.0 mfxvpp
To view debug, log or error messages for a GStreamer pipeline using the MFX plugins:
export GST_DEBUG=mfx*:<log_level>,mfxsink:<log_level>
before executing the GStreamer pipeline. For this particular case,
we are logging the runtime debug output of mfxsink and its associated gst-libs.
<log_level> represents a GStreamer debug value from 1 to 8.
To view running frame rate statistics on the terminal when decoding, encoding or rendering,
run the following command first:
export GST_DEBUG=fpsdisplaysink:6
Some GStreamer pipelines to demonstrate performance benchmarking of MFX plugins:
# Benchmark mfxsink rendering performance
gst-launch-1.0 filesrc location=input.mkv ! matroskademux ! h265parse ! mfxhevcdec ! \
fpsdisplaysink video-sink=mfxsink text-overlay=false signal-fps-measurements=true
# Benchmark HEVC decoder performance
gst-launch-1.0 filesrc location=input.mkv ! matroskademux ! h265parse ! mfxhevcdec ! \
fpsdisplaysink video-sink=fakesink text-overlay=false signal-fps-measurements=true sync=false
Example GStreamer Pipelines
===========================
# Video playback with audio and subtitles (from GStreamer 1.8 onwards)
gst-play-1.0 /path/to/video.mkv
# Fullscreen video playback using playbin with VPP rotation and EGL rendering
gst-launch-1.0 playbin uri=file:///path/to/video.mp4 \
video-filter="mfxvpp rotation=90" video-sink="mfxsink display=egl fullscreen=true"
# Basic H264 decode with OSD frame rate tracking
gst-launch-1.0 filesrc location=input.mp4 ! qtdemux ! h264parse ! mfxh264dec ! \
fpsdisplaysink video-sink=mfxsink
# Basic MPEG2 decode
gst-launch-1.0 filesrc location=input.mpg ! tsdemux ! mpegvideoparse ! mfxmpeg2dec ! mfxsinkelement
# Basic HEVC decode
gst-launch-1.0 filesrc location=input.mkv ! matroskademux ! h265parse ! mfxhevcdec ! mfxsinkelement
# Basic JPEG decode
gst-launch-1.0 filesrc location=input.avi ! avidemux ! mfxjpegdec ! mfxsinkelement
# Basic VC1 decode with custom VC1 parser
gst-launch-1.0 filesrc location=input.wmv ! asfdemux ! mfxvc1parse ! mfxvc1dec ! mfxsinkelement
# Basic VP8 / VP9 decode
gst-launch-1.0 filesrc location=input.webm ! matroskademux ! mfxdecode ! mfxsinkelement
# H264 raw file encode
gst-launch-1.0 filesrc location=raw.yuv ! \
videoparse width=<width> height=<height> format=<format> ! \
mfxh264enc ! matroskamux ! filesink location=/path/to/output.mkv sync=false
# Trancode an H264 video to an HEVC video
gst-launch-1.0 filesrc location=video.mp4 ! qtdemux ! h264parse ! mfxdecode ! \
mfxhevcenc ! matroskamux ! filesink location=/path/to/output.mkv sync=false
# Trancode a 4k H264 video to a resized 1080p HEVC video with AAC audio encoding and muxing
gst-launch-1.0 filesrc location=4k_video.mp4 ! qtdemux name=demux demux.video_0 ! h264parse ! \
mfxh264dec ! mfxvpp width=1920 height=1080 ! mfxhevcenc ! mux. demux.audio_0 ! queue ! decodebin ! \
avenc_aac ! mux. matroskamux name=mux ! filesink location=/path/to/output.mkv sync=false
# Video preview with transcoding
gst-launch-1.0 filesrc location=video.mp4 ! qtdemux ! h264parse ! mfxdecode ! \
tee name=tp tp. ! queue ! mfxsinkelement tp. ! queue ! \
mfxmpeg2enc ! mpegtsmux ! filesink location=/path/to/output.mpg
# Simultaneous camera preview using dma-buffer sharing and H264 encoding
gst-launch-1.0 v4l2src io-mode=5 ! video/x-raw, width=<w>, height=<h> ! mfxvpp ! \
tee name=tp ! queue ! mfxsinkelement tp. ! mfxh264enc ! 'video/x-h264, profile=baseline' ! \
flvmux streamable=true ! filesink location=/path/to/output.flv
# RTP sender (H264)
gst-launch-1.0 v4l2src io-mode=5 ! mfxh264enc ! \
'video/x-h264, stream-format=byte-stream, profile=baseline' ! \
rtph264pay pt=96 ! udpsink host=<ip> port=<port>
# RTP receiver (H264)
gst-launch-1.0 -v udpsrc port=<port> caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264" ! \
rtph264depay ! h264parse ! mfxh264dec ! mfxsink
# Multi-window decode with different renderers
gst-launch-1.0 filesrc location=video.mp4 ! qtdemux ! h264parse ! mfxdecode ! \
tee name=tp tp. ! queue ! mfxsink display=egl tp. ! queue ! mfxsink display=x11
# VPP postprocessing after decode (gst-inspect-1.0 mfxvpp for <options>)
gst-launch-1.0 filesrc location=video.mkv ! matroskademux ! h265parse ! mfxhevcdec ! \
mfxvpp <options> ! mfxsinkelement
# VPP postprocessing during MPEG2 to H264 transcoding (gst-inspect-1.0 mfxvpp for <options>)
gst-launch-1.0 filesrc location=video.mpg ! mpegpsdemux ! mpegvideoparse ! mfxdecode ! \
mfxvpp <options> ! mfxh264enc ! qtmux ! filesink location=/path/to/output.mp4 sync=false
Optimized Usage with GL Plugins
===============================
The GStreamer Media SDK plugins include optimized support for GL plugins by enabling zero-copy
EGL texture transfers using dma-buffer sharing feature. This dma-buffer sharing optimization
has been introduced since GStreamer version 1.8, and hence only works from this version onwards.
To enable this feature, run the following command before executing the GStreamer pipeline:
export GST_GL_PLATFORM=egl
To demonstrate optimized zero-copy rendering with glimagesink,
gst-launch-1.0 filesrc location=input.mp4 ! qtdemux ! h264parse ! mfxh264dec ! \
fpsdisplaysink video-sink=glimagesink
For a more useful real-world example of video playback with glimagesink,
gst-play-1.0 /path/to/video.mp4 --videosink=glimagesink
Finally, we demonstrate a complex pipeline that creates a video wall running 4 video streams concurrently
while ensuring all frames are processed in video memory for full performance.
gst-launch-1.0 glvideomixer name=m
sink_0::xpos=0 sink_0::ypos=0 sink_0::width=960 sink_0::height=540
sink_1::xpos=960 sink_1::ypos=0 sink_1::width=960 sink_1::height=540
sink_2::xpos=0 sink_2::ypos=540 sink_2::width=960 sink_2::height=540
sink_3::xpos=960 sink_3::ypos=540 sink_3::width=960 sink_3::height=540 ! glimagesink \
v4l2src io-mode=5 ! mfxvpp ! m.sink_0 \
filesrc location=video1.mp4 ! qtdemux ! h264parse ! mfxdecode ! mfxvpp brightness=-90 ! m.sink_1 \
filesrc location=video2.mpg ! tsdemux ! mpegvideoparse ! mfxdecode ! m.sink_2 \
filesrc location=video3.mkv ! matroskademux ! h265parse ! mfxdecode ! mfxvpp contrast=3 ! m.sink_3