gstreamer and ffmpeg - stereoboy/Study GitHub Wiki

Contents

References

• Linux TV GStreamer Wiki
  • https://www.linuxtv.org/wiki/index.php/GStreamer
• Pipeline Examples from the Official Web Page
  • https://thiblahute.github.io/GStreamer-doc/tools/gst-launch.html?gi-language=c#pipeline-examples
• GStreamer Pipeline Samples
  • https://gist.github.com/liviaerxin/bb34725037fd04afa76ef9252c2ee875
• GStreamer Debugging Options
  • https://developer.ridgerun.com/wiki/index.php/GStreamer_Debugging
  • https://gstreamer.freedesktop.org/documentation/gstreamer/running.html?gi-language=c
• Media Types and Properties
  • https://gstreamer.freedesktop.org/documentation/plugin-development/advanced/media-types.html?gi-language=c
• How many total threads in a given GStreamer pipeline?
  • https://stackoverflow.com/questions/69521161/how-many-total-threads-in-a-given-gstreamer-pipeline

Open Sourced Sample Codes

• GStreamer Pipeline Arena (Samples)
  • https://github.com/nicolargo/gstpipelinearena/tree/master
• gstreamer-cheat-sheet
  • https://github.com/matthew1000/gstreamer-cheat-sheet
• Gstreamer Pipeline Samples
  • https://gist.github.com/liviaerxin/bb34725037fd04afa76ef9252c2ee875#file-gstreamer_pipeline_samples-md
• Python Example
  • https://github.com/TheImagingSource/tiscamera/tree/master/examples/python
  • Google Coral
    • https://github.com/google-coral/examples-camera/blob/master/gstreamer/gstreamer.py
  • https://github.com/makepluscode/gstreamer-examples-python

Plugins Samples

• https://github.com/3p3r/gst-timestamper/tree/master

Element Samples

• https://mathieuduponchelle.github.io/2018-02-01-Python-Elements.html
• https://mathieuduponchelle.github.io/2018-02-15-Python-Elements-2.html

NVIDIA DeepStream

• Getting Started with NVIDIA DeepStream-5.0
  • Getting Started with NVIDIA DeepStream-5.0
• NVIDIA Metropolis Documentation Archive
  • https://docs.nvidia.com/metropolis/deepstream-archive.html
• Install for Jetson/Ubuntu
  • https://docs.nvidia.com/metropolis/deepstream/5.0/dev-guide/index.html#page/DeepStream_Development_Guide/deepstream_quick_start.html

Gst-Python

• PyGObject
  • https://lazka.github.io/pgi-docs/
• Gst
  • https://lazka.github.io/pgi-docs/#Gst-1.0
• GLib
  • https://lazka.github.io/pgi-docs/#GLib-2.0
• GModule
  • https://lazka.github.io/pgi-docs/#GModule-2.0
• GObject
  • https://lazka.github.io/pgi-docs/#GObject-2.0

PyGObject

• https://pygobject.readthedocs.io/en/latest/
• GTK
  • https://docs.gtk.org/
  • GTK-3.0
    • https://lazka.github.io/pgi-docs/#Gtk-3.0/classes/Widget.html#gtk-widget-methods
  • GLib-2.0
    • https://docs.gtk.org/glib/
  • GModule-2.0
    • https://docs.gtk.org/gmodule/
  • GObject-2.0
    • https://docs.gtk.org/gobject/
  • Gio-2.0
    • https://docs.gtk.org/gio/

Tools

• Web Audio Equalizer
  • https://mp3cut.net/ko/equalizer

gstreamer and ffmpeg Overview

gstreamer vs ffmpeg

• https://www.quora.com/Multimedia-Which-is-better-FFmpeg-or-GStreamer-Why#:~:text=GStreamer%20is%20a%20broader%20library,operations%2C%20GStreamer%20is%20super%20powerful.

GStreamer is a broader library, and can actually use FFmpeg plugins. For simple and typical transcoding jobs, maybe FFmpeg is easier to use. But for more complex operations, GStreamer is super powerful.

gstreamer with RTSP

ffmpeg with RTSP

• FFmpeg를 사용하여 웹캠 영상과 동영상 파일을 RTSP 스트리밍하기
  • https://webnautes.tistory.com/1427
  • Assume additional RTSP Setup, FFmpeg is just transfer video streaming to RTSP server.

---

GStreamer

• Unofficial Overview
  • https://medium.com/may-i-lab/gstreamer-gstreamer-%EA%B8%B0%EC%B4%88-da5015f531fc

GStreamer Build Setup

• https://github.com/stereoboy/devel/wiki/Docker#gstreamer

GStreamer command line usages

• Simple usage (Playing in local)
  • https://webnautes.tistory.com/1426?category=874967
  • https://medium.com/@petehouston/play-webcam-using-gstreamer-9b7596e4e181

  $ gst-launch-1.0 autovideosrc device=/dev/video0 !  autovideosink
  

• Simple usage using gst-launch through UDP
  • https://endland.medium.com/gstreamer-%EC%8B%A4%EC%8B%9C%EA%B0%84-streaming-f7e6f4608768
  • Sender Side

    gst-launch-1.0 -v v4l2src device=/dev/video0 ! video/x-raw, width=640, height=480 ! videoconvert ! jpegenc ! rtpjpegpay ! udpsink \
    host=127.0.0.1 port=8554
    

  • Receiver Side

    gst-launch-1.0 udpsrc port=8554 ! application/x-rtp,encoding-name=JPEG,payload=26 ! rtpjpegdepay ! jpegdec ! autovideosink
    

gstreamer Tutorials

• Simple References written in Korean
  • https://medium.com/may-i-lab/gstreamer-gstreamer-%EA%B8%B0%EC%B4%88-da5015f531fc
• Simple Tutorial on Ubuntu
  • https://webnautes.tistory.com/1426?category=874967
• Basic tutorial 1: Hello world!
  • https://gitlab.freedesktop.org/gstreamer/gst-docs

    $ gst-launch-1.0 playbin uri=https://www.freedesktop.org/software/gstreamer-sdk/data/media/sintel_trailer-480p.webm
    

  • https://gstreamer.freedesktop.org/documentation/tutorials/basic/hello-world.html?gi-language=c
• Pipeline manipulation
  • https://gstreamer.freedesktop.org/documentation/application-development/advanced/pipeline-manipulation.html?gi-language=c

ffmpeg

• https://www.ffmpeg.org/
• Unofficial Tutorials
  • http://dranger.com/ffmpeg/

How to capture Audio Only from Webcam

$ ffmpeg -f pulse -i default out.wav

$ ffmpeg -f alsa -i hw:1 -t 30 out.wav

How can I capture audio AND video simultenaous with ffmpeg from a linux USB capture device

• https://stackoverflow.com/questions/6311560/how-can-i-capture-audio-and-video-simultenaous-with-ffmpeg-from-a-linux-usb-capt

$ ffmpeg -y -f alsa -i hw:0 -f v4l2 -i /dev/video0  -vcodec libx264  -t 20 prueba1.mp4

• https://stackoverflow.com/questions/11625020/recording-sound-from-webcam-using-ffmpeg

$ arecord -L
default
    Playback/recording through the PulseAudio sound server
null
    Discard all samples (playback) or generate zero samples (capture)
pulse
    PulseAudio Sound Server
...
dmix:CARD=StudioTM,DEV=0
    Microsoft® LifeCam Studio(TM), USB Audio
    Direct sample mixing device
dsnoop:CARD=StudioTM,DEV=0
    Microsoft® LifeCam Studio(TM), USB Audio
    Direct sample snooping device
hw:CARD=StudioTM,DEV=0
    Microsoft® LifeCam Studio(TM), USB Audio
    Direct hardware device without any conversions
plughw:CARD=StudioTM,DEV=0
    Microsoft® LifeCam Studio(TM), USB Audio
    Hardware device with all software conversions

$ ffmpeg -y  -f alsa -i "plughw:CARD=StudioTM,DEV=0"  -f v4l2 -i /dev/video0  -vcodec libx264  -t 20 prueba1.mp4

Stream camera video and audio with FFmpeg

• http://4youngpadawans.com/stream-camera-video-and-audio-with-ffmpeg/

Capture Audio ALSA

• https://trac.ffmpeg.org/wiki/Capture/ALSA