I'm working on a streaming solution and I want to combine two sources into one output stream, a Pi Camera and a webcam. Rather than decode the h264 output and then encode it again after it gets mixed together I'm trying to figure out how to get the raw output to work with gstreamer. I'm having a hard time figuring out what the proper format is supposed to be. I've tried switching it to 'rgb' on both sides but when I view the output I get a matrix of 6 copies all in grayscale, 3 on top and 3 on the bottom and I don't know what to choose for the 'yuv' from raspivid.
What is the correct gstreamer format for any of the pi camera raw formats?
Anyone have a sample pipeline?
Edit: Currently I'm using the rapsivid | gst-launch-1.0 style input and wondering if that's still the proper way to access the pi or if there's a gstreamer plugin that is capable like v4l2 or something.