Question on h264 RTP packet decoding / forwarding to Websocket
question
@mpromonet Great work on implementing the `rtsp2web` server, the code is quite minimalist. I'm implementing a RTP/h264 relay server in Golang similar to yours.
I'm wondering if you might be able to clarify some questions on how the `rtsp2web` server is able to relay h264 media to the browser webcodecs:
1) is the server just relaying the RTP packets that contain the h264 media as-is to the Websocket connection? or,
2) is the server capturing the RTP packets, then decodes part or all of the h264 media into frames and then sends these decoded frames over the Websocket connection?
The `EncodedVideoChunk()` method of the Webcodecs API expects the `data` parameter to be an `ArrayBuffer` but doesn't specify if this data should be plain RTP packets or already decoded h264 media?
I'm asking all these because I'm not familiar (yet) how h264 or the Webcodecs API should work together.
关闭于 2024-10-13 1 条评论