HLS Dump Issues #1668

TheTurkeyDev · 2024-07-18T17:01:02Z

TheTurkeyDev
Jul 18, 2024

I am working with the HLS Dump feature and I am experience some issues with it's functionality. For context my use case is that I have some cameras that are streaming 24/7. I would like to "restart" the HLS Dump every 24 hours so that I can have vods of individual days and make cleaning up the vods after a day or two a more simple process.

After stopping a dump, you are not able to make a new dump with the same ID. Is it possible to have the ID's freed up once they are stopped so a new dump can be made?
Tied in with the one above, I could make a new ID for each dump, but there is no endpoint to get a list of all the dumps for a stream to more easily track the dumps that are active.
More a general question, but with the HLS dump for the usage as a VOD, the dumped llhls.m3u8 file only contains the last 10 or so segments making it impossible to have a vod for the entire day (or even a vod more than like 2 minutes long). Am I doing something wrong here? Do I need to make a separate playlist for the dump that has all the segments in it's playlist? All the segments files are preserved in the dumped folder, but the segment playlist file only contains around the last 10 segments.

Let me know if there are any further details or files that you'd like me to provide to help out.

Answered by getroot

Jul 26, 2024

This is a bug. It is managed as an issue and has been moved to #1669.

View full answer

getroot · 2024-07-18T17:07:29Z

getroot
Jul 18, 2024
Maintainer Sponsor

If your HLS Dump doesn't have all the files listed in the Playlist, it's likely a regression bug. What version of OME are you using? And the 24-hour Playlist is so long that I'm not sure if it will work properly.

32 replies

getroot Jul 26, 2024
Maintainer Sponsor

Hmm... #EXT-X-MEDIA-SEQUENCE:0 looks like everything is normal, but it seems like the old segment list for VoD Dump has been initialized. I don't know if it's a timing issue or a race condition. I'll have to analyze it in more detail.

If you can, I think it would be good if you could analyze the following.

Before the stream ends (before calling stopDump), can you observe how the playlist changes while periodically calling the command below?

$ cat chunklist_0_video_10159970873491820195_llhls.m3u8

When observing as above, can you check when the seg_0_0_video_~~.m4s file, i.e. the first segment, disappears from the list?
So I'm wondering if the list keeps on holding 10-11 items, or if it keeps growing (which is normal), and when stopDump is called or the stream is deleted, segment 0 is removed from the list.

If you could provide me with the above information, I think it would speed up my work. The best thing would be if it could be reproduced in my environment, but it is difficult to reproduce.

TheTurkeyDev Jul 26, 2024
Author

Let's try this because I can't think of anything else. This is the exact steps I took and got the issue. (I started this before seeing your previous comment)

Made a folder named temp in my home folder with config, video, and logs sub folders
Copied this Server.xml into the config folder

Server.xml

<?xml version="1.0" encoding="UTF-8" ?>
<Server version="8">
        <Name>OvenMediaEngine</Name>
        <Type>origin</Type>
        <IP>*</IP>
        <PrivacyProtection>false</PrivacyProtection>
        <StunServer>stun.ovenmediaengine.com:13478</StunServer>

        <Modules>
                <HTTP2>
                        <Enable>true</Enable>
                </HTTP2>

                <LLHLS>
                        <Enable>true</Enable>
                </LLHLS>
                <P2P>
                        <Enable>false</Enable>
                        <MaxClientPeersPerHostPeer>2</MaxClientPeersPerHostPeer>
                </P2P>
        </Modules>
        <Bind>
                <Managers>
                        <API>
                                <Port>8081</Port>
                                <WorkerCount>1</WorkerCount>
                        </API>
                </Managers>
                <Providers>
                        <RTSPC>
                                <WorkerCount>1</WorkerCount>
                        </RTSPC>
                        <OVT>
                                <WorkerCount>1</WorkerCount>
                        </OVT>
                        <RTMP>
                                <Port>${env:OME_RTMP_PROV_PORT:1935}</Port>
                                <WorkerCount>1</WorkerCount>
                        </RTMP>
                        <SRT>
                                <Port>${env:OME_SRT_PROV_PORT:9999}</Port>
                                <WorkerCount>1</WorkerCount>
                        </SRT>
                        <WebRTC>
                                <Signalling>
                                        <Port>${env:OME_WEBRTC_SIGNALLING_PORT:3333}</Port>
                                        <TLSPort>${env:OME_WEBRTC_SIGNALLING_TLS_PORT:3334}</TLSPort>
                                        <WorkerCount>1</WorkerCount>
                                </Signalling>
                                <IceCandidates>
                                        <IceCandidate>${env:OME_HOST_IP:*}:10002-10007/udp</IceCandidate>
                                        <TcpRelay>${env:OME_HOST_IP:*}:${env:OME_WEBRTC_TCP_RELAY_PORT:3478}</TcpRelay>
                                        <TcpForce>true</TcpForce>
                                        <TcpRelayWorkerCount>1</TcpRelayWorkerCount>
                                </IceCandidates>
                        </WebRTC>
                </Providers>
                <Publishers>
                        <OVT>
                                <Port>${env:OME_ORIGIN_PORT:9000}</Port>
                                <WorkerCount>1</WorkerCount>
                        </OVT>
                        <LLHLS>
                                <Port>${env:OME_LLHLS_STREAM_PORT:3333}</Port>
                                <TLSPort>${env:OME_LLHLS_STREAM_TLS_PORT:3334}</TLSPort>
                                <WorkerCount>1</WorkerCount>
                        </LLHLS>
                        <WebRTC>
                                <Signalling>
                                        <Port>${env:OME_WEBRTC_SIGNALLING_PORT:3333}</Port>
                                        <TLSPort>${env:OME_WEBRTC_SIGNALLING_TLS_PORT:3334}</TLSPort>
                                        <WorkerCount>1</WorkerCount>
                                </Signalling>
                                <IceCandidates>
					<TcpRelay>*:3478</TcpRelay>
                			<TcpForce>false</TcpForce>
                			<IceCandidate>*:10002-10007/udp</IceCandidate>
                                        <TcpRelayWorkerCount>1</TcpRelayWorkerCount>
                                </IceCandidates>
                        </WebRTC>
                </Publishers>
        </Bind>
        <Managers>
                <API>
                        <AccessToken>test:token</AccessToken>
                        <CrossDomains>
                                <Url>*</Url>
                        </CrossDomains>
                </API>
        </Managers>
        <VirtualHosts>
                <VirtualHost include="VHost*.xml" />
                <VirtualHost>
                        <Name>default</Name>
                        <Distribution>ovenmediaengine.com</Distribution>
                        <Host>
                                <Names>
                                        <Name>*</Name>
                                </Names>
                        </Host>
                        <CrossDomains>
                                <Url>*</Url>
                        </CrossDomains>
                        <Applications>
                                <Application>
                                        <Name>live</Name>
                                        <Type>live</Type>
                                        <OutputProfiles>
                                                <HWAccels>
                                                        <Decoder>
                                                                <Enable>false</Enable>
                                                        </Decoder>
                                                        <Encoder>
                                                                <Enable>false</Enable>
                                                        </Encoder>
                                                </HWAccels>
                                                <OutputProfile>
                                                        <Name>bypass_stream</Name>
                                                        <OutputStreamName>${OriginStreamName}</OutputStreamName>
                                                        <Encodes>
                                                                <Video>
                                                                        <Name>bypass_video</Name>
                                                                        <Bypass>true</Bypass>
                                                                </Video>
                                                                <Audio>
                                                                        <Name>aac_audio</Name>
                                                                        <Codec>aac</Codec>
                                                                        <Bitrate>128000</Bitrate>
                                                                        <Samplerate>48000</Samplerate>
                                                                        <Channel>2</Channel>
                                                                        <BypassIfMatch>
                                                                                <Codec>eq</Codec>
                                                                        </BypassIfMatch>
                                                                </Audio>
                                                                <Audio>
                                                                        <Name>opus_audio</Name>
                                                                        <Codec>opus</Codec>
                                                                        <Bitrate>128000</Bitrate>
                                                                        <Samplerate>48000</Samplerate>
                                                                        <Channel>2</Channel>
                                                                        <BypassIfMatch>
                                                                                <Codec>eq</Codec>
                                                                        </BypassIfMatch>
                                                                </Audio>
                                                        </Encodes>
                                                </OutputProfile>
                                        </OutputProfiles>
                                        <Providers>
                                                <OVT />
                                                <WebRTC>
                                                        <Timeout>30000</Timeout>
                                                        <CrossDomains>
                                                                <Url>*</Url>
                                                        </CrossDomains>
                                                </WebRTC>
                                                <RTMP />
                                                <SRT />
                                                <RTSPPull />
                                        </Providers>
                                        <Publishers>
                                                <AppWorkerCount>1</AppWorkerCount>
                                                <StreamWorkerCount>8</StreamWorkerCount>
                                                <OVT />
                                                <WebRTC>
                                                        <Timeout>30000</Timeout>
                                                        <Rtx>false</Rtx>
                                                        <Ulpfec>false</Ulpfec>
                                                        <JitterBuffer>false</JitterBuffer>
                                                </WebRTC>
                                                <LLHLS>
							<OriginMode>true</OriginMode>
                                                        <ChunkDuration>0.5</ChunkDuration>
                                                        <PartHoldBack>1.5</PartHoldBack>
                                                        <SegmentDuration>6</SegmentDuration>
                                                        <SegmentCount>10</SegmentCount>
                                                        <CrossDomains>
                                                                <Url>*</Url>
                                                        </CrossDomains>
                                                        <DVR>
                                                                <Enable>true</Enable>
                                                                <TempStoragePath>/rewind</TempStoragePath>
                                                                <MaxDuration>10800</MaxDuration>
                                                        </DVR>
                                                        <Dumps>
                                                                <Dump>
                                                                        <Enable>true</Enable>
                                                                        <TargetStreamName>ignore</TargetStreamName>
                                                                        <OutputPath>/video/${StreamName}</OutputPath>
                                                                </Dump>
                                                        </Dumps>
                                                </LLHLS>
                                                <RTMPPush>
                                                </RTMPPush>
						<SRTPush>
      						</SRTPush>
                                        </Publishers>
                                </Application>
                        </Applications>
                </VirtualHost>
        </VirtualHosts>
</Server>

Ran docker run --name ome -d -e OME_HOST_IP=Your.HOST.IP.Address -v ~/temp/config:/opt/ovenmediaengine/bin/origin_conf -v ~/temp/logs:/var/log/ovenmediaengine -v ~/temp/video:/video -p 8081:8081 -p 1935:1935 -p 9999:9999/udp -p 9000:9000 -p 3333:3333 -p 3478:3478 -p 10000-10009:10000-10009/udp airensoft/ovenmediaengine:latest Obviously with my actual IP
Ran this FFMPEG command to create a test stream ffmpeg -re -f lavfi -i "aevalsrc=if(eq(floor(t)\,ld(2))\,st(0\,random(4)*3000+1000))\;st(2\,floor(t)+1)\;st(1\,mod(t\,1))\;(0.6*sin(1*ld(0)*ld(1))+0.4*sin(2*ld(0)*ld(1)))*exp(-4*ld(1)) [out1]; testsrc=s=800x600,drawtext=borderw=5:fontcolor=white:fontsize=30:text='%{localtime}/%{pts\:hms}':x=$w-text_w$/2:y=$h-text_h-line_h$/2 [out0]" -acodec aac -vcodec h264 -strict -2 -pix_fmt yuv420p -profile:v baseline -level 3.0 -g 50 -f flv rtmp://192.168.1.200:1935/live/1
Made a GET request to http://192.168.1.200:8081/v1/vhosts/default/apps/live/streams To verify the stream was up (I used Postman for these API calls)
Made a POST request to http://192.168.1.200:8081/v1/vhosts/default/apps/live/streams/1:startHlsDump with the body

{
"outputStreamName": "1",
"id":"dump_1_test_1",
"outputPath":"/video/1/test",
"playlist":[
"llhls.m3u8"
]
}

Waited for ~3 minutes
Viewed the chunklist_0_video_10159970873491820195_llhls.m3u8 inside ~/temp/video/1/test
Noted contents

#EXTM3U
#EXT-X-VERSION:10
#EXT-X-TARGETDURATION:6
#EXT-X-SERVER-CONTROL:HOLD-BACK=18
#EXT-X-MEDIA-SEQUENCE:0
#EXT-X-MAP:URI="init_0_video_10159970873491820195_llhls.m4s"
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:02:57.864+00:00
#EXTINF:6.000000,
seg_0_37_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:03.864+00:00
#EXTINF:6.000000,
seg_0_38_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:09.864+00:00
#EXTINF:6.000000,
seg_0_39_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:15.864+00:00
#EXTINF:6.000000,
seg_0_40_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:21.864+00:00
#EXTINF:6.000000,
seg_0_41_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:27.864+00:00
#EXTINF:6.000000,
seg_0_42_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:33.864+00:00
#EXTINF:6.000000,
seg_0_43_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:39.864+00:00
#EXTINF:6.000000,
seg_0_44_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:45.864+00:00
#EXTINF:6.000000,
seg_0_45_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:51.864+00:00
#EXTINF:6.000000,
seg_0_46_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:57.864+00:00
#EXTINF:6.000000,
seg_0_47_video_10159970873491820195_llhls.m4s
#EXT-X-ENDLIST

Waited ~30 seconds
Viewed the contents again

#EXTM3U
#EXT-X-VERSION:10
#EXT-X-TARGETDURATION:6
#EXT-X-SERVER-CONTROL:HOLD-BACK=18
#EXT-X-MEDIA-SEQUENCE:0
#EXT-X-MAP:URI="init_0_video_10159970873491820195_llhls.m4s"
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:33.864+00:00
#EXTINF:6.000000,
seg_0_43_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:39.864+00:00
#EXTINF:6.000000,
seg_0_44_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:45.864+00:00
#EXTINF:6.000000,
seg_0_45_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:51.864+00:00
#EXTINF:6.000000,
seg_0_46_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:03:57.864+00:00
#EXTINF:6.000000,
seg_0_47_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:04:03.864+00:00
#EXTINF:6.000000,
seg_0_48_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:04:09.864+00:00
#EXTINF:6.000000,
seg_0_49_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:04:15.864+00:00
#EXTINF:6.000000,
seg_0_50_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:04:21.864+00:00
#EXTINF:6.000000,
seg_0_51_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:04:27.864+00:00
#EXTINF:6.000000,
seg_0_52_video_10159970873491820195_llhls.m4s
#EXT-X-PROGRAM-DATE-TIME:2024-07-26T15:04:33.864+00:00
#EXTINF:6.000000,
seg_0_53_video_10159970873491820195_llhls.m4s
#EXT-X-ENDLIST

Confirmed contents are different and the chunklist is incorrectly dropping older segments, but segment files are still present inside of ~/temp/video/1/test folder

Let me know if you do these exact steps if you see something different

getroot Jul 26, 2024
Maintainer Sponsor

Thanks for the quick test. This definitely narrows down my scope of analysis. It's not that the old_segments list is deleted later, but rather that no information is added to old_segments. I'll look into some things based on this information. Thanks.

getroot Jul 26, 2024
Maintainer Sponsor

This is a bug. It is managed as an issue and has been moved to #1669.

Answer selected by TheTurkeyDev

getroot · 2024-07-18T17:27:59Z

getroot
Jul 18, 2024
Maintainer Sponsor

After stopping a dump, you are not able to make a new dump with the same ID. Is it possible to have the ID's freed up once they are stopped so a new dump can be made?
Tied in with the one above, I could make a new ID for each dump, but there is no endpoint to get a list of all the dumps for a stream to more easily track the dumps that are active.

I think you could create a new ID on your server by combining the date and the Sequence Number and track it. I may not understand exactly what your problem is.

1 reply

TheTurkeyDev Jul 18, 2024
Author

That was one thought I had, but would it then be possible to add an endpoint to get the current dumps to help me track the previous ID's and better manage/track the active dumps?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HLS Dump Issues #1668

{{title}}

Replies: 2 comments 33 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

HLS Dump Issues #1668

TheTurkeyDev Jul 18, 2024

Replies: 2 comments · 33 replies

getroot Jul 18, 2024 Maintainer Sponsor

getroot Jul 26, 2024 Maintainer Sponsor

TheTurkeyDev Jul 26, 2024 Author

getroot Jul 26, 2024 Maintainer Sponsor

getroot Jul 26, 2024 Maintainer Sponsor

getroot Jul 18, 2024 Maintainer Sponsor

TheTurkeyDev Jul 18, 2024 Author

TheTurkeyDev
Jul 18, 2024

Replies: 2 comments 33 replies

getroot
Jul 18, 2024
Maintainer Sponsor

getroot Jul 26, 2024
Maintainer Sponsor

TheTurkeyDev Jul 26, 2024
Author

getroot Jul 26, 2024
Maintainer Sponsor

getroot Jul 26, 2024
Maintainer Sponsor

getroot
Jul 18, 2024
Maintainer Sponsor

TheTurkeyDev Jul 18, 2024
Author