[FFmpeg-user] missing a selected frame

[Ulf Zibis]

Am 19.07.19 um 08:30 schrieb Carl Eugen Hoyos:
> Am Fr., 19. Juli 2019 um 00:22 Uhr schrieb Ulf Zibis <Ulf.Zibis at gmx.de>:
>
>> my command is:
>> ./ffmpeg -y -v warning -i debug/CYD_1.5m_x264.mp4
> If you want support on this mailing list, do not use -v warning
> and post the command line together with the complete, uncut
> console output.
Sorry for that, here is the complete output:
$ ./ffmpeg -y -i debug/CYD_1.5m_x264.mp4 -vf
select='eq(t\,10.16)+eq(t\,10.2)+eq(t\,10.24)+eq(t\,10.28)+eq(t\,10.32)+eq(t\,10.36)+eq(t\,10.4)+eq(t\,10.44)+eq(t\,17.52)+eq(t\,47.96)+eq(t\,49.08)+eq(t\,49.2)+eq(t\,55.72)+eq(t\,83.0)'
-q 5 -c:a copy -vsync vfr debug/outsides2/CYD_1.5m_x264_%02d.png
ffmpeg version N-94139-g718d6c6ee5 Copyright (c) 2000-2019 the FFmpeg
developers
  built with gcc 7 (Ubuntu 7.4.0-1ubuntu1~18.04.1)
  configuration:
  libavutil      56. 29.100 / 56. 29.100
  libavcodec     58. 53.100 / 58. 53.100
  libavformat    58. 28.101 / 58. 28.101
  libavdevice    58.  7.100 / 58.  7.100
  libavfilter     7. 55.100 /  7. 55.100
  libswscale      5.  4.101 /  5.  4.101
  libswresample   3.  4.100 /  3.  4.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'debug/CYD_1.5m_x264.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.20.100
  Duration: 00:01:30.40, start: 0.000000, bitrate: 1729 kb/s
    Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p,
704x576 [SAR 12:11 DAR 4:3], 1594 kb/s, 25 fps, 25 tbr, 12800 tbn, 50
tbc (default)
    Metadata:
      handler_name    : VideoHandler
    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz,
stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> png (native))
Press [q] to stop, [?] for help
Output #0, image2, to 'debug/outsides2/CYD_1.5m_x264_%02d.png':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.28.101
    Stream #0:0(und): Video: png, rgb24, 704x576 [SAR 12:11 DAR 4:3],
q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
    Metadata:
      handler_name    : VideoHandler
      encoder         : Lavc58.53.100 png
frame=   13 fps=1.8 q=-0.0 Lsize=N/A time=00:01:23.04 bitrate=N/A
speed=11.6x   
video:4910kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB
muxing overhead: unknown


> In this case, you may want to use -debug_ts and check for
> yourself though;-)
Thanks for the hint. Here is the output (this time I have truncated to
avoid bloating). From my inspection I dont see a reason, why frame with
time 10.2 was left out:
$ ./ffmpeg -debug_ts -y -i debug/CYD_1.5m_x264.mp4 -vf
select='eq(t\,10.16)+eq(t\,10.2)+eq(t\,10.24)+eq(t\,10.28)+eq(t\,10.32)+eq(t\,10.36)+eq(t\,10.4)+eq(t\,10.44)+eq(t\,17.52)+eq(t\,47.96)+eq(t\,49.08)+eq(t\,49.2)+eq(t\,55.72)+eq(t\,83.0)'
-q 5 -c:a copy -vsync vfr debug/outsides2/CYD_1.5m_x264_%02d.png
ffmpeg version N-94139-g718d6c6ee5 Copyright (c) 2000-2019 the FFmpeg
developers
  built with gcc 7 (Ubuntu 7.4.0-1ubuntu1~18.04.1)
  configuration:
  libavutil      56. 29.100 / 56. 29.100
  libavcodec     58. 53.100 / 58. 53.100
  libavformat    58. 28.101 / 58. 28.101
  libavdevice    58.  7.100 / 58.  7.100
  libavfilter     7. 55.100 /  7. 55.100
  libswscale      5.  4.101 /  5.  4.101
  libswresample   3.  4.100 /  3.  4.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'debug/CYD_1.5m_x264.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.20.100
  Duration: 00:01:30.40, start: 0.000000, bitrate: 1729 kb/s
    Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p,
704x576 [SAR 12:11 DAR 4:3], 1594 kb/s, 25 fps, 25 tbr, 12800 tbn, 50
tbc (default)
    Metadata:
      handler_name    : VideoHandler
    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz,
stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> png (native))
Press [q] to stop, [?] for help
demuxer -> ist_index:0 type:video next_dts:NOPTS next_dts_time:NOPTS
next_pts:NOPTS next_pts_time:NOPTS pkt_pts:0 pkt_pts_time:0
pkt_dts:-1024 pkt_dts_time:-0.08 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:0 pkt_pts_time:0
pkt_dts:-1024 pkt_dts_time:-0.08 off:0 off_time:0
demuxer -> ist_index:0 type:video next_dts:-40000 next_dts_time:-0.04
next_pts:0 next_pts_time:0 pkt_pts:2048 pkt_pts_time:0.16 pkt_dts:-512
pkt_dts_time:-0.04 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:2048 pkt_pts_time:0.16
pkt_dts:-512 pkt_dts_time:-0.04 off:0 off_time:0
demuxer -> ist_index:0 type:video next_dts:0 next_dts_time:0 next_pts:0
next_pts_time:0 pkt_pts:1024 pkt_pts_time:0.08 pkt_dts:0 pkt_dts_time:0
off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:1024 pkt_pts_time:0.08
pkt_dts:0 pkt_dts_time:0 off:0 off_time:0
demuxer -> ist_index:0 type:video next_dts:40000 next_dts_time:0.04
next_pts:0 next_pts_time:0 pkt_pts:512 pkt_pts_time:0.04 pkt_dts:512
pkt_dts_time:0.04 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:512 pkt_pts_time:0.04
pkt_dts:512 pkt_dts_time:0.04 off:0 off_time:0
demuxer -> ist_index:0 type:video next_dts:80000 next_dts_time:0.08
next_pts:0 next_pts_time:0 pkt_pts:1536 pkt_pts_time:0.12 pkt_dts:1024
pkt_dts_time:0.08 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:1536 pkt_pts_time:0.12
pkt_dts:1024 pkt_dts_time:0.08 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:0 frame_pts_time:0
best_effort_ts:0 best_effort_ts_time:0 keyframe:1 frame_type:1
time_base:1/12800
Output #0, image2, to 'debug/outsides2/CYD_1.5m_x264_%02d.png':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.28.101
    Stream #0:0(und): Video: png, rgb24, 704x576 [SAR 12:11 DAR 4:3],
q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
    Metadata:
      handler_name    : VideoHandler
      encoder         : Lavc58.53.100 png
demuxer -> ist_index:0 type:video next_dts:120000 next_dts_time:0.12
next_pts:40000 next_pts_time:0.04 pkt_pts:4096 pkt_pts_time:0.32
pkt_dts:1536 pkt_dts_time:0.12 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:4096 pkt_pts_time:0.32
pkt_dts:1536 pkt_dts_time:0.12 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:512 frame_pts_time:0.04
best_effort_ts:512 best_effort_ts_time:0.04 keyframe:0 frame_type:3
time_base:1/12800
demuxer -> ist_index:0 type:video next_dts:160000 next_dts_time:0.16
next_pts:80000 next_pts_time:0.08 pkt_pts:3072 pkt_pts_time:0.24
pkt_dts:2048 pkt_dts_time:0.16 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:3072 pkt_pts_time:0.24
pkt_dts:2048 pkt_dts_time:0.16 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:1024 frame_pts_time:0.08
best_effort_ts:1024 best_effort_ts_time:0.08 keyframe:0 frame_type:3
time_base:1/12800
demuxer -> ist_index:0 type:video next_dts:200000 next_dts_time:0.2
next_pts:120000 next_pts_time:0.12 pkt_pts:2560 pkt_pts_time:0.2
pkt_dts:2560 pkt_dts_time:0.2 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:2560 pkt_pts_time:0.2
pkt_dts:2560 pkt_dts_time:0.2 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:1536 frame_pts_time:0.12
best_effort_ts:1536 best_effort_ts_time:0.12 keyframe:0 frame_type:3
time_base:1/12800
demuxer -> ist_index:0 type:video next_dts:240000 next_dts_time:0.24
next_pts:160000 next_pts_time:0.16 pkt_pts:3584 pkt_pts_time:0.28
pkt_dts:3072 pkt_dts_time:0.24 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:3584 pkt_pts_time:0.28
pkt_dts:3072 pkt_dts_time:0.24 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:2048 frame_pts_time:0.16
best_effort_ts:2048 best_effort_ts_time:0.16 keyframe:0 frame_type:2
time_base:1/12800
demuxer -> ist_index:0 type:video next_dts:280000 next_dts_time:0.28
next_pts:200000 next_pts_time:0.2 pkt_pts:6144 pkt_pts_time:0.48
pkt_dts:3584 pkt_dts_time:0.28 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:6144 pkt_pts_time:0.48
pkt_dts:3584 pkt_dts_time:0.28 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:2560 frame_pts_time:0.2
best_effort_ts:2560 best_effort_ts_time:0.2 keyframe:0 frame_type:3
time_base:1/12800
demuxer -> ist_index:0 type:video next_dts:320000 next_dts_time:0.32
next_pts:240000 next_pts_time:0.24 pkt_pts:5120 pkt_pts_time:0.4
pkt_dts:4096 pkt_dts_time:0.32 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:5120 pkt_pts_time:0.4
pkt_dts:4096 pkt_dts_time:0.32 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:3072 frame_pts_time:0.24
best_effort_ts:3072 best_effort_ts_time:0.24 keyframe:0 frame_type:3
time_base:1/12800
[.....]
######## 1. frame catched from select filter for time 10.16 ########
demuxer -> ist_index:0 type:video next_dts:10240000 next_dts_time:10.24
next_pts:10160000 next_pts_time:10.16 pkt_pts:132096 pkt_pts_time:10.32
pkt_dts:131072 pkt_dts_time:10.24 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:132096
pkt_pts_time:10.32 pkt_dts:131072 pkt_dts_time:10.24 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:130048 frame_pts_time:10.16
best_effort_ts:130048 best_effort_ts_time:10.16 keyframe:0 frame_type:3
time_base:1/12800
filter -> pts:254 pts_time:10.16 exact:254.000008 time_base:1/25
encoder <- type:video frame_pts:254 frame_pts_time:10.16 time_base:1/25
######## 2. frame NOT catched from select filter for time 10.2 ########
demuxer -> ist_index:0 type:video next_dts:10280000 next_dts_time:10.28
next_pts:10200000 next_pts_time:10.2 pkt_pts:131584 pkt_pts_time:10.28
pkt_dts:131584 pkt_dts_time:10.28 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:131584
pkt_pts_time:10.28 pkt_dts:131584 pkt_dts_time:10.28 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:130560 frame_pts_time:10.2
best_effort_ts:130560 best_effort_ts_time:10.2 keyframe:0 frame_type:3
time_base:1/12800
######## 3. frame again catched from select filter for time 10.24 ########
demuxer -> ist_index:0 type:video next_dts:10320000 next_dts_time:10.32
next_pts:10240000 next_pts_time:10.24 pkt_pts:132608 pkt_pts_time:10.36
pkt_dts:132096 pkt_dts_time:10.32 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:132608
pkt_pts_time:10.36 pkt_dts:132096 pkt_dts_time:10.32 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:131072 frame_pts_time:10.24
best_effort_ts:131072 best_effort_ts_time:10.24 keyframe:0 frame_type:2
time_base:1/12800
filter -> pts:256 pts_time:10.24 exact:256.000008 time_base:1/25
encoder <- type:video frame_pts:256 frame_pts_time:10.24 time_base:1/25
demuxer -> ist_index:0 type:video next_dts:10360000 next_dts_time:10.36
next_pts:10280000 next_pts_time:10.28 pkt_pts:135168 pkt_pts_time:10.56
pkt_dts:132608 pkt_dts_time:10.36 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:135168
pkt_pts_time:10.56 pkt_dts:132608 pkt_dts_time:10.36 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:131584 frame_pts_time:10.28
best_effort_ts:131584 best_effort_ts_time:10.28 keyframe:0 frame_type:3
time_base:1/12800
filter -> pts:257 pts_time:10.28 exact:257.000008 time_base:1/25
encoder <- type:video frame_pts:257 frame_pts_time:10.28 time_base:1/25
encoder -> type:video pkt_pts:254 pkt_pts_time:10.16 pkt_dts:254
pkt_dts_time:10.16
    Last message repeated 1 times
muxer <- type:video pkt_pts:254 pkt_pts_time:10.16 pkt_dts:254
pkt_dts_time:10.16 size:256087
demuxer -> ist_index:0 type:video next_dts:10400000 next_dts_time:10.4
next_pts:10320000 next_pts_time:10.32 pkt_pts:134144 pkt_pts_time:10.48
pkt_dts:133120 pkt_dts_time:10.4 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:134144
pkt_pts_time:10.48 pkt_dts:133120 pkt_dts_time:10.4 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:132096 frame_pts_time:10.32
best_effort_ts:132096 best_effort_ts_time:10.32 keyframe:0 frame_type:3
time_base:1/12800
filter -> pts:258 pts_time:10.32 exact:258.000008 time_base:1/25
encoder <- type:video frame_pts:258 frame_pts_time:10.32 time_base:1/25
encoder -> type:video pkt_pts:256 pkt_pts_time:10.24 pkt_dts:256
pkt_dts_time:10.24
    Last message repeated 1 times
muxer <- type:video pkt_pts:256 pkt_pts_time:10.24 pkt_dts:256
pkt_dts_time:10.24 size:238191
demuxer -> ist_index:0 type:video next_dts:10440000 next_dts_time:10.44
next_pts:10360000 next_pts_time:10.36 pkt_pts:133632 pkt_pts_time:10.44
pkt_dts:133632 pkt_dts_time:10.44 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:133632
pkt_pts_time:10.44 pkt_dts:133632 pkt_dts_time:10.44 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:132608 frame_pts_time:10.36
best_effort_ts:132608 best_effort_ts_time:10.36 keyframe:0 frame_type:3
time_base:1/12800
filter -> pts:259 pts_time:10.36 exact:259.000008 time_base:1/25
encoder <- type:video frame_pts:259 frame_pts_time:10.36 time_base:1/25
encoder -> type:video pkt_pts:257 pkt_pts_time:10.28 pkt_dts:257
pkt_dts_time:10.28
    Last message repeated 1 times
muxer <- type:video pkt_pts:257 pkt_pts_time:10.28 pkt_dts:257
pkt_dts_time:10.28 size:243939
demuxer -> ist_index:0 type:video next_dts:10480000 next_dts_time:10.48
next_pts:10400000 next_pts_time:10.4 pkt_pts:134656 pkt_pts_time:10.52
pkt_dts:134144 pkt_dts_time:10.48 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:134656
pkt_pts_time:10.52 pkt_dts:134144 pkt_dts_time:10.48 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:133120 frame_pts_time:10.4
best_effort_ts:133120 best_effort_ts_time:10.4 keyframe:0 frame_type:2
time_base:1/12800
filter -> pts:260 pts_time:10.4 exact:260.000008 time_base:1/25
encoder <- type:video frame_pts:260 frame_pts_time:10.4 time_base:1/25
encoder -> type:video pkt_pts:258 pkt_pts_time:10.32 pkt_dts:258
pkt_dts_time:10.32
    Last message repeated 1 times
muxer <- type:video pkt_pts:258 pkt_pts_time:10.32 pkt_dts:258
pkt_dts_time:10.32 size:247024
demuxer -> ist_index:0 type:video next_dts:10520000 next_dts_time:10.52
next_pts:10440000 next_pts_time:10.44 pkt_pts:137216 pkt_pts_time:10.72
pkt_dts:134656 pkt_dts_time:10.52 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:137216
pkt_pts_time:10.72 pkt_dts:134656 pkt_dts_time:10.52 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:133632 frame_pts_time:10.44
best_effort_ts:133632 best_effort_ts_time:10.44 keyframe:0 frame_type:3
time_base:1/12800
filter -> pts:261 pts_time:10.44 exact:261.000008 time_base:1/25
encoder <- type:video frame_pts:261 frame_pts_time:10.44 time_base:1/25
encoder -> type:video pkt_pts:259 pkt_pts_time:10.36 pkt_dts:259
pkt_dts_time:10.36
    Last message repeated 1 times
muxer <- type:video pkt_pts:259 pkt_pts_time:10.36 pkt_dts:259
pkt_dts_time:10.36 size:248772
demuxer -> ist_index:0 type:video next_dts:10560000 next_dts_time:10.56
next_pts:10480000 next_pts_time:10.48 pkt_pts:136192 pkt_pts_time:10.64
pkt_dts:135168 pkt_dts_time:10.56 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:136192
pkt_pts_time:10.64 pkt_dts:135168 pkt_dts_time:10.56 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:134144 frame_pts_time:10.48
best_effort_ts:134144 best_effort_ts_time:10.48 keyframe:0 frame_type:3
time_base:1/12800
demuxer -> ist_index:0 type:video next_dts:10600000 next_dts_time:10.6
next_pts:10520000 next_pts_time:10.52 pkt_pts:135680 pkt_pts_time:10.6
pkt_dts:135680 pkt_dts_time:10.6 off:0 off_time:0
demuxer+ffmpeg -> ist_index:0 type:video pkt_pts:135680
pkt_pts_time:10.6 pkt_dts:135680 pkt_dts_time:10.6 off:0 off_time:0
decoder -> ist_index:0 type:video frame_pts:134656 frame_pts_time:10.52
best_effort_ts:134656 best_effort_ts_time:10.52 keyframe:0 frame_type:3
time_base:1/12800

[.....]

For the 1st catched frame there is "next_dts_time:10.24" and
"next_pts_time:10.16". So how can I be sure, that this is the
corresponding frame to the output of my filter? :
[Parsed_lineshiftrecover_0 @ 0x55798cbf8f80] frame:    254, pts: 
130048, time:   0:10.16  - ...

I'm also wondering, why there is no "encoder -> ..." message for the
first 3 frames.