[FFmpeg-user] OVERLAY_CUDA and PGS Subtitle burn
Panda Sing Cool
pandacoolsing at gmail.com
Wed Sep 23 03:08:06 EEST 2020
Hi Dennis,
thanks for the link. I have rebuild ffmpeg with all the latest version of
any source i can find, update to the latest cuda 11 patch 3 and NV
headers...
Also included the latest vulkan sdk and support for ffmpeg.
overlay_cuda and overlay_opencl, same issue: video appear but not subtitle.
overlay_vulkan -> direct crash dump from ffmpeg.
:(
Any change from your side ?
On Fri, 18 Sep 2020 at 22:46, Dennis Mungai <dmngaie at gmail.com> wrote:
> On Thu, 17 Sep 2020 at 03:29, Panda Sing Cool <pandacoolsing at gmail.com>
> wrote:
>
> > Hi,
> >
> > Changed the input format:
> > Video -> yuv420p
> > Sub -> yuv*a*420p (to include Alpha Channel)
> >
> > Now the video is showing, but still no subtitles.
> > Still get the error message:
> > *Error while add the frame to buffer source(Internal bug, should not have
> > happened).*
> >
> >
> > ./ffmpeg -threads 1 -loglevel info -nostdin -y -fflags +genpts-fastseek \
> > -ss 00:00:00 -t 00:00:15 \
> > -extra_hw_frames 3 -vsync 0 -async 0 -filter_threads 1
> > -filter_complex_threads 1 \
> > -init_hw_device cuda=cuda -hwaccel cuda -filter_hw_device cuda
> > -hwaccel_output_format cuda \
> > -i input.mkv \
> >
> >
> >
> >
> > * -filter_complex \
> > "[0:v]scale_npp=w=-1:h=720:interp_algo=lanczos:format=yuv420p[vid]; \
> > [0:s]format=yuva420p,hwupload[sub]; \
> [vid][sub]overlay_cuda[v]"
> > \* -map "[v]" -map 0:a \
> > -force_key_frames "expr:gte(t,n_forced*5)" \
> > -c:v h264_nvenc -preset:v slow -profile:v high -level:v 51 \
> > -rc:v cbr_hq -rc-lookahead:v 32 -refs:v 16 -cq:v 16 -bf:v 3 -b:v 2000K
> > -minrate:v 2000K -maxrate:v 2000k -bufsize:v 8M -coder:v cabac
> > -b_ref_mode:v middle \
> > -c:a libfdk_aac -ac 2 -ar 48000 -b:a 128k \
> > output.mkv
> >
> >
> >
> >
> > On Thu, 17 Sep 2020 at 07:08, Panda Sing Cool <pandacoolsing at gmail.com>
> > wrote:
> >
> > > Hi everyone,
> > >
> > > i'm trying to use the OVERLAY_CUDA function to burn PGS titles over a
> > > video and the result is not working.
> > > i might misunderstand the usage of this function, so some help is
> > welcome.
> > >
> > > The result of this command is a black screen with audio, using
> 'standard'
> > > overlay filter is working fine, but slow ...
> > >
> > > Notice this message at the end of the log file (ffmpeg version
> > > N-99194-g142ae27b1d ( compiled myself from git) ):
> > > *Error while add the frame to buffer source(Internal bug, should not
> have
> > > happened).*
> > >
> > > Thanks for any help.
> > >
> > >
> > >
> >
> ***************************************************************************************************************
> > >
> > > ./ffmpeg -threads 1 -loglevel info -nostdin -y -fflags
> > +genpts-fastseek
> > > \
> > > -ss 00:00:00 -t 00:01:00 \
> > > -extra_hw_frames 3 -vsync 0 -async 0 -filter_threads 1
> > > -filter_complex_threads 1 \
> > > -init_hw_device cuda=cuda -hwaccel cuda -filter_hw_device cuda
> > > -hwaccel_output_format cuda \
> > > -i input.mkv \
> > > -filter_complex \
> > >
> > >
> > > * "[0:v]scale_npp=w=-1:h=720:interp_algo=lanczos:format=nv12[vid]; \
> > > [0:s]format=nv12,hwupload_cuda[sub]; \ [vid][sub]overlay_cuda[v]" \*
> > > -map "[v]" -map 0:a \
> > > -force_key_frames "expr:gte(t,n_forced*5)" \
> > > -c:v h264_nvenc -preset:v slow -profile:v high -level:v 51 \
> > > -rc:v cbr_hq -rc-lookahead:v 32 -refs:v 16 -cq:v 16 -bf:v 3 -b:v
> 2000K
> > > -minrate:v 2000K -maxrate:v 2000k -bufsize:v 8M -coder:v cabac
> > > -b_ref_mode:v middle \
> > > -c:a libfdk_aac -ac 2 -ar 48000 -b:a 128k \
> > > output.mkv
> > >
> > >
> > > ***** LOG ****
> > >
> > > f*fmpeg version N-99194-g142ae27b1d *Copyright (c) 2000-2020 the FFmpeg
> > > developers
> > > built with gcc 10 (GCC)
> > > configuration: --prefix=/home/users/work/ffmpeg_build
> > > --pkg-config-flags=--static --extra-libs=-lpthread --extra-libs=-lm
> > > --bindir=/home/users/work/ffmpeg_build/bin --enable-gpl
> > --enable-libfdk_aac
> > > --enable-libfreetype --enable-libmp3lame --enable-libopus
> --enable-libvpx
> > > --enable-libx264 --enable-libx265 --enable-vulkan --enable-nonfree
> > > --enable-libnpp --enable-nvenc --enable-cuvid --enable-libass
> > > --enable-libfontconfig --enable-libfreetype --enable-libfribidi
> > > --enable-cuda
> > > libavutil 56. 59.100 / 56. 59.100
> > > libavcodec 58.106.100 / 58.106.100
> > > libavformat 58. 56.100 / 58. 56.100
> > > libavdevice 58. 11.102 / 58. 11.102
> > > libavfilter 7. 87.100 / 7. 87.100
> > > libswscale 5. 8.100 / 5. 8.100
> > > libswresample 3. 8.100 / 3. 8.100
> > > libpostproc 55. 8.100 / 55. 8.100
> > > Input #0, matroska,webm, from 'input.mkv':
> > > Metadata:
> > > encoder : libebml v1.3.10 + libmatroska v1.5.2
> > > creation_time : 2020-08-13T06:58:46.000000Z
> > > Duration: 00:57:53.06, start: 0.000000, bitrate: 12993 kb/s
> > > Chapter #0:0: start 0.000000, end 508.424583
> > > Metadata:
> > > title : Chapter 01
> > > Chapter #0:1: start 508.424583, end 1037.202833
> > > Metadata:
> > > title : Chapter 02
> > > Chapter #0:2: start 1037.202833, end 1510.175333
> > > Metadata:
> > > title : Chapter 03
> > > Chapter #0:3: start 1510.175333, end 2231.896333
> > > Metadata:
> > > title : Chapter 04
> > > Chapter #0:4: start 2231.896333, end 2908.530625
> > > Metadata:
> > > title : Chapter 05
> > > Chapter #0:5: start 2908.530625, end 3473.052917
> > > Metadata:
> > > title : Chapter 06
> > > Stream #0:0: Video: h264 (High), yuv420p(progressive), 1920x1080,
> SAR
> > > 1:1 DAR 16:9, 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default)
> > > Metadata:
> > > BPS-eng : 10946248
> > > DURATION-eng : 00:57:53.053000000
> > > NUMBER_OF_FRAMES-eng: 83270
> > > NUMBER_OF_BYTES-eng: 4752112489
> > > _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper
> Escape')
> > > 64-bit
> > > _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46
> > > _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES
> NUMBER_OF_BYTES
> > > Stream #0:1(eng): Audio: dts (DTS-HD MA), 48000 Hz, 5.1(side), s16p
> > > Metadata:
> > > BPS-eng : 2022940
> > > DURATION-eng : 00:57:53.056000000
> > > NUMBER_OF_FRAMES-eng: 325599
> > > NUMBER_OF_BYTES-eng: 878223124
> > > _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper
> Escape')
> > > 64-bit
> > > _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46
> > > _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES
> NUMBER_OF_BYTES
> > > Stream #0:2(eng): Subtitle: hdmv_pgs_subtitle, 1920x1080
> > > Metadata:
> > > BPS-eng : 44076
> > > DURATION-eng : 00:56:53.660000000
> > > NUMBER_OF_FRAMES-eng: 1450
> > > NUMBER_OF_BYTES-eng: 18807980
> > > _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper
> Escape')
> > > 64-bit
> > > _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46
> > > _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES
> NUMBER_OF_BYTES
> > > Stream mapping:
> > > Stream #0:0 (h264) -> scale_npp (graph 0)
> > > Stream #0:2 (pgssub) -> format (graph 0)
> > > overlay_cuda (graph 0) -> Stream #0:0 (h264_nvenc)
> > > Stream #0:1 -> #0:1 (dts (dca) -> aac (libfdk_aac))
> > > [matroska,webm @ 0x3a39bc0] sub2video: using 1920x1080 canvas
> > > Output #0, matroska, to 'output.mkv':
> > > Metadata:
> > > encoder : Lavf58.56.100
> > > Chapter #0:0: start 0.000000, end 508.424583
> > > Metadata:
> > > title : Chapter 01
> > > Chapter #0:1: start 508.424583, end 1037.202833
> > > Metadata:
> > > title : Chapter 02
> > > Chapter #0:2: start 1037.202833, end 1510.175333
> > > Metadata:
> > > title : Chapter 03
> > > Chapter #0:3: start 1510.175333, end 2231.896333
> > > Metadata:
> > > title : Chapter 04
> > > Chapter #0:4: start 2231.896333, end 2908.530625
> > > Metadata:
> > > title : Chapter 05
> > > Chapter #0:5: start 2908.530625, end 3473.052917
> > > Metadata:
> > > title : Chapter 06
> > > Stream #0:0: Video: h264 (h264_nvenc) (High) (H264 / 0x34363248),
> > > cuda, 1280x720 [SAR 1:1 DAR 16:9], q=-1--1, 23.98 fps, 1k tbn, 23.98
> tbc
> > > (default)
> > > Metadata:
> > > encoder : Lavc58.106.100 h264_nvenc
> > > Side data:
> > > cpb: bitrate max/min/avg: 2000000/0/0 buffer size: 8000000
> > > vbv_delay: N/A
> > > Stream #0:1(eng): Audio: aac (libfdk_aac) ([255][0][0][0] /
> 0x00FF),
> > > 48000 Hz, stereo, s16, 128 kb/s
> > > Metadata:
> > > BPS-eng : 2022940
> > > DURATION-eng : 00:57:53.056000000
> > > NUMBER_OF_FRAMES-eng: 325599
> > > NUMBER_OF_BYTES-eng: 878223124
> > > _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper
> Escape')
> > > 64-bit
> > > _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46
> > > _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES
> NUMBER_OF_BYTES
> > > encoder : Lavc58.106.100 libfdk_aac
> > > *Error while add the frame to buffer source(Internal bug, should not
> have
> > > happened).*
> > > frame= 360 fps=241 q=11.0 Lsize= 3813kB time=00:00:15.01
> > > bitrate=2079.9kbits/s speed=10.1x
> > > video:3568kB audio:236kB subtitle:0kB other streams:0kB global
> > headers:0kB
> > > muxing overhead: 0.243563%
> > > ************************
> > >
> > >
> > > Infos:
> > > ******** lspci *******
> > > 0e:00.0 VGA compatible controller: NVIDIA Corporation TU102 [*GeForce
> RTX
> > > 2080 Ti Rev. A]* (rev a1) (prog-if 00 [VGA controller])
> > > Subsystem: ZOTAC International (MCO) Ltd. Device 1503
> > > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
> > > Stepping- SERR- FastB2B- DisINTx+
> > > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
> > > <MAbort- >SERR- <PERR- INTx-
> > > *Kernel driver in use: nvidia*
> > > Kernel modules: nouveau, nvidia_drm, nvidia
> > > **********************
> > >
> > > ******** nvidia-smi *******
> > >
> > >
> >
> +-----------------------------------------------------------------------------+
> > > | NVIDIA-SMI *450.66 Driver Version: 450.66 CUDA Version:
> > > 11.0* |
> > >
> > >
> >
> |-------------------------------+----------------------+----------------------+
> > > **********************
> > >
> > >
> > >
> > >
> > >
> >
> >
> Related, see: https://trac.ffmpeg.org/ticket/8831
>
> I ran into the same issue approximately seven weeks ago, as documented
> above.
> Even downgrading device drivers (from R450, R440 to below) did not resolve
> the issue.
> Another filter affected by the same issue is the overlay_opencl
> implementation, wherein the video canvas on overlay turns up black.
>
> Regards,
>
> Dennis.
> _______________________________________________
> ffmpeg-user mailing list
> ffmpeg-user at ffmpeg.org
> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".
More information about the ffmpeg-user
mailing list