[MPlayer-users] [BUGREPORT] mencoder segfaults on encoding DVD

[vitko]

Well, I must say I'm rather confused now. I've configured mplayer using

    ./configure --enable-debug=3

and it compiled cleanly. That's the end of good news, as debug enabled
mplayer doesn't segfault at all. There is just nothing to debug when
debug is enabled!

I'm sending extended gdb (bt+registers) output of 'normal' segfaulting
mplayer instead.

I'm experiencing my problems on Centrino (1.4 GHz Banias), Ubuntu Breezy,
kernel is 2.6.12-something.

Thanks for any input, I'd be more than glad to provide additional details
as needed.

Vit


--- gdb says: ---

(gdb) run -v dvd://1 -dvd-device ./ -oac copy -ovc lavc -lavcopts 
vcodec=mpeg4:vbitrate=1400:v4mv:mbd=2:subcmp=3:mbcmp=3:autoaspect:vlelim=-4:vcelim=9:lumi_mask=0.05:dark_mask=0.01:vpass=1 
-o /dev/null
Starting program: /usr/local/bin/mencoder -v dvd://1 -dvd-device ./ -oac copy 
-ovc lavc -lavcopts 
vcodec=mpeg4:vbitrate=1400:v4mv:mbd=2:subcmp=3:mbcmp=3:autoaspect:vlelim=-4:vcelim=9:lumi_mask=0.05:dark_mask=0.01:vpass=1 
-o /dev/null
(no debugging symbols found)

...

(no debugging symbols found)
MEncoder dev-CVS-060110-14:12-4.0.2 (C) 2000-2006 MPlayer Team
CPU: Intel Pentium M Banias (Family: 6, Stepping: 5)
CPUflags: Type: 6 MMX: 1 MMX2: 1 3DNow: 0 3DNow2: 0 SSE: 1 SSE2: 1
Compiled for x86 CPU with extensions: MMX MMX2 SSE SSE2

...

*** [lavc] Allocating mp_image_t, 720x576x12bpp YUV planar, 622080 bytes
*** [expand] Direct Rendering mp_image_t, 720x576x12bpp YUV planar, 622080 bytes
*** [lavc] Allocating mp_image_t, 720x576x12bpp YUV planar, 622080 bytesms 4/35 
D/B/S 0/1/0
*** [expand] Direct Rendering mp_image_t, 720x576x12bpp YUV planar, 622080 bytes
Muxer frame buffer sending 2 frame(s) to muxer. 0mb  A-V:0.004 [0:0] A/Vms 4/31 
D/B/S 0/2/0
Writing header...
ODML: vprp aspect is 4:3.
Writing header...
ODML: vprp aspect is 4:3.

1 duplicate frame(s)!
*** [lavc] Allocating mp_image_t, 720x576x12bpp YUV planar, 622080 bytesms 4/36 
D/B/S 1/2/0
*** [expand] Direct Rendering mp_image_t, 720x576x12bpp YUV planar, 622080 bytes

Program received signal SIGSEGV, Segmentation fault.
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) bt
#0  0x08459f39 in ff_fdct_sse2 ()
#1  0x001dfff5 in ?? ()
#2  0xffbd0001 in ?? ()
#3  0x00250007 in ?? ()
#4  0xffd7001f in ?? ()
#5  0x0005ffd9 in ?? ()
#6  0xffd3ffe9 in ?? ()
#7  0xffe1fff5 in ?? ()
#8  0x002fffd7 in ?? ()
#9  0xffcdfff5 in ?? ()
#10 0xffedfff3 in ?? ()
#11 0xffcbffe3 in ?? ()
#12 0xffcfffda in ?? ()
#13 0xfff0ffd0 in ?? ()
#14 0xffe0ffe0 in ?? ()
#15 0xfff8ffe0 in ?? ()
#16 0xffe8fff8 in ?? ()
#17 0xffe6fffd in ?? ()
#18 0xfff8ffeb in ?? ()
#19 0xffdcfff5 in ?? ()
#20 0xfff0ffd3 in ?? ()
#21 0x000b0003 in ?? ()
#22 0x00130009 in ?? ()
#23 0x00070005 in ?? ()
#24 0x0001000b in ?? ()
#25 0x000c0012 in ?? ()
#26 0x00070008 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) disass $pc-32 $pc+32
Dump of assembler code from 0x8459f19 to 0x8459f59:
0x08459f19 <ff_fdct_sse2+729>:  cmc
0x08459f1a <ff_fdct_sse2+730>:  int3
0x08459f1b <ff_fdct_sse2+731>:  paddd  %xmm7,%xmm3
0x08459f1f <ff_fdct_sse2+735>:  paddd  %xmm2,%xmm1
0x08459f23 <ff_fdct_sse2+739>:  paddd  %xmm6,%xmm3
0x08459f27 <ff_fdct_sse2+743>:  paddd  %xmm6,%xmm1
0x08459f2b <ff_fdct_sse2+747>:  psrad  $0x11,%xmm3
0x08459f30 <ff_fdct_sse2+752>:  psrad  $0x11,%xmm1
0x08459f35 <ff_fdct_sse2+757>:  packssdw %xmm3,%xmm1
0x08459f39 <ff_fdct_sse2+761>:  movdqa %xmm1,0x0(%ecx)
0x08459f3e <ff_fdct_sse2+766>:  movq   0x40(%esp),%xmm2
0x08459f44 <ff_fdct_sse2+772>:  movq   0x48(%esp),%xmm0
0x08459f4a <ff_fdct_sse2+778>:  movdqa 0x20(%edx),%xmm3
0x08459f4f <ff_fdct_sse2+783>:  movdqa 0x30(%edx),%xmm7
0x08459f54 <ff_fdct_sse2+788>:  movq   %xmm2,%xmm1
0x08459f58 <ff_fdct_sse2+792>:  pshuflw $0x1b,%xmm0,%xmm0
End of assembler dump.
(gdb) info all-registers
eax            0x85f8720        140478240
ecx            0xbfb23648       -1078839736
edx            0x85f8520        140477728
ebx            0xbfb236a0       -1078839648
esp            0xbfb23598       0xbfb23598
ebp            0x86e95e0        0x86e95e0
esi            0xbfb236c0       -1078839616
edi            0xbfb23650       -1078839728
eip            0x8459f39        0x8459f39
eflags         0x210282 2163330
cs             0x73     115
ss             0x7b     123
ds             0x7b     123
es             0x7b     123
fs             0x0      0
gs             0x33     51
st0            -nan(0xffd7001f00250007) (raw 0xffffffd7001f00250007)
st1            -nan(0xfff4fffd0000fffa) (raw 0xfffffff4fffd0000fffa)
st2            -nan(0x10027002d0011)    (raw 0xffff00010027002d0011)
st3            -nan(0x4000900070007)    (raw 0xffff0004000900070007)
st4            -nan(0xcfff300000006)    (raw 0xffff000cfff300000006)
st5            -nan(0xfff0ffd3ffdcfff5) (raw 0xfffffff0ffd3ffdcfff5)
st6            -nan(0x8fff700000004)    (raw 0xffff0008fff700000004)
st7            -nan(0xffcfffdaffcbffe3) (raw 0xffffffcfffdaffcbffe3)
fctrl          0x37f    895
fstat          0x4020   16416
ftag           0xaaaa   43690
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb)
...