[FFmpeg-devel] [PATCH] fate/aacenc: increase tolerance for ln-128k test

[Lynne]

The encoder is sensitive to changes in precision, and its test target
was a compromise. It was already close to failing on x87 FPUs.
ff_mdct_init used double precision entirely from the scale to computing
the MDCT exp tables. av_tx_init uses single-precision for the scale,
with a small input change which was enough to tip the test into failing on
x87 FPUs.

Increase the fuzz factor in line with other AAC encoder tests to fix.

Patch attached.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: 0001-fate-aacenc-increase-tolerance-for-ln-128k-test.patch
Type: text/x-diff
Size: 1458 bytes
Desc: not available
URL: <https://ffmpeg.org/pipermail/ffmpeg-devel/attachments/20221117/627e0c16/attachment.patch>