[FFmpeg-cvslog] avcodec/vp3: Add missing check for av_malloc

[Jiasheng Jiang]

ffmpeg | branch: release/4.3 | Jiasheng Jiang <jiasheng at iscas.ac.cn> | Tue Feb 15 17:58:08 2022 +0800| [7694a44baaaa4786995590a8ba2b16acd8ef8177] | committer: James Almer

avcodec/vp3: Add missing check for av_malloc

Since the av_malloc() may fail and return NULL pointer,
it is needed that the 's->edge_emu_buffer' should be checked
whether the new allocation is success.

Fixes: d14723861b ("VP3: fix decoding of videos with stride > 2048")
Reviewed-by: Peter Ross <pross at xvid.org>
Signed-off-by: Jiasheng Jiang <jiasheng at iscas.ac.cn>

> http://git.videolan.org/gitweb.cgi/ffmpeg.git/?a=commit;h=7694a44baaaa4786995590a8ba2b16acd8ef8177
---

 libavcodec/vp3.c | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)

diff --git a/libavcodec/vp3.c b/libavcodec/vp3.c
index 49d4911fb3..65907e8d04 100644
--- a/libavcodec/vp3.c
+++ b/libavcodec/vp3.c
@@ -2733,8 +2733,13 @@ static int vp3_decode_frame(AVCodecContext *avctx,
     if ((ret = ff_thread_get_buffer(avctx, &s->current_frame, AV_GET_BUFFER_FLAG_REF)) < 0)
         goto error;
 
-    if (!s->edge_emu_buffer)
+    if (!s->edge_emu_buffer) {
         s->edge_emu_buffer = av_malloc(9 * FFABS(s->current_frame.f->linesize[0]));
+        if (!s->edge_emu_buffer) {
+            ret = AVERROR(ENOMEM);
+            goto error;
+        }
+    }
 
     if (s->keyframe) {
         if (!s->theora) {