[FFmpeg-devel] [V2 1/2] lavc/vaapi_encode: fix the caculation	overflow
    Pengfei Qu 
    Pengfei.Qu at intel.com
       
    Mon Mar 26 08:51:17 EEST 2018
    
    
  
this fix the overflow during the caculation before value assignment.
Signed-off-by: Pengfei Qu <Pengfei.Qu at intel.com>
---
 libavcodec/vaapi_encode.c | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/libavcodec/vaapi_encode.c b/libavcodec/vaapi_encode.c
index 36c85a3..78347d4 100644
--- a/libavcodec/vaapi_encode.c
+++ b/libavcodec/vaapi_encode.c
@@ -1168,9 +1168,9 @@ static av_cold int vaapi_encode_init_rate_control(AVCodecContext *avctx)
             rc_target_percentage = 100;
         } else {
             rc_bits_per_second   = avctx->rc_max_rate;
-            rc_target_percentage = (avctx->bit_rate * 100) / rc_bits_per_second;
+            rc_target_percentage = (unsigned long)(avctx->bit_rate * 100) / rc_bits_per_second;
         }
-        rc_window_size = (hrd_buffer_size * 1000) / avctx->bit_rate;
+        rc_window_size = (unsigned long)(hrd_buffer_size * 1000) / avctx->bit_rate;
     }
 
     ctx->rc_params.misc.type = VAEncMiscParameterTypeRateControl;
-- 
2.9.3
    
    
More information about the ffmpeg-devel
mailing list