[FFmpeg-devel] [PATCH]Avoid overflows when reading pgm with maxval != 255 and 65535

[Carl Eugen Hoyos]

Carl Eugen Hoyos <cehoyos <at> ag.or.at> writes:

> +++ b/libavcodec/pnm.h
>  <at>  <at>  -30,6 +30,7  <at>  <at>  typedef struct PNMContext {
>      uint8_t *bytestream_end;
>      AVFrame picture;
>      int maxval;                 ///< maximum value of a pixel
> +    int maskval;

maskval removed from context, "unsigned int maskval = 0" added 
and all occurrences of s->maskval replaced by maskval locally.

Carl Eugen