I also wonder about this. I think that multithreaded increases the encoding speed, but the decoding speed remains the same, making a bottleneck. Maybe if you used the ffmpeg-mt decoder with multiple threads it would increase speed?