[FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models

[Guo, Yejun]

> -----Original Message-----
> From: ffmpeg-devel <ffmpeg-devel-bounces at ffmpeg.org> On Behalf Of
> Maximilian Kaindl
> Sent: Tuesday, February 18, 2025 12:29 AM
> To: FFmpeg development discussions and patches <ffmpeg-
> devel at ffmpeg.org>
> Subject: Re: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image
> classification using CLIP models
> 
> Hello Yejun Guo,
> 
> yes i can do that and submit it in another patch. Do you also have some
> feedback for the clip backend? I have already made some small changes (cuda
> accel and new preprocessing) that i will submit along with the other patch, but
> i would like to hear your thoughts.
> 
Could you share why we need a new backend?

> Thanks
> 
> ________________________________
> From: ffmpeg-devel <ffmpeg-devel-bounces at ffmpeg.org> on behalf of Guo,
> Yejun <yejun.guo-at-intel.com at ffmpeg.org>
> Sent: Sunday, February 16, 2025 7:09 AM
> To: FFmpeg development discussions and patches <ffmpeg-
> devel at ffmpeg.org>
> Subject: Re: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image
> classification using CLIP models
> 
> 
> 
> > -----Original Message-----
> > From: ffmpeg-devel <ffmpeg-devel-bounces at ffmpeg.org> On Behalf Of
> > m.kaindl0208 at gmail.com
> > Sent: Thursday, January 30, 2025 4:33 AM
> > To: ffmpeg-devel at ffmpeg.org
> > Subject: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image
> > classification using CLIP models
> >
> > Add a new filter 'dnn_clip' that performs zero-shot image
> > classification using CLIP (Contrastive Language-Image Pre-Training) models.
> The filter supports:
> 
> For image classification with new dnn models, we'd better add the new model
> support with dnn_classify at https://ffmpeg.org/ffmpeg-
> filters.html#dnn_005fclassify
> 
> 
> _______________________________________________
> ffmpeg-devel mailing list
> ffmpeg-devel at ffmpeg.org
> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
> 
> To unsubscribe, visit link above, or email ffmpeg-devel-request at ffmpeg.org
> with subject "unsubscribe".
> _______________________________________________
> ffmpeg-devel mailing list
> ffmpeg-devel at ffmpeg.org
> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
> 
> To unsubscribe, visit link above, or email ffmpeg-devel-request at ffmpeg.org
> with subject "unsubscribe".