Conference paper
WEmbSim: A simple yet effective metric for image captioning
2020 Digital Image Computing: Techniques and Applications (DICTA)
2020 Digital Image Computing: Techniques and Applications (DICTA) (Melbourne, Australia, 29/11/2020–02/12/2020)
2020
Abstract
The area of automatic image caption evaluation is still undergoing intensive research to address the needs of generating captions which can meet adequacy and fluency requirements. Based on our past attempts at developing highly sophisticated learning-based metrics, we have discovered that a simple cosine similarity measure using the Mean of Word Embeddings (MOWE) of captions can actually achieve a surprisingly high performance on unsupervised caption evaluation. This inspires our proposed work on an effective metric WEmbSim, which beats complex measures such as SPICE, CIDEr and WMD at system-level correlation with human judgments. Moreover, it also achieves the best accuracy at matching human consensus scores for caption pairs, against commonly used unsupervised methods. Therefore, we believe that WEmbSim sets a new baseline for any complex metric to be justified.
Details
- Title
- WEmbSim: A simple yet effective metric for image captioning
- Authors/Creators
- N. Sharif (Author/Creator)L. White (Author/Creator)M. Bennamoun (Author/Creator)W. Liu (Author/Creator)S.A.A. Shah (Author/Creator)
- Publication Details
- 2020 Digital Image Computing: Techniques and Applications (DICTA)
- Conference
- 2020 Digital Image Computing: Techniques and Applications (DICTA) (Melbourne, Australia, 29/11/2020–02/12/2020)
- Identifiers
- 991005544672607891
- Murdoch Affiliation
- School of Information Technology
- Language
- English
- Resource Type
- Conference paper
Metrics
90 Record Views