Contents Science Lab

News

November 10, 2020: Our work on Imageability estimation using visual and language features by C. Matsuhira et al. got presented at ICMR2020.

October 16, 2020: Our work on sentence imageability-aware image captioning by K. Umemura et al. got accepted by MMM2021.

April 1, 2020: Contents Science Lab was established.

Recent projects

Book page colorization based on perception

In this research, we colorize pages of books according to human perception in order to summarize and compare book contents.

Image captioning considering imageability

In this research, we incorporate psycholinguistics into image captioning in order to tailor captions to different applications.

Imageability estimation

In this research, we model the human perception of the semantic gap for use in affective computing.

Mimetic words

In this research, we analyze the phonetic characteristics and human perception of mimetic words used in Japanese to describe human gait.

Go to all projects >

Recent publications

Image-Generative Quantification of Referential Phonaesthesia. 松平茅隼. 博士論文, February 2025.

形容詞の視覚的な多様性の定量化. 田中優衣. 卒業論文, February 2025.

Multi-proposal collaboration and multi-task training for weakly-supervised video moment retrieval. Bolin Zhang, Chao Yang, Bin Jiang, Takahiro Komamizu, Ichiro Ide. International Journal of Machine Learning and Cybernetics, January 2025.

Quantifying Image-Adjective Associations by Leveraging Large-Scale Pretrained Models. Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Ichiro Ide. Lecture Notes in Computer Science, Vol.15523, pp.428-441, January 2025.

Towards Visual Storytelling by Understanding Narrative Context through Scene-Graphs. PHUEAKSRI Itthisak, Marc A. Kastner, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide. International Conference on Multimedia Modeling (MMM), 15523 (4), pp.226-239, January 2025.

MultiMedia Modeling -31st Int. Conf. on Multimedia Modeling, MMM 2025, Nara, Japan, Jan. 8-10, 2025, Procs., Part II-. Ichiro Ide, Ioannis Kompatsiaris, Changsheng Xu, Keiji Yanai, Wei-Ta Chu, Naoko Nitta, Michael Riegler, Toshihiko Yamasaki. Lecture Notes in Computer Science, Vol.15521, January 2025.

MultiMedia Modeling -31st Int. Conf. on Multimedia Modeling, MMM 2025, Nara, Japan, Jan. 8-10, 2025, Procs., Part III-. 井手一郎, Ioannis Kompatsiaris, Changsheng Xu, 柳井啓司, Wei-Ta Chu, 新田直子, Michael Riegler, Toshihiko Yamasaki. Lecture Notes in Computer Science, Vol.15522, January 2025.

MultiMedia Modeling -31st Int. Conf. on Multimedia Modeling, MMM 2025, Nara, Japan, Jan. 8-10, 2025, Procs., Part V-. Ichiro Ide, Ioannis Kompatsiaris, Changsheng Xu, Keiji Yanai, Wei-Ta Chu, Naoko Nitta, Michael Riegler, Toshihiko Yamasaki. Lecture Notes in Computer Science, Vol.15524, January 2025.

MultiMedia Modeling -31st Int. Conf. on Multimedia Modeling, MMM 2025, Nara, Japan, Jan. 8-10, 2025, Procs., Parts I-. Ichiro Ide, Ioannis Kompatsiaris, Changsheng Xu, Keiji Yanai, Wei-Ta Chu, Naoko Nitta, Michael Riegler, Toshihiko Yamasaki. Lecture Notes in Computer Science, Vol.15520, January 2025.

MultiMedia Modeling -31st Int. Conf. on Multimedia Modeling, MMM 2025, Nara, Japan, Jan. 8-10, 2025, Procs., Parts IV-. Ichiro Ide, Ioannis Kompatsiaris, Changsheng Xu, Keiji Yanai, Wei-Ta Chu, Naoko Nitta, Michael Riegler, Toshihiko Yamasaki. Lecture Notes in Computer Science, Vol.15523, January 2025.

Go to all publications >