Cogeneration of Innovative Audio-visual Content: A New Challenge for Computing Art

doi:10.1007/s11633-023-1453-5

CORC > 自动化研究所 > 中国科学院自动化研究所 > 学术期刊 > International Journal of Automation and Computing

	Cogeneration of Innovative Audio-visual Content: A New Challenge for Computing Art
	Mengting Liu 1
刊名	Machine Intelligence Research
	2024
卷号	21 期号:1 页码:4-28
关键词	Artificial intelligence (AI) art, audio-visual, artificial intelligence generated content (AIGC), multimodal, artistic evaluation
ISSN号	2731-538X
DOI	10.1007/s11633-023-1453-5
英文摘要	In recent years, computing art has developed rapidly with the in-depth cross study of artificial intelligence generated content (AIGC) and the main features of artworks. Audio-visual content generation has gradually been applied to various practical tasks, including video or game score, assisting artists in creation, art education and other aspects, which demonstrates a broad application prospect. In this paper, we introduce innovative achievements in audio-visual content generation from the perspective of visual art generation and auditory art generation based on artificial intelligence (AI). We outline the development tendency of image and music datasets, visual and auditory content modelling, and related automatic generation systems. The objective and subjective evaluation of generated samples plays an important role in the measurement of algorithm performance. We provide a cogeneration mechanism of audio-visual content in multimodal tasks from image to music and display the construction of specific stylized datasets. There are still many new opportunities and challenges in the field of audio-visual synesthesia generation, and we provide a comprehensive discussion on them.
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/54572]
专题	自动化研究所_学术期刊_International Journal of Automation and Computing
作者单位	1.Advanced Institute of Information Technology, Peking University, Hangzhou 311215, China 2.School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University, Shenzhen 518000, China 3.Peng Cheng Laboratory, Shenzhen 518000, China 4.School of Arts, Peking University, Beijing 100871, China
推荐引用方式 GB/T 7714	Mengting Liu. Cogeneration of Innovative Audio-visual Content: A New Challenge for Computing Art[J]. Machine Intelligence Research,2024,21(1):4-28.
APA	Mengting Liu.(2024).Cogeneration of Innovative Audio-visual Content: A New Challenge for Computing Art.Machine Intelligence Research,21(1),4-28.
MLA	Mengting Liu."Cogeneration of Innovative Audio-visual Content: A New Challenge for Computing Art".Machine Intelligence Research 21.1(2024):4-28.