A self-attention-based neural network for three-dimensional multivariate modeling and its skillful ENSO predictions

doi:10.1126/sciadv.adf2827

CORC > 海洋研究所 > 中国科学院海洋研究所 > 海洋环流与波动重点实验室

	A self-attention-based neural network for three-dimensional multivariate modeling and its skillful ENSO predictions
	Zhou, Lu 2,3,4; Zhang, Rong-Hua 1,5
刊名	SCIENCE ADVANCES
	2023-03-10
卷号	9 期号:10 页码:1
ISSN号	2375-2548
DOI	10.1126/sciadv.adf2827
通讯作者	Zhang, Rong-Hua(rzhang@nuist.edu.cn)
英文摘要	Large biases and uncertainties remain in real-time predictions of El Nino-Southern Oscillation (ENSO) using process-based dynamical models; recent advances in data-driven deep learning algorithms provide a promising mean to achieve superior skill in the tropical Pacific sea surface temperature (SST) modeling. Here, a specific selfattention-based neural network model is developed for ENSO predictions based on the much sought-after Transformer model, named 3D-Geoformer, which is used to predict three-dimensional (3D) upper-ocean temperature anomalies and wind stress anomalies. This purely data-driven and time-space attention-enhanced model achieves surprisingly high correlation skills for Nino 3.4 SST anomaly predictions made 18 months in advance and initiated beginning in boreal spring. Further, sensitivity experiments demonstrate that the 3DGeoformer model can depict the evolution of upper-ocean temperature and the coupled ocean-atmosphere dynamics following the Bjerknes feedback mechanism during ENSO cycles. Such successful realizations of the self-attention-based model in ENSO predictions indicate its great potential for multidimensional spatiotemporal modeling in geoscience.
资助项目	National Natural Science Foundation of China[42030410] ; National Natural Science Foundation of China[LSL202202402] ; Strategic Priority Research Program of the Chinese Academy of Sciences[XDB40000000] ; Startup Foundation for Introducing Talent of NUIST
WOS关键词	2015-2016 EL-NINO ; MULTIMODEL ENSEMBLE ; TELECONNECTIONS ; PREDICTABILITY ; VARIABILITY ; FORECASTS ; EVOLUTION ; PROGRESS
WOS研究方向	Science & Technology - Other Topics
语种	英语
出版者	AMER ASSOC ADVANCEMENT SCIENCE
WOS记录号	WOS:000960951400021
内容类型	期刊论文
源URL	[http://ir.qdio.ac.cn/handle/337002/182735]
专题	海洋研究所_海洋环流与波动重点实验室
通讯作者	Zhang, Rong-Hua
作者单位	1.Nanjing Univ Informat Sci & Technol, Sch Marine Sci, Nanjing 210044, Peoples R China 2.Univ Chinese Acad Sci, Beijing 10029, Peoples R China 3.Chinese Acad Sci, Inst Oceanol, Key Lab Ocean Circulat & Waves, Qingdao 266071, Peoples R China 4.Chinese Acad Sci, Ctr Ocean Mega Sci, Qingdao 266071, Peoples R China 5.Laoshan Lab, Qingdao 266237, Peoples R China
推荐引用方式 GB/T 7714	Zhou, Lu,Zhang, Rong-Hua. A self-attention-based neural network for three-dimensional multivariate modeling and its skillful ENSO predictions[J]. SCIENCE ADVANCES,2023,9(10):1.
APA	Zhou, Lu,&Zhang, Rong-Hua.(2023).A self-attention-based neural network for three-dimensional multivariate modeling and its skillful ENSO predictions.SCIENCE ADVANCES,9(10),1.
MLA	Zhou, Lu,et al."A self-attention-based neural network for three-dimensional multivariate modeling and its skillful ENSO predictions".SCIENCE ADVANCES 9.10(2023):1.