Application of an emotional classification model in e-commerce text based on an improved transformer model

doi:10.1371/journal.pone.0247984

CORC > 兰州理工大学 > 兰州理工大学

	Application of an emotional classification model in e-commerce text based on an improved transformer model
	Wang, Xuyang; Tong, Yixuan
刊名	PLOS ONE
	2021
卷号	16 期号:3
ISSN号	1932-6203
DOI	10.1371/journal.pone.0247984
英文摘要	With the rapid development of the mobile internet, people are becoming more dependent on the internet to express their comments on products or stores; meanwhile, text sentiment classification of these comments has become a research hotspot. In existing methods, it is fairly popular to apply a deep learning method to the text classification task. Aiming at solving information loss, weak context and other problems, this paper makes an improvement based on the transformer model to reduce the difficulty of model training and training time cost and achieve higher overall model recall and accuracy in text sentiment classification. The transformer model replaces the traditional convolutional neural network (CNN) and the recurrent neural network (RNN) and is fully based on the attention mechanism; therefore, the transformer model effectively improves the training speed and reduces training difficulty. This paper selects e-commerce reviews as research objects and applies deep learning theory. First, the text is preprocessed by word vectorization. Then the IN standardized method and the GELUs activation function are applied based on the original model to analyze the emotional tendencies of online users towards stores or products. The experimental results show that our method improves by 9.71%, 6.05%, 5.58% and 5.12% in terms of recall and approaches the peak level of the F1 value in the test model by comparing BiLSTM, Naive Bayesian Model, the serial BiLSTM_CNN model and BiLSTM with an attention mechanism model. Therefore, this finding proves that our method can be used to improve the text sentiment classification accuracy and effectively apply the method to text classification.
WOS研究方向	Science & Technology - Other Topics
语种	英语
出版者	PUBLIC LIBRARY SCIENCE
WOS记录号	WOS:000626604300008
内容类型	期刊论文
源URL	[http://ir.lut.edu.cn/handle/2XXMBERH/147424]
专题	兰州理工大学
作者单位	Lanzhou Univ Technol, Sch Comp & Commun, Lanzhou, Gansu, Peoples R China
推荐引用方式 GB/T 7714	Wang, Xuyang,Tong, Yixuan. Application of an emotional classification model in e-commerce text based on an improved transformer model[J]. PLOS ONE,2021,16(3).
APA	Wang, Xuyang,&Tong, Yixuan.(2021).Application of an emotional classification model in e-commerce text based on an improved transformer model.PLOS ONE,16(3).
MLA	Wang, Xuyang,et al."Application of an emotional classification model in e-commerce text based on an improved transformer model".PLOS ONE 16.3(2021).