Scratches are one of the most common defects in industrial manufacturing. Weak scratches in the industrial environment have an ambiguous edge, low contrast, large span, and unfixed shape, which brings difficulty for automatic defect detection. Recently, many existing visual inspection methods based on deep learning cannot completely and effectively inspect industrial weak scratches due to the lack of discriminative features and sufficient spatial detail. In this paper, a novel DeepScratchNet is proposed for automatic weak scratch detection by aggregating rich multi-dimensional feature for scratch representation. To obtain rich features, a pre-trained ResNet block as a feature extractor is proposed in this paper. In order to highlight features of scratch and weaken the noise, an attention feature fusion block (AFB) is proposed, which densely fuses high-level semantic features with low-level details features using dual-attention mechanism. Due to the long span and connectivity of the weak scratches, a context fusion block (CFB) is proposedto learn the complete context.To further improve the scratch segmentation performance, the auxiliary loss is integrated into the proposed network. The proposed DeepScratchNet outperforms traditional and other state-of-the-art deep learning-based methods on three given real-world industrial datasets with mIoU over 0.8005, 0.812 and 0.9286. The experimental results demonstrate that DeepScratchNetachievesgoodgeneralizationcapabilities