For the problem that the limited star map field angle cannot obtain the complete star map accurately, the paper study astral intrinsic and imaging features, a star map stitching algorithm based on the principle of visual perception is proposed firstly. The matching models of time and space dimensions is constructed by simulating the visual perception, then the stars and the planets points are saved by searching the matching star group dynamically, the star map is stitched and reconstructed efficiently by creating the computer sparse storage model. The experimental results show that the algorithm can achieve data compression quickly, compression ratio is 99.54%, which can reduce complexity of manual processing and can achieve star map stitching accurately.