We make full use of the pre-known knowledge of environment, and establish a hierarchical semantic map offline for large-scale outdoor environment. The map contains semantic information which is more stable than the commonly used feature points. And the description and recognition methods of locations based on semantic information are similar to human habits. Experiment results show that the all parts of the map working together can achieve path planning, location recognition and relative pose estimation to complete the robot navigation task.