Among many types of efforts to improve the accuracy of remote sensing image classification, using spatial information is an effective strategy. The classification method integrates spatial information into spectral information, which is called the spectral-spatial classification approach, has better performance than traditional classification methods. Construct spectral-spatial distance used for classification is a common method to combine the spatial and spectral information. In order to improve the performance of spectral-spatial classification based on spectral-spatial distance, we introduce the information content (IC) in which two pixels are shared to measure spatial relation between them and propose a novel spectral-spatial distance measure method. The IC of two pixels shared was computed from the hierarchical tree constructed by the statistical region merging (SRM) segmentation. The distance we proposed was applied in two distance-based contextual classifiers, the k-nearest neighbors-statistical region merging (k-NN-SRM) and optimum-path forest-statistical region merging (OPF-SRM), to obtain two new contextual classifiers, the k-NN-SRM-IC and OPF-SRM-IC. The classifiers with the novel distance were implemented in four land cover images. The classification results of the classifier based on our spectral-spatial distance outperformed all the other competitive contextual classifiers, which demonstrated the validity of the proposed distance measure method.