Recently, local gradient microstructure of image textures has become an important field of texture classification, but it is generally to investigate the multiscale local microstructures of image gradient, and rarely consider the multidirectional and multiscale local microstructure of image gradient. The proposed algorithm first extracts the two-order gradient feature of the image from different orthogonal directions and further constructs the multiple shape index of the image, and then calculates the histogram feature vectors of the shape index on different orthogonal directions and scales, and finally connects all histogram feature vectors on different orthogonal directions and scales to obtain the final matching feature vector of the image. To further enhance the discriminant ability of feature vector generated by multidirectional shape index schemes, the weight of each block of images is also considered. Experiments on two texture databases and one palmprint database have fully confirmed the effective of proposed algorithm.