Action recognition is an important topic in computer vision and most current work focuses on view-dependent representations. In this paper, we develop a novel free viewpoint action recognition based on Self-similarity matrix (SSM), which tends to be