In this paper, RankNet, LambdaRank, LambdaMART and the XGBoost are studied and analyzed. The idea of improving the LambdaMART is proposed, that is,adding the regulation to the loss function of LambdaMART. Two commonly regulations L1 and L2 are added