This paper improves the concept of simulation execution validity and a methodology to assess the complex simulation system. As the complexity of the simulation system gradually rises, the magnitude of the simulation data obtained continues to increase, which makes it extremely difficult for experts to provide expert knowledge to evaluate the execution validity of the simulation system. More precisely, the essence of execution validity is to dig out the hidden relationships in the simulation time series data and complete the classification task whether it is valid. Considering that machine learning can better complete the two tasks of mining data features and classification, this paper adopts long short-term memory, a neural network used to process time series data, to evaluate the execution validity. Finally, an experiment is conducted on a simulation system, and the results show that the evaluation method based on LSTM can accurately evaluate the validity of the simulation system, and can greatly improve the efficiency of evaluation.