An Objective Measurement Method for Credibility of Effectiveness Evaluation

作者：Wang, Jun; Li, Jianxun; Wang, Xing; Qi, Zongfeng

来源：Journal of Xi'an Jiaotong University, 2018, 52(2): 37-44.

DOI：10.7652/xjtuxb201802006

• Calculation accuracy
• Classification algorithm
• Classification confidence
• Concrete applications
• Credibility analysis
• Effectiveness evaluation
• Equipment effectiveness
• Objective measurement

An objective measurement method for the credibility of evaluation from three aspects: evaluation data, evaluation model and single sample confidence is proposed to solve the problem that effectiveness evaluation credibility cannot be objectively measured for equipment systems. The credibility of evaluation data is determined by analyzing the uncertainty of the evaluation data;and the model classification accuracy is transformed into a credibility index of the evaluation model. A method to calculate the classification confidence is proposed based on the distribution of the different types of samples in a space with high dimension and the method is applicable to most classification algorithms. These aspects are then integrated through a credibility propagation model to get a comprehensive credibility. Finally, the concrete application of the method is discussed in detail by taking the credibility calculation of effectiveness evaluation of a radar anti-jamming efficiency as an example. It is found from the analysis of the application that the method can objectively measure the credibility of effectiveness evaluation without the needs of the knowledge of experts, the results are not affected by evaluation subjects, and the problem that different evaluation experts give different credibility for the same equipment effectiveness evaluation is solved. The calculation accuracy of the proposed method is 10% higher than that of an existing subjective method.

• 出版日期2018
• 单位上海交通大学