A multilevel modelling approach to investigating the predictive validity of editorial decisions: do the editors of a high profile journal select manuscripts that are highly cited after publication?

作者：Bornmann Lutz^*; Mutz Ruediger; Marx Werner; Schier Hermann; Daniel Hans Dieter

来源：Journal of the Royal Statistical Society - Series A: Statistics in Society , 2011, 174: 857-879.

DOI：10.1111/j.1467-985X.2011.00689.x

• Chemistry
• Editorial decisions
• Multilevel modelling
• Peer review
• Predictive validity
• Reference standard

Scientific journals must deal with the following questions concerning the predictive validity of editorial decisions. Is the best scientific work selected from submitted manuscripts? Does selection of the best manuscripts also mean selecting papers that after publication show top citation performance within their fields? Taking the journal Angewandte Chemie International Edition as an example, this study proposes a new methodology for investigating whether manuscripts that are most worthy of publication are in fact selected validly. First, the influence on citation of the accepted and rejected but then published elsewhere manuscripts was appraised on the basis of percentile impact classes scaled in a subfield of chemistry and, second, the association between the decisions on selection and the influence on citation of the manuscripts was determined by using a multilevel logistic regression for ordinal categories. This approach has many advantages over methodologies that were used in previous research studies on the predictive validity of editorial selection decisions.

• 出版日期2011