Word frequencies: A comparison of Pareto type distributions

作者：Wiegand Martin; Nadarajah Saralees^*; Si Yuancheng

来源：Physics Letters, Section A: General, Atomic and Solid State Physics , 2018, 382(9): 621-632.

DOI：10.1016/j.physleta.2017.12.056

• Kolmogorov-Smirnov test statistic
• Squared error
• Zipf's law

Mehri and Jamaati (2017) [18] used Zipf's law to model word frequencies in Holy Bible translations for one hundred live languages. We compare the fit of Zipf's law to a number of Pareto type distributions. The latter distributions are shown to provide the best fit, as judged by a number of comparative plots and error measures. The fit of Zipf's law appears generally poor.

• 出版日期2018-3-9