Advanced mean-field theory of the restricted Boltzmann machine

作者:Huang Haiping*; Toyoizumi Taro
来源:Physical Review E, 2015, 91(5): 050101.
DOI:10.1103/PhysRevE.91.050101

摘要

Learning in restricted Boltzmann machine is typically hard due to the computation of gradients of log-likelihood function. To describe the network state statistics of the restricted Boltzmann machine, we develop an advanced mean-field theory based on the Bethe approximation. Our theory provides an efficient message-passing-based method that evaluates not only the partition free energy) but also its gradients without requiring statistical sampling. The results are compared with those obtained by the computationally expensive sampling-based method.

  • 出版日期2015-5-18
  • 单位RIKEN