引用clickok · 2016-09
“Lin & Tegmark offer details in the paper, but it comes from the fact that the singular values of the transition matrix are all less than or equal to one”
引用它解释马尔可夫链记忆衰减,源于转移矩阵奇异值不超过 1
证明互信息在正则文法中指数衰减,在上下文无关文法中可幂律衰减
证明两个符号之间的互信息随间隔符号数的变化,在任何概率正则文法中呈指数衰减,而在上下文无关文法中可以按幂律衰减。这一形式语言结论与经典统计力学中“低于二维无相变”的结果密切相关,也与湍流和宇宙暴胀中通过递归生成过程出现幂律关联有联系,作者还讨论其对训练循环神经网络等机器学习任务的潜在应用,并引入“有理互信息”这一量。
讨论 Tegmark 关于物理与深度学习的讲座时,评论者引用它来解释马尔可夫链的记忆为何衰减,以及讲座所依据的论文。
“Lin & Tegmark offer details in the paper, but it comes from the fact that the singular values of the transition matrix are all less than or equal to one”
“He comments on the video linking to two papers on arXiv which relate to the material in the lecture: [OTHER_PAPER] and Criticality in Formal Languages and Statistical Physics”