2.845

2023影响因子

(CJCR)

  • 中文核心
  • EI
  • 中国科技核心
  • Scopus
  • CSCD
  • 英国科学文摘

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

间接互惠与合作演化的若干问题研究进展

张艳玲 刘爱志 孙长银

张艳玲, 刘爱志, 孙长银. 间接互惠与合作演化的若干问题研究进展. 自动化学报, 2018, 44(1): 1-12. doi: 10.16383/j.aas.2018.c170200
引用本文: 张艳玲, 刘爱志, 孙长银. 间接互惠与合作演化的若干问题研究进展. 自动化学报, 2018, 44(1): 1-12. doi: 10.16383/j.aas.2018.c170200
ZHANG Yan-Ling, LIU Ai-Zhi, SUN Chang-Yin. Development of Several Studies on Indirect Reciprocity and the Evolution of Cooperation. ACTA AUTOMATICA SINICA, 2018, 44(1): 1-12. doi: 10.16383/j.aas.2018.c170200
Citation: ZHANG Yan-Ling, LIU Ai-Zhi, SUN Chang-Yin. Development of Several Studies on Indirect Reciprocity and the Evolution of Cooperation. ACTA AUTOMATICA SINICA, 2018, 44(1): 1-12. doi: 10.16383/j.aas.2018.c170200

间接互惠与合作演化的若干问题研究进展

doi: 10.16383/j.aas.2018.c170200
基金项目: 

国家自然科学基金 61520106009

中央高校基础科研业务费 FRF-TP-15-116A1

国家自然科学基金 61603036

国家自然科学基金 61533008

中国博士后科学基金 2015M580989

详细信息
    作者简介:

    张艳玲北京科技大学自动化学院师资博士后.2014年获得北京大学一般力学与力学基础专业博士学位.主要研究方向为演化博弈动力学.E-mail:yanlzhang@ustb.edu.cn

    刘爱志北京科技大学博士研究生.2014年获得北京科技大学硕士学位.主要研究方向为复杂系统建模和演化博弈动力学.E-mail:ustb_laz@xs.ustb.edu.cn

    通讯作者:

    孙长银东南大学自动化学院教授.主要研究方向为人工智能, 神经网络, 智能控制理论与方法, 模式识别.本文通信作者.E-mail:cysun@seu.edu.cn

Development of Several Studies on Indirect Reciprocity and the Evolution of Cooperation

Funds: 

National Natural Science Foundation of China 61520106009

Fundamental Research Funds for the Central Universities FRF-TP-15-116A1

National Natural Science Foundation of China 61603036

National Natural Science Foundation of China 61533008

China Postdoctoral Science Foundation 2015M580989

More Information
    Author Bio:

    The teachers postdoctoral at the School of Automation and Electrical Engineering, University of Science and Technology Beijing. She received her Ph. D. degree from Peking University in 2014. Her research interest covers evolutionary game dynamics

    Ph. D. candidate at the School of Automation and Electrical Engineering, University of Science and Technology Beijing. He received his master degree from University of Science and Technology Beijing in 2014. His research interest covers complex system modeling and evolutionary game dynamics

    Corresponding author: SUN Chang-Yin Professor at the School of Automation, Southeast University. His research interest covers artiflcial intelligence, neural networks, theory and design of intelligent control systems, and pattern recognition. Corresponding author of this paper
  • 摘要: 2005年Science杂志指出"合作行为如何进化"是21世纪最关键的25个科学问题之一.间接互惠如何促进合作演化的研究已吸引了包括经济学家、社会学家和演化生物学家等众多学者的关注.这是由于:人类社会道德的形成、社会化分工、语言的出现、人类大脑的进化等都和间接互惠密不可分;随着经济全球化和网络时代的到来,依赖声望和信誉的陌生个体间的交易日益频繁,局部信息条件下个体的信任被利用的"道德风险"逐渐增大.本文所关注的间接互惠是以声望为核心的"下游互惠",具体而言,个体通过帮助他人建立自己在群体中的好声望,从而期待未来获得他人的帮助.可见,声望是"下游互惠"发挥作用的关键.声望的建立引发了两方面的研究:1)如何评价个体声望的好与坏,焦点是何种声望评估准则能够促进合作的演化;2)个体的声望如何在群体中快速、准确、广泛地传播,使得陌生个体间能够获得彼此的声望信息,其中八卦这种声望传播方式成为间接互惠的研究热点之一.基于声望的间接互惠研究前景广阔,未来可能的研究方向主要有复杂网络上的间接互惠、声望传播系统的鲁棒性、声望共享系统的建立和间接互惠在P2P网络中的应用.
  • 达尔文的进化论认为"物竞天择、适者生存", 说明竞争在进化中起核心的作用[1].依据这一理论, 在"弱肉强食"的生存斗争中, 适应性强的个体胜出, 适应性差的个体被淘汰.从而在激烈的生存斗争中, 每个个体均会从自身利益出发, 变得利己自私、唯利是图.然而, 从细菌群落到蜂群蚁群, 从狼群狮群围捕猎物到群居的大猩猩, 再到复杂而有序的人类社会, 合作行为无处不在[1-4].显然, 帮助对手会降低自身的适应度, 从而削弱自身的竞争优势, 合作的存在看似并不合理.面对广泛存在的合作行为, 达尔文本人也深感困惑, 在其著作中相应的解释只是一笔带过[5].

    合作行为广泛存在, 同时在很多领域中又十分匮乏.研究促进合作涌现的机制有以下三点益处: 1)有助于解释众多产生原因未知的现象, 例如, 细胞的癌变[6]、语言的产生[7]和集群行为[8]; 2)有助于解决我们面临的全球性问题, 例如, "公地悲剧" [9]、环境恶化[10]和资源枯竭[11]; 3)有助于破解互联网时代在虚拟世界中我们遇到的新问题, 例如, 网络欺诈[12]等违法犯罪行为.由此可见, 研究促进合作演化的机制对人类发展有着重大的现实意义和时代紧迫感.

    如何研究合作行为的演化?这是一个热点问题, 2005年 $Science$ 杂志就指出"合作行为如何进化"是21世纪最关键的25个科学问题之一[13].演化博弈论(Evolutionary game theory)为研究合作的演化提供一个有力的数学框架. Smith等首次将von Neumann开创的博弈论观点(大脑在利益冲突时做出理性决定)扩展为根据自然选择而得出决定[14], 这标志着演化博弈论的开创.近年来, 国内外越来越多的学者利用此理论研究促进合作涌现的机制[15-37].其中最著名的是哈佛大学的Nowak教授, 他对"综合进化论" (这一理论将突变、选择和进化的基本概念整合到一个数学框架中)的思想进行了扩展, 将囚徒困境放到演化的群体中进行研究. Nowak首次总结了促进合作涌现的5大机制[38]:亲缘选择(Kin selection)、直接互惠(Direct selection)、间接互惠(Indirect selection)、网络互惠(Network reciprocity)和群组选择(Group selection).亲缘选择意味着, 与谁的血缘关系越近, 就越倾向与之合作; 直接互惠意味着, 今天我帮助你, 明天你会帮助我; 间接互惠意味着, 今天我帮助你, 明天会有他人帮助我; 网络互惠意味着, 个体仅仅与邻居进行博弈, 合作者团簇最终胜出背叛者团簇; 群组选择意味着, 竞争既发生在个体之间, 也发生在群组之间.除了这5大机制, 最近的综述还归纳出另外5种促进合作演化的机制[39]:绿胡子选择(Green beard selection)、强互惠性(Strong reciprocity)、有成本的示好(Costly signaling)、集合选择(Set selection)和选择性参与(Optional participation).绿胡子选择意味着, 相似性越高的个体之间越容易发生合作; 强互惠性意味着, 个体愿意牺牲自身利益惩罚背叛行为; 有成本的示好意味着, 个体愿意承担成本吸引其他个体的关注; 集合选择意味着, 个体仅仅与相同集合的个体进行交互; 选择性参与意味着, 个体有权利拒绝与特定个体进行博弈.

    间接互惠是促进合作涌现的重要机制之一.相对于直接互惠, 间接互惠不再要求相同的个体间重复相遇, 同时利他个体能够从第三方获得收益, 这可以很好地解释陌生个体间的合作行为[40-46].大量的非亲缘、非直接的间接互惠行为在人类社会和动物世界中广泛存在.特别地, 人类社会中语言的出现[7, 47]、道德规范的形成[38]、社会的分工[39]以及人类大脑的发育[47]都与间接互惠密不可分.在经济全球化和进入网络时代的背景下, 电子商务大大地增加了陌生个体间交易的频率, 陌生个体间的一次性交互逐步取代传统的相识个体间的重复交互[37, 48-52].此时的交易主要依赖于声望和信任, 从而局部信息条件下个体信任被利用的"道德风险"不断增大[45].因此, 针对间接互惠如何促进合作涌现的研究吸引了演化生物学家、经济学家和社会科学家等学者的极大兴趣.

    间接互惠包括"上游互惠" (Upstream reciprocity)、"下游互惠" (Downstream reciprocity)和"广义互惠" (Generalized reciprocity)三种形式[45, 53-57].如图 1所示, "上游互惠"指的是, $B$ 得到 $A$ 的帮助后受到激励, 继而帮助 $C$ ; "下游互惠"指的是, $C$ 观察到 $A$ 曾经帮助了 $B$ , 因此帮助 $A$ , 这是一种建立在声望基础上的间接互惠; "广义互惠"指的是, $D$ 观察到 $A$ 帮助 $B$ , 于是 $D$ 帮助 $C$ . "上游互惠"并不能单独促进合作的涌现, 只有与直接互惠或者网络互惠相结合才能促进合作的涌现[56-57]. "下游互惠"和"广义互惠"均可单独促进合作的涌现, 不过前者是研究间接互惠的主流方向, 而关于后者的相关研究还甚少.目前, 针对间接互惠的研究方法主要有理论分析、蒙特卡罗仿真(Monte Carlo simulation)和实验验证(包括实验室实验、实地实验和在线实验).

    图 1  间接互惠的三种形式
    Fig. 1  Three kinds of indirect reciprocity

    接下来的文章从以下三方面归纳总结关于"下游互惠"的研究:经典的博弈模型、声望评估准则与行为准则和基于八卦的声望信息传播.

    在演化博弈论框架下研究间接互惠, 需要将个体之间发生的交互行为抽象为博弈模型.目前, 常被用来研究间接互惠的博弈模型包括捐助博弈(Donation game) [43-44, 58-72]、信任博弈(Trust game) [73-75]、独裁者博弈(Dictator game) [76-82]和公共品博弈(Public goods game) [83-88].

    1) 捐助博弈, 如图 2 (a)所示.一方为捐助者 $A$ , 另一方为接受者 $B$ :如果 $A$ 给予 $B$ 捐助, 则 $A$ 付出成本 $c$ 且 $B$ 得到收益 $b$ ( $b>c$ ); 如果 $A$ 不给予 $B$ 捐助, 则双方均未获得收益且没有损失.

    图 2  博弈模型及收益矩阵
    Fig. 2  Games and their payoff matrices

    2) 信任博弈, 如图 2 (b)所示.一方为投资者 $A$ , 另一方为响应者 $B$ : $A$ 将部分资金 $c$ (总额为 $R$ , $0\leq c\leq R$ )给予 $B$ , 从而 $B$ 获得收益 $r\times c$ ( $r>1$ ); 随后, $B$ 决定将其获得的部分收益 $a$ ( $0\leq a\leq r\times c$ )返还给 $A$ .最后, $A$ 获得收益 $R-c+a$ , $B$ 获得收益 $r\times c-a$ .

    3) 独裁者博弈, 如图 2 (c)所示.一方为独裁者 $A$ , 另一方为接受者 $B$ : $A$ 将部分资金 $c$ (总额为 $R$ , $0\leq c\leq R$ )分给 $B$ .无论 $A$ 给了 $B$ 多少, $B$ 只能接受, 没有拒绝的权利, 从而 $B$ 得到收益 $c$ , 而 $A$ 获得其余收益 $R-c$ .

    4) 公共品博弈, 如图 2 (d)所示.博弈的成员同时向公共资源池进行投资, 投资总额乘以增益系数 $r$ ( $1<r<$ 博弈人数)后平均分配给所有博弈成员, 每个成员的收益为所获得的回报减去自身的投资额.

    声望是间接互惠发挥作用的核心, 然而声望的建立首先面临的问题是如何评价个体声望的好与坏, 即如何构建声望评估准则.目前, 被广泛研究的评估准则包括"一阶评估"、"二阶评估"和"三阶评估" [43-44, 59-71, 85-101], 如表 1所示.

    表 1  声望评估准则
    Table 1  Reputation evaluation criterion
    声望评估准则 定义 数量(种) 典型的例子
    "一阶评估" 考虑捐助者行为 $2^2=4$ "形象分数"
    "二阶评估" 同时考虑捐助者行为和接受者声望 ${(2^2)}^2=16$ "温和准则"、"严苛准则"
    "三阶评估" 同时考虑捐助者行为和声望及接受者声望 ${({(2^2)}^2)}^2=256$
    下载: 导出CSV 
    | 显示表格

    "一阶评估"在评价个体声望时仅考虑捐助者行为(是否给予帮助).经典的"一阶评估"是"形象分数":当捐助者帮助接受者时, 捐助者的形象分数增加一分; 当捐助者拒绝帮助接受者时, 捐助者的形象分数减少一分. 1998年, Nowak等首次利用"形象分数"构建了刻画间接互惠的数学模型, 如图 3所示.他们认识到间接互惠在促进合作演化方面的巨大作用[43]:当玩家的声望由多值"形象分数"确定时, 蒙特卡罗仿真表明合作行为在群体中以较高频率涌现.之后, 这个结论被行为实验证实[63].与此同时, Nowak等理论分析了二值"形象分数" [43-44].稍后的理论研究表明很多因素导致合作行为在采取二值"形象分数"的群体中消失[64-66, 96].这种现象是由于此准则固有的困境:拒绝帮助形象差的玩家, 虽然惩罚了他们, 但同时也令自身形象变差[67, 97-98].显然, 仅考虑捐助者行为的二值"形象分数"会造成不公正的声望评价.最近, 理论工作揭示了多人博弈[68, 99]、三值"形象分数" (好、中性、坏) [69]或特定"一阶评估" (观察者根据捐赠者在以往多次行动中的表现确定其名声) [70, 100]可以克服这个困境, 促进合作行为的涌现.

    图 3  经典的间接互惠模型
    Fig. 3  Representative model about indirect reciprocity

    "二阶评估"也能弥补二值"形象分数"固有的缺陷:在评价个体声望时, 不仅考虑捐助者的行为(是否给予捐助), 还要考虑接受者的声望(好、坏).典型的"二阶评估"包括"温和准则"和"严苛准则", 如表 2所示.二者唯一的不同点在于, 前者认为拒绝帮助坏人会为捐助者带来好的声望, 而后者认为此行为会为捐助者带来坏的声望.学者在"二阶评估"中引入惩罚策略(不仅给被惩罚者带来损失, 而且惩罚者也要承担少量损失), 发现对背叛者置之不理比惩罚背叛者更有利于合作的涌现[71].

    表 2  典型的"二阶评估"
    Table 2  Representative "second-order evaluation"
    捐助者行为/接受者声望
    捐助/好 捐助/坏 不捐助/好 不捐助/坏
    "温和准则"
    "严苛准则"
    下载: 导出CSV 
    | 显示表格

    在"二阶评估"基础上, 额外考虑捐赠者的声望, 这种评估准则被称为"三阶评估" [91-92].例如, 名声差的人通过帮助好名声之人"收买"好名声.学者考察所有可能的"三阶评估", 假设群体最多拥有两种策略, 发现了8种评估准则可以令合作行为具有演化稳定性[93].这8种准则如表 3所示, 具有一些共性:与好人合作(捐助)其名声为好, 而背叛好人(不捐助)则为坏, 同时好人背叛坏人不会损坏名声.值得一提的是, 它们均不属于"一阶评估", 而其中两种属于"二阶评估", 分别为"温和准则"和"严苛准则".学者在群体共存多种策略的假设下对这两种准则进行研究[94].上述研究均假设群体共享相同评估准则, 而比较的是不同行为准则的竞争.鉴于认知差异会导致个体对于如何评估声望的理解不同, 学者也考虑了评估准则因人而异的情形[95, 101].

    表 3  8种促进合作演化的声望评估准则
    Table 3  Eight reputation evaluation criterions which favor the evolution of cooperation
    捐助者声望/接受者声望
    好/好 好/坏 坏/好 坏/坏
    捐助者捐助 未知 未知
    捐助者不捐助 未知
    下载: 导出CSV 
    | 显示表格

    关于间接互惠的早期研究假设个体仅帮助声望好的个体, 或者个体仅帮助形象分数高于某一阈值的个体[43-44, 64-68, 96-99].这些最简单的行为准则(行为准则是能否捐助的依据)要求个体仅根据对手的声望决定自己是否给予捐助.稍后, 略微复杂的行为准则, 例如个体决定是否捐助时需要同时考虑自身和对手的声望, 受到关注[69-71, 89-90, 94-95, 100-101].上述研究主要关注哪种声望评估准则更有利于合作的演化.最近, 学者们对较为复杂的行为准则如何影响合作涌现进行了探索[72, 87, 102].一些学者考察个体在决定是否捐助时对接受者的声望有一定的容忍范围(当接受者的声望在这个范围内则进行捐助), 通过仿真发现, 一定的声望容忍度有助于合作的涌现[87, 102].还有一些研究提出了一种基于向量的行为准则(捐助者将自身声望与接受者声望进行比较, 当至少满足三种条件中的两种时则进行捐助, 这三种条件包括声望近似、声望高于自己和声望低于自己), 通过仿真发现, "捐赠者会为与自己声望近似或者高于自己声望的接受者进行捐助"这种策略在较小的成本收益比下能够成为占优策略, 同时促进合作的演化[72].

    直接观察和八卦(个体之间通过交流, 共享彼此的声望信息)是声望信息传播的两种方式[45, 103-104], 如图 4所示.当群体规模较小时, 个体可以通过直接交互或者直接观察获得对方一手的声望信息.然而随着群体规模的扩大, 直接观察到所有个体行为变得不大可能, 必须通过与第三方交流来分享和传播二手的声望信息[104-105].可见在较大的群体中, 八卦常常是声望信息传播的主要方式.

    图 4  声望信息传播的两种方式
    Fig. 4  Two ways of reputation dispersal

    一些学者通过解析和仿真的方式对于八卦如何影响合作的涌现进行研究.此时的模型通常假设观察者以一定的概率 $q$ 了解玩家的声望(通过概率的形式简单模拟了声望的局部传播).针对"形象分数", Nowak等给出了简单的数学关系:当 $q$ 高于成本收益比 $c/b$ 时, 合作可以涌现[43-44].在"二阶评估"下, 类似的条件在两个调查中获得[106-107], 这两个调查最大区别在于, 当观察者未看到交互过程时, 捐赠者的名声保持不变或者设定为未知.若将交互划分为公开和私下两种(观察者一直看到公开交互而以概率 $q$ 看到私下交互), 类似的条件仍然满足[108].上述研究均假设 $q$ 为常数, 针对 $q$ 随时间推移而增大的情形(观察者越来越可能了解其余个体的声望), 也有学者进行了理论分析[109].

    八卦在传播声望信息过程中可能受到噪声的干扰和谎言的入侵, 导致不公正的声望评价.噪声一方面来源于不完整的观察给出不公正的声望, 另一方面来源于在声望传播过程中无意地误导他人; 而谎言则是故意传播虚假的声望信息而对他人进行误导.一项研究在声望传播中引入欺骗策略(传播虚假声望信息), 发现这种策略在没有其他机制的情形下导致群体合作演化的失败[110].另两项研究表明:当群体中没有虚假信息传播时, 八卦数量的增加有助于促进合作的演化; 而存在噪声干扰和谎言所导致的不公正评价时, 中等数量的八卦最有利于促进合作的演化[111-112].这两项研究是基于累加的八卦信息进行决策, 而最近的研究发现基于最新的八卦信息作出决策更能促进合作的演化[113].上述关于八卦的模型均没有加入声望传播所需的成本(例如时间的消耗).当考虑这种成本时, 结果表明间接互惠不再促进合作的演化[114].

    另一部分学者通过行为实验的方法对八卦进行研究, 主要发现如下.即使个体能够通过直接交互或者直接观察获取他人的一手声望信息, 实验发现个体也会倾向于基于八卦信息做出判断[115-117].八卦所传播的声望信息有助于个体甄别合作对象从而避免被欺骗, 并有效提高群体的合作水平[88, 103, 118].当八卦将个体的声望传播到未来会与其发生交互的个体时, 八卦可以促使个体更加关注自身声望并促进慷慨行为的产生[82, 119-121].八卦按照传播主题可以被划分为传播好名声和传播坏名声两种, 传播好名声的八卦更能够促进合作的涌现[115].社会网络结构允许个体可以在不同时间从多个来源获取彼此的声望信息, 这有助于减少信息传播中可能出现的误差[122-123]. "道德威慑"通过拆穿谎言后的惩罚机制维护八卦的可信性, 从而促进合作的涌现[124].当声望被视为可以买卖的物品时, 由于人类具有认知和辨别能力以及欺骗者为了购买声望会付出一定的收益而降低适应度, 因此, 虚假的声望对合作水平的影响并不明显[125-126].

    合作行为在很多领域中十分匮乏, 因此, 研究促进合作演化的机制对人类发展有着重大的现实意义和时代紧迫感. 2005年 $Science$ 杂志就指出"合作行为如何进化"是21世纪最关键的25个科学问题之一.在演化博弈论的框架下, 研究人员已提出一些促进合作演化的机制, 其中间接互惠是促进合作演化的最重要机制之一, 并已吸引了演化生物学家、经济学家和社会学家等学者的极大兴趣.它包括"上游互惠"、"下游互惠"和"广义互惠"三种方式: "上游互惠"并不能单独促进合作的涌现, 只有与直接互惠或者网络互惠相结合才能促进合作的涌现; "下游互惠"和"广义互惠"均可单独促进合作的涌现, 不过前者是研究间接互惠的主流方向, 而关于后者的相关研究还甚少.本文关注的是以声望为核心的"下游互惠", 具体而言, 个体通过帮助他人建立自己在群体中的好声望, 从而期待未来获得他人的帮助.

    本文从三个方面对关于"下游互惠"的研究进行总结.首先, 回顾了在演化博弈论框架下研究间接互惠的博弈模型:捐助博弈、信任博弈、独裁者博弈和公共品博弈.其次, 回顾了被广泛研究的三类声望评估准则: "一阶评估"、"二阶评估"和"三阶评估".相关研究假设采用比较简单的行为准则, 而聚焦于哪种声望评估准则能够促进合作的演化.同时回顾了关于较为复杂的行为准则如何促进合作演化的一些研究.再次, 回顾了利用解析方法和仿真方法对八卦如何促进合作演化进行的研究.解析研究一般假设个体以一定的概率获得彼此的声望信息, 这个概率通常为常值, 个别研究假设其可随时间变化.仿真研究假设更加复杂的模型, 例如八卦不再如实传递信息, 而是融入了噪声和谎言.同时也回顾了利用行为实验对八卦进行的研究, 内容十分宽泛.

    基于声望的间接互惠具有广阔的研究前景, 其未来可能的研究方向有复杂网络上的间接互惠、声望传播系统的鲁棒性、声望共享系统的建立和间接互惠在P2P网络中的应用.

    目前, 大部分理论研究均是在混合均匀群体中获得的[127-129].然而, 绝大多数现实社会中的群体并非混合均匀的, 个体之间的交互和声望传播都是利用复杂网络实现的.在演化博弈论框架下, 未涉及间接互惠的静态复杂网络和动态复杂网络已被广泛研究[130-142], 而只有较少研究关注复杂网络上的间接互惠[143-147].文献[143]发现在社会网络中, 根据声望选择交互伙伴这种行为有助于促进合作的演化.文献[144-145]假设小世界网络和无标度网络等复杂网络可以重构(断边重连), 发现声望共享"联盟"的存在有助于促进群体合作.文献[146-147]假设直接互惠和间接互惠同时存在于网络上, 发现间接互惠有助于刻画现实社会的无标度网络的形成.

    虽然科研人员已经对于复杂网络上的间接互惠进行了一些初步的探索, 但是还有很多问题需要进一步研究.例如, 上述研究均认为声望是通过观察获得的公共信息(即声望全局可知), 然而在现实社会中, 声望多数情况下是通过八卦进行传播的, 由此可见, 静态或动态复杂网络上八卦这种声望传播方式如何影响合作的演化是一个值得深入研究的方向.

    八卦是大规模群体中声望传播的主要方式, 它在传播声望信息过程中可能受到噪声的干扰和谎言的入侵, 从而导致不公正的声望评价.噪声一方面来源于不完整的观察给出不公正的声望, 另一方面来源于在声望传播过程中无意地误导他人; 而谎言则是故意传播虚假的声望信息而对他人进行误导.一项研究在声望传播中引入欺骗策略(传播虚假声望信息), 发现这种策略在没有其他机制的情形下导致群体合作演化的失败[110].另两项研究表明:当群体中没有虚假信息传播时, 八卦数量的增加有助于促进合作的演化; 而存在噪声干扰和谎言所导致的不公正评价时, 中等数量的八卦最有利于促进合作的演化[111-112].这两项研究是基于累加的八卦信息进行决策, 而最近的研究发现基于最新的八卦信息作出决策更能促进合作的演化[113].

    科研人员已经对于加入噪声和谎言的八卦进行了初步的探索, 但已研究的模型还有很多可以改进的地方, 相应的结果并不全面.在未来的研究中, 我们需要建立更加合适的模型, 结合现实生活提出能够抵抗噪声干扰和谎言入侵的八卦, 令声望传播系统具有鲁棒性, 进而发现能够促进合作演化且强抗干扰的机制.

    以往关于间接互惠的绝大多数研究均没有考虑个体间声望共享所需的成本.但在实际中, 人们在评价和分享他人声望的过程中需要耗费时间和精力.例如, 在网络购物平台中, 人们需要花费时间和精力去评价所购买的产品或者服务.近期的一项研究表明, 当考虑声望共享所需成本时, 间接互惠无法促进合作的涌现[114].

    随着经济全球化和网络时代的到来, 陌生个体间的交易日益频繁.为什么人们会不计成本、不厌其烦地和陌生人分享他人的真实声望呢?目前的研究还没有给出一个满意的答复.因此, 我们需要针对考虑声望共享所需成本的模型, 提出能够建立声望共享系统且促进合作涌现的有效机制.

    近年来, P2P (Peer to peer)网络应用广泛, 因此对其研究发展快速.在P2P网络中, 参与者共享自身所拥有的一部分硬件资源(存储能力、网络连接能力和打印机等), 这些共享资源通过网络提供服务和内容, 能被其他对等节点(Peer)直接访问而无需经过中间实体.在此网络中的参与者既是资源、服务和内容的提供者(Server), 又是资源、服务和内容的获取者(Client).合作是确保所有参与者获得所需服务的关键, 出于恶意和自私的非合作行为往往导致参与者获得较少服务甚至一无所获.消除非合作行为的有效机制包括信任机制和激励机制.信任机制指的是根据参与者的交互历史计算他的可信任值[148-153], 例如, eBay声望系统[151]、Beta声望系统[152]、Eigentrust声望系统[148]和Powertrust声望系统[153].激励机制包括金钱激励和非金钱激励[154-157].

    鉴于P2P网络中个人利益和集体利益相冲突, 经典博弈理论已被广泛用来研究此类网络[154, 157-160].不过经典博弈理论假设参与者完全理性且拥有全局信息.这些假设并不现实, 同时经典博弈理论不能描述参与者策略的动态演化过程及策略在整个系统中的传播过程.近来, 可以克服上述缺点的演化博弈论被用来研究P2P网络[155, 161-165].文献[161]假设P2P网络是混合均匀且有无限节点, 并利用复制动力学研究三种激励机制的稳定性.文献[162]同样利用复制动力学发现一种延拓的模仿动力学可以改进整个网络路径选择的效率, 从而避免路径上的过载或长延迟.文献[163]假设P2P网络具有有限节点, 分别在混合均匀网络和同型结构网络上研究一种激励机制(Reciprocation-based incentive mechanism).文献[164]将关于同类激励机制的研究推广到异型结构的P2P网络.文献[155, 165]假设P2P网络具有有限节点, 利用计算机仿真调查两种信任机制.上述研究是针对一般性的P2P网络, 还有一些研究利用演化博弈论分析特殊的P2P网络, 例如基于P2P的无线传感网络[166-169]和基于P2P的车辆自组织网络[170].

    科研人员已利用演化博弈论对P2P网络进行了一些探索, 本文主体部分总结了在演化博弈论框架下对于间接互惠的研究成果, 一个自然的想法是将这些研究思路应用到关于P2P网络的研究中.大体思路有以下4点:

    1) 声望评估准则可视作信任机制.将"一阶评估"、"二阶评估"或"三阶评估"作为信任机制集合, 寻找能够令P2P网络中合作行为稳定的信任机制.

    2) 行为准则可视为激励机制.将已研究过的行为准则构成激励机制集合, 寻找能够令P2P网络高效、有序运行的激励机制.

    3) 在P2P网络的声望传播过程中融入八卦, 研究八卦对于网络稳定性的影响.

    4) 可以将深度学习方法[171]与间接互惠机制结合, 来研究网络控制问题[172-174].

    致谢: 对北京科技大学自动化学院刘剑、孟祥钰、古鹏飞和王雷等同学给予的帮助表示感谢!
  • 本文责任编委 张化光
  • 图  1  间接互惠的三种形式

    Fig.  1  Three kinds of indirect reciprocity

    图  2  博弈模型及收益矩阵

    Fig.  2  Games and their payoff matrices

    图  3  经典的间接互惠模型

    Fig.  3  Representative model about indirect reciprocity

    图  4  声望信息传播的两种方式

    Fig.  4  Two ways of reputation dispersal

    表  1  声望评估准则

    Table  1  Reputation evaluation criterion

    声望评估准则 定义 数量(种) 典型的例子
    "一阶评估" 考虑捐助者行为 $2^2=4$ "形象分数"
    "二阶评估" 同时考虑捐助者行为和接受者声望 ${(2^2)}^2=16$ "温和准则"、"严苛准则"
    "三阶评估" 同时考虑捐助者行为和声望及接受者声望 ${({(2^2)}^2)}^2=256$
    下载: 导出CSV

    表  2  典型的"二阶评估"

    Table  2  Representative "second-order evaluation"

    捐助者行为/接受者声望
    捐助/好 捐助/坏 不捐助/好 不捐助/坏
    "温和准则"
    "严苛准则"
    下载: 导出CSV

    表  3  8种促进合作演化的声望评估准则

    Table  3  Eight reputation evaluation criterions which favor the evolution of cooperation

    捐助者声望/接受者声望
    好/好 好/坏 坏/好 坏/坏
    捐助者捐助 未知 未知
    捐助者不捐助 未知
    下载: 导出CSV
  • [1] Darwin C. On the origin of species by means of natural selection. Science, 1963, 71(6):354-357 http://www.gutenberg.org/ebooks/1228
    [2] McDonald D B. Cooperation among animals:an evolutionary perspective. Lee Alan Dugatkin. The Quarterly Review of Biology, 1998, 73(3):387-388 doi: 10.1086/420391
    [3] Nowak M A, Sigmund K. Evolutionary dynamics of biological games. Science, 2004, 303(5659):793-799 doi: 10.1126/science.1093411
    [4] Clutton-Brock T. Cooperation between non-kin in animal societies. Nature, 2009, 462(7269):51-57 doi: 10.1038/nature08366
    [5] Darwin C. The Works of Charles Darwin, Volume 15:On the Origin of Species 1859. New York:New York University Press, 2010. 69-83
    [6] Axelrod R, Axelrod D E, Pienta K J. Evolution of cooperation among tumor cells. Proceedings of the National Academy of Sciences of the United States of America, 2006, 103(36):13474-13479 doi: 10.1073/pnas.0606053103
    [7] Smith E A. Communication and collective action:language and the evolution of human cooperation. Evolution and Human Behavior, 2010, 31(4):231-245 doi: 10.1016/j.evolhumbehav.2010.03.001
    [8] Tuyls K, Parsons S. What evolutionary game theory tells us about multiagent learning. Artificial Intelligence, 2007, 171(7):406-416 doi: 10.1016/j.artint.2007.01.004
    [9] Hardin G. The tragedy of the commons. Science, 1968, 162(3859):1243-1248 doi: 10.1126/science.162.3859.1243
    [10] Milinski M, Sommerfeld R D, Krambeck H J, Reed F A, Marotzke J. The collective-risk social dilemma and the prevention of simulated dangerous climate change. Proceedings of the National Academy of Sciences of the United States of America, 2008, 105(7):2291-2294 doi: 10.1073/pnas.0709546105
    [11] Requejo R J, Camacho J. Evolution of cooperation mediated by limiting resources:connecting resource based models and evolutionary game theory. Journal of Theoretical Biology, 2011, 272(1):35-41 doi: 10.1016/j.jtbi.2010.12.005
    [12] Zhang Y, He J H. Research on the mobile net business knowledge sharing strategy of fraud evade. Applied Mechanics and Materials, 2014, 631-632:1171-1173 https://www.researchgate.net/publication/272113750_Research_on_the_Mobile_Net_Business_Knowledge_Sharing_Strategy_of_Fraud_Evade
    [13] Pennisi E. How did cooperative behavior evolve? Science, 2005, 309(5731):93 doi: 10.1126/science.309.5731.93
    [14] Smith J M, Price G R. The logic of animal conflict. Nature, 1973, 246(5427):15-18 doi: 10.1038/246015a0
    [15] Fu F. Evolutionary Games and Evolution of Cooperation[Ph.D. dissertation], Peking University, China, 2009.
    [16] Chen X J. Evolutionary Dynamics of Cooperation in Complex Networks[Ph.D. dissertation], Peking University, China, 2010.
    [17] Wu B. Evolutionary Game Dynamics in Finite Populations[Ph.D. dissertation], Peking University, China, 2011.
    [18] Wang J. Evolutionary Game Dynamics in Populations[Ph.D. dissertation], Peking University, China, 2011.
    [19] Zhang C Y. Cooperation in Evolutionary Games on Networks of Agents[Ph.D. dissertation], Peking University, China, 2012.
    [20] Zhang J L. Cooperation Mechanisms in Evolutionary Games[Ph.D. dissertation], Peking University, China, 2013.
    [21] Wu T. Evolutionary Cooperation Dynamics[Ph.D. dissertation], Peking University, China, 2013.
    [22] Yang Z H. Evolutionary Games and Evolutionary Cooperation Dynamics in Complex Networks[Ph.D. dissertation], Xidian University, China, 2014.
    [23] Zhang Y L. Two Theoretical Methods upon the Evolution of Cooperation in Finite Populations and the Applications[Ph.D. dissertation], Peking University, China, 2015.
    [24] Cong R. Coevolutionary Games on Complex Networks[Ph.D. dissertation], Xidian University, China, 2014.
    [25] Du J M. Evolutionary Game Dynamics in Complex Systems[Ph.D. dissertation], Xidian University, China, 2016.
    [26] Li K. Evolutionary Dynamics in Collective Behavior[Ph.D. dissertation], Peking University, China, 2016.
    [27] 王龙, 伏锋, 陈小杰, 王靖, 李卓政, 谢广明, 楚天广.复杂网络上的演化博弈.智能系统学报, 2007, 2(2):1-10 http://d.old.wanfangdata.com.cn/Periodical/xdkjyc200702001

    Wang Long, Fu Feng, Chen Xiao-Jie, Wang Jing, Li Zhuo-Zheng, Xie Guang-Ming, Chu Tian-Guang. Evolutionary games on complex networks. CAAI Transactions on Intelligent Systems, 2007, 2(2):1-10 http://d.old.wanfangdata.com.cn/Periodical/xdkjyc200702001
    [28] 王龙, 伏锋, 陈小杰, 王靖, 武斌, 楚天广, 谢广明.复杂网络上的群体决策.智能系统学报, 2008, 3(2):95-108 http://www.docin.com/p-1440573413.html

    Wang Long, Fu Feng, Chen Xiao-Jie, Wang Jing, Wu Bin, Chu Tian-Guang, Xie Guang-Ming. Collective decision-making over complex networks. CAAI Transactions on Intelligent Systems, 2008, 3(2):95-108 http://www.docin.com/p-1440573413.html
    [29] 王龙, 王靖, 武斌.量子博弈:新方法与新策略.智能系统学报, 2008, 3(4):294-304 http://www.cnki.com.cn/Article/CJFDTotal-JSJA201410056.htm

    Wang Long, Wang Jing, Wu Bin. Quantum games:new methodologies and strategies. CAAI Transactions on Intelligent Systems, 2008, 3(4):294-304 http://www.cnki.com.cn/Article/CJFDTotal-JSJA201410056.htm
    [30] 王龙, 吴特, 张艳玲.共演化博弈中的反馈机制.控制理论与应用, 2014, 31(7):823-836 https://www.wenkuxiazai.com/doc/5b517652f12d2af90342e609.html

    Wang Long, Wu Te, Zhang Yan-Ling. Feedback mechanism in coevolutionary games. Control Theory & Applications, 2014, 31(7):823-836 https://www.wenkuxiazai.com/doc/5b517652f12d2af90342e609.html
    [31] Boccabella A, Natalini R, Pareschi L. On a continuous mixed strategies model for evolutionary game theory. Kinetic & Related Models, 2011, 4(1):187-213 https://arxiv.org/abs/1112.3663?context=cond-mat.stat-mech
    [32] Salimi Sartakhti J, Manshaei M H, Sadeghi M. MMP-TIMP interactions in cancer invasion:an evolutionary game-theoretical framework. Journal of Theoretical Biology, 2017, 412:17-26 doi: 10.1016/j.jtbi.2016.09.019
    [33] Perc M, Jordan J J, Rand D G, Wang Z, Boccaletti S, Szolnoki A. Statistical physics of human cooperation. Physics Reports, 2017, 687:1-51 doi: 10.1016/j.physrep.2017.05.004
    [34] Wang Z, Jusup M, Wang R W, Shi L, Iwasa Y, Moreno Y, Kurths J. Onymity promotes cooperation in social dilemma experiments. Science Advances, 2017, 3(3):Article No.e1601444 doi: 10.1126/sciadv.1601444
    [35] Allen B, Lippner G, Chen Y T, Fotouhi B, Momeni N, Yau S T, Nowak M A. Evolutionary dynamics on any population structure. Nature, 2017, 544(7649):227-230 doi: 10.1038/nature21723
    [36] Taylor C, Nowak M A. Transforming the dilemma. Evolution, 2007, 61(10):2281-2292 doi: 10.1111/evo.2007.61.issue-10
    [37] Rand D G, Nowak M A. Human cooperation. Trends in Cognitive Sciences, 2013, 17(8):413-425 doi: 10.1016/j.tics.2013.06.003
    [38] Nowak M A. Five rules for the evolution of cooperation. Science, 2006, 314(5805):1560-1563 doi: 10.1126/science.1133755
    [39] Zaggl M A. Eleven mechanisms for the evolution of cooperation. Journal of Institutional Economics, 2014, 10(2):197-230 doi: 10.1017/S1744137413000374
    [40] Boyd R, Richerson P J. The evolution of indirect reciprocity. Social Networks, 1989, 11(3):213-236 doi: 10.1016/0378-8733(89)90003-8
    [41] Wedekind C. Give and ye shall be recognized. Science, 1998, 280(5372):2070-2071 http://www.sciencemag.org/content/280/5372/2070.2.summary?related-urls=yes&legid=sci;280/5372/2070b
    [42] Ferriére R. Evolutionary biology:help and you shall be helped. Nature, 1998, 393(6685):517-519 doi: 10.1038/31102
    [43] Nowak M A, Sigmund K. Evolution of indirect reciprocity by image scoring. Nature, 1998, 393(6685):573-577 doi: 10.1038/31225
    [44] Nowak M A, Sigmund K. The dynamics of indirect reciprocity. Journal of Theoretical Biology, 1998, 194(4):561-574 doi: 10.1006/jtbi.1998.0775
    [45] Nowak M A, Sigmund K. Evolution of indirect reciprocity. Nature, 2005, 437(6685):1291-1298 https://www.unil.ch/files/live/sites/dee/files/shared/textes/Nowak_Sigmund_Nature_2005.pdf
    [46] Wedekind C, Braithwaite A V A. The long-term benefits of human generosity in indirect reciprocity. Current Biology, 2002, 12(12):1012-1015 doi: 10.1016/S0960-9822(02)00890-4
    [47] Gardenfors P. Games, Actions and Social Software. Berlin:Springer-Verlag, 2012. 164-183
    [48] Resnick P, Kuwabara K, Zeckhauser R, Zeckhauser R, Friedman E. Reputation systems. Communications of the ACM, 2000, 43(12):45-48 doi: 10.1145/355112.355122
    [49] Bolton G E, Katok E, Ockenfels A. How effective are electronic reputation mechanisms? An experimental investigation. Management Science, 2004, 50(11):1587-1602 doi: 10.1287/mnsc.1030.0199
    [50] Resnick P, Zeckhauser R, Swanson J R, Lockwood K. The value of reputation on eBay:a controlled experiment. Experimental Economics, 2006, 9(2):79-101 doi: 10.1007/s10683-006-4309-2
    [51] Geunes J, Akçali E, Pardalos P M, Romeijn H E, Shen Z J M. Applications of Supply Chain Management and E-Commerce Research. Boston:Springer-Verlag, 2005. 195-216
    [52] Lucking-Reiley D, Bryan D, Prasad N, Reeves D. Pennies from eBay:the determinants of price in online auctions. The Journal of Industrial Economics, 2007, 55(2):223-233 doi: 10.1111/joie.2007.55.issue-2
    [53] Greiner B, Levati M V. Indirect reciprocity in cyclical networks:an experimental study. Journal of Economic Psychology, 2003, 26(5):711-731 https://www.sciencedirect.com/science/article/pii/S0167487005000334
    [54] Pfeiffer T, Rutte C, Killingback T, Taborsky M, Bonhoeffer S. Evolution of cooperation by generalized reciprocity. Proceedings of the Royal Society B, 2005, 272(1568):1115-1120 doi: 10.1098/rspb.2004.2988
    [55] Chiong R, Kirley M. Promotion of cooperation in social dilemma games via generalised indirect reciprocity. Connection Science, 2015, 27(4):417-433 doi: 10.1080/09540091.2015.1080226
    [56] Nowak M A, Roch S. Upstream reciprocity and the evolution of gratitude. Proceedings of the Royal Society B, 2007, 274(1610):605-610 doi: 10.1098/rspb.2006.0125
    [57] Iwagami A, Masuda N. Upstream reciprocity in heterogeneous networks. Journal of Theoretical Biology, 2010, 265(3):297-305 doi: 10.1016/j.jtbi.2010.05.010
    [58] Roberts G. Partner choice drives the evolution of cooperation via indirect reciprocity. PLoS One, 2015, 10(6):Article No.e0129442 doi: 10.1371/journal.pone.0129442
    [59] Swakman V, Molleman L, Ule A, Egas M. Reputation-based cooperation:empirical evidence for behavioral strategies. Evolution and Human Behavior, 2016, 37(3):230-235 doi: 10.1016/j.evolhumbehav.2015.12.001
    [60] dos Santos M, Plací S, Wedekind C. Stochasticity in economic losses increases the value of reputation in indirect reciprocity. Scientific Reports, 2015, 5:Article No.18182 https://www.researchgate.net/publication/286897806_Stochasticity_in_economic_losses_increases_the_value_of_reputation_in_indirect_reciprocity
    [61] Berger U, Grüne A. On the stability of cooperation under indirect reciprocity with first-order information. Games and Economic Behavior, 2016, 98:19-33 doi: 10.1016/j.geb.2016.05.003
    [62] Tian L L, Li M C, Wang Z. Cooperation enhanced by indirect reciprocity in spatial prisoner's dilemma games for social P2P systems. Physica A:Statistical Mechanics and its Applications, 2016, 462:1252-1260 doi: 10.1016/j.physa.2016.07.004
    [63] Wedekind C, Milinski M. Cooperation through image scoring in humans. Science, 2000, 288(5467):850-852 doi: 10.1126/science.288.5467.850
    [64] Leimar O, Hammerstein P. Evolution of cooperation through indirect reciprocity. Proceedings of the Royal Society B, 2001, 268(1468):745-753 doi: 10.1098/rspb.2000.1573
    [65] Milinski M, Semmann D, Bakker T C M, Krambeck H J. Cooperation through indirect reciprocity:image scoring or standing strategy? Proceedings of the Royal Society B, 2001, 268(1484):2495-2501 doi: 10.1098/rspb.2001.1809
    [66] Panchanathan K, Boyd R. A tale of two defectors:the importance of standing for evolution of indirect reciprocity. Journal of Theoretical Biology, 2003, 224(1):115-126 doi: 10.1016/S0022-5193(03)00154-1
    [67] Fehr E, Gächter S. Altruistic punishment in humans. Nature, 2002, 415(6868):137-140 doi: 10.1038/415137a
    [68] Suzuki S, Akiyama E. Evolution of indirect reciprocity in groups of various sizes and comparison with direct reciprocity. Journal of Theoretical Biology, 2007, 245(3):539-552 doi: 10.1016/j.jtbi.2006.11.002
    [69] Tanabe S, Suzuki H, Masuda N. Indirect reciprocity with trinary reputations. Journal of Theoretical Biology, 2013, 317:338-347 doi: 10.1016/j.jtbi.2012.10.031
    [70] Berger U. Learning to cooperate via indirect reciprocity. Games and Economic Behavior, 2011, 72(1):30-37 doi: 10.1016/j.geb.2010.08.009
    [71] Ohtsuki H, Iwasa Y, Nowak M A. Indirect reciprocity provides only a narrow margin of efficiency for costly punishment. Nature, 2009, 457(7225):79-82 doi: 10.1038/nature07601
    [72] Whitaker R M, Colombo G B, Allen S M, Dunbar R I M. A dominant social comparison heuristic unites alternative mechanisms for the evolution of indirect reciprocity. Scientific Reports, 2016, 6:Article No.31459 doi: 10.1038/srep31459
    [73] Espín A M, Exadaktylos F, Neyse L. Heterogeneous motives in the trust game:a tale of two roles. Frontiers in Psychology, 2016, 7:Article No.728 doi: 10.3389/fpsyg.2016.00728/full
    [74] Burks S V, Carpenter J P, Verhoogen E. Playing both roles in the trust game. Journal of Economic Behavior & Organization, 2003, 51(2):195-216 https://www.sciencedirect.com/science/article/pii/S0167268102000938
    [75] Wu J H, Balliet D, Van Lange P A M. Gossip versus punishment:the efficiency of reputation to promote and maintain cooperation. Scientific Reports, 2016, 6:Article No.23919 doi: 10.1038/srep23919
    [76] Eckel C C, Grossman P J. Altruism in anonymous dictator games. Games and Economic Behavior, 1996, 16(2):181-191 doi: 10.1006/game.1996.0081
    [77] Bardsley N. Dictator game giving:altruism or artefact? Experimental Economics, 2008, 11(2):122-133 doi: 10.1007/s10683-007-9172-2
    [78] Engel C. Dictator games:a meta study. Experimental Economics, 2011, 14(4):583-610 doi: 10.1007/s10683-011-9283-7
    [79] Deng X Y, Liu Q, Sadiq R, Deng Y. Impact of roles assignation on heterogeneous populations in evolutionary dictator game. Scientific Reports, 2014, 4:Article No.6937
    [80] Schank J C, Smaldino P E, Miller M L. Evolution of fairness in the dictator game by multilevel selection. Journal of Theoretical Biology, 2015, 382:64-73 doi: 10.1016/j.jtbi.2015.06.031
    [81] Strang S, Grote X, Kuss K, Park S Q, Weber B. Generalized negative reciprocity in the dictator game-how to interrupt the chain of unfairness. Scientific Reports, 2016, 6:Article No.22316 doi: 10.1038/srep22316
    [82] Piazza J, Bering J M. Concerns about reputation via gossip promote generous allocations in an economic game. Evolution and Human Behavior, 2008, 29(3):172-178 doi: 10.1016/j.evolhumbehav.2007.12.002
    [83] Milinski M, Semmann D, Krambeck H J. Reputation helps solve the 'tragedy of the commons'. Nature, 2002, 415(6870):424-426 doi: 10.1038/415424a
    [84] Hauert C, De Monte S, Hofbauer J, Sigmund K. Replicator dynamics for optional public good games. Journal of Theoretical Biology, 2002, 218(2):187-194 doi: 10.1006/jtbi.2002.3067
    [85] Brandt H, Hauert C, Sigmund K. Punishment and reputation in spatial public goods games. Proceedings of the Royal Society B, 2003, 270(1519):1099-1104 doi: 10.1098/rspb.2003.2336
    [86] Hauert C. Replicator dynamics of reward & reputation in public goods games. Journal of Theoretical Biology, 2010, 267(1):22-28 doi: 10.1016/j.jtbi.2010.08.009
    [87] Li A M, Wu T, Cong R, Wang L. One step memory of group reputation is optimal to promote cooperation in public goods games. EPL, 2013, 103(3):Article No.30007 doi: 10.1209/0295-5075/103/30007
    [88] Feinberg M, Willer R, Schultz M. Gossip and ostracism promote cooperation in groups. Psychological Science, 2014, 25(3):656-664 doi: 10.1177/0956797613510184
    [89] Sigmund K. Moral assessment in indirect reciprocity. Journal of Theoretical Biology, 2012, 299:25-30 doi: 10.1016/j.jtbi.2011.03.024
    [90] Fehr E, Fischbacher U. Social norms and human cooperation. Trends in Cognitive Sciences, 2004, 8(4):185-190 doi: 10.1016/j.tics.2004.02.007
    [91] Ohtsuki H, Iwasa Y. How should we define goodness?——reputation dynamics in indirect reciprocity. Journal of Theoretical Biology, 2004, 231(1):107-120 doi: 10.1016/j.jtbi.2004.06.005
    [92] Brandt H, Sigmund K. The logic of reprobation:assessment and action rules for indirect reciprocation. Journal of Theoretical Biology, 2004, 231(4):475-486 doi: 10.1016/j.jtbi.2004.06.032
    [93] Ohtsuki H, Iwasa Y. The leading eight:social norms that can maintain cooperation by indirect reciprocity. Journal of Theoretical Biology, 2006, 239(4):435-444 doi: 10.1016/j.jtbi.2005.08.008
    [94] Ohtsuki H, Iwasa Y. Global analyses of evolutionary dynamics and exhaustive search for social norms that maintain cooperation by reputation. Journal of Theoretical Biology, 2007, 244(3):518-531 doi: 10.1016/j.jtbi.2006.08.018
    [95] Pacheco J M, Santos F C, Chalub F A C C. Stern-judging:a simple, successful norm which promotes cooperation under indirect reciprocity. PLoS Computational Biology, 2007, 2(12):Article No.e178 https://www.researchgate.net/publication/6604852_Stern-Judging_A_Simple_Successful_Norm_Which_Promotes_Cooperation_under_Indirect_Reciprocity
    [96] Ohtsuki H. Reactive strategies in indirect reciprocity. Journal of Theoretical Biology, 2004, 227(3):299-314 doi: 10.1016/j.jtbi.2003.11.008
    [97] Dawes R M, Messick D M. Social dilemmas. International Journal of Psychology, 2000, 35(2):111-116 doi: 10.1080/002075900399402
    [98] Fehr E, Fischbacher U. The nature of human altruism. Nature, 2003, 425(6960):785-791 doi: 10.1038/nature02043
    [99] Suzuki S, Akiyama E. Three-person game facilitates indirect reciprocity under image scoring. Journal of Theoretical Biology, 2007, 249(1):93-100 doi: 10.1016/j.jtbi.2007.07.017
    [100] Berger U, Grüne A. Evolutionary Stability of Indirect Reciprocity by Image Scoring, Department of Economics Working Papers, WU Vienna University of Economics and Business, Vienna, 2014. 1-22
    [101] Uchida S, Sigmund K. The competition of assessment rules for indirect reciprocity. Journal of Theoretical Biology, 2010, 263(1):13-19 doi: 10.1016/j.jtbi.2009.11.013
    [102] Ding H, Cao L, Ren Y Z, Choo K K R, Shi B Y. Reputation-based investment helps to optimize group behaviors in spatial lattice networks. PLoS One, 2016, 11(9):Article No.e0162781 doi: 10.1371/journal.pone.0162781
    [103] Dunbar R I M. Gossip in evolutionary perspective. Review of General Psychology, 2004, 8(2):100-110 doi: 10.1037/1089-2680.8.2.100
    [104] Foster E K. Research on gossip:taxonomy, methods, and future directions. Review of General Psychology, 2004, 8(2):78-99 doi: 10.1037/1089-2680.8.2.78
    [105] Anderson C, Shirako A. Are individuals' reputations related to their history of behavior? Journal of Personality and Social Psychology, 2008, 94(2):320-333 doi: 10.1037/0022-3514.94.2.320
    [106] Uchida S. Effect of private information on indirect reciprocity. Physical Review E, 2010, 82(2):Article No.036111 https://www.sciencedirect.com/science/article/pii/S0960077913001598
    [107] Nakamura M, Masuda N. Indirect reciprocity under incomplete observation. PLoS Computational Biology, 2011, 7(7):Article No.e1002113 doi: 10.1371/journal.pcbi.1002113
    [108] Ohtsuki H, Iwasa Y, Nowak M A. Reputation effects in public and private interactions. PLoS Computational Biology, 2015, 11(11):Article No.e1004527 doi: 10.1371/journal.pcbi.1004527
    [109] Brandt H, Sigmund K. Indirect reciprocity, image scoring, and moral hazard. Proceedings of the National Academy of Sciences of the United States of America, 2005, 102(7):2666-2670 doi: 10.1073/pnas.0407370102
    [110] Számadó S, Szalai F, Scheuring I. Deception undermines the stability of cooperation in games of indirect reciprocity. PLoS One, 2016, 11(1):Article No.e0147623 doi: 10.1371/journal.pone.0147623
    [111] Nakamaru M, Kawata M. Evolution of rumours that discriminate lying defectors. Evolutionary Ecology Research, 2004, 6(2):261-283 https://www.researchgate.net/publication/276295304_Evolution_of_rumours_that_discriminate_lying_defectors
    [112] Seki M, Nakamaru M. A model for gossip-mediated evolution of altruism with various types of false information by speakers and assessment by listeners. Journal of Theoretical Biology, 2016, 407:90-105 doi: 10.1016/j.jtbi.2016.07.001
    [113] Franks H, Griffiths N. Robust reputation in decentralized markets. Computational Intelligence, 2015, 31(4):569-592 doi: 10.1111/coin.v31.4
    [114] Suzuki S, Kimura H. Indirect reciprocity is sensitive to costs of information transfer. Scientific Reports, 2013, 3:Article No.1435 doi: 10.1038/srep01435
    [115] Sommerfeld R D, Krambeck H J, Semmann D, Milinski M. Gossip as an alternative for direct observation in games of indirect reciprocity. Proceedings of the National Academy of Sciences of the United States of America, 2007, 104(44):17435-17440 doi: 10.1073/pnas.0704598104
    [116] Sommerfeld R D, Krambeck H J, Milinski M. Multiple gossip statements and their effect on reputation and trustworthiness. Proceedings of the Royal Society B, 2008, 275(1650):2529-2536 doi: 10.1098/rspb.2008.0762
    [117] Lorenz J, Rauhut H, Schweitzer F, Helbing D. How social influence can undermine the wisdom of crowd effect. Proceedings of the National Academy of Sciences of the United States of America, 2011, 108(22):9020-9025 doi: 10.1073/pnas.1008636108
    [118] Giardini F, Norling E. Multi-Agent-Based Simulation XV. Switzerland:Springer-Verlag, 2014. 104-118
    [119] Wu J H, Balliet D, Van Lange P A M. Reputation management:why and how gossip enhances generosity. Evolution and Human Behavior, 2016, 37(3):193-201 doi: 10.1016/j.evolhumbehav.2015.11.001
    [120] Wu J H, Balliet D, Van Lange P A M. When does gossip promote generosity? Indirect reciprocity under the shadow of the future. Social Psychological and Personality Science, 2015, 6(8):923-930 doi: 10.1177/1948550615595272
    [121] Wu J H, Balliet D, Van Lange P A M. Reputation, gossip, and human cooperation. Social and Personality Psychology Compass, 2016, 10(6):350-364 doi: 10.1111/spc3.v10.6
    [122] Hess N H, Hagen E H. Psychological adaptations for assessing gossip veracity. Human Nature, 2006, 17(3):337-354 doi: 10.1007/s12110-006-1013-z
    [123] Giardini F, Vilone D. Evolution of gossip-based indirect reciprocity on a bipartite network. Scientific Reports, 2016, 6:Article No.37931 doi: 10.1038/srep37931
    [124] Giardini F. Deterrence and transmission as mechanisms ensuring reliability of gossip. Cognitive Processing, 2012, 13(S2):465-475 doi: 10.1007/s10339-011-0421-0
    [125] Pfeiffer T, Tran L, Krumme C, Rand D G. The value of reputation. Journal of the Royal Society Interface, 2012, 9(76):2791-2797 doi: 10.1098/rsif.2012.0332
    [126] Antonioni A, Sánchez A, Tomassini M. Cooperation survives and cheating pays in a dynamic network structure with unreliable reputation. Scientific Reports, 2016, 6:Article No.27160 doi: 10.1038/srep27160
    [127] Zhang Y L, Fu F, Wu T, Xie G M, Wang L. A tale of two contribution mechanisms for nonlinear public goods. Scientific Reports, 2013, 3:Article No.2021 doi: 10.1038/srep02021
    [128] Zhang Y L, Wu T, Cheng X J, Xie G M, Wang L. Mixed strategy under generalized public goods games. Journal of Theoretical Biology 2013, 334:52-60 doi: 10.1016/j.jtbi.2013.05.011
    [129] Zhang Y L, Fu F, Wu T, Xie G M, Wang L. Inertia in strategy switching transforms the strategy evolution. Physical Review E, 2011, 84(6):Article No.066103 http://adsabs.harvard.edu/abs/2011PhRvE..84f6103Z
    [130] Lieberman E, Hauert C, Nowak M A. Evolutionary dynamics on graphs. Nature, 2005, 433(7023):312-316 doi: 10.1038/nature03204
    [131] Ohtsuki H, Hauert C, Lieberman E, Nowak M A. A simple rule for the evolution of cooperation on graphs and social networks. Nature, 2006, 441(7092):502-505 doi: 10.1038/nature04605
    [132] Nowak M A, Tarnita C E, Antal T. Evolutionary dynamics in structured populations. Philosophical Transactions of the Royal Society of London, 2009, 365(1537):19-30 https://scholar.princeton.edu/sites/default/files/philtrans10_0.pdf
    [133] Hauert C, Imhof L A. Evolutionary games in deme structured, finite populations. Journal of Theoretical Biology, 2012, 299:106-112 doi: 10.1016/j.jtbi.2011.06.010
    [134] Vilone D, Giardini F, Paolucci M. Partner selection supports reputation-based cooperation in a Public Goods Game. Social Science Electronic Publishing, 2014. http://www.pnas.org/content/113/45/E7003.full
    [135] Efferson C, Lalive R, Fehr E. The coevolution of cultural groups and ingroup favoritism. Science, 2008, 321(5897):1844-1849 doi: 10.1126/science.1155805
    [136] Perc M, Szolnoki A. Coevolutionary games——a mini review. Biosystems, 2010, 99(2):109-125 doi: 10.1016/j.biosystems.2009.10.003
    [137] Fehl K, Van der Post D J, Semmann D. Co-evolution of behaviour and social network structure promotes human cooperation. Ecology Letters, 2011, 14(6):546-551 doi: 10.1111/j.1461-0248.2011.01615.x
    [138] Wang J, Suri S, Watts D J. Cooperation and assortativity with dynamic partner updating. Proceedings of the National Academy of Sciences of the United States of America, 2012, 109(36):14363-14368 doi: 10.1073/pnas.1120867109
    [139] Jordan J J, Rand D G, Arbesman S, Fowler J H, Christakis N A. Contagion of cooperation in static and fluid social networks. PLoS One, 2013, 8(6):Article No.e66199 doi: 10.1371/journal.pone.0066199
    [140] Zhang Y L, Liu A Z, Sun C Y. Impact of migration on the multi-strategy selection in finite group-structured populations. Scientific Reports, 2016, 6:Article No.35114 doi: 10.1038/srep35114
    [141] Zhang Y L, Su Q, Sun C Y. Intermediate-range migration furnishes a narrow margin of efficiency in the two-strategy competition. PLoS One, 2016, 11(5):Article No.e0155787 doi: 10.1371/journal.pone.0155787
    [142] Zhang Y L, Fu F, Chen X J, Xie G M, Wang L. Cooperation in group-structured populations with two layers of interactions. Scientific Reports, 2015, 5:Article No.17446 doi: 10.1038/srep17446
    [143] Fu F, Hauert C, Nowak M A, Wang L. Reputation-based partner choice promotes cooperation in social networks. Physical Review E, 2008, 78(2):Article No.026117 https://dash.harvard.edu/handle/1/4686797?show=full
    [144] Peleteiro A, Burguillo J C, Chong S Y. Exploring indirect reciprocity in complex networks using coalitions and rewiring. In:Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems. Paris, France:ACM, 2014. 669-676
    [145] Ding H, Huang J Y, Chen Y F, Ren Y Z. Don't speak to strangers:the suspicious strategy can help to improve cooperation in spatial donation game. In:Proceedings of the 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing (CIT/IUCC/DASC/PICOM). Liverpool, Britain:IEEE, 2015. 1954-1959
    [146] Phelps S. Emergence of social networks via direct and indirect reciprocity. Autonomous Agents and Multi-Agent Systems, 2013, 27(3):355-374 doi: 10.1007/s10458-012-9207-8.pdf
    [147] Han X, Shen Z S, Wang W X, Lai Y C, Grebogi C. Reconstructing direct and indirect interactions in networked public goods game. Scientific Reports, 2016, 6:Article No.30241 doi: 10.1038/srep30241
    [148] Kamvar S D, Schlosser M T, Garcia-Molina H. The eigentrust algorithm for reputation management in P2P networks. In:Proceedings of the 12th International Conference on World Wide Web. Budapest, Hungary:ACM, 2003. 640-651
    [149] Xiong L, Liu L. PeerTrust:supporting reputation-based trust for peer-to-peer electronic communities. IEEE Transactions on Knowledge and Data Engineering, 2004, 16(7):843-857 doi: 10.1109/TKDE.2004.1318566
    [150] Yu Y L, Li K Q, Jin Y W, Zhang Y. A trust management model for service-oriented distributed networks. Concurrency and Computation:Practice and Experience, 2013, 25(14):2098-2111 doi: 10.1002/cpe.v25.14
    [151] Resnick P, Zeckhauser R. Trust among strangers in internet transactions:empirical analysis of eBay's reputation system. The Economics of the Internet and E-Commerce. Amsterdam:Emerald Group Publishing Limited, 2002. 127-157
    [152] Josang A, Ismail R. The beta reputation system. In:Proceedings of the 15th Bled Electronic Commerce Conference e-Reality:Constructing the e-Economy. Bled, Slovenia, 2002. 2502-2511
    [153] Zhou R F, Hwang K. PowerTrust:a robust and scalable reputation system for trusted peer-to-peer computing. IEEE Transactions on Parallel and Distributed Systems, 2007, 18(4):460-473 doi: 10.1109/TPDS.2007.1021
    [154] Buragohain C, Agrawal D, Suri S. A game theoretic framework for incentives in P2P systems. In:Proceedings of the 3rd International Conference on Peer-To-Peer Computing. Washington DC, USA:IEEE, 2003. 48-56
    [155] Feldman M, Lai K, Stoica I, Chuang J. Robust incentive techniques for peer-to-peer networks. In:Proceedings of the 5th ACM Conference on Electronic Commerce. New York, USA:ACM, 2004. 102-111
    [156] Liu Y, Xiong N, Park J H, Yang C, Xu K. Fair incentive mechanism with pyramidal structure for peer-to-peer networks. IET Communications, 2010, 4(1):1-12 doi: 10.1049/iet-com.2008.0702
    [157] Ma R T B, Lee S C M, Lui J C S, Yau D K Y. Incentive and service differentiation in P2P networks:a game theoretic approach. IEEE/ACM Transactions on Networking, 2006, 14(5):978-991 doi: 10.1109/TNET.2006.882904
    [158] Gupta R, Somani A K. Game theory as a tool to strategize as well as predict peers' behavior in peer-to-peer networks. In:Proceedings of the 11th International Conference on Parallel and Distributed Systems. Fukuoka, Japan:IEEE, 2005. 244-249
    [159] Mortazavi B, Kesidis G. Cumulative reputation systems for peer-to-peer content distribution. In:Proceedings of the 40th Annual Conference on Information Sciences and Systems. Princeton NJ, USA:IEEE, 2006. 1546-1552
    [160] Mejia M, Peña N, Muñoz J L, Esparza O, Alzate M A. A game theoretic trust model for on-line distributed evolution of cooperation inMANETs. Journal of Network and Computer Applications, 2011, 34(1):39-51 doi: 10.1016/j.jnca.2010.09.007
    [161] Zhao B Q, Lui J C S, Chiu D M. Analysis of adaptive incentive protocols for P2P networks. In:Proceedings of the 2009 IEEE INFOCOM. Rio de Janeiro, Brazil:IEEE, 2009. 325-333
    [162] Zuo F, Zhang W. An evolutionary game-based mechanism for routing P2P network flow among selfish peers. Journal of Networks, 2014, 9(1):10-17 https://www.researchgate.net/publication/274663775_An_Evolutionary_Game-Based_Mechanism_for_Routing_P2P_Network_Flow_among_Selfish_Peers
    [163] Wang Y F, Nakao A, Vasilakos A V, Ma J H. P2P soft security:on evolutionary dynamics of P2P incentive mechanism. Computer Communications, 2011, 34(3):241-249 doi: 10.1016/j.comcom.2010.01.021
    [164] Cui G H, Li M C, Wang Z, Ren J K, Jiao D, Ma J H. Analysis and evaluation of incentive mechanisms in P2P networks:a spatial evolutionary game theory perspective. Concurrency and Computation:Practice and Experience, 2015, 27(12):3044-3064 doi: 10.1002/cpe.v27.12
    [165] Lu K, Wang J L, Li M C. An Eigentrust dynamic evolutionary model in P2P file-sharing systems. Peer-to-Peer Networking and Applications, 2016, 9(3):599-612 doi: 10.1007/s12083-015-0416-1
    [166] Chen Z D, Qiu Y H, Liu J J, Xu L. Incentive mechanism for selfish nodes in wireless sensor networks based on evolutionary game. Computers & Mathematics with Applications, 2011, 62(9):3378-3388 https://www.researchgate.net/publication/220513393_Incentive_mechanism_for_selfish_nodes_in_wireless_sensor_networks_based_on_evolutionary_game
    [167] Zhu J, Jiang D D, Yuan Y H, Fang W L. An evolutionary game theory-based channel access mechanism for wireless multimedia sensor network with rate-adaptive applications. Multimedia Tools and Applications, 2016, 75(22):14329-14349 doi: 10.1007/s11042-016-3403-5
    [168] Zhao S S, Zhu Q, Zhu H B. Evolutionary game theoretical approach to dynamic spectrum sharing. Journal of Computational Information Systems, 2012, 8(10):4225-4232 https://www.researchgate.net/publication/290229044_Evolutionary_game_theoretical_approach_to_dynamic_spectrum_sharing
    [169] Jiang C X, Chen Y, Gao Y, Liu K J R. Joint spectrum sensing and access evolutionary game in cognitive radio networks. IEEE Transactions on Wireless Communications, 2013, 12(5):2470-2483 doi: 10.1109/TWC.2013.031813.121135
    [170] Wu D, Liu H, Bi Y R, Zhu H S. Evolutionary game theoretic modeling and repetition of media distributed shared in P2P-based VANET. International Journal of Distributed Sensor Networks, 2014, 4(6):Article No.718639 https://www.researchgate.net/publication/275065915_Evolutionary_Game_Theoretic_Modeling_and_Repetition_of_Media_Distributed_Shared_in_P2P-Based_VANET
    [171] 张慧, 王坤峰, 王飞跃.深度学习在目标视觉检测中的应用进展与展望.自动化学报, 2017, 43(8):1289-1305 http://www.aas.net.cn/CN/abstract/abstract19104.shtml

    Zhang Hui, Wang Kun-Feng, Wang Fei-Yue. Advances and perspectives on applications of deep learning in visual object detection. Acta Automatica Sinica, 2017, 43(8):1289-1305 http://www.aas.net.cn/CN/abstract/abstract19104.shtml
    [172] 游科友, 谢立华.网络控制系统的最新研究综述.自动化学报, 2013, 39(2):101-118 http://www.aas.net.cn/CN/abstract/abstract17806.shtml

    You Ke-You, Xie Li-Hua. Survey of recent progress in networked control systems. Acta Automatica Sinica, 2013, 39(2):101-118 http://www.aas.net.cn/CN/abstract/abstract17806.shtml
    [173] 王丽媛, 郭戈, 庄严.网络控制系统发送功率分配问题研究.自动化学报, 2017, 43(8):1350-1357 http://www.aas.net.cn/CN/abstract/abstract19109.shtml

    Wang Li-Yuan, Guo Ge, Zhuang Yan. Transmission power allocation for networked control systems. Acta Automatica Sinica, 2017, 43(8):1350-1357 http://www.aas.net.cn/CN/abstract/abstract19109.shtml
    [174] 胡艳艳, 金增旺, 薛晓玲, 孙长银.基于异步IMM融合滤波的网络化系统故障诊断.自动化学报, 2017, 43(8):1329-1338 http://www.aas.net.cn/CN/abstract/abstract19107.shtml

    Hu Yan-Yan, Jin Zeng-Wang, Xue Xiao-Ling, Sun Chang-Yin. Fault diagnosis for networked systems by asynchronous IMM fusion filtering. Acta Automatica Sinica, 2017, 43(8):1329-1338 http://www.aas.net.cn/CN/abstract/abstract19107.shtml
  • 期刊类型引用(12)

    1. 孙圣力,何怡萱,李伟平. 产学合作演化博弈研究:以小核酸产业为例. 系统工程学报. 2024(03): 321-332 . 百度学术
    2. 毕文豪,王炤晰,吴伟,张安. 基于公共品博弈的无人机集群自主协同机制. 兵工学报. 2023(11): 3407-3421 . 百度学术
    3. 张艳玲,莫廷钰,李松涛,张妍,李擎. 演化博弈与资源配置综述. 工程科学学报. 2022(03): 402-410 . 百度学术
    4. 张文明,许洁,杨雯秀. 社会演进视角下受助者感恩与讹诈行为的仿真研究. 运筹与管理. 2022(04): 211-216 . 百度学术
    5. 张捷,陆阳,张本宏,刘广亮. 面向软件演化的可靠性分析代数方法. 自动化学报. 2021(01): 148-160 . 本站查看
    6. 舒明炳,周永辉. 带成本性的背叛行动对间接互惠种群进化博弈的影响. 贵州师范大学学报(自然科学版). 2021(03): 65-71 . 百度学术
    7. 程乐峰,杨汝,王晓刚,余涛. 三方多策略式博弈系统的长期演化稳定均衡特性研究. 控制理论与应用. 2021(10): 1631-1661 . 百度学术
    8. 全吉,周亚文,王先甲. 社会困境博弈中群体合作行为演化研究综述. 复杂系统与复杂性科学. 2020(01): 1-14 . 百度学术
    9. 许成磊,赵陈芳,段万春. 低聚度决策主体的信任元协同获取与位势演化. 中国管理科学. 2020(05): 176-188 . 百度学术
    10. 张倩,张延迟,解大. 含分布式能源的电网优化调度研究. 上海电机学院学报. 2019(03): 130-134+140 . 百度学术
    11. 张琦琮,朱立谷. 基于完全图网络的镜像激励机制研究. 中国传媒大学学报(自然科学版). 2019(04): 31-37+49 . 百度学术
    12. 王先甲,顾翠伶,赵金华,全吉. 随机演化动态及其合作机制研究综述. 系统科学与数学. 2019(10): 1533-1552 . 百度学术

    其他类型引用(23)

  • 加载中
  • 图(4) / 表(3)
    计量
    • 文章访问数:  2121
    • HTML全文浏览量:  460
    • PDF下载量:  1236
    • 被引次数: 35
    出版历程
    • 收稿日期:  2017-04-14
    • 录用日期:  2017-09-06
    • 刊出日期:  2018-01-01

    目录

    /

    返回文章
    返回