書記信箱 校長信箱 學生郵件 教工郵件
信息公開 綜合信息網 網站地圖 English
您當前所在位置: 首頁 > 講座報告 > 正文
講座報告

Differentially Private Distributed Machine Learning

来源:廣州研究院          点击:
報告人 潘淼 副教授 時間 12月16日9:00
地點 騰訊會議直播 报告時間

講座名稱:Differentially Private Distributed Machine Learning

講座人:潘淼 副教授

講座時間:12月16日9:00

講座地點:騰訊會議直播(会议ID:348908387)

 

 

座人介紹:

潘淼,休斯敦大学电子与计算机工程系副教授,曾获得2014年NSF CAREER Award。2012年8月获得佛罗里达大学电气与计算机工程博士学位。研究方向包括网络空间安全、深度学习隐私、大数据隐私、水下无线通信与网络、认知无线电网络等。在著名期刊和会议上发表论文两百余篇,其中包括IEEE/ACM Transactions on Networking、IEEE Journal on Selected Areas in Communications、IEEE Transactions on Mobile Computing和IEEE INFOCOM等。

 

 

講座内容:

Nowadays, the development of machine learning shows great potential in a variety of fields, such as retail, advertisement, manufacturing, healthcare, and insurance. Although machine learning has infiltrated into many areas due to its advantages, a vast amount of data has been generated at an ever-increasing rate, which leads to significant computational complexity for data collection and processing via a centralized machine learning approach. Distributed machine learning thus has received huge interests due to its capability of exploiting the collective computing power of edge devices. However, during the learning process, model updates using local private samples and large-scale parameter exchanges among agents impose severe privacy concerns and communication burdens. To address those challenges, we will present three recent works integrating differential privacy (DP) with Alternating Direction Method of Multipliers (ADMM) and Decentralized gradient descent, two promising optimization methods to achieve distributed machine learning. First, we propose a differentially private robust ADMM algorithm by adding Gaussian noise with decaying variance to perturb exchanged variables at each iteration, where two kinds of noise variance decay schemes are proposed to reduce the negative effects of noise addition and maintain the convergence behaviors. Second, in order to release the shackles of the exact optimal solution during each ADMM iteration to ensure DP, we consider outputting a noisy approximate solution for the perturbed objective and further adopting sparse vector technique to determine if an agent should update its neighbors with the current perturbed solution to avoid the redundant privacy loss accumulation and reduce the communication cost. Third, we develop a differentially private and communication efficient decentralized gradient descent method which will update the local models by integrating DP noise and random quantization operator to simultaneously enforce DP and communication efficiency.

 

 

主辦單位:廣州研究院

123

南校區地址:陝西省西安市西沣路興隆段266號

郵編:710126

北校區地址:陝西省西安市太白南路2號

郵編:710071

電話:029-88201000

訪問量:

版權所有:西安電子科技大學     陝ICP備05016463號     建設與運維:信息網絡技術中心