Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Personalized multi-tier federated learning
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0002-3451-2851
Umeå University, Faculty of Science and Technology, Department of Mathematics and Mathematical Statistics.ORCID iD: 0000-0001-7320-1506
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0002-9842-7840
2022 (English)Conference paper, Poster (with or without abstract) (Refereed)
Abstract [en]

The challenge of personalized federated learning (pFL) is to capture the heterogeneity properties of data with in-expensive communications and achieving customized performance for devices. To address that challenge, we introduced personalized multi-tier federated learning using Moreau envelopes (pFedMT) when there are known cluster structures within devices. Moreau envelopes are used as the devices’ and teams’ regularized loss functions. Empirically, we verify that the personalized model performs better than vanilla FedAvg, per-FedAvg, and pFedMe. pFedMT achieves 98.30% and 99.71% accuracy on MNIST dataset under convex and non-convex settings, respectively.

Place, publisher, year, edition, pages
2022.
Keywords [en]
Multi-tier Federate Learning, Personalization, Statistical Heterogeneity, Distributed Optimization, In-expensive Communication, Moreau Envelope
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:umu:diva-200943OAI: oai:DiVA.org:umu-200943DiVA, id: diva2:1709961
Conference
FL-NeurIPS'22, International Workshop on Federated Learning: Recent Advances and New Challenges in Conjunction with NeurIPS 2022, New Orleans, LA, USA, December 2, 2022
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)Available from: 2022-11-10 Created: 2022-11-10 Last updated: 2024-08-26Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Full text

Authority records

Banerjee, SourasekharYurtsever, AlpBhuyan, Monowar H.

Search in DiVA

By author/editor
Banerjee, SourasekharYurtsever, AlpBhuyan, Monowar H.
By organisation
Department of Computing ScienceDepartment of Mathematics and Mathematical Statistics
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 503 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf