Comparative federated algorithms for solving non-iid data challenges

This study compares three Federated Learning (FL) algorithms—FedAvg, FedProx, and MOON—by evaluating their performance in both IID and non-IID settings. We found that FedAvg performs best in IID scenarios, offering quick convergence and high accuracy. However, in non-IID settings, MOON stood out as the top performer, thanks to its contrastive learning method, providing better stability and accuracy across heterogeneous data. FedProx showed improvements over FedAvg in handling non-IID data but was less effective than MOON. Our findings suggest that for environments with IID data, FedAvg is ideal, while MOON is more suitable for non-IID cases. We also highlight the need for further research into personalized FL, regularization techniques, and the integration of multimodal data.