Michael G. Rabbat

Orcid: 0000-0003-0536-7904

Affiliations:
  • Facebook AI Research, Montreal, Canada


According to our database1, Michael G. Rabbat authored at least 190 papers between 2003 and 2024.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
DINOv2: Learning Robust Visual Features without Supervision.
Trans. Mach. Learn. Res., 2024

Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces.
CoRR, 2024

The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More.
CoRR, 2024

Revisiting Feature Prediction for Learning Visual Representations from Video.
CoRR, 2024

DP-RDM: Adapting Diffusion Models to Private Domains Without Fine-Tuning.
CoRR, 2024

Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping.
CoRR, 2024

Embracing Diversity: Interpretable Zero-shot Classification Beyond One Vector Per Class.
Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, 2024

2023
lo-fi: distributed fine-tuning without communication.
Trans. Mach. Learn. Res., 2023

A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale.
CoRR, 2023

Benchmarking Neural Network Training Algorithms.
CoRR, 2023

DINOv2: Learning Robust Visual Features without Supervision.
CoRR, 2023

Green Federated Learning.
CoRR, 2023

Privacy-Aware Compression for Federated Learning Through Numerical Mechanism Design.
Proceedings of the International Conference on Machine Learning, 2023

Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning.
Proceedings of the Eleventh International Conference on Learning Representations, 2023

The hidden uniform cluster prior in self-supervised learning.
Proceedings of the Eleventh International Conference on Learning Representations, 2023

Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture.
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

2022
FedShuffle: Recipes for Better Use of Local Work in Federated Learning.
Trans. Mach. Learn. Res., 2022

The Interpolated MVU Mechanism For Communication-efficient Private Federated Learning.
CoRR, 2022

The Hidden Uniform Cluster Prior in Self-Supervised Learning.
CoRR, 2022

Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning.
CoRR, 2022

Positive Unlabeled Contrastive Learning.
CoRR, 2022

Privacy-aware compression for federated data analysis.
Proceedings of the Uncertainty in Artificial Intelligence, 2022

Towards Fair Federated Recommendation Learning: Characterizing the Inter-Dependence of System and Data Heterogeneity.
Proceedings of the RecSys '22: Sixteenth ACM Conference on Recommender Systems, Seattle, WA, USA, September 18, 2022


PAPAYA: Practical, Private, and Scalable Federated Learning.
Proceedings of the Fifth Conference on Machine Learning and Systems, 2022

Federated Learning with Partial Model Personalization.
Proceedings of the International Conference on Machine Learning, 2022

Masked Siamese Networks for Label-Efficient Learning.
Proceedings of the Computer Vision - ECCV 2022, 2022

Federated Learning with Buffered Asynchronous Aggregation.
Proceedings of the International Conference on Artificial Intelligence and Statistics, 2022

2021
Asynchronous Gradient Push.
IEEE Trans. Autom. Control., 2021

Sustainable AI: Environmental Implications, Challenges and Opportunities.
CoRR, 2021

Trade-offs of Local SGD at Scale: An Empirical Study.
CoRR, 2021

Stochastic Polyak Stepsize with a Moving Target.
CoRR, 2021

Understanding and Improving Failure Tolerant Training for Deep Learning Recommendation with Partial Recovery.
Proceedings of the Fourth Conference on Machine Learning and Systems, 2021

Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samples.
Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Learning with Gradient Descent and Weakly Convex Losses.
Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 2021

2020
Optimization for Data-Driven Learning and Control.
Proc. IEEE, 2020

Advances in Asynchronous Parallel and Distributed Optimization.
Proc. IEEE, 2020

CPR: Understanding and Improving Failure Tolerant Training for Deep Learning Recommendation with Partial Recovery.
CoRR, 2020

A Closer Look at Codistillation for Distributed Training.
CoRR, 2020

Recovering Petaflops in Contrastive Semi-Supervised Learning of Visual Representations.
CoRR, 2020

Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge.
CoRR, 2020

On the Convergence of Nesterov's Accelerated Gradient Method in Stochastic Settings.
Proceedings of the 37th International Conference on Machine Learning, 2020

SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum.
Proceedings of the 8th International Conference on Learning Representations, 2020

Lookahead Converges to Stationary Points of Smooth Non-convex Functions.
Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

Stability of Decentralized Gradient Descent in Open Multi-Agent Systems.
Proceedings of the 59th IEEE Conference on Decision and Control, 2020

2019
Graph-Based Compression for Distributed Particle Filters.
IEEE Trans. Signal Inf. Process. over Networks, 2019

Improved Bounds for Max Consensus in Wireless Networks.
IEEE Trans. Signal Inf. Process. over Networks, 2019

Learning Graphs From Data: A Signal Representation Perspective.
IEEE Signal Process. Mag., 2019

MVFST-RL: An Asynchronous RL Framework for Congestion Control with Delayed Actions.
CoRR, 2019

Gossip-based Actor-Learner Architectures for Deep Reinforcement Learning.
Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

TarMAC: Targeted Multi-Agent Communication.
Proceedings of the 36th International Conference on Machine Learning, 2019

Stochastic Gradient Push for Distributed Deep Learning.
Proceedings of the 36th International Conference on Machine Learning, 2019

Provably Accelerated Randomized Gossip Algorithms.
Proceedings of the IEEE International Conference on Acoustics, 2019

2018
Characterization and Inference of Graph Diffusion Processes From Observations of Stationary Signals.
IEEE Trans. Signal Inf. Process. over Networks, 2018

Memory Vectors for Similarity Search in High-Dimensional Spaces.
IEEE Trans. Big Data, 2018

Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization.
Proc. IEEE, 2018

Temporal evolution of the degree distribution of alters in growing networks.
Netw. Sci., 2018

Effectiveness of Alter Sampling in Social Networks.
CoRR, 2018

fastMRI: An Open Dataset and Benchmarks for Accelerated MRI.
CoRR, 2018

Asynchronous Subgradient-Push.
CoRR, 2018

A Graph-CNN for 3D Point Cloud Classification.
Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

2017
A Multisensor Multi-Bernoulli Filter.
IEEE Trans. Signal Process., 2017

Time-Varying Mixtures of Markov Chains: An Application to Road Traffic Modeling.
IEEE Trans. Signal Process., 2017

Inferring Structural Characteristics of Networks With Strong and Weak Ties From Fixed-Choice Surveys.
IEEE Trans. Signal Inf. Process. over Networks, 2017

Cooperative Special Issue on Graph Signal Processing in the IEEE Journal of Selected Topics in Signal Processing and the IEEE Transactions on Signal and Information Processing Over Networks.
IEEE Trans. Signal Inf. Process. over Networks, 2017

Introduction to the IEEE Journal on Selected Topics in Signal Processing and IEEE Transactions on Signal and Information Processing Over Networks Joint Special Issue on Graph Signal Processing.
IEEE J. Sel. Top. Signal Process., 2017

Inferring sparse graphs from smooth signals with theoretical guarantees.
Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

An empirical comparison of multi-agent optimization algorithms.
Proceedings of the 2017 IEEE Global Conference on Signal and Information Processing, 2017

Algorithms for the multi-sensor assignment problem in the δ-generalized labeled multi-Bernoulli filter.
Proceedings of the 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2017

2016
Fault-Tolerant Associative Memories Based on c-Partite Graphs.
IEEE Trans. Signal Process., 2016

Efficient Distributed Online Prediction and Stochastic Optimization With Approximate Distributed Averaging.
IEEE Trans. Signal Inf. Process. over Networks, 2016

Detecting Convoys Using License Plate Recognition Data.
IEEE Trans. Signal Inf. Process. over Networks, 2016

Storing Sequences in Binary Tournament-Based Neural Networks.
IEEE Trans. Neural Networks Learn. Syst., 2016

On the Convergence of Alternating Direction Lagrangian Methods for Nonconvex Structured Optimization Problems.
IEEE Trans. Control. Netw. Syst., 2016

Distributed Finite-Time Computation of Digraph Parameters: Left-Eigenvector, Out-Degree and Spectrum.
IEEE Trans. Control. Netw. Syst., 2016

Multisensor CPHD filter.
IEEE Trans. Aerosp. Electron. Syst., 2016

A Distributed Particle Filter for Bearings-Only Tracking on Spherical Surfaces.
IEEE Signal Process. Lett., 2016

Characterization and inference of weighted graph topologies from observations of diffused signals.
CoRR, 2016

Qualities and Inequalities in Online Social Networks through the Lens of the Generalized Friendship Paradox.
CoRR, 2016

On reconstructability of quadratic utility functions from the iterations in gradient methods.
Autom., 2016

Inferring network properties from fixed-choice design with strong and weak ties.
Proceedings of the IEEE Statistical Signal Processing Workshop, 2016

Estimation of time-varying mixture models: An application to traffic estimation.
Proceedings of the IEEE Statistical Signal Processing Workshop, 2016

Distributed multi-sensor CPHD filter using pairwise gossiping.
Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

Graph Laplacian distributed particle filtering.
Proceedings of the 24th European Signal Processing Conference, 2016

Efficient Large-Scale Similarity Search Using Matrix Factorization.
Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016

Totally asynchronous distributed estimation of eigenvector centrality in digraphs with application to the PageRank problem.
Proceedings of the 55th IEEE Conference on Decision and Control, 2016

2015
Error Propagation in Gossip-Based Distributed Particle Filters.
IEEE Trans. Signal Inf. Process. over Networks, 2015

General solution and approximate implementation of the multisensor multitarget CPHD filter.
Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

Toward an uncertainty principle for weighted graphs.
Proceedings of the 23rd European Signal Processing Conference, 2015

Measuring the Generalized Friendship Paradox in Networks with Quality-Dependent Connectivity.
Proceedings of the Complex Networks VI, 2015

Performance investigation on constraint sufficient statistics distributed particle filter.
Proceedings of the IEEE 28th Canadian Conference on Electrical and Computer Engineering, 2015

Multi-agent mirror descent for decentralized stochastic optimization.
Proceedings of the 6th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2015

Particle weight approximation with clustering for gossip-based distributed particle filters.
Proceedings of the 6th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2015

Graph reconstruction from the observation of diffused signals.
Proceedings of the 53rd Annual Allerton Conference on Communication, 2015

2014
Active Learning of Multiple Source Multiple Destination Topologies.
IEEE Trans. Signal Process., 2014

Introduction to the Special Issue on Non-Cooperative Localization Networks.
IEEE J. Sel. Top. Signal Process., 2014

Combating Corrupt Messages in Sparse Clustered Associative Memories.
CoRR, 2014

Generalized Friendship Paradox: An Analytical Approach.
Proceedings of the Social Informatics - SocInfo 2014 International Workshops, Barcelona, 2014

Tradeoffs for task parallelization in distributed optimization.
Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing, 2014

Subspace synchronization: A network-coding approach to object reconciliation.
Proceedings of the 2014 IEEE International Symposium on Information Theory, Honolulu, HI, USA, June 29, 2014

Towards a spectral characterization of signals supported on small-world networks.
Proceedings of the IEEE International Conference on Acoustics, 2014

Cluster-based associative memories built from unreliable storage.
Proceedings of the IEEE International Conference on Acoustics, 2014

A GPU-based associative memory using sparse Neural Networks.
Proceedings of the International Conference on High Performance Computing & Simulation, 2014

Asynchronous decentralized optimization in heterogeneous systems.
Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

Sparse binary matrices as efficient associative memories.
Proceedings of the 52nd Annual Allerton Conference on Communication, 2014

On the convergence of an alternating direction penalty method for nonconvex problems.
Proceedings of the 48th Asilomar Conference on Signals, Systems and Computers, 2014

Detecting convoys in networks of short-ranged sensors.
Proceedings of the 48th Asilomar Conference on Signals, Systems and Computers, 2014

The ADMM algorithm for distributed averaging: Convergence rates and optimal parameter selection.
Proceedings of the 48th Asilomar Conference on Signals, Systems and Computers, 2014

2013
Broadcast Gossip Algorithms for Consensus on Strongly Connected Digraphs.
IEEE Trans. Signal Process., 2013

Multiscale Gossip for Efficient Decentralized Averaging in Wireless Packet Networks.
IEEE Trans. Signal Process., 2013

Background Subtraction for Online Calibration of Baseline RSS in RF Sensing Networks.
IEEE Trans. Mob. Comput., 2013

The Effect of Exogenous Inputs and Defiant Agents on Opinion Dynamics With Local and Global Interactions.
IEEE J. Sel. Top. Signal Process., 2013

A Massively Parallel Associative Memory Based on Sparse Neural Networks
CoRR, 2013

Bounds on associative memories
CoRR, 2013

Improving Sparse Associative Memories by Escaping from Bogus Fixed Points.
CoRR, 2013

Degree Correlation in Scale-Free Graphs.
CoRR, 2013

Voter Model with Arbitrary Degree Dependence: Clout, Confidence and Irreversibility.
CoRR, 2013

Maximum likelihood associative memories.
Proceedings of the 2013 IEEE Information Theory Workshop, 2013

Reconstructing a graph from path traces.
Proceedings of the 2013 IEEE International Symposium on Information Theory, 2013

Consensus-based distributed online prediction and optimization.
Proceedings of the IEEE Global Conference on Signal and Information Processing, 2013

Networked optimization with adaptive communication.
Proceedings of the IEEE Global Conference on Signal and Information Processing, 2013

Simple iteration-optimal distributed optimization.
Proceedings of the 21st European Signal Processing Conference, 2013

Performance comparison of randomized gossip, broadcast gossip and collection tree protocol for distributed averaging.
Proceedings of the 5th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2013

Sparse structured associative memories as efficient set-membership data structures.
Proceedings of the 51st Annual Allerton Conference on Communication, 2013

Distributed underwater acoustic source localization and tracking.
Proceedings of the 2013 Asilomar Conference on Signals, 2013

2012
Directed by Directionality: Benefiting from the Gain Pattern of Active RFID Badges.
IEEE Trans. Mob. Comput., 2012

Anomaly Detection Using Proximity Graph and PageRank Algorithm.
IEEE Trans. Inf. Forensics Secur., 2012

GSGS: A Computational Approach to Reconstruct Signaling Pathway Structures from Gene Sets.
IEEE ACM Trans. Comput. Biol. Bioinform., 2012

GANC: Greedy agglomerative normalized cut for graph clustering.
Pattern Recognit., 2012

Network Growth with Arbitrary Initial Conditions: Analytical Results for Uniform and Preferential Attachment
CoRR, 2012

Forwarding Without Repeating: Efficient Rumor Spreading in Bounded-Degree Graphs
CoRR, 2012

Dynamics of Infuence on Hierarchical Structures: Towards the Statistical Mechanics of Social Class Struggle
CoRR, 2012

The Impact of Communication Delays on Distributed Consensus Algorithms
CoRR, 2012

Bounded confidence opinion dynamics with network constraints and localized distributed averaging.
Proceedings of the IEEE Statistical Signal Processing Workshop, 2012

TOP-K selective gossip.
Proceedings of the 13th IEEE International Workshop on Signal Processing Advances in Wireless Communications, 2012

Communication/Computation Tradeoffs in Consensus-Based Distributed Optimization.
Proceedings of the Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3-6, 2012

Compressing multisets using tries.
Proceedings of the 2012 IEEE Information Theory Workshop, 2012

Random clique codes.
Proceedings of the 7th International Symposium on Turbo Codes and Iterative Information Processing, 2012

Approximating signals supported on graphs.
Proceedings of the 2012 IEEE International Conference on Acoustics, 2012

Graph spectral compressed sensing for sensor networks.
Proceedings of the 2012 IEEE International Conference on Acoustics, 2012

Efficiently reaching consensus on the largest entries of a vector.
Proceedings of the 51th IEEE Conference on Decision and Control, 2012

Push-Sum Distributed Dual Averaging for convex optimization.
Proceedings of the 51th IEEE Conference on Decision and Control, 2012

Data aggregation in wireless sensor networks: A comparison of collection tree protocols and gossip algorithms.
Proceedings of the 25th IEEE Canadian Conference on Electrical and Computer Engineering, 2012

Distributed dual averaging for convex optimization under communication delays.
Proceedings of the American Control Conference, 2012

Distributed strongly convex optimization.
Proceedings of the 50th Annual Allerton Conference on Communication, 2012

Consensus-based distributed optimization: Practical issues and applications in large-scale machine learning.
Proceedings of the 50th Annual Allerton Conference on Communication, 2012

Growing a network on a given substrate.
Proceedings of the 50th Annual Allerton Conference on Communication, 2012

Migration in a small world: A network approach to modeling immigration processes.
Proceedings of the 50th Annual Allerton Conference on Communication, 2012

Convergence properties of normalized random incremental gradient algorithms for least-squares source localization.
Proceedings of the Conference Record of the Forty Sixth Asilomar Conference on Signals, 2012

Session MP1b: Signal processing and learning in complex systems (invited).
Proceedings of the Conference Record of the Forty Sixth Asilomar Conference on Signals, 2012

2011
Efficient Decentralized Approximation via Selective Gossip.
IEEE J. Sel. Top. Signal Process., 2011

Cross-Layer Monitoring in Transparent Optical Networks.
JOCN, 2011

GANC: Greedy Agglomerative Normalized Cut
CoRR, 2011

Large scale probabilistic available bandwidth estimation.
Comput. Networks, 2011

A correlation model for shadow fading in multi-hop wireless networks.
Proceedings of the 2011 Spring Simulation Multi-conference, 2011

Sequential Monte Carlo for simultaneous passive device-free tracking and sensor localization using received signal strength measurements.
Proceedings of the 10th International Conference on Information Processing in Sensor Networks, 2011

Distributed auxiliary particle filters using selective gossip.
Proceedings of the IEEE International Conference on Acoustics, 2011

RSS-based node localization in the presence of attenuating objects.
Proceedings of the IEEE International Conference on Acoustics, 2011

Local silencing rules for randomized gossip.
Proceedings of the Distributed Computing in Sensor Systems, 2011

Distributed consensus and optimization under communication delays.
Proceedings of the 49th Annual Allerton Conference on Communication, 2011

2010
Greedy gossip with eavesdropping.
IEEE Trans. Signal Process., 2010

Optimization and analysis of distributed averaging with short node memory.
IEEE Trans. Signal Process., 2010

Gossip Algorithms for Distributed Signal Processing.
Proc. IEEE, 2010

Real-Time Multi-path Tracking of Probabilistic Available Bandwidth
CoRR, 2010

Multi-path Probabilistic Available Bandwidth Estimation through Bayesian Active Learning
CoRR, 2010

Fast Decentralized Averaging via Multi-scale Gossip.
Proceedings of the Distributed Computing in Sensor Systems, 2010

2009
Distributed adaptive diverse routing for voice-over-IP in service overlay networks.
IEEE Trans. Netw. Serv. Manag., 2009

The speed of greed: Characterizing myopic gossip through network voracity.
Proceedings of the IEEE International Conference on Acoustics, 2009

Multi-hop Greedy Gossip with Eavesdropping.
Proceedings of the 12th International Conference on Information Fusion, 2009

Compressed RF Tomography for Wireless Sensor Networks: Centralized and Decentralized Approaches.
Proceedings of the Distributed Computing in Sensor Systems, 2009

Optimization and analysis of distributed averaging with memory.
Proceedings of the 47th Annual Allerton Conference on Communication, 2009

2008
Distributed Average Consensus With Dithered Quantization.
IEEE Trans. Signal Process., 2008

Network Inference From Co-Occurrences.
IEEE Trans. Inf. Theory, 2008

Compressed Sensing for Networked Data.
IEEE Signal Process. Mag., 2008

Learning Minimum Delay Paths in Service Overlay Networks.
Proceedings of The Seventh IEEE International Symposium on Networking Computing and Applications, 2008

Greedy gossip with eavesdropping.
Proceedings of the Third International Symposium on Wireless Pervasive Computing, 2008

Rates of convergence for greedy gossip with eavesdropping.
Proceedings of the 46th Annual Allerton Conference on Communication, 2008

Learning Bigrams from Unigrams.
Proceedings of the ACL 2008, 2008

2007
Compressed network monitoring for ip and all-optical networks.
Proceedings of the 7th ACM SIGCOMM Internet Measurement Conference, 2007

Genomic Network Tomography.
Proceedings of the IEEE International Conference on Acoustics, 2007

2006
Multiple-Source Internet Tomography.
IEEE J. Sel. Areas Commun., 2006

Inferring Network Structure from Co-Occurrences.
Proceedings of the Advances in Neural Information Processing Systems 19, 2006

Decentralized compression and predistribution via randomized gossiping.
Proceedings of the Fifth International Conference on Information Processing in Sensor Networks, 2006

2005
Quantized incremental algorithms for distributed optimization.
IEEE J. Sel. Areas Commun., 2005

Understanding the topology of a telephone network via internally-sensed network tomography.
Proceedings of the 2005 IEEE International Conference on Acoustics, 2005

Robust decentralized source localization via averaging.
Proceedings of the 2005 IEEE International Conference on Acoustics, 2005

2004
Distributed optimization in sensor networks.
Proceedings of the Third International Symposium on Information Processing in Sensor Networks, 2004

Multiple Source, Multiple Destination Network Tomography.
Proceedings of the Proceedings IEEE INFOCOM 2004, 2004

Decentralized source localization and tracking [wireless sensor networks].
Proceedings of the 2004 IEEE International Conference on Acoustics, 2004

2003
Merging logical topologies using end-to-end measurements.
Proceedings of the 3rd ACM SIGCOMM Internet Measurement Conference, 2003


  Loading...