Aakriti Budhraja

According to our database, Aakriti Budhraja authored at least 4 papers between 2020 and 2021.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2021

On the Prunability of Attention Heads in Multilingual BERT.

Aakriti Budhraja, Madhura Pande, Pratyush Kumar, Mitesh M. Khapra

CoRR, 2021

The Heads Hypothesis: A Unifying Statistical Approach Towards Understanding Multi-Headed Attention in BERT.

Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

On the Importance of Local Information in Transformer Based Models.

Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra

CoRR, 2020

On the weak link between importance and prunability of attention heads.

Aakriti Budhraja, Madhura Pande, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020