×
2025
Jamba: Hybrid Transformer-Mamba Language Models.
[DOI]
Barak Lenz
,
Opher Lieber
,
Alan Arazi
,
Amir Bergman
,
Avshalom Manevich
,
Barak Peleg
,
Ben Aviram
,
Chen Almagor
,
Clara Fridman
,
Dan Padnos
,
Daniel Gissin
,
Daniel Jannai
,
Dor Muhlgay
,
Dor Zimberg
,
Edden M. Gerber
,
Elad Dolev
,
Eran Krakovsky
,
Erez Safahi
,
Erez Schwartz
,
Gal Cohen
,
et al.
Proceedings of the Thirteenth International Conference on Learning Representations, 2025
2024
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale.
[DOI]
Barak Lenz
,
Alan Arazi
,
Amir Bergman
,
Avshalom Manevich
,
Barak Peleg
,
Ben Aviram
,
Chen Almagor
,
Clara Fridman
,
Dan Padnos
,
Daniel Gissin
,
Daniel Jannai
,
Dor Muhlgay
,
Dor Zimberg
,
Edden M. Gerber
,
Elad Dolev
,
Eran Krakovsky
,
Erez Safahi
,
Erez Schwartz
,
Gal Cohen
,
Gal Shachaf
,
Haim Rozenblum
,
Hofit Bata
,
Ido Blass
,
Inbal Magar
,
Itay Dalmedigos
,
Jhonathan Osin
,
Julie Fadlon
,
Maria Rozman
,
Matan Danos
,
Michael Gokhman
,
Mor Zusman
,
Naama Gidron
,
Nir Ratner
,
Noam Gat
,
Noam Rozen
,
Oded Fried
,
Ohad Leshno
,
Omer Antverg
,
Omri Abend
,
Opher Lieber
,
Or Dagan
,
Orit Cohavi
,
Raz Alon
,
Ro'i Belson
,
Roi Cohen
,
Rom Gilad
,
Roman Glozman
,
Shahar Lev
,
Shaked Meirom
,
Tal Delbari
,
Tal Ness
,
Tomer Asida
,
Tom Ben Gal
,
Tom Braude
,
Uriya Pumerantz
,
Yehoshua Cohen
,
Yonatan Belinkov
,
Yuval Globerson
,
Yuval Peleg Levy
,
Yoav Shoham
CoRR, 2024