metaai·lightalo unofficial · independent

The papers

Every star in this catalog links to its sources. This is what those sources look like as one body of work: 74 arXiv papers, and how often the rest of the field has cited each one back. It is the shortest route from "that sounds interesting" to the actual research.

Citation counts from the Semantic Scholar Graph API, read 2026-11-02 and refreshed weekly.

74papers in the catalog
264kcitations of them, in total
40kof those judged influential
679median citations per paper
2016–2026publication years covered

Where to start

The twelve most-cited, which is a reasonable reading order for anyone new to the field. Bear in mind that a 2017 paper has had eight years to accumulate what a 2025 paper has had months for, so this ranks foundations, not importance.

All 74 papers

Sort by any column; filter by constellation or search the titles. Paper titles open on arXiv, project names open that project's page here.

74 papers
Constellation Venue
Mask R-CNN Mask R-CNN Vision 2017 33,790 4447
RoBERTa: A Robustly Optimized BERT Pretraining Approach RoBERTa Language & LLMs 2019 arXiv.org 32,372 6328
LLaMA: Open and Efficient Foundation Language Models LLaMA Language & LLMs 2023 arXiv.org 22,456 2297
The Llama 3 Herd of Models Llama 3 / 3.1 / 3.2 / 3.3 Language & LLMs 2024 20,541 3731
Llama 2: Open Foundation and Fine-Tuned Chat Models Llama 2 Language & LLMs 2023 arXiv.org 18,886 2332
Segment Anything Segment Anything Vision 2023 IEEE International Conference on C 16,654 2186
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension BART Language & LLMs 2019 Annual Meeting of the Association 13,542 2499
DINOv2: Learning Robust Visual Features without Supervision DINOv2 Vision 2023 Trans. Mach. Learn. Res. 11,794 1691
Enriching Word Vectors with Subword Information fastText Open Source Infra 2016 Transactions of the Association fo 11,227 1085
Emerging Properties in Self-Supervised Vision Transformers DINO Vision 2021 IEEE International Conference on C 10,855 1785
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations wav2vec 2.0 Speech & Sound 2020 Neural Information Processing Syst 9,848 3514
Unsupervised Cross-lingual Representation Learning at Scale XLM-R Language & LLMs 2019 Annual Meeting of the Association 9,773 1914
OPT: Open Pre-trained Transformer Language Models OPT-175B Language & LLMs 2022 arXiv.org 5,143 544
SAM 2: Segment Anything in Images and Videos SAM 2 Vision 2024 International Conference on Learni 4,746 698
Code Llama: Open Foundation Models for Code Code Llama Language & LLMs 2023 arXiv.org 3,722 408
fairseq: A Fast, Extensible Toolkit for Sequence Modeling fairseq Language & LLMs 2019 North American Chapter of the Asso 3,533 296
Make-A-Video: Text-to-Video Generation without Text-Video Data Make-A-Video Generative Media 2022 International Conference on Learni 2,249 111
Ego4D: Around the World in 3,000 Hours of Egocentric Video Ego4D World Models & Embodied AI 2021 Computer Vision and Pattern Recogn 2,206 297
No Language Left Behind: Scaling Human-Centered Machine Translation No Language Left Behind Speech & Sound 2022 arXiv.org 2,160 188
VGGT: Visual Geometry Grounded Transformer VGGT Vision 2025 Computer Vision and Pattern Recogn 2,132 535
ImageBind One Embedding Space to Bind Them All ImageBind Vision 2023 Computer Vision and Pattern Recogn 1,897 242
DINOv3 DINOv3 Vision 2025 1,883 336
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture I-JEPA World Models & Embodied AI 2023 Computer Vision and Pattern Recogn 1,532 184
Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations Purple Llama Safety & Trust 2023 arXiv.org 1,515 230
SAM 3: Segment Anything with Concepts SAM 3 Vision 2025 arXiv.org 1,386 223
GAIA: a benchmark for General AI Assistants GAIA Benchmark Safety & Trust 2023 arXiv.org 1,386 226
Accelerating 3D deep learning with PyTorch3D PyTorch3D Vision 2019 SIGGRAPH Asia 2020 Courses 1,221 92
Galactica: A Large Language Model for Science Galactica Language & LLMs 2022 arXiv.org 1,135 95
Chameleon: Mixed-Modal Early-Fusion Foundation Models Chameleon Vision 2024 arXiv.org 1,029 112
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning V-JEPA 2 World Models & Embodied AI 2025 arXiv.org 1,016 145
The Faiss Library faiss Open Source Infra 2024 IEEE Transactions on Big Data 994 57
The Open Catalyst 2020 (OC20) Dataset and Community Challenges Open Catalyst Project AI for Science 2020 ACS Catalysis 926 92
Training Large Language Models to Reason in a Continuous Latent Space Coconut Language & LLMs 2024 arXiv.org 876 167
Simple and Controllable Music Generation AudioCraft Speech & Sound 2023 Neural Information Processing Syst 870 111
Scaling Speech Technology to 1, 000+ Languages Massively Multilingual Speech Speech & Sound 2023 Journal of machine learning resear 819 142
Movie Gen: A Cast of Media Foundation Models Movie Gen Generative Media 2024 714 56
Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives Ego-Exo4D World Models & Embodied AI 2023 Computer Vision and Pattern Recogn 679 84
Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale Voicebox Speech & Sound 2023 Neural Information Processing Syst 638 70
Better & Faster Large Language Models via Multi-token Prediction Multi-token prediction Language & LLMs 2024 International Conference on Machin 452 49
ParlAI: A Dialog Research Software Platform ParlAI Open Source Infra 2017 Conference on Empirical Methods in 414 40
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases MobileLLM On-Device & Silicon 2024 International Conference on Machin 355 24
Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots Habitat World Models & Embodied AI 2023 International Conference on Learni 354 92
SAM 3D: 3Dfy Anything in Images SAM 3D (Objects + Body) Vision 2025 arXiv.org 332 77
Decoding speech perception from non-invasive brain recordings Brain & AI: Decoding Perception from MEG/EEG AI for Science 2022 Nature Machine Intelligence 327 45
UMA: A Family of Universal Models for Atoms UMA — Universal Models for Atoms AI for Science 2025 Neural Information Processing Syst 323 48
Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack Emu Generative Media 2023 arXiv.org 322 13
Sapiens: Foundation for Human Vision Models Sapiens Vision 2024 European Conference on Computer Vi 321 49
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage BlenderBot Language & LLMs 2022 arXiv.org 309 24
Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioning Emu Video & Emu Edit Generative Media 2023 European Conference on Computer Vi 299 12
SeamlessM4T: Massively Multilingual&Multimodal Machine Translation SeamlessM4T & the Seamless family Speech & Sound 2023 244 32
Combining Deep Reinforcement Learning and Search for Imperfect-Information Games ReBeL Games & Strategy 2020 Neural Information Processing Syst 211 17
Audiobox: Unified Audio Generation with Natural Language Prompts Audiobox Speech & Sound 2023 arXiv.org 197 13
Byte Latent Transformer: Patches Scale Better Than Tokens Byte Latent Transformer Language & LLMs 2024 arXiv.org 196 21
Open Materials 2024 (OMat24) Inorganic Materials Dataset and Models Open Materials 2024 AI for Science 2024 arXiv.org 185 15
SpiRit-LM: Interleaved Spoken and Written Language Model Spirit LM Speech & Sound 2024 Transactions of the Association fo 171 20
Large Concept Models: Language Modeling in a Sentence Representation Space Large Concept Models Language & LLMs 2024 arXiv.org 130 13
The Open Molecules 2025 (OMol25) Dataset, Evaluations, and Models Open Molecules 2025 AI for Science 2025 130 10
ELF OpenGo: An Analysis and Open Reimplementation of AlphaZero ELF OpenGo Games & Strategy 2019 International Conference on Machin 123 13
PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Tasks PARTNR World Models & Embodied AI 2024 arXiv.org 112 22
From Audio to Photoreal Embodiment: Synthesizing Humans in Conversations audio2photoreal Reality Labs Research 2024 Computer Vision and Pattern Recogn 108 17
CWM: An Open-Weights LLM for Research on Code Generation with World Models Code World Model Language & LLMs 2025 arXiv.org 88 13
Meta Large Language Model Compiler: Foundation Models of Compiler Optimization Meta LLM Compiler On-Device & Silicon 2024 arXiv.org 78 2
VL-JEPA: Joint Embedding Predictive Architecture for Vision-language VL-JEPA World Models & Embodied AI 2025 arXiv.org 71 4
Video Seal: Open and Efficient Video Watermarking Video Seal Vision 2024 arXiv.org 66 15
emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation emg2pose Reality Labs Research 2024 Neural Information Processing Syst 56 10
SAM Audio: Segment Anything in Audio SAM Audio Speech & Sound 2025 arXiv.org 55 11
Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languages Omnilingual ASR Speech & Sound 2025 arXiv.org 54 9
Memory Layers at Scale Memory Layers at Scale Language & LLMs 2024 arXiv.org 51 2
emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography emg2qwerty Reality Labs Research 2024 Neural Information Processing Syst 47 9
Brain-to-Text Decoding: A Non-invasive Approach via Typing Brain2Qwerty AI for Science 2025 arXiv.org 44 4
MobileLLM-R1: Exploring the Limits of Sub-Billion Language Model Reasoners with Open Training Recipes MobileLLM-R1 / R1.5 On-Device & Silicon 2025 arXiv.org 11 1
Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining Codec Avatars Reality Labs Research 2026 arXiv.org 5 0
MobileLLM-Pro Technical Report MobileLLM-Pro On-Device & Silicon 2025 arXiv.org 4 1
MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale Deployment MobileLLM-Flash On-Device & Silicon 2026 Annual Meeting of the Association 2 0

Counts move, and each is a snapshot. Citation counts favour age — a 2017 paper has had years to accumulate what a 2025 paper has had months for, so compare within a year cohort rather than across the table. Influential citations is Semantic Scholar's own measure of citations where the cited paper was central to the citing one, not merely mentioned; it is an estimate, not a count of anything a human checked. Semantic Scholar's index lags publication and misses some venues, and it occasionally holds duplicate records — one paper here reads from a second record because its arXiv entry returned zero. Only papers this catalog links are counted, so this is not all of Meta's research. Source: pulse.json.