Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works102 from public data

TitleCited by
  • On the Opportunities and Risks of Foundation Models

    Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Biagio Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, +22 more

    arXiv · 2021

    2,227
  • Mobility network models of COVID-19 explain inequities and inform reopening

    Serina Y. Chang, Emma Pierson, Pang Wei Koh, Jaline Gerardin, Beth Redbird, David B. Grusky, Jure Leskovec

    Nature · 2020

    A metapopulation susceptible–exposed–infectious–removed (SEIR) model that integrates fine-grained, dynamic mobility networks to simulate the spread of SARS-CoV-2 in ten of the largest US metropolitan areas is introduced and correctly predicts higher infection rates among disadvantaged racial and socioeconomic groups.

    1,561
  • 1,322
  • Distributionally Robust Neural Networks

    Shiori Sagawa, Pang Wei Koh, Tatsunori Hashimoto, Percy Liang

    International Conference on Learning Representations · 2020

    The results suggest that regularization is critical for worst-group performance in the overparameterized regime, even if it is not needed for average performance, and introduce and provide convergence guarantees for a stochastic optimizer for this group DRO setting.

    807
  • DataComp: In search of the next generation of multimodal datasets

    Samir Yitzhak Gadre, Gabriel Ilharco, Fang, Alex, Jonathan Hayase, Georgios Smyrnis, Thao D. Nguyen, Ryan Marten, Mitchell Wortsman, +22 more

    arXiv · 2023

    The introduction of DataComp, a testbed for dataset experiments centered around a new candidate pool of 12.8 billion image-text pairs from Common Crawl, enables training a CLIP ViT-L/14 from scratch to 79.2% zero-shot accuracy on ImageNet, and makes the benchmark accessible to researchers with varying resources.

    782
  • OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models

    Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, +8 more

    arXiv · 2023

    OpenFlamingo is an ongoing effort to produce an open-source replication of DeepMind's Flamingo models, and the models, training data, hyperparameters, and evaluation suite are introduced.

    663
  • Mapping the Pairwise Choices Leading from Pluripotency to Human Bone, Heart, and Other Mesoderm Cell Types

    Kyle M. Loh, Angela Chen, Pang Wei Koh, Tianda Z. Deng, Rahul Sinha, Jonathan M. Tsai, Amira A. Barkal, Kimberle Shen, +15 more

    Cell · 2016

    The extrinsic signals controlling each binary lineage decision were defined, enabling us to logically block differentiation towards unwanted fates and rapidly steer pluripotent stem cells towards 80–99% pure human mesodermal lineages at most branchpoints.

    490
  • On Random Weights and Unsupervised Feature Learning

    Andrew Saxe, Pang Wei Koh, Zhenghao Chen, Maneesh Bhand, Bipin Suresh, Andrew Y. Ng

    International Conference on Machine Learning · 2011

    The answer is that certain convolutional pooling architectures can be inherently frequency selective and translation invariant, even with random weights, and the viability of extremely fast architecture search is demonstrated by using random weights to evaluate candidate architectures, thereby sidestepping the time-consuming learning process.

    467
  • Are aligned neural networks adversarially aligned?

    Nicholas Carlini, Milad Nasr, Christopher A. Choquette-Choo, Matthew Jagielski, Irena Gao, Anas Awadalla, Pang Wei Koh, Daphne Ippolito, +3 more

    arXiv · 2023

    It is shown that existing NLP-based optimization attacks are insufficiently powerful to reliably attack aligned text models: even when current NLP-based attacks fail, the authors can find adversarial inputs with brute force.

    415
  • FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation

    Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, +1 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    372
  • Tiled convolutional neural networks

    Jiquan Ngiam, Zhenghao Chen, Daniel Chia, Pang Wei Koh, Quoc Viet Le, Andrew Y. Ng

    neural information processing systems · 2010

    This paper proposes tiled convolution neural networks (Tiled CNNs), which use a regular "tiled" pattern of tied weights that does not require that adjacent hidden units share identical weights, but instead requires only that hidden units k steps away from each other to have tied weights.

    353
  • OLMoE: Open Mixture-of-Experts Language Models

    Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Morrison, Sewon Min, Weijia Shi, Walsh, Pete, +16 more

    arXiv · 2024

    This work introduces OLMoE, a fully open, state-of-the-art language model leveraging sparse Mixture-of-Experts (MoE), and presents various experiments on MoE training, analyzes routing in the model showing high specialization, and open-source all aspects of the work: model weights, training data, code, and logs.

    352
  • 349
  • Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims

    Miles Brundage, Shahar Avin, Jasmine Wang, Haydn Belfield, Gretchen Marie Krueger, Gillian K. Hadfield, Heidy Khlaaf, Jingying Yang, +22 more

    arXiv · 2020

    296
  • Stronger data poisoning attacks break data sanitization defenses

    Pang Wei Koh, Jacob Steinhardt, Percy Liang

    Machine Learning · 2021

    Three attacks are developed that can bypass a broad range of common data sanitization defenses, including anomaly detectors based on nearest neighbors, training loss, and singular-value decomposition, and the Karush–Kuhn–Tucker conditions.

    292
  • 2 OLMo 2 Furious

    Team OLMo, Walsh, Pete, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora, Akshita Bhagia, Yuling Gu, +22 more

    arXiv · 2024

    This work describes the modified model architecture and training recipe, focusing on techniques for achieving better training stability and improved per-token efficiency, and introduces a new, specialized data mix called Dolmino Mix 1124, which significantly improves model capabilities across many downstream task benchmarks when introduced via late-stage curriculum training.

    286
  • Sparse Filtering

    Jiquan Ngiam, Zhenghao Chen, Sonia A. Bhaskar, Pang Wei Koh, Andrew Y. Ng

    neural information processing systems · 2011

    This work presents sparse filtering, a simple new algorithm which is efficient and only has one hyperparameter, the number of features to learn, and evaluates it on natural images, object classification, and phone classification, showing that the method works well on a range of different modalities.

    278
  • WILDS: A Benchmark of in-the-Wild Distribution Shifts

    Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, +15 more

    CaltechAUTHORS (California Institute of Technology) · 2020

    269
  • Spurious Rewards: Rethinking Training Signals in RLVR

    Rulin Shao, Shuyue Stella Li, Rui Xin, Scott Geng, Yiping Wang, Sewoong Oh, Simon S. Du, Nathan Lambert, +6 more

    arXiv · 2025

    235
  • MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoning

    Shuyue Li, Vidhisha Balachandran, Shangbin Feng, Jonathan Seth Ilgen, Emma Pierson, Pang Wei Koh, Yulia Tsvetkov

    neural information processing systems · 2024

    This paper proposes to change the static paradigm to an interactive one, develop systems that proactively ask questions to gather more information and respond reliably, and introduces an interactive MediQ benchmark and a novel question-asking system to evaluate question-asking ability in LLMs.

    218
  • Learning Deep Energy Models

    Jiquan Ngiam, Zhenghao Chen, Pang Wei Koh, Andrew Y. Ng

    International Conference on Machine Learning · 2011

    This work proposes deep energy models, which use deep feedforward neural networks to model the energy landscapes that define probabilistic models, and is able to efficiently train all layers of this model simultaneously, allowing the lower layers of the model to adapt to the training of the higher layers, and thereby producing better generative models.

    204
  • Impossibility theorems for feature attribution

    Blair Bilodeau, Natasha Jaques, Pang Wei Koh, Been Kim

    Proceedings of the National Academy of Sciences · 2024

    This work shows that complete and linear methods are provably less reliable than simpler methods at answering basic feature attribution questions, and provides impossibility results that highlight their failure cases.

    167
  • Concept Bottleneck Models

    Pang Wei Koh, Thao N. N. Nguyen, Yew Siang Tang, Stephen Mussmann, Emma Pierson, Been Kim, Percy Liang

    arXiv · 2020

    144
  • Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time

    Huaxiu Yao, Choi, Caroline, Bochuan Cao, Yoonho Lee, Pang Wei Koh, Chelsea Finn

    arXiv · 2022

    Wild-Time is curate, a benchmark of 5 datasets that reflect temporal distribution shifts arising in a variety of real-world applications, including patient prognosis and news classification that systematically benchmark 13 prior approaches, including methods in domain generalization, continual learning, self-supervised learning, and ensemble learning.

    143
  • The Generative AI Paradox: "What It Can Create, It May Not Understand"

    West, Peter, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian Fisher, +6 more

    arXiv · 2023

    The hypothesis that models' generative capability may not be contingent upon understanding capability, and call for caution in interpreting artificial intelligence by analogy to human intelligence, is supported.

    136

Show all 102 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report