publications

  1. ICLR (oral)
    SWE-bench: Can Language Models Resolve Real-world Github Issues?
    Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, Karthik Narasimhan
    In ICLR 2024
    Site PDF Code
  2. EMNLP
    C-STS: Conditional Semantic Textual Similarity
    Ameet Deshpande, Carlos E. Jimenez, Howard Chen, Vishvak Murahari, Victoria Graf, Tanmay Rajpurohit, Ashwin Kalyan, Danqi Chen, Karthik Narasimhan
    In EMNLP 2023
    PDF Code
  3. EMNLP Findings
    MUX-PLMs: Data Multiplexing for High-throughput Language Models
    Vishvak Murahari, Ameet Deshpande, Carlos E. Jimenez, Izhak Shafran, Mingqiu Wang, Yuan Cao, Karthik Narasimhan
    In EMNLP Findings 2023
    PDF Code
  4. NeurIPS
    DataMUX: Data Multiplexing for Neural Networks
    Vishvak Murahari, Carlos E. Jimenez, Runzhe Yang, Karthik Narasimhan
    In NeurIPS 2022
    Site PDF Code
  5. ACL
    CARETS: A Consistency And Robustness Evaluative Test Suite for VQA
    Carlos E. Jimenez, Olga Russakovsky, Karthik Narasimhan
    In ACL, 2022
    PDF Code