Fangyu Lei 雷方雨

I am Fangyu Lei, a postgraduate student at Institute of Automation, Chinese Academy of Sciences, advised by Prof. Kang Liu.

I have been under the guidance of Dr. Shizhu He since my undergraduate studies.

I also had the fortune to work with Dr. Qian Liu at Sea AI Lab.

My research interest lies in NLP, especially on LLM-Agent, code generation and table reasoning.

Email  /  Google Scholar  /  Twitter  /  Twitter

profile photo
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, Tao Yu
Preprint, 2024
S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models
Fangyu Lei*, Qian Liu*, Yiming Huang, Shizhu He, Jun Zhao, Kang Liu
NAACL, 2024
S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering
Fangyu Lei, Shizhu He, Xiang Li, Yifan Wei, Yiming Huang, Jun Zhao, Kang Liu
ACL, 2023
Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoderestion Answering
Fangyu Lei, Shizhu He, Xiang Li, Jun Zhao, Kang Liu
COLING, 2022
Competition-level problems are effective llm evaluators
Yiming Huang, Zhenghao Lin, Xiao Liu, Yeyun Gong, Fangyu Lei, Chen Lin, Nan Duan, Weizhu Chen
ACL-Findings, 2024
Teaching Small Language Models to Reason for Knowledge-Intensive Multi-Hop Question Answering
Xiang Li, Shizhu He, Fangyu Lei, Jun Yang, Tianhuang Su, Kang Liu, Jun Zhao
ACL-Findings, 2024
Multi-Target Semantic Parsing with Collaborative Deliberation Network
Xiang Li, Fangyu Lei, Shizhu He, Kang Liu, Jun Zhao
AACL, 2023
MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models
Yifan Wei, Yisong Su, Huanhuan Ma, Xiaoyan Yu, Fangyu Lei, Yuanzhe Zhang, Jun Zhao, Kang Liu
EMNLP-Findings, 2023
TableQAKit: A Comprehensive and Practical Toolkit for Table-based Question Answering
Fangyu Lei, Tongxu Luo, Pengqi Yang, Weihao Liu, Shizhu He, Jun Zhao, Kang Liu
Preprint, 2023