What we are working on?
Our research aims to ensure the correctness of Deep Learning Systems, building more reliable, effective, and efficient AI systems for software engineering. Specifically, we focus on the following AI Infrastructures Testing:
- Deep Learning Library/Framework (PyTorch, Tensorflow, Mindspore,etc.)
- Deep Learning compilers (Inductor, TVM, ONNXRuntime,etc.)
- End-side deployment (JavaScript Engine, Autonomous Driving, etc.)
Team
Faculty
Chunrong Fang
Associate Professor fangchunrong@nju.edu.cnChunrong Fang received the B.E. and Ph.D. degrees in software engineering from Software Institute, Nanjing University, Jiangsu, China. He is currently an Associate Professor with the Software Institute of Nanjing University. His research interests lie in intelligent software engineering, e.g. BigCode and AITesting.
Zhenyu Chen
Professor zychen@nju.edu.cnZhenyu Chen is currently a full professor with Software Institute of Nanjing University. He is an associate Editor of IEEE Transactions on Reliability. He is also the Contest Co-Chair at QRS 2018, ICST 2019, and ISSTA 2019. He is the Industrial Track Co-Chair of SANER 2019. His research interests include collective intelligence, deep learning testing and optimization, big data quality, and mobile application testing.
Ph.D. Students
Jiawei Liu
Ph.D. Student, Fall 2021 jw.liu@smail.nju.edu.cn
Yanzhou Mu
Ph.D. Student, Fall 2022 602022320006@smail.nju.edu.cn
Yinglong Zou
Ph.D. Student, Fall 2023 652023320004@smail.nju.edu.cnMaster Students
Peiran Yang
Master Student, Fall 2023 peiranyang@smail.nju.edu.cn
Shaoyu Yang
Master Student, Fall 2024 shaoyuyoung@gmail.com
Yupeng Zhang
Master Student, Fall 2024 522024320213@smail.nju.edu.cnPublications
- All
- ASE
- ISSTA
- ICSE
- TOSEM
- TRel
- JSS
Bug List
* Currently, artifacts of bug finding method can be found in manuscript. In the future, artifacts would be open-source in our GitHub Organization
| System | #Issue ID | #PR ID (if fixed) | Symptom | Bug Finding Method | Status |
|---|---|---|---|---|---|
| PyTorch Inductor | #148058 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #147848 | #147961 | 💥crash | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #147847 | 🔇silent incorrectness | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #147842 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #147256 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #147255 | 🔇silent incorrectness | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #145470 | 🔇silent incorrectness | FUEL (upcoming) | ❓️Pending | |
| PyTorch Inductor | #144836 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #144738 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #144310 | #144313 | 💥crash | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #144186 | #144243 | 💥crash | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #144183 | 💥crash | FUEL (upcoming) | ❓️Pending | |
| PyTorch Inductor | #144015 | 💥crash | FUEL (upcoming) | ❓️Pending | |
| PyTorch Inductor | #144013 | #144225 | 💥crash | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #143801 | #143802 | 💥crash | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #143790 | 💥crash | FUEL (upcoming) | ❓️Pending | |
| PyTorch Inductor | #143752 | 💥crash | FUEL (upcoming) | ❓️Pending | |
| PyTorch Inductor | #143738 | #144059 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #143729 | #143746 | 💥crash | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #143717 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #143556 | #143635 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #143555 | #143635 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #143184 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #143182 | 🔇silent incorrectness | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #142853 | #143460 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #142839 | 🔇silent incorrectness | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #142479 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #142466 | #142859 | 💥crash | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #142463 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #142345 | #142360 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #141541 | 🔇silent incorrectness | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #141538 | #144395 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #141536 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed | |
| PyTorch Inductor | #141317 | 🔇silent incorrectness | FUEL (upcoming) | 🥰Confirmed | |
| PyTorch Inductor | #137254 | #132554 | 🔇silent incorrectness | FUEL (upcoming) | 🥳Fixed |
| PyTorch Inductor | #133204 | 🔇silent incorrectness | FUEL (upcoming) | ❓️Pending | |
| TensorFlow XLA | #88042 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| TensorFlow XLA | #88040 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| TensorFlow XLA | #88038 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| TensorFlow XLA | #84205 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| TensorFlow XLA | #83063 | 💥crash | FUEL (upcoming) | 🥰Confirmed | |
| TensorFlow XLA | #82317 | 🔇silent incorrectness | FUEL (upcoming) | 🥰Confirmed | |
| TensorFlow.js | #8222 | DLJSFuzzer (ASE 2024) | Confirmed | ||
| TensorFlow.js | #7202 | DLJSFuzzer (ASE 2024) | Pending | ||
| TensorFlow.js | #8246 | DLJSFuzzer (ASE 2024) | Confirmed | ||
| TensorFlow.js | #8338 | DLJSFuzzer (ASE 2024) | Confirmed | ||
| TensorFlow.js | #8337 | DLJSFuzzer (ASE 2024) | Confirmed | ||
| TensorFlow.js | #8339 | DLJSFuzzer (ASE 2024) | Confirmed | ||
| TensorFlow.js | #8340 | DLJSFuzzer (ASE 2024) | Confirmed | ||
| TensorFlow.js | #8341 | DLJSFuzzer (ASE 2024) | Confirmed | ||
| keras | #15666 | Gandalf (TOSEM 2023) | Confirmed | ||
| keras | #15667 | Gandalf (TOSEM 2023) | Confirmed | ||
| keras | #15677 | Gandalf (TOSEM 2023) | Confirmed | ||
| keras | #15716 | Gandalf (TOSEM 2023) | Confirmed | ||
| keras | #15717 | Gandalf (TOSEM 2023) | Confirmed | ||
| TensorFlow | #53055 | Gandalf (TOSEM 2023) | Confirmed | ||
| TensorFlow | #53107 | Gandalf (TOSEM 2023) | Confirmed | ||
| keras | #68321 | Gandalf (TOSEM 2023) | Confirmed |