Software Testing Research

The Software Testing Research team is dedicated to exploring the challenges present in software testing and providing solutions by developing tools and innovative methods. Our main objective is to make testing easier by designing new techniques and tools.

Research Directions

Automated Test Generation

Metamorphic Testing

Bug Detection and Crash Reproduction

Validation of AI-Generated Code

People

Recent Publications

Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation

ICST 2025, full paper

Mutation Testing via Iterative Large Language Model-driven Scientific Debugging

MUTATION 2025, full paper

TestSpark: IntelliJ IDEA's Ultimate Test Generation Companion

ICSE 2024, tool demo paper

SBFT Tool Competition 2024 – Python Test Case Generation Track

SBFT 2024, competition

Evolutionary Generative Fuzzing for Differential Testing of the Kotlin Compiler

FSE 2024, full paper

Academic Collaborations

TestSpark

Tool

IntelliJ IDEA plugin for generating unit tests

TestSpark natively integrates different AI-based test generation tools and techniques in the IDE.

TestSpark currently supports two test generation strategies:

LLM-based test generation (using OpenAI, Hugging Face, Google, and JetBrains internal AI Assistant platform)
Local search-based test generation (using EvoSuite and Kex)

Download from JetBrains Marketplace

Contact us

If you are interested in collaborating with us or have any questions about our tools, projects, or publications, write to us at testing-research-team@jetbrains.com.

You can check our current research directions to learn about potential collaboration topics. If you have an idea outside the scope of our current directions, feel free to share it with us.

Research directions