ChatUniTest

ChatUniTest is an LLM-based framework designed to automate and improve unit test generation. It addresses common issues like incorrect code execution and manual integration friction by using two key mechanisms:

1. Adaptive Focal Context: Enhances prompts by including relevant code context.
2. Generation-Validation-Repair: A cycle that generates tests, validates them, and automatically repairs errors to ensure they execute correctly.

The project consists of ChatUniTest Core (the workflow library) and the ChatUniTest Toolchain (integrated tools).

ChatUniTest is a unit test generation tool that utilizes ChatGPT to overcome the limitations of traditional program analysis (which often lacks readability) and pre-trained models (which often suffer from low coverage).

It operates on a generate-verify-fix framework:

1. Generate: Collects necessary context information for the target method and uses ChatGPT to generate initial test cases.
2. Verify: Checks if the generated test cases execute correctly.
3. Fix: If verification fails, the compiler error information is fed back to ChatGPT to fix the test cases. This process iterates until the tests pass or the maximum number of iterations is reached.

Most research implementations of ChatUniTest are available as a Maven plugin. You can run different research-specific versions of the tool by specifying different phaseType values during the Maven execution.

To use a specific implementation, identify the corresponding phaseType from the implementation list and run your Maven command with that phase.

# Example: Running the HITS implementation (replace <phaseType> with the specific one)
mvn <phaseType>

# Available phaseTypes based on research papers:
# - CHATTESTER (Evaluating and Improving ChatGPT...)
# - TESTSPARK (TestSpark: IntelliJ IDEA's Companion)
# - SYMPROMPT (Code-Aware Prompting...)
# - HITS (HITS: High-coverage LLM-based...)
# - MUTAP (Effective Test Generation Using...)
# - TELPA (Enhancing LLM-based Test Generation...)
# - COVERUP (CoverUp: Coverage-Guided...)
# - TESTPILOT (An Empirical Evaluation...)

The following phaseType values correspond to specific research implementations within the ChatUniTest Maven plugin: