OpenParable
Skip to content
← Back to skills

Doris Docker Regression

Testing & Quality
doris-docker-regression

Doris Docker Regression is an Agent Skill for testing & quality published in the apache/doris repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Run Doris docker-based regression tests from a clean package

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/apache/doris/blob/HEAD/.claude/skills/doris-docker-regression/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/doris-docker-regression, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Purpose

Run Doris docker-based regression tests from a clean package, avoiding contamination from local conf/ or startup script modifications.

Prerequisites

Python Environment

Requires Python 3. Install dependencies from docker/runtime/doris-compose/requirements.txt:

python -m pip install --user -r docker/runtime/doris-compose/requirements.txt

If installation fails (especially PyYAML conflicts), use specific versions:

python -m pip install --user pyyaml==5.3.1 docker==6.1.3
python -m pip install --user -r docker/runtime/doris-compose/requirements.txt

Alternatively, use a virtual environment:

python -m venv doris-compose-env
source doris-compose-env/bin/activate
pip install -r docker/runtime/doris-compose/requirements.txt

Docker Environment

docker run hello-world       # Docker works
docker compose version       # Compose v2
docker-compose version       # Should resolve to Compose v2

If docker-compose shows TypeError: kwargs_from_env(), make sure it is indeed Docker Compose V2; if not, you need to install and point to the correct version.

Check port availability:

lsof -nP -iTCP:8030,8040,8050,8060,8070,9010,9020,9030,9050,9060 -sTCP:LISTEN

If there is a conflict, ask the user how to handle it.

Build

./build.sh --fe --be -j<parallel_jobs> --output <output_directory>

Prepare Clean Package

Sanitize configs from git HEAD:

git show HEAD:conf/fe.conf > <output_directory>/fe/conf/fe.conf
git show HEAD:conf/be.conf > <output_directory>/be/conf/be.conf
git show HEAD:bin/start_fe.sh > <output_directory>/fe/bin/start_fe.sh
chmod 755 <output_directory>/fe/bin/start_fe.sh

Verify clean configs use default ports:

  • fe.conf: 8030, 9020, 9030, 9010, 8070
  • be.conf: 9060, 8040, 9050, 8060, 8050
  • start_fe.sh: no -agentlib:jdwp debug agent

Build Docker Image

docker build \
  --build-arg OUTPUT_PATH=<output_directory> \
  -f docker/runtime/doris-compose/Dockerfile \
  -t <image_name>:latest \
  .

Configure Regression

Create regression-test/conf/regression-conf-custom.groovy:

image = "<image_name>:latest"
excludeDockerTest = false
testGroups = "docker"

Run Regression

./run-regression-test.sh --run -d <directory> -s <suite_name>

Troubleshooting

SymptomCauseFix
0 suitesexcludeDockerTest=true or missing testGroups="docker"Check regression-conf-custom.groovy
JDWP errorstart_fe.sh has debug agentRe-sanitize from git show HEAD:bin/start_fe.sh
Wrong portsConfigs have local editsRe-sanitize from git show HEAD:conf/fe.conf / be.conf
Port conflictProcesses using default portslsof then kill

Debug Logs

Runtime cluster at /tmp/doris/<suite_name>/:

  • fe-1/log/fe.log, fe.warn.log, fe.out, health.out
  • be-1/log/be.INFO, be.WARNING, be.out, health.out
  • doris-compose.log

Full Command Sequence

# 1. Check environment
python --version
docker run hello-world
docker compose version
lsof -nP -iTCP:8030,8040,8050,8060,8070,9010,9020,9030,9050,9060 -sTCP:LISTEN

# 2. Build
./build.sh --fe --be -j60

# 3. Sanitize package configs
git show HEAD:conf/fe.conf > <output_directory>/fe/conf/fe.conf
git show HEAD:conf/be.conf > <output_directory>/be/conf/be.conf
git show HEAD:bin/start_fe.sh > <output_directory>/fe/bin/start_fe.sh
chmod 755 <output_directory>/fe/bin/start_fe.sh

# 4. Build image
docker build --build-arg OUTPUT_PATH=<output_directory> -f docker/runtime/doris-compose/Dockerfile -t <image_name>:latest .

# 5. Configure (create regression-conf-custom.groovy)
# 6. Run
./run-regression-test.sh --run -d <directory> -s <suite_name>