fix(ci_visibility): itr skipped counts suites or tests [backport 3.13] by dd-octo-sts[bot] · Pull Request #14697 · DataDog/dd-trace-py

dd-octo-sts · 2025-09-24T17:01:16Z

Backport e239ca4 from #14681 to 3.13.

CI Visibility: Fixes some bad behavior in test skipping count, introduced in #14257

Checklist:

Done

github-actions · 2025-09-24T17:01:52Z

CODEOWNERS have been resolved as:

releasenotes/notes/ci_visibility_fix_itr_count-7f4c5da42df18aea.yaml    @DataDog/apm-python
ddtrace/contrib/internal/pytest/_plugin_v2.py                           @DataDog/ci-app-libraries
ddtrace/internal/ci_visibility/api/_suite.py                            @DataDog/ci-app-libraries
ddtrace/internal/ci_visibility/api/_test.py                             @DataDog/ci-app-libraries
tests/ci_visibility/api/fake_runner_mix_fail_itr_suite_level.py         @DataDog/ci-app-libraries
tests/ci_visibility/api/test_api_fake_runners.py                        @DataDog/ci-app-libraries
tests/contrib/pytest/test_pytest.py                                     @DataDog/ci-app-libraries
tests/contrib/pytest/test_pytest_xdist_itr.py                           @DataDog/ci-app-libraries
tests/snapshots/test_api_fake_runners.test_manual_api_fake_runner_all_itr_skip_suite_level.json  @DataDog/apm-python
tests/snapshots/test_api_fake_runners.test_manual_api_fake_runner_mix_fail_itr_suite_level.json  @DataDog/apm-python

github-actions · 2025-09-24T17:25:54Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 267 ± 2 ms.

The average import time from base is: 270 ± 3 ms.

The import time difference between this PR and base is: -3.5 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.125 ms (0.80%)

ddtrace.bootstrap.sitecustomize 1.449 ms (0.54%)

ddtrace.bootstrap.preload 1.449 ms (0.54%)

ddtrace.internal.remoteconfig.client 0.670 ms (0.25%)

ddtrace 0.676 ms (0.25%)

ddtrace.internal._unpatched 0.030 ms (0.01%)

json 0.030 ms (0.01%)

json.decoder 0.030 ms (0.01%)

re 0.030 ms (0.01%)

enum 0.030 ms (0.01%)

types 0.030 ms (0.01%)

pr-commenter · 2025-09-24T18:18:47Z

Performance SLOs

Comparing candidate backport-14681-to-3.13 (4de3136) with baseline 3.13 (f774a51)

📈 Performance Regressions (1 suite)

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.225µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +1.3%

Memory: ✅ 31.438MB (SLO: <34.000MB -7.5%) vs baseline: +4.9%

✅ 1-count-metrics-100-times

Time: ✅ 221.751µs (SLO: <250.000µs 📉 -11.3%) vs baseline: +1.7%

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +5.1%

✅ 1-distribution-metric-1-times

Time: ✅ 3.027µs (SLO: <20.000µs 📉 -84.9%) vs baseline: +2.1%

Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +5.1%

✅ 1-distribution-metrics-100-times

Time: ✅ 209.570µs (SLO: <220.000µs -4.7%) vs baseline: +7.3%

Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.6%

✅ 1-gauge-metric-1-times

Time: ✅ 2.172µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +4.1%

Memory: ✅ 31.398MB (SLO: <34.000MB -7.7%) vs baseline: +4.6%

✅ 1-gauge-metrics-100-times

Time: ✅ 124.514µs (SLO: <150.000µs 📉 -17.0%) vs baseline: -0.3%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +5.0%

✅ 1-rate-metric-1-times

Time: ✅ 3.603µs (SLO: <20.000µs 📉 -82.0%) vs baseline: 📈 +12.9%

Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.7%

✅ 1-rate-metrics-100-times

Time: ✅ 220.731µs (SLO: <250.000µs 📉 -11.7%) vs baseline: +1.9%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +5.1%

✅ 100-count-metrics-100-times

Time: ✅ 21.783ms (SLO: <23.500ms -7.3%) vs baseline: +0.3%

Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +5.1%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.100ms (SLO: <2.250ms -6.7%) vs baseline: +2.7%

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +5.1%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.278ms (SLO: <1.550ms 📉 -17.5%) vs baseline: +0.2%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +5.1%

✅ 100-rate-metrics-100-times

Time: ✅ 2.267ms (SLO: <2.550ms 📉 -11.1%) vs baseline: +1.5%

Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.9%

✅ flush-1-metric

Time: ✅ 4.695µs (SLO: <20.000µs 📉 -76.5%) vs baseline: 📈 +12.3%

Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 183.183µs (SLO: <250.000µs 📉 -26.7%) vs baseline: -0.2%

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +4.7%

✅ flush-1000-metrics

Time: ✅ 2.213ms (SLO: <2.500ms 📉 -11.5%) vs baseline: ~same

Memory: ✅ 32.598MB (SLO: <34.500MB -5.5%) vs baseline: +4.8%

🟡 Near SLO Breach (5 suites)

🟡 djangosimple - 24/24

✅ appsec

Time: ✅ 20.657ms (SLO: <22.300ms -7.4%) vs baseline: -0.1%

Memory: ✅ 64.468MB (SLO: <66.000MB -2.3%) vs baseline: +4.9%

✅ exception-replay-enabled

Time: ✅ 1.368ms (SLO: <1.450ms -5.6%) vs baseline: ~same

Memory: ✅ 63.404MB (SLO: <66.000MB -3.9%) vs baseline: +4.9%

✅ iast

Time: ✅ 20.707ms (SLO: <22.250ms -6.9%) vs baseline: +0.2%

Memory: ✅ 64.387MB (SLO: <66.000MB -2.4%) vs baseline: +4.8%

✅ profiler

Time: ✅ 15.182ms (SLO: <16.550ms -8.3%) vs baseline: -0.3%

Memory: ✅ 52.829MB (SLO: <53.500MB 🟡 -1.3%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 26.307ms (SLO: <28.200ms -6.7%) vs baseline: -0.1%

Memory: ✅ 66.296MB (SLO: <68.500MB -3.2%) vs baseline: +4.5%

✅ tracer

Time: ✅ 20.744ms (SLO: <21.750ms -4.6%) vs baseline: +0.4%

Memory: ✅ 64.350MB (SLO: <66.000MB -2.5%) vs baseline: +4.8%

✅ tracer-and-profiler

Time: ✅ 22.256ms (SLO: <23.500ms -5.3%) vs baseline: -0.1%

Memory: ✅ 65.428MB (SLO: <67.000MB -2.3%) vs baseline: +4.9%

✅ tracer-dont-create-db-spans

Time: ✅ 19.574ms (SLO: <21.500ms -9.0%) vs baseline: +0.5%

Memory: ✅ 64.389MB (SLO: <66.000MB -2.4%) vs baseline: +4.8%

✅ tracer-no-caches

Time: ✅ 18.600ms (SLO: <19.650ms -5.3%) vs baseline: +0.4%

Memory: ✅ 64.369MB (SLO: <66.000MB -2.5%) vs baseline: +5.0%

✅ tracer-no-databases

Time: ✅ 18.953ms (SLO: <20.100ms -5.7%) vs baseline: ~same

Memory: ✅ 63.996MB (SLO: <66.000MB -3.0%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 20.362ms (SLO: <21.500ms -5.3%) vs baseline: ~same

Memory: ✅ 64.409MB (SLO: <66.000MB -2.4%) vs baseline: +4.9%

✅ tracer-no-templates

Time: ✅ 20.477ms (SLO: <22.000ms -6.9%) vs baseline: -0.2%

Memory: ✅ 64.310MB (SLO: <66.000MB -2.6%) vs baseline: +4.7%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.198ms (SLO: <19.850ms -8.3%) vs baseline: +0.8%

Memory: ✅ 64.299MB (SLO: <65.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 18.270ms (SLO: <19.400ms -5.8%) vs baseline: +0.9%

Memory: ✅ 64.317MB (SLO: <65.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 18.202ms (SLO: <19.450ms -6.4%) vs baseline: +0.4%

Memory: ✅ 64.188MB (SLO: <65.500MB -2.0%) vs baseline: +5.2%

🟡 flasksimple - 15/15

✅ appsec-get

Time: ✅ 4.601ms (SLO: <4.750ms -3.1%) vs baseline: -0.2%

Memory: ✅ 61.873MB (SLO: <64.500MB -4.1%) vs baseline: +4.8%

✅ appsec-post

Time: ✅ 6.633ms (SLO: <6.750ms 🟡 -1.7%) vs baseline: -0.3%

Memory: ✅ 62.285MB (SLO: <64.500MB -3.4%) vs baseline: +4.8%

✅ appsec-telemetry

Time: ✅ 4.591ms (SLO: <4.750ms -3.3%) vs baseline: -0.4%

Memory: ✅ 61.794MB (SLO: <64.500MB -4.2%) vs baseline: +4.6%

✅ debugger

Time: ✅ 1.864ms (SLO: <2.000ms -6.8%) vs baseline: -0.2%

Memory: ✅ 44.532MB (SLO: <45.000MB 🟡 -1.0%) vs baseline: +4.6%

✅ iast-get

Time: ✅ 1.873ms (SLO: <2.000ms -6.4%) vs baseline: +0.4%

Memory: ✅ 41.681MB (SLO: <49.000MB 📉 -14.9%) vs baseline: +5.2%

✅ profiler

Time: ✅ 1.918ms (SLO: <2.100ms -8.7%) vs baseline: -0.2%

Memory: ✅ 44.374MB (SLO: <46.500MB -4.6%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.389ms (SLO: <3.650ms -7.2%) vs baseline: ~same

Memory: ✅ 51.334MB (SLO: <53.500MB -4.0%) vs baseline: +4.8%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.976ms (SLO: <4.200ms -5.3%) vs baseline: +0.6%

Memory: ✅ 62.161MB (SLO: <66.000MB -5.8%) vs baseline: +4.8%

✅ iast-enabled

Time: ✅ 2.544ms (SLO: <2.800ms -9.2%) vs baseline: +0.6%

Memory: ✅ 57.941MB (SLO: <59.000MB 🟡 -1.8%) vs baseline: +5.0%

✅ tracer-enabled

Time: ✅ 2.100ms (SLO: <2.250ms -6.7%) vs baseline: +0.2%

Memory: ✅ 51.250MB (SLO: <53.500MB -4.2%) vs baseline: +4.8%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 45.232ms (SLO: <47.150ms -4.1%) vs baseline: -0.5%

Memory: ✅ 44.523MB (SLO: <46.500MB -4.3%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 322.294ms (SLO: <344.800ms -6.5%) vs baseline: -0.1%

Memory: ✅ 552.980MB (SLO: <562.000MB 🟡 -1.6%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 294.403ms (SLO: <314.000ms -6.2%) vs baseline: +0.8%

Memory: ✅ 554.500MB (SLO: <563.500MB 🟡 -1.6%) vs baseline: +4.5%

✅ get-context

Time: ✅ 86.197ms (SLO: <92.350ms -6.7%) vs baseline: +0.8%

Memory: ✅ 39.717MB (SLO: <46.500MB 📉 -14.6%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 43.091ms (SLO: <44.500ms -3.2%) vs baseline: +0.6%

Memory: ✅ 43.903MB (SLO: <46.500MB -5.6%) vs baseline: +4.6%

✅ record-exception

Time: ✅ 61.867ms (SLO: <67.650ms -8.5%) vs baseline: +0.3%

Memory: ✅ 39.967MB (SLO: <46.500MB 📉 -14.1%) vs baseline: +4.8%

✅ set-status

Time: ✅ 49.715ms (SLO: <50.400ms 🟡 -1.4%) vs baseline: +2.0%

Memory: ✅ 44.090MB (SLO: <46.500MB -5.2%) vs baseline: +5.0%

✅ start

Time: ✅ 42.235ms (SLO: <43.450ms -2.8%) vs baseline: +0.6%

Memory: ✅ 43.962MB (SLO: <46.500MB -5.5%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 82.615ms (SLO: <88.000ms -6.1%) vs baseline: +0.3%

Memory: ✅ 33.856MB (SLO: <46.500MB 📉 -27.2%) vs baseline: +4.8%

✅ start-finish-telemetry

Time: ✅ 84.247ms (SLO: <89.000ms -5.3%) vs baseline: +0.3%

Memory: ✅ 33.915MB (SLO: <46.500MB 📉 -27.1%) vs baseline: +5.0%

✅ update-name

Time: ✅ 44.384ms (SLO: <45.150ms 🟡 -1.7%) vs baseline: +1.0%

Memory: ✅ 44.232MB (SLO: <46.500MB -4.9%) vs baseline: +5.0%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 12/12 (2 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.422µs (SLO: <20.000µs 📉 -32.9%) vs baseline: -0.2%

Memory: ✅ 31.457MB (SLO: <33.500MB -6.1%) vs baseline: +5.1%

✅ context_with_data_no_listeners

Time: ✅ 3.391µs (SLO: <10.000µs 📉 -66.1%) vs baseline: -0.8%

Memory: ✅ 31.457MB (SLO: <33.500MB -6.1%) vs baseline: +4.8%

⚠️ context_with_data_only_all_listeners

Time: ⚠️ 13.411µs (SLO: <20.000µs 📉 -32.9%) vs baseline: ~same

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +5.1%

✅ get_item_exists

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%) vs baseline: +4.9%

✅ get_item_missing

Time: ✅ 0.635µs (SLO: <10.000µs 📉 -93.6%) vs baseline: -0.6%

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%) vs baseline: +4.9%

✅ set_item

Time: ✅ 24.078µs (SLO: <30.000µs 📉 -19.7%) vs baseline: -0.9%

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%) vs baseline: +4.9%

✅ All Tests Passing (17 suites)

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.107ms (SLO: <2.300ms -8.4%) vs baseline: ~same

Memory: ✅ 51.071MB (SLO: <53.500MB -4.5%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 2.102ms (SLO: <2.250ms -6.6%) vs baseline: -0.5%

Memory: ✅ 51.051MB (SLO: <53.500MB -4.6%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.109ms (SLO: <2.300ms -8.3%) vs baseline: -0.1%

Memory: ✅ 51.051MB (SLO: <53.500MB -4.6%) vs baseline: +4.9%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.823µs (SLO: <100.000µs 📉 -18.2%) vs baseline: +1.3%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ b3_headers

Time: ✅ 14.282µs (SLO: <20.000µs 📉 -28.6%) vs baseline: +0.3%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ b3_single_headers

Time: ✅ 13.600µs (SLO: <20.000µs 📉 -32.0%) vs baseline: +2.5%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.733µs (SLO: <80.000µs 📉 -19.1%) vs baseline: +1.6%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.372µs (SLO: <80.000µs 📉 -17.0%) vs baseline: +0.4%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +5.1%

✅ empty_headers

Time: ✅ 1.602µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.3%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.8%

✅ full_t_id_datadog_headers

Time: ✅ 22.958µs (SLO: <30.000µs 📉 -23.5%) vs baseline: +0.4%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ invalid_priority_header

Time: ✅ 6.656µs (SLO: <10.000µs 📉 -33.4%) vs baseline: +2.6%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.8%

✅ invalid_span_id_header

Time: ✅ 6.529µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.6%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.7%

✅ invalid_tags_header

Time: ✅ 6.550µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.9%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.6%

✅ invalid_trace_id_header

Time: ✅ 6.573µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +2.0%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ large_header_no_matches

Time: ✅ 27.508µs (SLO: <30.000µs -8.3%) vs baseline: -0.5%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +5.1%

✅ large_valid_headers_all

Time: ✅ 28.613µs (SLO: <40.000µs 📉 -28.5%) vs baseline: -0.2%

Memory: ✅ 31.595MB (SLO: <33.500MB -5.7%) vs baseline: +5.3%

✅ medium_header_no_matches

Time: ✅ 9.918µs (SLO: <20.000µs 📉 -50.4%) vs baseline: +0.9%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +5.0%

✅ medium_valid_headers_all

Time: ✅ 11.272µs (SLO: <20.000µs 📉 -43.6%) vs baseline: +0.4%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.7%

✅ none_propagation_style

Time: ✅ 1.686µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -0.4%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ tracecontext_headers

Time: ✅ 34.629µs (SLO: <40.000µs 📉 -13.4%) vs baseline: +0.8%

Memory: ✅ 31.457MB (SLO: <33.500MB -6.1%) vs baseline: +4.7%

✅ valid_headers_all

Time: ✅ 6.500µs (SLO: <10.000µs 📉 -35.0%) vs baseline: +0.2%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%

✅ valid_headers_basic

Time: ✅ 6.116µs (SLO: <10.000µs 📉 -38.8%) vs baseline: +0.7%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.8%

✅ wsgi_empty_headers

Time: ✅ 1.596µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.2%

Memory: ✅ 31.457MB (SLO: <33.500MB -6.1%) vs baseline: +4.6%

✅ wsgi_invalid_priority_header

Time: ✅ 6.611µs (SLO: <10.000µs 📉 -33.9%) vs baseline: +0.6%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +5.1%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.605µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.6%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.6%

✅ wsgi_invalid_tags_header

Time: ✅ 6.585µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.3%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +5.1%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.585µs (SLO: <10.000µs 📉 -34.1%) vs baseline: ~same

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ wsgi_large_header_no_matches

Time: ✅ 28.717µs (SLO: <40.000µs 📉 -28.2%) vs baseline: ~same

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.716µs (SLO: <40.000µs 📉 -25.7%) vs baseline: -0.6%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.9%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.137µs (SLO: <20.000µs 📉 -49.3%) vs baseline: -0.1%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.543µs (SLO: <20.000µs 📉 -42.3%) vs baseline: +1.0%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ wsgi_valid_headers_all

Time: ✅ 6.574µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.3%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ wsgi_valid_headers_basic

Time: ✅ 6.192µs (SLO: <10.000µs 📉 -38.1%) vs baseline: +2.5%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.960µs (SLO: <30.000µs 📉 -26.8%) vs baseline: +1.1%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.9%

✅ with_all

Time: ✅ 33.955µs (SLO: <40.000µs 📉 -15.1%) vs baseline: ~same

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ with_dd_origin

Time: ✅ 28.524µs (SLO: <30.000µs -4.9%) vs baseline: +0.2%

Memory: ✅ 31.457MB (SLO: <33.500MB -6.1%) vs baseline: +4.6%

✅ with_priority_and_origin

Time: ✅ 27.905µs (SLO: <40.000µs 📉 -30.2%) vs baseline: +0.3%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.8%

✅ with_sampling_priority

Time: ✅ 22.114µs (SLO: <30.000µs 📉 -26.3%) vs baseline: +0.9%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ with_tags

Time: ✅ 30.889µs (SLO: <40.000µs 📉 -22.8%) vs baseline: +1.7%

Memory: ✅ 31.457MB (SLO: <33.500MB -6.1%) vs baseline: +4.7%

✅ with_tags_invalid

Time: ✅ 33.762µs (SLO: <40.000µs 📉 -15.6%) vs baseline: +0.7%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ with_tags_max_size

Time: ✅ 31.548µs (SLO: <40.000µs 📉 -21.1%) vs baseline: +1.8%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +5.1%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 33.132µs (SLO: <40.000µs 📉 -17.2%) vs baseline: +0.9%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.0%

✅ re_expand_noaspect

Time: ✅ 28.439µs (SLO: <40.000µs 📉 -28.9%) vs baseline: -0.8%

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ re_findall_aspect

Time: ✅ 3.653µs (SLO: <10.000µs 📉 -63.5%) vs baseline: +0.2%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ re_findall_noaspect

Time: ✅ 1.409µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.6%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ re_finditer_aspect

Time: ✅ 5.108µs (SLO: <10.000µs 📉 -48.9%) vs baseline: ~same

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +5.4%

✅ re_finditer_noaspect

Time: ✅ 1.410µs (SLO: <10.000µs 📉 -85.9%) vs baseline: ~same

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ re_fullmatch_aspect

Time: ✅ 3.372µs (SLO: <10.000µs 📉 -66.3%) vs baseline: +0.2%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ re_fullmatch_noaspect

Time: ✅ 1.282µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -1.6%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ re_group_aspect

Time: ✅ 3.463µs (SLO: <10.000µs 📉 -65.4%) vs baseline: +0.5%

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +5.0%

✅ re_group_noaspect

Time: ✅ 1.596µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.3%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ re_groups_aspect

Time: ✅ 3.551µs (SLO: <10.000µs 📉 -64.5%) vs baseline: -0.4%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +5.1%

✅ re_groups_noaspect

Time: ✅ 1.689µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -1.1%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ re_match_aspect

Time: ✅ 3.406µs (SLO: <10.000µs 📉 -65.9%) vs baseline: +1.7%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ re_match_noaspect

Time: ✅ 1.297µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.9%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ re_search_aspect

Time: ✅ 3.253µs (SLO: <10.000µs 📉 -67.5%) vs baseline: -0.2%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ re_search_noaspect

Time: ✅ 1.182µs (SLO: <10.000µs 📉 -88.2%) vs baseline: -1.6%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.4%

✅ re_sub_aspect

Time: ✅ 4.616µs (SLO: <10.000µs 📉 -53.8%) vs baseline: ~same

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +5.0%

✅ re_sub_noaspect

Time: ✅ 1.558µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +1.9%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ re_subn_aspect

Time: ✅ 4.838µs (SLO: <10.000µs 📉 -51.6%) vs baseline: ~same

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ re_subn_noaspect

Time: ✅ 1.604µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.327µs (SLO: <10.000µs 📉 -96.7%) vs baseline: +0.2%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ add_inplace_aspect

Time: ✅ 0.332µs (SLO: <10.000µs 📉 -96.7%) vs baseline: +0.5%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.8%

✅ add_inplace_noaspect

Time: ✅ 0.318µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +1.2%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ add_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.7%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.8%

✅ bytearray_aspect

Time: ✅ 1.813µs (SLO: <10.000µs 📉 -81.9%) vs baseline: -0.5%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.0%

✅ bytearray_extend_aspect

Time: ✅ 1.370µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -0.6%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ bytearray_extend_noaspect

Time: ✅ 0.610µs (SLO: <10.000µs 📉 -93.9%) vs baseline: ~same

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ bytearray_noaspect

Time: ✅ 0.486µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.3%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.7%

✅ bytes_aspect

Time: ✅ 1.818µs (SLO: <10.000µs 📉 -81.8%) vs baseline: -0.4%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.1%

✅ bytes_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.7%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ bytesio_aspect

Time: ✅ 1.865µs (SLO: <10.000µs 📉 -81.3%) vs baseline: +0.1%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.7%

✅ bytesio_noaspect

Time: ✅ 0.499µs (SLO: <10.000µs 📉 -95.0%) vs baseline: ~same

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ capitalize_aspect

Time: ✅ 0.737µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.7%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.1%

✅ capitalize_noaspect

Time: ✅ 0.430µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -0.4%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ casefold_aspect

Time: ✅ 0.735µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.8%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.0%

✅ casefold_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.3%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +5.1%

✅ decode_aspect

Time: ✅ 0.732µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +1.2%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +5.0%

✅ decode_noaspect

Time: ✅ 0.418µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.7%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ encode_aspect

Time: ✅ 0.710µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -1.3%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ encode_noaspect

Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.4%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.0%

✅ format_aspect

Time: ✅ 3.436µs (SLO: <10.000µs 📉 -65.6%) vs baseline: +0.5%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ format_map_aspect

Time: ✅ 3.189µs (SLO: <10.000µs 📉 -68.1%) vs baseline: -1.0%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ format_map_noaspect

Time: ✅ 0.769µs (SLO: <10.000µs 📉 -92.3%) vs baseline: -1.6%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +5.2%

✅ format_noaspect

Time: ✅ 0.592µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -1.0%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ index_aspect

Time: ✅ 0.342µs (SLO: <10.000µs 📉 -96.6%) vs baseline: -0.3%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ index_noaspect

Time: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.2%

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +4.9%

✅ join_aspect

Time: ✅ 1.221µs (SLO: <10.000µs 📉 -87.8%) vs baseline: -0.9%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.1%

✅ join_noaspect

Time: ✅ 0.490µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.1%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ ljust_aspect

Time: ✅ 10.231µs (SLO: <20.000µs 📉 -48.8%) vs baseline: +0.6%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%

✅ ljust_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.2%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.7%

✅ lower_aspect

Time: ✅ 2.240µs (SLO: <10.000µs 📉 -77.6%) vs baseline: -0.8%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ lower_noaspect

Time: ✅ 0.363µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -1.0%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ lstrip_aspect

Time: ✅ 10.971µs (SLO: <20.000µs 📉 -45.1%) vs baseline: +7.2%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +5.1%

✅ lstrip_noaspect

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.5%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%

✅ modulo_aspect

Time: ✅ 0.928µs (SLO: <10.000µs 📉 -90.7%) vs baseline: -0.4%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.6%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.430µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +0.4%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.8%

✅ modulo_aspect_for_bytes

Time: ✅ 0.906µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.1%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.121µs (SLO: <10.000µs 📉 -88.8%) vs baseline: +0.3%

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +4.9%

✅ modulo_noaspect

Time: ✅ 0.634µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +1.4%

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ replace_aspect

Time: ✅ 4.559µs (SLO: <10.000µs 📉 -54.4%) vs baseline: -0.2%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +5.1%

✅ replace_noaspect

Time: ✅ 0.463µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.6%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.8%

✅ repr_aspect

Time: ✅ 0.901µs (SLO: <10.000µs 📉 -91.0%) vs baseline: -0.3%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.8%

✅ repr_noaspect

Time: ✅ 0.418µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.9%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.8%

✅ rstrip_aspect

Time: ✅ 10.204µs (SLO: <20.000µs 📉 -49.0%) vs baseline: +0.4%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.6%

✅ rstrip_noaspect

Time: ✅ 0.378µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.8%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.0%

✅ slice_aspect

Time: ✅ 0.475µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +0.2%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ slice_noaspect

Time: ✅ 0.443µs (SLO: <10.000µs 📉 -95.6%) vs baseline: ~same

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ stringio_aspect

Time: ✅ 2.174µs (SLO: <10.000µs 📉 -78.3%) vs baseline: +0.4%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ stringio_noaspect

Time: ✅ 0.722µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +0.5%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ strip_aspect

Time: ✅ 10.232µs (SLO: <20.000µs 📉 -48.8%) vs baseline: ~same

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +5.1%

✅ strip_noaspect

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.6%

✅ swapcase_aspect

Time: ✅ 2.434µs (SLO: <10.000µs 📉 -75.7%) vs baseline: -0.2%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ swapcase_noaspect

Time: ✅ 0.533µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -0.2%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.0%

✅ title_aspect

Time: ✅ 2.384µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +0.1%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ title_noaspect

Time: ✅ 0.512µs (SLO: <10.000µs 📉 -94.9%) vs baseline: +2.2%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ translate_aspect

Time: ✅ 3.309µs (SLO: <10.000µs 📉 -66.9%) vs baseline: +0.9%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%

✅ translate_noaspect

Time: ✅ 1.042µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.4%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.0%

✅ upper_aspect

Time: ✅ 2.436µs (SLO: <10.000µs 📉 -75.6%) vs baseline: +6.2%

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ upper_noaspect

Time: ✅ 0.364µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.9%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.147µs (SLO: <10.000µs 📉 -58.5%) vs baseline: +2.0%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ ospathbasename_noaspect

Time: ✅ 1.078µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -0.1%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.6%

✅ ospathjoin_aspect

Time: ✅ 6.043µs (SLO: <10.000µs 📉 -39.6%) vs baseline: +2.8%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.6%

✅ ospathjoin_noaspect

Time: ✅ 2.293µs (SLO: <10.000µs 📉 -77.1%) vs baseline: -0.1%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ ospathnormcase_aspect

Time: ✅ 3.362µs (SLO: <10.000µs 📉 -66.4%) vs baseline: +0.7%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +5.2%

✅ ospathnormcase_noaspect

Time: ✅ 0.566µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -1.7%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.7%

✅ ospathsplit_aspect

Time: ✅ 4.782µs (SLO: <10.000µs 📉 -52.2%) vs baseline: +4.0%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.8%

✅ ospathsplit_noaspect

Time: ✅ 1.587µs (SLO: <10.000µs 📉 -84.1%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%

✅ ospathsplitdrive_aspect

Time: ✅ 3.580µs (SLO: <10.000µs 📉 -64.2%) vs baseline: ~same

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.1%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.695µs (SLO: <10.000µs 📉 -93.1%) vs baseline: -0.5%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.7%

✅ ospathsplitext_aspect

Time: ✅ 4.419µs (SLO: <10.000µs 📉 -55.8%) vs baseline: -0.4%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ ospathsplitext_noaspect

Time: ✅ 1.378µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.4%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.7%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.458µs (SLO: <10.000µs 📉 -85.4%) vs baseline: +0.2%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.6%

✅ rsplit_noaspect

Time: ✅ 0.577µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.9%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +4.8%

✅ split_aspect

Time: ✅ 1.468µs (SLO: <10.000µs 📉 -85.3%) vs baseline: +1.9%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%

✅ split_noaspect

Time: ✅ 0.569µs (SLO: <10.000µs 📉 -94.3%) vs baseline: ~same

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.6%

✅ splitlines_aspect

Time: ✅ 1.460µs (SLO: <10.000µs 📉 -85.4%) vs baseline: +3.1%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.6%

✅ splitlines_noaspect

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +5.3%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.787µs (SLO: <60.000µs 📉 -18.7%) vs baseline: ~same

Memory: ✅ 36.923MB (SLO: <39.000MB -5.3%) vs baseline: +4.9%

✅ propagation_enabled

Time: ✅ 143.203µs (SLO: <160.000µs 📉 -10.5%) vs baseline: -0.2%

Memory: ✅ 36.962MB (SLO: <39.000MB -5.2%) vs baseline: +5.2%

✅ propagation_enabled_100

Time: ✅ 1.564ms (SLO: <1.800ms 📉 -13.1%) vs baseline: -0.5%

Memory: ✅ 36.943MB (SLO: <39.000MB -5.3%) vs baseline: +4.8%

✅ propagation_enabled_1000

Time: ✅ 29.220ms (SLO: <30.550ms -4.4%) vs baseline: +0.3%

Memory: ✅ 36.962MB (SLO: <39.000MB -5.2%) vs baseline: +4.7%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 41.009ms (SLO: <42.000ms -2.4%) vs baseline: +0.9%

Memory: ✅ 34.170MB (SLO: <39.000MB 📉 -12.4%) vs baseline: +4.7%

✅ add-link

Time: ✅ 36.390ms (SLO: <38.550ms -5.6%) vs baseline: +0.1%

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +5.2%

✅ add-metrics

Time: ✅ 219.245ms (SLO: <232.000ms -5.5%) vs baseline: -1.1%

Memory: ✅ 34.210MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 212.580ms (SLO: <221.600ms -4.1%) vs baseline: +0.2%

Memory: ✅ 34.170MB (SLO: <39.000MB 📉 -12.4%) vs baseline: +4.9%

✅ get-context

Time: ✅ 29.160ms (SLO: <31.300ms -6.8%) vs baseline: -0.6%

Memory: ✅ 34.190MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 29.076ms (SLO: <31.000ms -6.2%) vs baseline: -0.1%

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 63.197ms (SLO: <65.850ms -4.0%) vs baseline: ~same

Memory: ✅ 34.229MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.9%

✅ set-status

Time: ✅ 31.687ms (SLO: <34.150ms -7.2%) vs baseline: -0.9%

Memory: ✅ 34.229MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.9%

✅ start

Time: ✅ 28.660ms (SLO: <30.150ms -4.9%) vs baseline: -0.4%

Memory: ✅ 34.210MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +5.0%

✅ start-finish

Time: ✅ 33.838ms (SLO: <35.350ms -4.3%) vs baseline: +0.1%

Memory: ✅ 34.190MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 33.804ms (SLO: <35.450ms -4.6%) vs baseline: -0.7%

Memory: ✅ 34.092MB (SLO: <39.000MB 📉 -12.6%) vs baseline: +4.4%

✅ update-name

Time: ✅ 30.888ms (SLO: <33.400ms -7.5%) vs baseline: -0.6%

Memory: ✅ 34.269MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +5.0%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 339.875ms (SLO: <354.300ms -4.1%) vs baseline: -0.8%

Memory: ✅ 37.412MB (SLO: <40.000MB -6.5%) vs baseline: +4.0%

✅ cache_on

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.7%

Memory: ✅ 35.454MB (SLO: <39.000MB -9.1%) vs baseline: +5.2%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.513µs (SLO: <170.000µs -8.5%) vs baseline: ~same

Memory: ✅ 36.521MB (SLO: <38.500MB -5.1%) vs baseline: +4.9%

✅ import_many_cached

Time: ✅ 121.800µs (SLO: <130.000µs -6.3%) vs baseline: +0.6%

Memory: ✅ 36.675MB (SLO: <38.500MB -4.7%) vs baseline: +5.2%

✅ import_many_stdlib

Time: ✅ 1.613ms (SLO: <1.750ms -7.8%) vs baseline: +0.2%

Memory: ✅ 36.669MB (SLO: <38.500MB -4.8%) vs baseline: +4.9%

✅ import_many_stdlib_cached

Time: ✅ 0.961ms (SLO: <1.100ms 📉 -12.7%) vs baseline: -0.5%

Memory: ✅ 36.598MB (SLO: <38.500MB -4.9%) vs baseline: +4.5%

✅ import_many_unknown

Time: ✅ 826.954µs (SLO: <890.000µs -7.1%) vs baseline: -0.5%

Memory: ✅ 36.753MB (SLO: <38.500MB -4.5%) vs baseline: +5.4%

✅ import_many_unknown_cached

Time: ✅ 796.652µs (SLO: <870.000µs -8.4%) vs baseline: +1.1%

Memory: ✅ 36.855MB (SLO: <38.500MB -4.3%) vs baseline: +5.8%

✅ import_one

Time: ✅ 19.770µs (SLO: <30.000µs 📉 -34.1%) vs baseline: -0.2%

Memory: ✅ 36.662MB (SLO: <39.000MB -6.0%) vs baseline: +5.7%

✅ import_one_cache

Time: ✅ 6.306µs (SLO: <10.000µs 📉 -36.9%) vs baseline: ~same

Memory: ✅ 36.642MB (SLO: <38.500MB -4.8%) vs baseline: +5.5%

✅ import_one_stdlib

Time: ✅ 18.675µs (SLO: <20.000µs -6.6%) vs baseline: -0.7%

Memory: ✅ 36.690MB (SLO: <38.500MB -4.7%) vs baseline: +5.4%

✅ import_one_stdlib_cache

Time: ✅ 6.240µs (SLO: <10.000µs 📉 -37.6%) vs baseline: +0.1%

Memory: ✅ 36.758MB (SLO: <38.500MB -4.5%) vs baseline: +6.0%

✅ import_one_unknown

Time: ✅ 45.397µs (SLO: <50.000µs -9.2%) vs baseline: -0.4%

Memory: ✅ 36.822MB (SLO: <38.500MB -4.4%) vs baseline: +5.6%

✅ import_one_unknown_cache

Time: ✅ 6.338µs (SLO: <10.000µs 📉 -36.6%) vs baseline: +0.4%

Memory: ✅ 36.656MB (SLO: <38.500MB -4.8%) vs baseline: +5.9%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.340µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.2%

Memory: ✅ 30.966MB (SLO: <34.000MB -8.9%) vs baseline: +5.1%

✅ high_rate_limit

Time: ✅ 2.395µs (SLO: <10.000µs 📉 -76.0%) vs baseline: -0.6%

Memory: ✅ 30.966MB (SLO: <34.000MB -8.9%) vs baseline: +4.7%

✅ long_window

Time: ✅ 2.351µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.3%

Memory: ✅ 30.966MB (SLO: <34.000MB -8.9%) vs baseline: +4.9%

✅ low_rate_limit

Time: ✅ 2.343µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.9%

Memory: ✅ 30.926MB (SLO: <34.000MB -9.0%) vs baseline: +4.8%

✅ no_rate_limit

Time: ✅ 0.826µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.2%

Memory: ✅ 31.064MB (SLO: <34.000MB -8.6%) vs baseline: +5.2%

✅ short_window

Time: ✅ 2.488µs (SLO: <10.000µs 📉 -75.1%) vs baseline: +0.5%

Memory: ✅ 31.044MB (SLO: <34.000MB -8.7%) vs baseline: +5.1%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 310.764ms (SLO: <320.950ms -3.2%) vs baseline: +0.4%

Memory: ✅ 32.578MB (SLO: <34.500MB -5.6%) vs baseline: +4.9%

✅ deep-profiled

Time: ✅ 326.480ms (SLO: <359.150ms -9.1%) vs baseline: -0.3%

Memory: ✅ 35.154MB (SLO: <39.000MB -9.9%) vs baseline: +4.8%

✅ medium

Time: ✅ 7.062ms (SLO: <7.400ms -4.6%) vs baseline: -0.2%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +5.0%

✅ shallow

Time: ✅ 0.951ms (SLO: <1.050ms -9.5%) vs baseline: -0.3%

Memory: ✅ 31.359MB (SLO: <34.000MB -7.8%) vs baseline: +4.8%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 273.062µs (SLO: <290.000µs -5.8%) vs baseline: -0.4%

Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +5.1%

✅ high_match

Time: ✅ 446.408µs (SLO: <480.000µs -7.0%) vs baseline: ~same

Memory: ✅ 31.300MB (SLO: <34.000MB -7.9%) vs baseline: +4.5%

✅ low_match

Time: ✅ 110.908µs (SLO: <120.000µs -7.6%) vs baseline: +0.5%

Memory: ✅ 631.821MB (SLO: <700.000MB -9.7%) vs baseline: +4.8%

✅ very_low_match

Time: ✅ 7.704ms (SLO: <8.500ms -9.4%) vs baseline: +0.6%

Memory: ✅ 69.564MB (SLO: <75.000MB -7.2%) vs baseline: +4.9%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 12.033µs (SLO: <20.000µs 📉 -39.8%) vs baseline: -1.9%

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +4.0%

✅ all-enabled

Time: ✅ 42.762µs (SLO: <50.000µs 📉 -14.5%) vs baseline: +1.9%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +3.8%

✅ collectipvariant_exists

Time: ✅ 43.638µs (SLO: <50.000µs 📉 -12.7%) vs baseline: +2.0%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +3.7%

✅ no-collectipvariant

Time: ✅ 42.696µs (SLO: <50.000µs 📉 -14.6%) vs baseline: +1.8%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.5%

✅ no-useragentvariant

Time: ✅ 40.967µs (SLO: <50.000µs 📉 -18.1%) vs baseline: +0.9%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.0%

✅ obfuscation-no-query

Time: ✅ 42.358µs (SLO: <50.000µs 📉 -15.3%) vs baseline: ~same

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +4.3%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 79.193µs (SLO: <90.000µs 📉 -12.0%) vs baseline: ~same

Memory: ✅ 32.263MB (SLO: <34.000MB -5.1%) vs baseline: +5.0%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 79.501µs (SLO: <90.000µs 📉 -11.7%) vs baseline: -0.2%

Memory: ✅ 32.283MB (SLO: <34.000MB -5.0%) vs baseline: +4.9%

✅ obfuscation-send-querystring-disabled

Time: ✅ 157.061µs (SLO: <170.000µs -7.6%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <34.500MB -6.6%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 151.583µs (SLO: <160.000µs -5.3%) vs baseline: +0.3%

Memory: ✅ 32.244MB (SLO: <34.500MB -6.5%) vs baseline: +4.8%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 159.186µs (SLO: <170.000µs -6.4%) vs baseline: +1.0%

Memory: ✅ 32.244MB (SLO: <34.500MB -6.5%) vs baseline: +5.2%

✅ useragentvariant_exists_1

Time: ✅ 41.535µs (SLO: <50.000µs 📉 -16.9%) vs baseline: +0.6%

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +4.6%

✅ useragentvariant_exists_2

Time: ✅ 43.374µs (SLO: <50.000µs 📉 -13.3%) vs baseline: +1.9%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.2%

✅ useragentvariant_exists_3

Time: ✅ 42.099µs (SLO: <50.000µs 📉 -15.8%) vs baseline: -0.5%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +3.7%

✅ useragentvariant_not_exists_1

Time: ✅ 42.154µs (SLO: <50.000µs 📉 -15.7%) vs baseline: +1.3%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.4%

✅ useragentvariant_not_exists_2

Time: ✅ 42.254µs (SLO: <50.000µs 📉 -15.5%) vs baseline: +1.4%

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +4.1%

✅ span - 26/26

✅ add-event

Time: ✅ 24.183ms (SLO: <26.200ms -7.7%) vs baseline: +0.3%

Memory: ✅ 51.138MB (SLO: <53.000MB -3.5%) vs baseline: +5.0%

✅ add-metrics

Time: ✅ 91.555ms (SLO: <98.350ms -6.9%) vs baseline: ~same

Memory: ✅ 607.061MB (SLO: <961.000MB 📉 -36.8%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 150.160ms (SLO: <168.550ms 📉 -10.9%) vs baseline: ~same

Memory: ✅ 607.941MB (SLO: <962.500MB 📉 -36.8%) vs baseline: +5.0%

✅ get-context

Time: ✅ 22.315ms (SLO: <23.700ms -5.8%) vs baseline: ~same

Memory: ✅ 49.811MB (SLO: <53.000MB -6.0%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 22.756ms (SLO: <23.900ms -4.8%) vs baseline: +0.1%

Memory: ✅ 49.788MB (SLO: <53.000MB -6.1%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 42.726ms (SLO: <44.500ms -4.0%) vs baseline: +0.6%

Memory: ✅ 42.719MB (SLO: <53.000MB 📉 -19.4%) vs baseline: +5.0%

✅ set-status

Time: ✅ 24.474ms (SLO: <26.000ms -5.9%) vs baseline: +0.5%

Memory: ✅ 49.757MB (SLO: <53.000MB -6.1%) vs baseline: +4.6%

✅ start

Time: ✅ 22.408ms (SLO: <23.500ms -4.6%) vs baseline: +0.2%

Memory: ✅ 49.900MB (SLO: <53.000MB -5.8%) vs baseline: +5.0%

✅ start-finish

Time: ✅ 51.558ms (SLO: <55.500ms -7.1%) vs baseline: -0.6%

Memory: ✅ 31.379MB (SLO: <34.000MB -7.7%) vs baseline: +4.5%

✅ start-finish-telemetry

Time: ✅ 52.911ms (SLO: <58.300ms -9.2%) vs baseline: ~same

Memory: ✅ 31.379MB (SLO: <34.000MB -7.7%) vs baseline: +4.6%

✅ start-finish-traceid128

Time: ✅ 54.892ms (SLO: <60.050ms -8.6%) vs baseline: -0.2%

Memory: ✅ 31.438MB (SLO: <34.000MB -7.5%) vs baseline: +5.1%

✅ start-traceid128

Time: ✅ 22.648ms (SLO: <24.600ms -7.9%) vs baseline: -0.4%

Memory: ✅ 49.796MB (SLO: <53.000MB -6.0%) vs baseline: +4.8%

✅ update-name

Time: ✅ 23.108ms (SLO: <24.100ms -4.1%) vs baseline: -0.3%

Memory: ✅ 50.434MB (SLO: <53.000MB -4.8%) vs baseline: +4.7%

✅ tracer - 6/6

✅ large

Time: ✅ 30.543ms (SLO: <32.950ms -7.3%) vs baseline: +0.3%

Memory: ✅ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.9%

✅ medium

Time: ✅ 2.996ms (SLO: <3.200ms -6.4%) vs baseline: +1.0%

Memory: ✅ 31.339MB (SLO: <34.000MB -7.8%) vs baseline: +5.0%

✅ small

Time: ✅ 340.213µs (SLO: <370.000µs -8.1%) vs baseline: +0.8%

Memory: ✅ 31.359MB (SLO: <34.000MB -7.8%) vs baseline: +4.6%

ℹ️ Scenarios Missing SLO Configuration (14 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-context_with_data_listeners_and_all_listeners
coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_listeners_and_all_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_only_all_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_listeners_and_all_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
coreapiscenario-core_dispatch_with_results_only_all_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

CI Visibility: Fixes some bad behavior in test skipping count, introduced in #14257 (cherry picked from commit e239ca4)

dd-octo-sts Bot added the CI App label Sep 24, 2025

dd-octo-sts Bot requested review from a team as code owners September 24, 2025 17:01

dd-octo-sts Bot requested review from Kyle-Verhoog and vitor-de-araujo September 24, 2025 17:01

fix(ci_visibility): itr skipped counts suites or tests (#14681)

4de3136

CI Visibility: Fixes some bad behavior in test skipping count, introduced in #14257 (cherry picked from commit e239ca4)

gnufede force-pushed the backport-14681-to-3.13 branch from 55f5bd8 to 4de3136 Compare September 25, 2025 07:57

gnufede approved these changes Sep 25, 2025

View reviewed changes

gnufede enabled auto-merge (squash) September 25, 2025 07:59

gnufede merged commit 78002f1 into 3.13 Sep 25, 2025
431 checks passed

gnufede deleted the backport-14681-to-3.13 branch September 25, 2025 09:09

Conversation

dd-octo-sts Bot commented Sep 24, 2025 • edited by gnufede Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Sep 24, 2025

Uh oh!

github-actions Bot commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter Bot commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ 1-count-metric-1-times

✅ 1-count-metrics-100-times

✅ 1-distribution-metric-1-times

✅ 1-distribution-metrics-100-times

✅ 1-gauge-metric-1-times

✅ 1-gauge-metrics-100-times

✅ 1-rate-metric-1-times

✅ 1-rate-metrics-100-times

✅ 100-count-metrics-100-times

✅ 100-distribution-metrics-100-times

✅ 100-gauge-metrics-100-times

✅ 100-rate-metrics-100-times

✅ flush-1-metric

✅ flush-100-metrics

✅ flush-1000-metrics

✅ appsec

✅ exception-replay-enabled

✅ iast

✅ profiler

✅ span-code-origin

✅ tracer

✅ tracer-and-profiler

✅ tracer-dont-create-db-spans

✅ tracer-no-caches

✅ tracer-no-databases

✅ tracer-no-middleware

✅ tracer-no-templates

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ appsec-get

✅ appsec-post

✅ appsec-telemetry

✅ debugger

✅ iast-get

✅ profiler

✅ tracer

✅ appsec-enabled

✅ iast-enabled

✅ tracer-enabled

✅ add-event

✅ add-metrics

✅ add-tags

✅ get-context

✅ is-recording

✅ record-exception

✅ set-status

✅ start

✅ start-finish

✅ start-finish-telemetry

✅ update-name

⚠️ context_with_data_listeners

✅ context_with_data_no_listeners

⚠️ context_with_data_only_all_listeners

✅ get_item_exists

✅ get_item_missing

✅ set_item

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ all_styles_all_headers

✅ b3_headers

✅ b3_single_headers

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

dd-octo-sts Bot commented Sep 24, 2025 •

edited by gnufede

Loading

github-actions Bot commented Sep 24, 2025 •

edited

Loading

pr-commenter Bot commented Sep 24, 2025 •

edited

Loading