WARNING: THIS SITE IS A MIRROR OF GITHUB.COM / IT CANNOT LOGIN OR REGISTER ACCOUNTS / THE CONTENTS ARE PROVIDED AS-IS / THIS SITE ASSUMES NO RESPONSIBILITY FOR ANY DISPLAYED CONTENT OR LINKS / IF YOU FOUND SOMETHING MAY NOT GOOD FOR EVERYONE, CONTACT ADMIN AT ilovescratch@foxmail.com
Skip to content

Conversation

@avara1986
Copy link
Member

Update benchmark functions, we need this changes in the main branches

@avara1986 avara1986 added changelog/no-changelog A changelog entry is not required for this PR. backport 4.0 backport 3.19 labels Dec 5, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Dec 5, 2025

CODEOWNERS have been resolved as:

benchmarks/appsec_iast_aspects/config.yaml                              @DataDog/asm-python
benchmarks/appsec_iast_aspects/functions.py                             @DataDog/asm-python

@github-actions
Copy link
Contributor

github-actions bot commented Dec 5, 2025

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 247 ± 2 ms.

The average import time from base is: 250 ± 2 ms.

The import time difference between this PR and base is: -3.24 ± 0.09 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.749 ms (1.11%)
ddtrace 1.395 ms (0.56%)
ddtrace._logger 0.684 ms (0.28%)
ddtrace.internal.telemetry 0.684 ms (0.28%)
ddtrace.internal.telemetry.writer 0.684 ms (0.28%)
ddtrace.internal.utils.version 0.684 ms (0.28%)
ddtrace.version 0.684 ms (0.28%)
ddtrace.internal._unpatched 0.063 ms (0.03%)
subprocess 0.035 ms (0.01%)
contextlib 0.035 ms (0.01%)
json 0.028 ms (0.01%)
json.decoder 0.028 ms (0.01%)
re 0.028 ms (0.01%)
enum 0.028 ms (0.01%)
types 0.028 ms (0.01%)
ddtrace.bootstrap.sitecustomize 1.355 ms (0.55%)
ddtrace.bootstrap.preload 1.355 ms (0.55%)
ddtrace.internal.remoteconfig.client 0.654 ms (0.26%)

@pr-commenter
Copy link

pr-commenter bot commented Dec 5, 2025

Performance SLOs

Comparing candidate avara1986/APPSEC-60151_update_benchmarks (db4f6ed) with baseline main (3d755fb)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.448µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.9%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.7%


✅ add_inplace_aspect

Time: ✅ 0.446µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.3%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%


✅ add_inplace_noaspect

Time: ✅ 0.288µs (SLO: <10.000µs 📉 -97.1%) vs baseline: +0.3%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.4%


✅ add_noaspect

Time: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.4%

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.1%


✅ bytearray_aspect

Time: ✅ 1.368µs (SLO: <10.000µs 📉 -86.3%) vs baseline: +0.8%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.6%


✅ bytearray_extend_aspect

Time: ✅ 1.523µs (SLO: <10.000µs 📉 -84.8%) vs baseline: -1.4%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.6%


✅ bytearray_extend_noaspect

Time: ✅ 0.619µs (SLO: <10.000µs 📉 -93.8%) vs baseline: ~same

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.6%


✅ bytearray_noaspect

Time: ✅ 0.486µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.2%

Memory: ✅ 40.088MB (SLO: <41.500MB -3.4%) vs baseline: +4.4%


✅ bytes_aspect

Time: ✅ 1.296µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.2%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.1%


✅ bytes_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.2%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%


✅ bytesio_aspect

Time: ✅ 1.354µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +2.5%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%


✅ bytesio_noaspect

Time: ✅ 0.498µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.4%

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.3%


✅ capitalize_aspect

Time: ✅ 0.739µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.3%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +4.9%


✅ capitalize_noaspect

Time: ✅ 0.440µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.4%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.2%


✅ casefold_aspect

Time: ✅ 0.737µs (SLO: <10.000µs 📉 -92.6%) vs baseline: ~same

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%


✅ casefold_noaspect

Time: ✅ 0.371µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.5%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.7%


✅ decode_aspect

Time: ✅ 0.725µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.3%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.5%


✅ decode_noaspect

Time: ✅ 0.424µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.8%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.7%


✅ encode_aspect

Time: ✅ 0.715µs (SLO: <10.000µs 📉 -92.9%) vs baseline: ~same

Memory: ✅ 40.383MB (SLO: <41.500MB -2.7%) vs baseline: +5.2%


✅ encode_noaspect

Time: ✅ 0.405µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.3%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.7%


✅ format_aspect

Time: ✅ 3.495µs (SLO: <10.000µs 📉 -65.1%) vs baseline: ~same

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.4%


✅ format_map_aspect

Time: ✅ 3.620µs (SLO: <10.000µs 📉 -63.8%) vs baseline: -2.2%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +5.0%


✅ format_map_noaspect

Time: ✅ 0.822µs (SLO: <10.000µs 📉 -91.8%) vs baseline: +0.7%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.0%


✅ format_noaspect

Time: ✅ 0.594µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.3%


✅ index_aspect

Time: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.4%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ index_noaspect

Time: ✅ 0.314µs (SLO: <10.000µs 📉 -96.9%) vs baseline: -1.8%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.6%


✅ join_aspect

Time: ✅ 1.392µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +1.0%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.9%


✅ join_noaspect

Time: ✅ 0.535µs (SLO: <10.000µs 📉 -94.7%) vs baseline: +0.8%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.3%


✅ ljust_aspect

Time: ✅ 2.633µs (SLO: <20.000µs 📉 -86.8%) vs baseline: +0.5%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.0%


✅ ljust_noaspect

Time: ✅ 0.414µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.9%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.2%


✅ lower_aspect

Time: ✅ 2.303µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +2.1%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.7%


✅ lower_noaspect

Time: ✅ 0.373µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.7%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.0%


✅ lstrip_aspect

Time: ✅ 2.232µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +0.6%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +3.9%


✅ lstrip_noaspect

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.3%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.4%


✅ modulo_aspect

Time: ✅ 1.091µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +4.1%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.8%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.598µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.6%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.6%


✅ modulo_aspect_for_bytes

Time: ✅ 1.025µs (SLO: <10.000µs 📉 -89.7%) vs baseline: +1.0%

Memory: ✅ 40.088MB (SLO: <41.500MB -3.4%) vs baseline: +4.9%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.311µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +3.1%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +4.8%


✅ modulo_noaspect

Time: ✅ 0.670µs (SLO: <10.000µs 📉 -93.3%) vs baseline: -0.6%

Memory: ✅ 40.029MB (SLO: <41.500MB -3.5%) vs baseline: +4.3%


✅ replace_aspect

Time: ✅ 4.933µs (SLO: <10.000µs 📉 -50.7%) vs baseline: -1.0%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.4%


✅ replace_noaspect

Time: ✅ 0.469µs (SLO: <10.000µs 📉 -95.3%) vs baseline: +0.4%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%


✅ repr_aspect

Time: ✅ 0.958µs (SLO: <10.000µs 📉 -90.4%) vs baseline: +0.3%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ repr_noaspect

Time: ✅ 0.458µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.5%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.7%


✅ rstrip_aspect

Time: ✅ 1.912µs (SLO: <20.000µs 📉 -90.4%) vs baseline: +0.7%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ rstrip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.1%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%


✅ slice_aspect

Time: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -1.0%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.4%


✅ slice_noaspect

Time: ✅ 0.453µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.7%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.4%


✅ stringio_aspect

Time: ✅ 1.715µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +1.6%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.4%


✅ stringio_noaspect

Time: ✅ 0.912µs (SLO: <10.000µs 📉 -90.9%) vs baseline: -0.9%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%


✅ strip_aspect

Time: ✅ 2.217µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +0.9%

Memory: ✅ 40.088MB (SLO: <41.500MB -3.4%) vs baseline: +4.6%


✅ strip_noaspect

Time: ✅ 0.390µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.7%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.6%


✅ swapcase_aspect

Time: ✅ 2.799µs (SLO: <10.000µs 📉 -72.0%) vs baseline: 📈 +13.6%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.7%


✅ swapcase_noaspect

Time: ✅ 0.539µs (SLO: <10.000µs 📉 -94.6%) vs baseline: -0.8%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.0%


✅ title_aspect

Time: ✅ 2.457µs (SLO: <10.000µs 📉 -75.4%) vs baseline: +3.4%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%


✅ title_noaspect

Time: ✅ 0.506µs (SLO: <10.000µs 📉 -94.9%) vs baseline: +0.2%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%


✅ translate_aspect

Time: ✅ 3.326µs (SLO: <10.000µs 📉 -66.7%) vs baseline: +0.6%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.7%


✅ translate_noaspect

Time: ✅ 1.040µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.6%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%


✅ upper_aspect

Time: ✅ 2.316µs (SLO: <10.000µs 📉 -76.8%) vs baseline: +3.7%

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.0%


✅ upper_noaspect

Time: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +1.7%

Memory: ✅ 39.931MB (SLO: <41.500MB -3.8%) vs baseline: +4.2%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.155µs (SLO: <10.000µs 📉 -48.5%) vs baseline: 📈 +24.1%

Memory: ✅ 40.069MB (SLO: <41.000MB -2.3%) vs baseline: +4.4%


✅ ospathbasename_noaspect

Time: ✅ 1.089µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +0.7%

Memory: ✅ 40.364MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +5.4%


✅ ospathjoin_aspect

Time: ✅ 6.148µs (SLO: <10.000µs 📉 -38.5%) vs baseline: ~same

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.6%


✅ ospathjoin_noaspect

Time: ✅ 2.281µs (SLO: <10.000µs 📉 -77.2%) vs baseline: ~same

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.9%


✅ ospathnormcase_aspect

Time: ✅ 3.404µs (SLO: <10.000µs 📉 -66.0%) vs baseline: -0.5%

Memory: ✅ 40.069MB (SLO: <41.000MB -2.3%) vs baseline: +4.3%


✅ ospathnormcase_noaspect

Time: ✅ 0.568µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.4%

Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.5%


✅ ospathsplit_aspect

Time: ✅ 4.719µs (SLO: <10.000µs 📉 -52.8%) vs baseline: -1.1%

Memory: ✅ 40.364MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +5.5%


✅ ospathsplit_noaspect

Time: ✅ 1.590µs (SLO: <10.000µs 📉 -84.1%) vs baseline: ~same

Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +3.9%


✅ ospathsplitdrive_aspect

Time: ✅ 3.643µs (SLO: <10.000µs 📉 -63.6%) vs baseline: ~same

Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.4%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.691µs (SLO: <10.000µs 📉 -93.1%) vs baseline: -1.5%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.0%


✅ ospathsplitext_aspect

Time: ✅ 4.532µs (SLO: <10.000µs 📉 -54.7%) vs baseline: -0.9%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.7%


✅ ospathsplitext_noaspect

Time: ✅ 1.384µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.4%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.9%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.378µs (SLO: <20.000µs 📉 -83.1%) vs baseline: 📈 +15.9%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.2%


✅ 1-count-metrics-100-times

Time: ✅ 200.952µs (SLO: <220.000µs -8.7%) vs baseline: +0.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.0%


✅ 1-distribution-metric-1-times

Time: ✅ 3.272µs (SLO: <20.000µs 📉 -83.6%) vs baseline: -0.6%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +3.9%


✅ 1-distribution-metrics-100-times

Time: ✅ 217.802µs (SLO: <230.000µs -5.3%) vs baseline: +0.7%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.5%


✅ 1-gauge-metric-1-times

Time: ✅ 2.166µs (SLO: <20.000µs 📉 -89.2%) vs baseline: +1.3%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.3%


✅ 1-gauge-metrics-100-times

Time: ✅ 135.866µs (SLO: <150.000µs -9.4%) vs baseline: -0.2%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +3.8%


✅ 1-rate-metric-1-times

Time: ✅ 3.063µs (SLO: <20.000µs 📉 -84.7%) vs baseline: +0.6%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.1%


✅ 1-rate-metrics-100-times

Time: ✅ 214.029µs (SLO: <250.000µs 📉 -14.4%) vs baseline: -0.6%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ 100-count-metrics-100-times

Time: ✅ 20.416ms (SLO: <22.000ms -7.2%) vs baseline: +0.2%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.261ms (SLO: <2.550ms 📉 -11.3%) vs baseline: -1.5%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.4%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.410ms (SLO: <1.550ms -9.0%) vs baseline: +0.1%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ 100-rate-metrics-100-times

Time: ✅ 2.224ms (SLO: <2.550ms 📉 -12.8%) vs baseline: +0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%


✅ flush-1-metric

Time: ✅ 4.649µs (SLO: <20.000µs 📉 -76.8%) vs baseline: -0.7%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.0%


✅ flush-100-metrics

Time: ✅ 174.413µs (SLO: <250.000µs 📉 -30.2%) vs baseline: -0.4%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.7%


✅ flush-1000-metrics

Time: ✅ 2.171ms (SLO: <2.500ms 📉 -13.1%) vs baseline: -0.4%

Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +4.9%

🟡 Near SLO Breach (17 suites)
🟡 coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.193µs (SLO: <20.000µs 📉 -34.0%) vs baseline: ~same

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%


✅ context_with_data_no_listeners

Time: ✅ 3.275µs (SLO: <10.000µs 📉 -67.2%) vs baseline: +0.5%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%


✅ get_item_exists

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.2%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%


✅ get_item_missing

Time: ✅ 0.631µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -1.2%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%


✅ set_item

Time: ✅ 24.021µs (SLO: <30.000µs 📉 -19.9%) vs baseline: +0.5%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


🟡 djangosimple - 29/29

✅ appsec

Time: ✅ 19.550ms (SLO: <22.300ms 📉 -12.3%) vs baseline: +0.1%

Memory: ✅ 68.164MB (SLO: <70.500MB -3.3%) vs baseline: +4.8%


✅ exception-replay-enabled

Time: ✅ 1.362ms (SLO: <1.450ms -6.1%) vs baseline: -0.2%

Memory: ✅ 66.217MB (SLO: <67.500MB 🟡 -1.9%) vs baseline: +4.6%


✅ iast

Time: ✅ 19.588ms (SLO: <22.250ms 📉 -12.0%) vs baseline: ~same

Memory: ✅ 68.203MB (SLO: <70.000MB -2.6%) vs baseline: +4.9%


✅ profiler

Time: ✅ 15.442ms (SLO: <16.550ms -6.7%) vs baseline: ~same

Memory: ✅ 56.437MB (SLO: <57.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ resource-renaming

Time: ✅ 19.477ms (SLO: <21.750ms 📉 -10.4%) vs baseline: ~same

Memory: ✅ 68.164MB (SLO: <70.500MB -3.3%) vs baseline: +4.9%


✅ span-code-origin

Time: ✅ 20.151ms (SLO: <28.200ms 📉 -28.5%) vs baseline: +2.1%

Memory: ✅ 68.108MB (SLO: <71.000MB -4.1%) vs baseline: +4.9%


✅ tracer

Time: ✅ 19.590ms (SLO: <21.750ms -9.9%) vs baseline: +0.4%

Memory: ✅ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +4.8%


✅ tracer-and-profiler

Time: ✅ 21.723ms (SLO: <23.500ms -7.6%) vs baseline: -0.2%


✅ tracer-dont-create-db-spans

Time: ✅ 19.698ms (SLO: <21.500ms -8.4%) vs baseline: +0.8%

Memory: ✅ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +4.9%


✅ tracer-minimal

Time: ✅ 16.800ms (SLO: <17.500ms -4.0%) vs baseline: +0.3%

Memory: ✅ 67.751MB (SLO: <70.000MB -3.2%) vs baseline: +4.7%


✅ tracer-native

Time: ✅ 19.502ms (SLO: <21.750ms 📉 -10.3%) vs baseline: +0.2%

Memory: ✅ 68.203MB (SLO: <72.500MB -5.9%) vs baseline: +4.9%


✅ tracer-no-caches

Time: ✅ 17.604ms (SLO: <19.650ms 📉 -10.4%) vs baseline: -0.1%

Memory: ✅ 67.889MB (SLO: <70.000MB -3.0%) vs baseline: +4.7%


✅ tracer-no-databases

Time: ✅ 19.233ms (SLO: <20.100ms -4.3%) vs baseline: +0.9%

Memory: ✅ 67.928MB (SLO: <70.000MB -3.0%) vs baseline: +5.0%


✅ tracer-no-middleware

Time: ✅ 19.208ms (SLO: <21.500ms 📉 -10.7%) vs baseline: -0.5%

Memory: ✅ 68.066MB (SLO: <70.000MB -2.8%) vs baseline: +5.0%


✅ tracer-no-templates

Time: ✅ 19.418ms (SLO: <22.000ms 📉 -11.7%) vs baseline: +0.6%

Memory: ✅ 68.137MB (SLO: <70.500MB -3.4%) vs baseline: +4.9%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.297ms (SLO: <19.850ms 📉 -17.9%) vs baseline: ~same

Memory: ✅ 69.757MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 16.312ms (SLO: <19.400ms 📉 -15.9%) vs baseline: -0.1%

Memory: ✅ 69.855MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +5.0%


✅ tracer-enabled

Time: ✅ 16.335ms (SLO: <19.450ms 📉 -16.0%) vs baseline: ~same

Memory: ✅ 69.835MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +4.9%


🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.059ms (SLO: <2.300ms 📉 -10.5%) vs baseline: -0.3%

Memory: ✅ 55.778MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 2.073ms (SLO: <2.250ms -7.9%) vs baseline: ~same

Memory: ✅ 55.738MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.061ms (SLO: <2.300ms 📉 -10.4%) vs baseline: ~same

Memory: ✅ 55.620MB (SLO: <56.500MB 🟡 -1.6%) vs baseline: +4.6%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.391ms (SLO: <4.750ms 📉 -28.6%) vs baseline: +0.4%

Memory: ✅ 55.470MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +5.1%


✅ appsec-post

Time: ✅ 2.854ms (SLO: <6.750ms 📉 -57.7%) vs baseline: -0.1%

Memory: ✅ 55.548MB (SLO: <66.500MB 📉 -16.5%) vs baseline: +4.4%


✅ appsec-telemetry

Time: ✅ 3.383ms (SLO: <4.750ms 📉 -28.8%) vs baseline: +0.3%

Memory: ✅ 55.467MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +4.9%


✅ debugger

Time: ✅ 1.865ms (SLO: <2.000ms -6.8%) vs baseline: -0.4%

Memory: ✅ 47.920MB (SLO: <49.500MB -3.2%) vs baseline: +4.8%


✅ iast-get

Time: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: +0.1%

Memory: ✅ 44.618MB (SLO: <49.000MB -8.9%) vs baseline: +4.7%


✅ profiler

Time: ✅ 1.903ms (SLO: <2.100ms -9.4%) vs baseline: -0.1%

Memory: ✅ 48.745MB (SLO: <50.000MB -2.5%) vs baseline: +4.8%


✅ resource-renaming

Time: ✅ 3.363ms (SLO: <3.650ms -7.9%) vs baseline: ~same

Memory: ✅ 55.392MB (SLO: <56.000MB 🟡 -1.1%) vs baseline: +4.7%


✅ tracer

Time: ✅ 3.369ms (SLO: <3.650ms -7.7%) vs baseline: ~same

Memory: ✅ 55.450MB (SLO: <56.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ tracer-native

Time: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: -0.3%

Memory: ✅ 55.470MB (SLO: <60.000MB -7.6%) vs baseline: +5.0%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.055ms (SLO: <4.200ms 📉 -51.1%) vs baseline: -0.2%

Memory: ✅ 55.738MB (SLO: <66.000MB 📉 -15.5%) vs baseline: +4.7%


✅ iast-enabled

Time: ✅ 2.064ms (SLO: <2.800ms 📉 -26.3%) vs baseline: ~same

Memory: ✅ 55.719MB (SLO: <62.500MB 📉 -10.9%) vs baseline: +4.7%


✅ tracer-enabled

Time: ✅ 2.053ms (SLO: <2.250ms -8.8%) vs baseline: ~same

Memory: ✅ 55.660MB (SLO: <56.500MB 🟡 -1.5%) vs baseline: +4.6%


🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 82.083µs (SLO: <100.000µs 📉 -17.9%) vs baseline: +0.9%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ b3_headers

Time: ✅ 14.275µs (SLO: <20.000µs 📉 -28.6%) vs baseline: +0.4%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.5%


✅ b3_single_headers

Time: ✅ 13.335µs (SLO: <20.000µs 📉 -33.3%) vs baseline: -0.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.8%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.057µs (SLO: <80.000µs 📉 -19.9%) vs baseline: +0.2%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.215µs (SLO: <80.000µs 📉 -17.2%) vs baseline: +0.1%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%


✅ empty_headers

Time: ✅ 1.623µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.3%


✅ full_t_id_datadog_headers

Time: ✅ 22.501µs (SLO: <30.000µs 📉 -25.0%) vs baseline: +0.9%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.9%


✅ invalid_priority_header

Time: ✅ 6.526µs (SLO: <10.000µs 📉 -34.7%) vs baseline: -0.2%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.5%


✅ invalid_span_id_header

Time: ✅ 6.497µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.5%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ invalid_tags_header

Time: ✅ 6.496µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.1%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%


✅ invalid_trace_id_header

Time: ✅ 6.544µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.3%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ large_header_no_matches

Time: ✅ 27.711µs (SLO: <30.000µs -7.6%) vs baseline: -0.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%


✅ large_valid_headers_all

Time: ✅ 28.737µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.5%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.1%


✅ medium_header_no_matches

Time: ✅ 9.804µs (SLO: <20.000µs 📉 -51.0%) vs baseline: -0.3%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.8%


✅ medium_valid_headers_all

Time: ✅ 11.314µs (SLO: <20.000µs 📉 -43.4%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%


✅ none_propagation_style

Time: ✅ 1.767µs (SLO: <10.000µs 📉 -82.3%) vs baseline: +3.1%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.3%


✅ tracecontext_headers

Time: ✅ 34.635µs (SLO: <40.000µs 📉 -13.4%) vs baseline: +0.2%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%


✅ valid_headers_all

Time: ✅ 6.523µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.1%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%


✅ valid_headers_basic

Time: ✅ 6.101µs (SLO: <10.000µs 📉 -39.0%) vs baseline: +0.2%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ wsgi_empty_headers

Time: ✅ 1.617µs (SLO: <10.000µs 📉 -83.8%) vs baseline: -0.3%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%


✅ wsgi_invalid_priority_header

Time: ✅ 6.578µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.6%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.605µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.3%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ wsgi_invalid_tags_header

Time: ✅ 6.572µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.658µs (SLO: <10.000µs 📉 -33.4%) vs baseline: +1.4%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%


✅ wsgi_large_header_no_matches

Time: ✅ 28.729µs (SLO: <40.000µs 📉 -28.2%) vs baseline: ~same

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.811µs (SLO: <40.000µs 📉 -25.5%) vs baseline: +0.1%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.230µs (SLO: <20.000µs 📉 -48.8%) vs baseline: +0.4%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.681µs (SLO: <20.000µs 📉 -41.6%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ wsgi_valid_headers_all

Time: ✅ 6.567µs (SLO: <10.000µs 📉 -34.3%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ wsgi_valid_headers_basic

Time: ✅ 6.164µs (SLO: <10.000µs 📉 -38.4%) vs baseline: +0.9%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%


🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.161µs (SLO: <30.000µs 📉 -26.1%) vs baseline: +5.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ with_all

Time: ✅ 27.884µs (SLO: <40.000µs 📉 -30.3%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ with_dd_origin

Time: ✅ 24.770µs (SLO: <30.000µs 📉 -17.4%) vs baseline: -0.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ with_priority_and_origin

Time: ✅ 24.406µs (SLO: <40.000µs 📉 -39.0%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%


✅ with_sampling_priority

Time: ✅ 21.251µs (SLO: <30.000µs 📉 -29.2%) vs baseline: +0.5%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ with_tags

Time: ✅ 25.948µs (SLO: <40.000µs 📉 -35.1%) vs baseline: -0.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.5%


✅ with_tags_invalid

Time: ✅ 27.414µs (SLO: <40.000µs 📉 -31.5%) vs baseline: +0.4%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%


✅ with_tags_max_size

Time: ✅ 26.569µs (SLO: <40.000µs 📉 -33.6%) vs baseline: +0.4%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%


🟡 iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 33.983µs (SLO: <40.000µs 📉 -15.0%) vs baseline: +7.1%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.8%


✅ re_expand_noaspect

Time: ✅ 28.436µs (SLO: <40.000µs 📉 -28.9%) vs baseline: -0.6%

Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.2%


✅ re_findall_aspect

Time: ✅ 2.908µs (SLO: <10.000µs 📉 -70.9%) vs baseline: -0.4%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.0%


✅ re_findall_noaspect

Time: ✅ 1.420µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.4%

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.8%


✅ re_finditer_aspect

Time: ✅ 4.427µs (SLO: <10.000µs 📉 -55.7%) vs baseline: -1.0%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.7%


✅ re_finditer_noaspect

Time: ✅ 1.395µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -0.3%

Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.7%


✅ re_fullmatch_aspect

Time: ✅ 2.692µs (SLO: <10.000µs 📉 -73.1%) vs baseline: ~same

Memory: ✅ 40.324MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +5.3%


✅ re_fullmatch_noaspect

Time: ✅ 1.315µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.1%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.8%


✅ re_group_aspect

Time: ✅ 3.005µs (SLO: <10.000µs 📉 -70.0%) vs baseline: +0.5%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.5%


✅ re_group_noaspect

Time: ✅ 1.643µs (SLO: <10.000µs 📉 -83.6%) vs baseline: +1.4%

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.9%


✅ re_groups_aspect

Time: ✅ 3.139µs (SLO: <10.000µs 📉 -68.6%) vs baseline: +1.0%

Memory: ✅ 40.108MB (SLO: <41.000MB -2.2%) vs baseline: +4.6%


✅ re_groups_noaspect

Time: ✅ 1.721µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +1.0%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.8%


✅ re_match_aspect

Time: ✅ 2.781µs (SLO: <10.000µs 📉 -72.2%) vs baseline: +0.9%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.9%


✅ re_match_noaspect

Time: ✅ 1.316µs (SLO: <10.000µs 📉 -86.8%) vs baseline: -0.2%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.8%


✅ re_search_aspect

Time: ✅ 2.574µs (SLO: <10.000µs 📉 -74.3%) vs baseline: +0.3%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.1%


✅ re_search_noaspect

Time: ✅ 1.191µs (SLO: <10.000µs 📉 -88.1%) vs baseline: -1.2%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.5%


✅ re_sub_aspect

Time: ✅ 3.501µs (SLO: <10.000µs 📉 -65.0%) vs baseline: +2.2%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.6%


✅ re_sub_noaspect

Time: ✅ 1.528µs (SLO: <10.000µs 📉 -84.7%) vs baseline: ~same

Memory: ✅ 40.364MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +5.0%


✅ re_subn_aspect

Time: ✅ 3.645µs (SLO: <10.000µs 📉 -63.6%) vs baseline: -0.8%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.9%


✅ re_subn_noaspect

Time: ✅ 1.605µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +5.0%


🟡 iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.539µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +6.1%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.9%


✅ rsplit_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.9%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.7%


✅ split_aspect

Time: ✅ 1.443µs (SLO: <10.000µs 📉 -85.6%) vs baseline: +3.2%

Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.3%


✅ split_noaspect

Time: ✅ 0.572µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.2%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.1%


✅ splitlines_aspect

Time: ✅ 1.414µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.7%

Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.9%


✅ splitlines_noaspect

Time: ✅ 0.587µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.4%

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.3%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.233ms (SLO: <47.150ms 📉 -14.7%) vs baseline: ~same

Memory: ✅ 39.311MB (SLO: <47.000MB 📉 -16.4%) vs baseline: +4.6%


✅ add-metrics

Time: ✅ 260.888ms (SLO: <344.800ms 📉 -24.3%) vs baseline: -1.2%

Memory: ✅ 43.642MB (SLO: <47.500MB -8.1%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 318.728ms (SLO: <321.000ms 🟡 -0.7%) vs baseline: +0.5%

Memory: ✅ 43.626MB (SLO: <47.500MB -8.2%) vs baseline: +4.7%


✅ get-context

Time: ✅ 80.430ms (SLO: <92.350ms 📉 -12.9%) vs baseline: ~same

Memory: ✅ 39.871MB (SLO: <46.500MB 📉 -14.3%) vs baseline: +4.9%


✅ is-recording

Time: ✅ 37.806ms (SLO: <44.500ms 📉 -15.0%) vs baseline: -0.6%

Memory: ✅ 39.489MB (SLO: <47.500MB 📉 -16.9%) vs baseline: +5.0%


✅ record-exception

Time: ✅ 58.883ms (SLO: <67.650ms 📉 -13.0%) vs baseline: -0.4%

Memory: ✅ 40.029MB (SLO: <47.000MB 📉 -14.8%) vs baseline: +4.7%


✅ set-status

Time: ✅ 44.181ms (SLO: <50.400ms 📉 -12.3%) vs baseline: -0.3%

Memory: ✅ 39.370MB (SLO: <47.000MB 📉 -16.2%) vs baseline: +4.5%


✅ start

Time: ✅ 38.061ms (SLO: <43.450ms 📉 -12.4%) vs baseline: +1.9%

Memory: ✅ 39.507MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.6%


✅ start-finish

Time: ✅ 82.577ms (SLO: <88.000ms -6.2%) vs baseline: ~same

Memory: ✅ 37.277MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +4.7%


✅ start-finish-telemetry

Time: ✅ 84.191ms (SLO: <89.000ms -5.4%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <46.500MB 📉 -19.9%) vs baseline: +4.7%


✅ update-name

Time: ✅ 38.647ms (SLO: <45.150ms 📉 -14.4%) vs baseline: -0.3%

Memory: ✅ 39.643MB (SLO: <47.000MB 📉 -15.7%) vs baseline: +4.7%


🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.357µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.4%

Memory: ✅ 35.252MB (SLO: <35.500MB 🟡 -0.7%) vs baseline: +5.4%


✅ high_rate_limit

Time: ✅ 2.433µs (SLO: <10.000µs 📉 -75.7%) vs baseline: +0.3%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.1%


✅ long_window

Time: ✅ 2.369µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.5%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.0%


✅ low_rate_limit

Time: ✅ 2.356µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.1%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.9%


✅ no_rate_limit

Time: ✅ 0.827µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.6%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ short_window

Time: ✅ 2.486µs (SLO: <10.000µs 📉 -75.1%) vs baseline: -1.2%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.8%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 308.843ms (SLO: <320.950ms -3.8%) vs baseline: -0.4%

Memory: ✅ 35.861MB (SLO: <36.500MB 🟡 -1.7%) vs baseline: +4.6%


✅ deep-profiled

Time: ✅ 328.286ms (SLO: <359.150ms -8.6%) vs baseline: -0.3%

Memory: ✅ 39.793MB (SLO: <40.500MB 🟡 -1.7%) vs baseline: +4.7%


✅ medium

Time: ✅ 6.992ms (SLO: <7.400ms -5.5%) vs baseline: ~same

Memory: ✅ 34.642MB (SLO: <35.500MB -2.4%) vs baseline: +4.5%


✅ shallow

Time: ✅ 0.948ms (SLO: <1.050ms -9.7%) vs baseline: +1.1%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.3%


🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 136.997µs (SLO: <290.000µs 📉 -52.8%) vs baseline: -0.7%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%


✅ high_match

Time: ✅ 176.642µs (SLO: <480.000µs 📉 -63.2%) vs baseline: +1.3%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%


✅ low_match

Time: ✅ 99.134µs (SLO: <120.000µs 📉 -17.4%) vs baseline: -0.2%

Memory: ✅ 603.448MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.660ms (SLO: <8.500ms 📉 -68.7%) vs baseline: -0.4%

Memory: ✅ 71.037MB (SLO: <75.000MB -5.3%) vs baseline: +4.9%


🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.617µs (SLO: <20.000µs 📉 -46.9%) vs baseline: +0.7%

Memory: ✅ 35.625MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.8%


✅ all-enabled

Time: ✅ 40.957µs (SLO: <50.000µs 📉 -18.1%) vs baseline: +1.6%

Memory: ✅ 35.547MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +4.5%


✅ collectipvariant_exists

Time: ✅ 40.843µs (SLO: <50.000µs 📉 -18.3%) vs baseline: -0.3%

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.4%


✅ no-collectipvariant

Time: ✅ 40.609µs (SLO: <50.000µs 📉 -18.8%) vs baseline: +0.8%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.0%


✅ no-useragentvariant

Time: ✅ 38.883µs (SLO: <50.000µs 📉 -22.2%) vs baseline: +0.2%

Memory: ✅ 35.488MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.5%


✅ obfuscation-no-query

Time: ✅ 40.562µs (SLO: <50.000µs 📉 -18.9%) vs baseline: -0.2%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +3.8%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.990µs (SLO: <90.000µs 📉 -15.6%) vs baseline: ~same

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +4.9%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.740µs (SLO: <90.000µs 📉 -14.7%) vs baseline: +0.2%

Memory: ✅ 35.645MB (SLO: <36.500MB -2.3%) vs baseline: +4.7%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.269µs (SLO: <170.000µs -9.3%) vs baseline: ~same

Memory: ✅ 35.625MB (SLO: <36.500MB -2.4%) vs baseline: +4.7%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.609µs (SLO: <160.000µs -7.1%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <36.500MB -2.5%) vs baseline: +4.7%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.983µs (SLO: <170.000µs -8.8%) vs baseline: -0.2%

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +5.1%


✅ useragentvariant_exists_1

Time: ✅ 39.595µs (SLO: <50.000µs 📉 -20.8%) vs baseline: -0.4%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +3.9%


✅ useragentvariant_exists_2

Time: ✅ 40.571µs (SLO: <50.000µs 📉 -18.9%) vs baseline: -0.4%

Memory: ✅ 35.547MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +4.7%


✅ useragentvariant_exists_3

Time: ✅ 40.166µs (SLO: <50.000µs 📉 -19.7%) vs baseline: ~same

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +3.6%


✅ useragentvariant_not_exists_1

Time: ✅ 39.788µs (SLO: <50.000µs 📉 -20.4%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <36.000MB 🟡 -1.1%) vs baseline: +4.9%


✅ useragentvariant_not_exists_2

Time: ✅ 39.498µs (SLO: <50.000µs 📉 -21.0%) vs baseline: -0.3%

Memory: ✅ 35.409MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.0%


🟡 span - 26/26

✅ add-event

Time: ✅ 18.257ms (SLO: <22.500ms 📉 -18.9%) vs baseline: +0.6%

Memory: ✅ 36.904MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 88.199ms (SLO: <93.500ms -5.7%) vs baseline: -0.6%

Memory: ✅ 40.993MB (SLO: <53.000MB 📉 -22.7%) vs baseline: +4.7%


✅ add-tags

Time: ✅ 141.328ms (SLO: <155.000ms -8.8%) vs baseline: -0.6%

Memory: ✅ 41.096MB (SLO: <53.000MB 📉 -22.5%) vs baseline: +4.9%


✅ get-context

Time: ✅ 17.006ms (SLO: <20.500ms 📉 -17.0%) vs baseline: +0.3%

Memory: ✅ 36.801MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +5.1%


✅ is-recording

Time: ✅ 17.351ms (SLO: <20.500ms 📉 -15.4%) vs baseline: +0.8%

Memory: ✅ 36.685MB (SLO: <53.000MB 📉 -30.8%) vs baseline: +4.7%


✅ record-exception

Time: ✅ 36.644ms (SLO: <40.000ms -8.4%) vs baseline: +0.1%

Memory: ✅ 37.200MB (SLO: <53.000MB 📉 -29.8%) vs baseline: +4.6%


✅ set-status

Time: ✅ 18.682ms (SLO: <22.000ms 📉 -15.1%) vs baseline: -0.3%

Memory: ✅ 36.819MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +5.2%


✅ start

Time: ✅ 17.458ms (SLO: <20.500ms 📉 -14.8%) vs baseline: +3.3%

Memory: ✅ 36.686MB (SLO: <53.000MB 📉 -30.8%) vs baseline: +4.8%


✅ start-finish

Time: ✅ 50.891ms (SLO: <52.500ms -3.1%) vs baseline: -0.4%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%


✅ start-finish-telemetry

Time: ✅ 52.275ms (SLO: <54.500ms -4.1%) vs baseline: -0.7%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.9%


✅ start-finish-traceid128

Time: ✅ 54.193ms (SLO: <57.000ms -4.9%) vs baseline: +0.1%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ start-traceid128

Time: ✅ 17.245ms (SLO: <22.500ms 📉 -23.4%) vs baseline: +0.4%

Memory: ✅ 36.706MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.6%


✅ update-name

Time: ✅ 17.335ms (SLO: <22.000ms 📉 -21.2%) vs baseline: +0.4%

Memory: ✅ 36.861MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +5.0%


🟡 tracer - 6/6

✅ large

Time: ✅ 29.290ms (SLO: <32.950ms 📉 -11.1%) vs baseline: -0.2%

Memory: ✅ 35.842MB (SLO: <36.500MB 🟡 -1.8%) vs baseline: +4.6%


✅ medium

Time: ✅ 2.886ms (SLO: <3.200ms -9.8%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.0%


✅ small

Time: ✅ 333.857µs (SLO: <370.000µs -9.8%) vs baseline: +1.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.4%

⚠️ Unstable Tests (1 suite)
⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.017µs (SLO: <170.000µs -8.8%) vs baseline: ~same

Memory: ✅ 39.306MB (SLO: <41.000MB -4.1%) vs baseline: +5.1%


✅ import_many_cached

Time: ✅ 120.512µs (SLO: <130.000µs -7.3%) vs baseline: -0.4%

Memory: ✅ 39.228MB (SLO: <41.000MB -4.3%) vs baseline: +4.8%


✅ import_many_stdlib

Time: ✅ 0.753ms (SLO: <1.750ms 📉 -57.0%) vs baseline: -0.5%

Memory: ✅ 39.204MB (SLO: <41.000MB -4.4%) vs baseline: +4.7%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.172ms (SLO: <1.100ms 📉 -84.3%) vs baseline: +0.2%

Memory: ✅ 39.230MB (SLO: <41.000MB -4.3%) vs baseline: +4.6%


✅ import_many_unknown

Time: ✅ 827.187µs (SLO: <890.000µs -7.1%) vs baseline: ~same

Memory: ✅ 39.468MB (SLO: <41.000MB -3.7%) vs baseline: +5.0%


✅ import_many_unknown_cached

Time: ✅ 796.890µs (SLO: <870.000µs -8.4%) vs baseline: -0.6%

Memory: ✅ 39.164MB (SLO: <41.000MB -4.5%) vs baseline: +4.2%


✅ import_one

Time: ✅ 19.612µs (SLO: <30.000µs 📉 -34.6%) vs baseline: -0.6%

Memory: ✅ 39.524MB (SLO: <41.000MB -3.6%) vs baseline: +5.6%


✅ import_one_cache

Time: ✅ 6.256µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -1.3%

Memory: ✅ 39.556MB (SLO: <41.000MB -3.5%) vs baseline: +5.3%


✅ import_one_stdlib

Time: ✅ 18.665µs (SLO: <20.000µs -6.7%) vs baseline: ~same

Memory: ✅ 39.582MB (SLO: <41.000MB -3.5%) vs baseline: +5.0%


✅ import_one_stdlib_cache

Time: ✅ 6.250µs (SLO: <10.000µs 📉 -37.5%) vs baseline: -0.8%

Memory: ✅ 39.178MB (SLO: <41.000MB -4.4%) vs baseline: +3.8%


✅ import_one_unknown

Time: ✅ 45.360µs (SLO: <50.000µs -9.3%) vs baseline: ~same

Memory: ✅ 39.163MB (SLO: <41.000MB -4.5%) vs baseline: +4.1%


✅ import_one_unknown_cache

Time: ✅ 6.274µs (SLO: <10.000µs 📉 -37.3%) vs baseline: ~same

Memory: ✅ 39.259MB (SLO: <41.000MB -4.2%) vs baseline: +3.7%

✅ All Tests Passing (3 suites)
iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.789µs (SLO: <60.000µs 📉 -18.7%) vs baseline: +0.3%

Memory: ✅ 40.049MB (SLO: <42.000MB -4.6%) vs baseline: +4.7%


✅ propagation_enabled

Time: ✅ 174.066µs (SLO: <190.000µs -8.4%) vs baseline: -1.3%

Memory: ✅ 40.108MB (SLO: <42.000MB -4.5%) vs baseline: +5.0%


✅ propagation_enabled_100

Time: ✅ 1.934ms (SLO: <2.300ms 📉 -15.9%) vs baseline: +0.6%

Memory: ✅ 40.108MB (SLO: <42.000MB -4.5%) vs baseline: +5.1%


✅ propagation_enabled_1000

Time: ✅ 32.558ms (SLO: <34.550ms -5.8%) vs baseline: -0.2%

Memory: ✅ 40.206MB (SLO: <42.000MB -4.3%) vs baseline: +5.4%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.565ms (SLO: <42.000ms -3.4%) vs baseline: -0.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ add-link

Time: ✅ 36.356ms (SLO: <38.550ms -5.7%) vs baseline: ~same

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.3%


✅ add-metrics

Time: ✅ 217.030ms (SLO: <232.000ms -6.5%) vs baseline: -0.9%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.0%


✅ add-tags

Time: ✅ 212.853ms (SLO: <221.600ms -3.9%) vs baseline: +1.2%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.7%


✅ get-context

Time: ✅ 29.153ms (SLO: <31.300ms -6.9%) vs baseline: +0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ is-recording

Time: ✅ 29.149ms (SLO: <31.000ms -6.0%) vs baseline: +0.3%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.2%


✅ record-exception

Time: ✅ 63.176ms (SLO: <65.850ms -4.1%) vs baseline: -0.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ set-status

Time: ✅ 31.890ms (SLO: <34.150ms -6.6%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ start

Time: ✅ 29.347ms (SLO: <30.150ms -2.7%) vs baseline: +1.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ start-finish

Time: ✅ 34.008ms (SLO: <35.350ms -3.8%) vs baseline: -0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ start-finish-telemetry

Time: ✅ 34.207ms (SLO: <35.450ms -3.5%) vs baseline: ~same

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.1%


✅ update-name

Time: ✅ 31.100ms (SLO: <33.400ms -6.9%) vs baseline: +0.6%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.5%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.853ms (SLO: <354.300ms -3.2%) vs baseline: -0.9%

Memory: ✅ 40.223MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%


✅ cache_on

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.9%

Memory: ✅ 39.162MB (SLO: <41.000MB -4.5%) vs baseline: +4.5%

ℹ️ Scenarios Missing SLO Configuration (10 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled

@avara1986 avara1986 marked this pull request as ready for review December 9, 2025 07:34
@avara1986 avara1986 requested a review from a team as a code owner December 9, 2025 07:34
@avara1986 avara1986 merged commit 21b25aa into main Dec 9, 2025
389 checks passed
@avara1986 avara1986 deleted the avara1986/APPSEC-60151_update_benchmarks branch December 9, 2025 10:24
dd-octo-sts bot pushed a commit that referenced this pull request Dec 9, 2025
Update benchmark functions, we need this changes in the main branches

(cherry picked from commit 21b25aa)
dd-octo-sts bot pushed a commit that referenced this pull request Dec 9, 2025
Update benchmark functions, we need this changes in the main branches

(cherry picked from commit 21b25aa)
avara1986 added a commit that referenced this pull request Dec 9, 2025
Update benchmark functions, we need this changes in the main branches

(cherry picked from commit 21b25aa)
Signed-off-by: Alberto Vara <[email protected]>
avara1986 added a commit that referenced this pull request Dec 9, 2025
Update benchmark functions, we need this changes in the main branches

(cherry picked from commit 21b25aa)
Signed-off-by: Alberto Vara <[email protected]>
avara1986 added a commit that referenced this pull request Dec 9, 2025
Update benchmark functions, we need this changes in the main branches

(cherry picked from commit 21b25aa)
Signed-off-by: Alberto Vara <[email protected]>
avara1986 added a commit that referenced this pull request Dec 9, 2025
Backport 21b25aa from #15534 to 4.0.

Update benchmark functions, we need this changes in the main branches

Signed-off-by: Alberto Vara <[email protected]>
Co-authored-by: Alberto Vara <[email protected]>
avara1986 added a commit that referenced this pull request Dec 9, 2025
Backport 21b25aa from #15534 to 3.19.

Update benchmark functions, we need this changes in the main branches

Signed-off-by: Alberto Vara <[email protected]>
Co-authored-by: Alberto Vara <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 3.19 backport 4.0 changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants