Skip to content

chore: EXC: Heap benchmarks (take 3) #4801

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 12 commits into
base: master
Choose a base branch
from

Conversation

berestovskyy
Copy link
Contributor

@berestovskyy berestovskyy commented Apr 14, 2025

This PR splits the THP for host memory #4671 into three separate commits and runs Embedders Heap benchmarks (including 2 MiB pseudo-random) on each commit independently.

  1. Commit 8bab8a6 sets MAX_PAGES_TO_MAP to 512 (2 MiB):

    = c5e2324da2..3cc2d870fb: Embedders Heap total time: 123947 ms (improved by -15991.0 
    ms / -11.4%)
    

    See b52f12533a.log for more details.

  2. Commit e4fba84 adds MADV_HUGEPAGE:

    = c5e2324da2..e4fba84ca1: Embedders Heap total time: 109428 ms (improved by -30509.7 
    ms / -21.8%)
    

    See e4fba84ca1.log for more details.

  3. Commit b52f125 adds huge page alignments:

    = c5e2324da2..b52f12533a: Embedders Heap total time: 98138 ms (improved by -41799.3 m
    s / -29.9%)
    

    See 3cc2d870fb.log for more details.

To reproduce the results, run on spm server:

rm EMBEDDERS_HEAP.*; REPEAT=5 time ./rs/execution_environment/benches/run-all-benchmarks.sh 2>&1 | tee b52f12533a.log

```
= c5e2324..3cc2d87: Embedders Heap total time: 127663 ms (improved by -12274.2 ms / -8.8%)
= c5e2324..3cc2d87: Embedders Heap total time: 126586 ms (improved by -13351.9 ms / -9.5%)
= c5e2324..3cc2d87: Embedders Heap total time: 124938 ms (improved by -14999.2 ms / -10.7%)
= c5e2324..3cc2d87: Embedders Heap total time: 124426 ms (improved by -15511.7 ms / -11.1%)
= c5e2324..3cc2d87: Embedders Heap total time: 123947 ms (improved by -15991.0 ms / -11.4%)
```

See `3cc2d870fb.log` for more details.
```
= c5e2324..e4fba84: Embedders Heap total time: 112484 ms (improved by -27453.1 ms / -19.6%)
= c5e2324..e4fba84: Embedders Heap total time: 111173 ms (improved by -28764.6 ms / -20.6%)
= c5e2324..e4fba84: Embedders Heap total time: 109748 ms (improved by -30189.6 ms / -21.6%)
= c5e2324..e4fba84: Embedders Heap total time: 109432 ms (improved by -30505.9 ms / -21.8%)
= c5e2324..e4fba84: Embedders Heap total time: 109428 ms (improved by -30509.7 ms / -21.8%)
```
```
= c5e2324..b52f125: Embedders Heap total time: 100337 ms (improved by -39601.0 ms / -28.3%)
= c5e2324..b52f125: Embedders Heap total time: 99081 ms (improved by -40856.4 ms / -29.2%)
= c5e2324..b52f125: Embedders Heap total time: 98666 ms (improved by -41271.8 ms / -29.5%)
= c5e2324..b52f125: Embedders Heap total time: 98358 ms (improved by -41579.2 ms / -29.7%)
= c5e2324..b52f125: Embedders Heap total time: 98138 ms (improved by -41799.3 ms / -29.9%)
```

See `b52f12533a.log` for more details.
@github-actions github-actions bot added the chore label Apr 14, 2025
@berestovskyy
Copy link
Contributor Author

It's a draft PR is not supposed to be merged but just to run more benchmarks for the #4671 PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant