Skip to content

chore: EXC: Pseudo-random embedders heap benchmarks on master #4769

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

berestovskyy
Copy link
Contributor

@berestovskyy berestovskyy commented Apr 10, 2025

This PR adds temporary pseudo-random heap benchmarks with 2 MiB, 5 MiB and 500 MiB steps on master branch:

= 71c613a2bc..a7913712a6: Embedders Heap total time: 708 ms (new)

Details:

query/wasm32_query_read_fwd_1gb_step_2mb_checkpoint:    11 ms/iter
query/wasm64_query_read_fwd_1gb_step_2mb_checkpoint:    11 ms/iter
query/wasm32_query_read_fwd_1gb_step_2mb_page_delta:     7 ms/iter
query/wasm64_query_read_fwd_1gb_step_2mb_page_delta:     7 ms/iter
query/wasm32_query_read_fwd_1gb_step_2mb_new_allocation:     6 ms/iter
query/wasm64_query_read_fwd_1gb_step_2mb_new_allocation:     6 ms/iter
query/wasm32_query_read_fwd_1gb_step_5mb_checkpoint:     4 ms/iter
query/wasm64_query_read_fwd_1gb_step_5mb_checkpoint:     4 ms/iter
query/wasm32_query_read_fwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm64_query_read_fwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm32_query_read_fwd_1gb_step_5mb_new_allocation:     2 ms/iter
query/wasm64_query_read_fwd_1gb_step_5mb_new_allocation:     2 ms/iter
query/wasm32_query_read_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm64_query_read_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm32_query_read_fwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm64_query_read_fwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm32_query_read_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
query/wasm64_query_read_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
query/wasm32_query_read_bwd_1gb_step_2mb_checkpoint:    11 ms/iter
query/wasm64_query_read_bwd_1gb_step_2mb_checkpoint:    11 ms/iter
query/wasm32_query_read_bwd_1gb_step_2mb_page_delta:     7 ms/iter
query/wasm64_query_read_bwd_1gb_step_2mb_page_delta:     7 ms/iter
query/wasm32_query_read_bwd_1gb_step_2mb_new_allocation:     6 ms/iter
query/wasm64_query_read_bwd_1gb_step_2mb_new_allocation:     6 ms/iter
query/wasm32_query_read_bwd_1gb_step_5mb_checkpoint:     4 ms/iter
query/wasm64_query_read_bwd_1gb_step_5mb_checkpoint:     4 ms/iter
query/wasm32_query_read_bwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm64_query_read_bwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm32_query_read_bwd_1gb_step_5mb_new_allocation:     2 ms/iter
query/wasm64_query_read_bwd_1gb_step_5mb_new_allocation:     2 ms/iter
query/wasm32_query_read_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm64_query_read_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm32_query_read_bwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm64_query_read_bwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm32_query_read_bwd_1gb_step_500mb_new_allocation:       0 ms/iter
query/wasm64_query_read_bwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm32_update_read_fwd_1gb_step_2mb_checkpoint:     8 ms/iter
update/wasm64_update_read_fwd_1gb_step_2mb_checkpoint:     8 ms/iter
update/wasm32_update_read_fwd_1gb_step_2mb_page_delta:    11 ms/iter
update/wasm64_update_read_fwd_1gb_step_2mb_page_delta:    11 ms/iter
update/wasm32_update_read_fwd_1gb_step_2mb_new_allocation:     6 ms/iter
update/wasm64_update_read_fwd_1gb_step_2mb_new_allocation:     6 ms/iter
update/wasm32_update_read_fwd_1gb_step_5mb_checkpoint:     3 ms/iter
update/wasm64_update_read_fwd_1gb_step_5mb_checkpoint:     3 ms/iter
update/wasm32_update_read_fwd_1gb_step_5mb_page_delta:     4 ms/iter
update/wasm64_update_read_fwd_1gb_step_5mb_page_delta:     4 ms/iter
update/wasm32_update_read_fwd_1gb_step_5mb_new_allocation:     2 ms/iter
update/wasm64_update_read_fwd_1gb_step_5mb_new_allocation:     2 ms/iter
update/wasm32_update_read_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm64_update_read_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm32_update_read_fwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm64_update_read_fwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm32_update_read_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm64_update_read_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm32_update_read_bwd_1gb_step_2mb_checkpoint:     8 ms/iter
update/wasm64_update_read_bwd_1gb_step_2mb_checkpoint:     8 ms/iter
update/wasm32_update_read_bwd_1gb_step_2mb_page_delta:    10 ms/iter
update/wasm64_update_read_bwd_1gb_step_2mb_page_delta:    10 ms/iter
update/wasm32_update_read_bwd_1gb_step_2mb_new_allocation:     6 ms/iter
update/wasm64_update_read_bwd_1gb_step_2mb_new_allocation:     6 ms/iter
update/wasm32_update_read_bwd_1gb_step_5mb_checkpoint:     3 ms/iter
update/wasm64_update_read_bwd_1gb_step_5mb_checkpoint:     3 ms/iter
update/wasm32_update_read_bwd_1gb_step_5mb_page_delta:     4 ms/iter
update/wasm64_update_read_bwd_1gb_step_5mb_page_delta:     4 ms/iter
update/wasm32_update_read_bwd_1gb_step_5mb_new_allocation:     2 ms/iter
update/wasm64_update_read_bwd_1gb_step_5mb_new_allocation:     2 ms/iter
update/wasm32_update_read_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm64_update_read_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm32_update_read_bwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm64_update_read_bwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm32_update_read_bwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm64_update_read_bwd_1gb_step_500mb_new_allocation:       0 ms/iter
query/wasm32_query_write_fwd_1gb_step_2mb_checkpoint:     9 ms/iter
query/wasm64_query_write_fwd_1gb_step_2mb_checkpoint:     8 ms/iter
query/wasm32_query_write_fwd_1gb_step_2mb_page_delta:     7 ms/iter
query/wasm64_query_write_fwd_1gb_step_2mb_page_delta:     7 ms/iter
query/wasm32_query_write_fwd_1gb_step_2mb_new_allocation:     7 ms/iter
query/wasm64_query_write_fwd_1gb_step_2mb_new_allocation:     7 ms/iter
query/wasm32_query_write_fwd_1gb_step_5mb_checkpoint:     3 ms/iter
query/wasm64_query_write_fwd_1gb_step_5mb_checkpoint:     3 ms/iter
query/wasm32_query_write_fwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm64_query_write_fwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm32_query_write_fwd_1gb_step_5mb_new_allocation:     3 ms/iter
query/wasm64_query_write_fwd_1gb_step_5mb_new_allocation:     3 ms/iter
query/wasm32_query_write_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm64_query_write_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm32_query_write_fwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm64_query_write_fwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm32_query_write_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
query/wasm64_query_write_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
query/wasm32_query_write_bwd_1gb_step_2mb_checkpoint:     8 ms/iter
query/wasm64_query_write_bwd_1gb_step_2mb_checkpoint:     8 ms/iter
query/wasm32_query_write_bwd_1gb_step_2mb_page_delta:     7 ms/iter
query/wasm64_query_write_bwd_1gb_step_2mb_page_delta:     8 ms/iter
query/wasm32_query_write_bwd_1gb_step_2mb_new_allocation:     7 ms/iter
query/wasm64_query_write_bwd_1gb_step_2mb_new_allocation:     7 ms/iter
query/wasm32_query_write_bwd_1gb_step_5mb_checkpoint:     3 ms/iter
query/wasm64_query_write_bwd_1gb_step_5mb_checkpoint:     3 ms/iter
query/wasm32_query_write_bwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm64_query_write_bwd_1gb_step_5mb_page_delta:     3 ms/iter
query/wasm32_query_write_bwd_1gb_step_5mb_new_allocation:     3 ms/iter
query/wasm64_query_write_bwd_1gb_step_5mb_new_allocation:     3 ms/iter
query/wasm32_query_write_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm64_query_write_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
query/wasm32_query_write_bwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm64_query_write_bwd_1gb_step_500mb_page_delta:       0 ms/iter
query/wasm32_query_write_bwd_1gb_step_500mb_new_allocation:       0 ms/iter
query/wasm64_query_write_bwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm32_update_write_fwd_1gb_step_2mb_checkpoint:    20 ms/iter
update/wasm64_update_write_fwd_1gb_step_2mb_checkpoint:    20 ms/iter
update/wasm32_update_write_fwd_1gb_step_2mb_page_delta:    15 ms/iter
update/wasm64_update_write_fwd_1gb_step_2mb_page_delta:    15 ms/iter
update/wasm32_update_write_fwd_1gb_step_2mb_new_allocation:    10 ms/iter
update/wasm64_update_write_fwd_1gb_step_2mb_new_allocation:    10 ms/iter
update/wasm32_update_write_fwd_1gb_step_5mb_checkpoint:     8 ms/iter
update/wasm64_update_write_fwd_1gb_step_5mb_checkpoint:     8 ms/iter
update/wasm32_update_write_fwd_1gb_step_5mb_page_delta:     6 ms/iter
update/wasm64_update_write_fwd_1gb_step_5mb_page_delta:     6 ms/iter
update/wasm32_update_write_fwd_1gb_step_5mb_new_allocation:     4 ms/iter
update/wasm64_update_write_fwd_1gb_step_5mb_new_allocation:     4 ms/iter
update/wasm32_update_write_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm64_update_write_fwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm32_update_write_fwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm64_update_write_fwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm32_update_write_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm64_update_write_fwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm32_update_write_bwd_1gb_step_2mb_checkpoint:    19 ms/iter
update/wasm64_update_write_bwd_1gb_step_2mb_checkpoint:    20 ms/iter
update/wasm32_update_write_bwd_1gb_step_2mb_page_delta:    15 ms/iter
update/wasm64_update_write_bwd_1gb_step_2mb_page_delta:    15 ms/iter
update/wasm32_update_write_bwd_1gb_step_2mb_new_allocation:    10 ms/iter
update/wasm64_update_write_bwd_1gb_step_2mb_new_allocation:    10 ms/iter
update/wasm32_update_write_bwd_1gb_step_5mb_checkpoint:     8 ms/iter
update/wasm64_update_write_bwd_1gb_step_5mb_checkpoint:     8 ms/iter
update/wasm32_update_write_bwd_1gb_step_5mb_page_delta:     6 ms/iter
update/wasm64_update_write_bwd_1gb_step_5mb_page_delta:     6 ms/iter
update/wasm32_update_write_bwd_1gb_step_5mb_new_allocation:     4 ms/iter
update/wasm64_update_write_bwd_1gb_step_5mb_new_allocation:     4 ms/iter
update/wasm32_update_write_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm64_update_write_bwd_1gb_step_500mb_checkpoint:       0 ms/iter
update/wasm32_update_write_bwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm64_update_write_bwd_1gb_step_500mb_page_delta:       0 ms/iter
update/wasm32_update_write_bwd_1gb_step_500mb_new_allocation:       0 ms/iter
update/wasm64_update_write_bwd_1gb_step_500mb_new_allocation:       0 ms/iter

@github-actions github-actions bot added the chore label Apr 10, 2025
@berestovskyy berestovskyy force-pushed the andriy/exc-2012-random-benchmarks-master branch from c162246 to 76a64a9 Compare April 10, 2025 20:23
@berestovskyy berestovskyy force-pushed the andriy/exc-2012-random-benchmarks-master branch from 76a64a9 to 960556c Compare April 11, 2025 20:03
@berestovskyy berestovskyy changed the title chore: EXC: Baseline "random" embedders heap benchmark chore: EXC: Baseline "random" embedders heap benchmarks Apr 11, 2025
@berestovskyy berestovskyy changed the title chore: EXC: Baseline "random" embedders heap benchmarks chore: EXC: Pseudo-random embedders heap benchmarks on master Apr 13, 2025
@berestovskyy
Copy link
Contributor Author

It's a draft PR is not supposed to be merged but just to run more benchmarks for the #4671 PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant