Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[REVIEW] Profile graph creation runtime and memory footprint #3518

Merged
merged 6 commits into from
Apr 28, 2023
Merged

[REVIEW] Profile graph creation runtime and memory footprint #3518

merged 6 commits into from
Apr 28, 2023

Conversation

VibhuJawa
Copy link
Member

@VibhuJawa VibhuJawa commented Apr 27, 2023 •
edited
Loading

This PR closes part of https://github.com/rapidsai/graph_dl/issues/187 and #3439
Command to run:

python cugraph_graph_creation.py

See below benchmarks on SG (Works on MNMG too) :

scale num_input_edges directed renumber input_memory_per_worker peak_allocation_workers input_to_peak_ratio output_to_peak_ratio
22 67108864 TRUE TRUE 1.0GB 5.9GB 5.885 7.69
22 67108864 TRUE FALSE 1.0GB 5.9GB 5.885 7.69
22 67108864 FALSE TRUE 1.0GB 12.1GB 12.08 6.13
22 67108864 FALSE FALSE 1.0GB 12.1GB 12.08 6.13
23 134217728 TRUE TRUE 2.0GB 11.8GB 5.914 7.70
23 134217728 TRUE FALSE 2.0GB 11.8GB 5.914 7.70
23 134217728 FALSE TRUE 2.0GB 24.3GB 12.16 6.14
23 134217728 FALSE FALSE 2.0GB 24.3GB 12.16 6.14
24 268435456 TRUE TRUE 4.0GB 23.8GB 5.93 7.72
24 268435456 TRUE FALSE 4.0GB 23.8GB 5.93 7.72

image

@VibhuJawa VibhuJawa added non-breaking Non-breaking change feature request New feature or request labels Apr 27, 2023
@VibhuJawa VibhuJawa marked this pull request as ready for review April 27, 2023 19:54
@VibhuJawa VibhuJawa requested a review from a team as a code owner April 27, 2023 19:54
@VibhuJawa VibhuJawa changed the title [WIP] Profile graph creation runtime and memory footprint [REVIEW] Profile graph creation runtime and memory footprint Apr 27, 2023
@VibhuJawa VibhuJawa added this to the 23.06 milestone Apr 27, 2023
rlratzel
rlratzel reviewed Apr 27, 2023
View reviewed changes
benchmarks/cugraph/standalone/cugraph_graph_creation.py Outdated Show resolved Hide resolved
python/cugraph/cugraph/testing/mg_utils.py Outdated Show resolved Hide resolved
python/cugraph/cugraph/testing/mg_utils.py Outdated Show resolved Hide resolved
python/cugraph/cugraph/testing/mg_utils.py Outdated Show resolved Hide resolved
python/cugraph/cugraph/testing/mg_utils.py Outdated Show resolved Hide resolved
rlratzel
rlratzel approved these changes Apr 27, 2023
View reviewed changes
Copy link
Contributor

@rlratzel rlratzel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@rlratzel
Copy link
Contributor

/merge

@rapids-bot rapids-bot bot merged commit 9789c2c into rapidsai:branch-23.06 Apr 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@rlratzel rlratzel rlratzel approved these changes

Assignees
No one assigned
Labels
feature request New feature or request non-breaking Non-breaking change
Projects
None yet
Milestone
23.06
Development

Successfully merging this pull request may close these issues.
2 participants
@VibhuJawa @rlratzel