Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Infinite loop problem in convert_graph_to_model.py #45

Open
jayhpark530 opened this issue May 19, 2020 · 3 comments
Open

Infinite loop problem in convert_graph_to_model.py #45

jayhpark530 opened this issue May 19, 2020 · 3 comments

Comments

@jayhpark530
Copy link

I had a problem using the optimizer for the resnet101 model.
Following the README, the following commands were executed sequentially.

python optimizer_graph_hierarchical.py
-f ../profiler/image_classification/profiles/resnet101/graph.txt
--activation_compression_ratio 1
-o resnet101_partitioned
--all_num_machines 4 4
--network_bandwidths 15750000000 7000000000
--memory_size 16000000000

python convert_graph_to_model.py
-f resnet101_partitioned/gpus=16.txt
-n RESNET101Partitioned
-a resnet101
-o ../runtime/image_classification/models/gpus=16

In the resnet101 (or resnet152) model, an infinite loop occurs in convert_graph_to_model.py.
(resnet50 or vgg16 had no problem.)

When I checked it, an infinite loop occurs in the populate_depths function in pipedream/graph/graph.py.

Is my execution wrong?
Can you confirm what's the problem?

@nirandaperera
Copy link

I had a similar issue for densenet121

@deepakn94
Copy link
Collaborator

Not sure -- haven't run this code in a while. The populate_depths function itself is not too important -- you could perhaps try commenting it out and seeing what happens

@nirandaperera
Copy link

nirandaperera commented Jun 5, 2020

commenting out populate_depths worked actually

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants