Import Error, not compatible with transformer package

[tang-t21]

File "/home/Qwen/infer.py", line 63, in
import mii
File "/usr/local/lib/python3.10/dist-packages/mii/init.py", line 7, in
from .legacy import MIIServer, MIIClient, mii_query_handle, deploy, terminate, DeploymentType, TaskType, aml_output_path, MIIConfig, ModelConfig, get_supported_models
File "/usr/local/lib/python3.10/dist-packages/mii/legacy/init.py", line 7, in
from .client import MIIClient, mii_query_handle
File "/usr/local/lib/python3.10/dist-packages/mii/legacy/client.py", line 12, in
from .method_table import GRPC_METHOD_TABLE
File "/usr/local/lib/python3.10/dist-packages/mii/legacy/method_table.py", line 8, in
from transformers import Conversation
ImportError: cannot import name 'Conversation' from 'transformers' (/usr/local/lib/python3.10/dist-packages/transformers/init.py)

[tang-t21]

Need to use an older version of transformer, but 'pip install deepspeed-mii' installs the latest one.

[zyyyyy5]

Need to use an older version of transformer, but 'pip install deepspeed-mii' installs the latest one.

I encountered this issue too. May I ask which version of transformer you use?

[loadams]

Hi @tang-t21 - this is resolved in the latest source builds of DeepSpeed-MII here #492. But we have not done a new release of MII that contains these fixes. We will work on this and update you when this is done soon.

[loadams]

@tang-t21 - this is resolved in the latest release of DeepSpeed MII. If you hit any issues, please let us know and we can re-open this issue.