DataFrame' object has no attribute 'tokens' in analyzing_artemis task.

[lr19960813]

I try running the analyzing_artemis file to analysis the first examples but there are something wrong with that.
When I do this I got：
File "Downloads/code/artemis_code/analyzing.py", line 28, in
df.tokens = df.tokens.apply(literal_eval) # to make them a python list.
File "artemis/lib/python3.8/site-packages/pandas/core/generic.py", line 5465, in __getattr__return object.getattribute(self, name)
AttributeError: 'DataFrame' object has no attribute 'tokens'
I think maybe something wrong with df（artemis_preprocessed_csv）, but I am not sure.

[yiren-jian]

I have run the analyzing_artemis.ipynb without an issue. First you need to preprocess the downloaded data using the command python artemis/scripts/preprocess_artemis_data.py -save-out-dir <ADD_YOURS> -raw-artemis-data-csv <ADD_YOURS>.

I'm running pytorch-1.10 with cuda-11.3 on a RTX A6000. Here's the version for each package (by pip freeze > requirements.txt)

absl-py==1.0.0
argon2-cffi==21.3.0
argon2-cffi-bindings==21.2.0
-e git+https://github.com/optas/artemis.git@d84b719573f70d5f20eae724d5d7c8855f6ee3af#egg=artemis
async-generator==1.10
attrs==21.4.0
backcall==0.2.0
beautifulsoup4==4.10.0
bleach==4.1.0
cachetools==4.2.4
certifi==2020.6.20
cffi==1.15.0
charset-normalizer==2.0.11
click==8.0.3
cycler==0.11.0
dask==2021.3.0
dataclasses==0.8
decorator==4.4.2
defusedxml==0.7.1
entrypoints==0.4
filelock==3.4.1
fsspec==2022.1.0
gdown==4.2.1
google-auth==2.6.0
google-auth-oauthlib==0.4.6
grpcio==1.43.0
idna==3.3
imageio==2.14.1
importlib-metadata==4.8.3
ipykernel==5.5.6
ipython==7.16.3
ipython-genutils==0.2.0
ipywidgets==7.6.5
jedi==0.17.2
Jinja2==3.0.3
joblib==1.1.0
jsonschema==3.2.0
jupyter==1.0.0
jupyter-client==7.1.2
jupyter-console==6.4.0
jupyter-core==4.9.1
jupyterlab-pygments==0.1.2
jupyterlab-widgets==1.0.2
kiwisolver==1.3.1
locket==0.2.1
Markdown==3.3.6
MarkupSafe==2.0.1
matplotlib==3.3.4
mistune==0.8.4
nbclient==0.5.9
nbconvert==6.0.7
nbformat==5.1.3
nest-asyncio==1.5.4
networkx==2.5.1
nltk==3.6.7
notebook==6.4.8
numpy==1.19.5
oauthlib==3.2.0
packaging==21.3
pandas==1.1.5
pandocfilters==1.5.0
parso==0.7.1
partd==1.2.0
pexpect==4.8.0
pickleshare==0.7.5
Pillow==8.4.0
plotly==5.5.0
prometheus-client==0.13.1
prompt-toolkit==3.0.26
protobuf==3.19.4
ptyprocess==0.7.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
Pygments==2.11.2
pyparsing==3.0.7
pyrsistent==0.18.0
PySocks==1.7.1
python-dateutil==2.8.2
pytz==2021.3
PyWavelets==1.1.1
PyYAML==6.0
pyzmq==22.3.0
qtconsole==5.2.2
QtPy==2.0.1
regex==2022.1.18
requests==2.27.1
requests-oauthlib==1.3.1
rsa==4.8
scikit-image==0.17.2
scikit-learn==0.24.2
scipy==1.5.4
seaborn==0.11.2
Send2Trash==1.8.0
six==1.16.0
soupsieve==2.3.1
symspellpy==6.5.2
tenacity==8.0.1
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
termcolor==1.1.0
terminado==0.12.1
testpath==0.5.0
threadpoolctl==3.1.0
tifffile==2020.9.3
toolz==0.11.2
torch==1.10.2+cu113
torchaudio==0.10.2+cu113
torchvision==0.11.3+cu113
tornado==6.1
tqdm==4.62.3
traitlets==4.3.3
typing_extensions==4.0.1
urllib3==1.26.8
wcwidth==0.2.5
webencodings==0.5.1
Werkzeug==2.0.2
widgetsnbextension==3.5.2
zipp==3.6.0