Benchmarking not working using pytest

[roussel-ryan]

Using running pytest on Xopt/tests fails due to the benchmarking code giving the error below:

============================= test session starts =============================
collecting ... collected 207 items / 1 error

!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
========================= 1 warning, 1 error in 9.92s =========================

tests/benchmarks/test_mo.py:None (tests/benchmarks/test_mo.py)
'benchmark' not found in `markers` configuration option

[roussel-ryan]

@nikitakuklev

[nikitakuklev]

Interesting...maybe something to do with missing pytest-benchmark (it had to be added to specs)? I'll poke around

[roussel-ryan]

@nikitakuklev do you think you'll be able to fix this today? If not I think I will remove the benchmarking files for now and we can add it back in later. We are trying to do a release

[nikitakuklev]

In what environment does this fail? Can you verify it was updated with the new pytest-benchmark dependency?

On my windows machine runs fine, even when combining tests and benchmarks with a simple 'pytest tests'.

[roussel-ryan]

Ok it works with the additional pytest-benchmark dependency, can we move it out of the tests dir at least? Running tests is supposed to be a quick process. I can do the PR if you want

[nikitakuklev]

The run_tests script excludes benchmarks with '--ignore=tests/benchmarks', but yes we can move it out. Please go ahead with PR.

[roussel-ryan]

Done #192