[major] Upgrade to PyTorch 2

[noxan]

Another attempt to upgrade to PyTorch 2.0

• 2.0.1 seems to be broken due to
  • Poetry doesn't detect PyTorch 2.0.1 dependencies correctly python-poetry/poetry#8002 and
  • Pytorch 2.0.1 pypi wheel does not install dependent cuda libraries pytorch/pytorch#100974
• There is no direct version dependency on Lightning, as stated in the docs: "Is 2.0 code backwards-compatible with 1.X? Yes, using 2.0 will not require you to modify your PyTorch workflows." see point 4 of https://pytorch.org/get-started/pytorch-2.0/#faqs

[github-actions]

Model Benchmark

Benchmark	Metric	main	current	diff
YosemiteTemps	MAE_val	1.349	1.34899	-0.0%	✅
YosemiteTemps	RMSE_val	2.00817	2.00817	-0.0%	✅
YosemiteTemps	Loss_val	0.00078	0.00078	-0.0%	✅
YosemiteTemps	MAE	1.32133	1.32133	0.0%	✅
YosemiteTemps	RMSE	2.13713	2.13713	-0.0%	✅
YosemiteTemps	Loss	0.00064	0.00064	0.0%	✅
YosemiteTemps	time	85.3615	62.25	-27.07%	🎉
PeytonManning	MAE_val	0.58162	0.58162	0.0%	✅
PeytonManning	RMSE_val	0.72218	0.72218	0.0%	✅
PeytonManning	Loss_val	0.01239	0.01239	0.0%	✅
PeytonManning	MAE	0.41671	0.41671	-0.0%	✅
PeytonManning	RMSE	0.55961	0.55961	0.0%	✅
PeytonManning	Loss	0.00612	0.00612	-0.0%	✅
PeytonManning	time	17.4582	13.43	-23.07%	🎉
AirPassengers	MAE_val	13.0627	13.0627	0.0%	✅
AirPassengers	RMSE_val	15.9453	15.9453	0.0%	✅
AirPassengers	Loss_val	0.00131	0.00131	0.0%	✅
AirPassengers	MAE	9.88153	9.88153	0.0%	✅
AirPassengers	RMSE	11.7354	11.7354	-0.0%	✅
AirPassengers	Loss	0.00052	0.00052	0.0%	✅
AirPassengers	time	7.63756	5.61	-26.55%	🎉

Model training plots

Model Training

PeytonManning

YosemiteTemps

AirPassengers

[codecov]

Codecov Report

Merging #1404 (900eda1) into main (d236471) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #1404   +/-   ##
=======================================
  Coverage   89.85%   89.85%           
=======================================
  Files          38       38           
  Lines        5068     5068           
=======================================
  Hits         4554     4554           
  Misses        514      514           

Files Changed	Coverage Δ
neuralprophet/configure.py	90.18% <100.00%> (ø)

[leoniewgnr]

This is amazing, thanks so much Richard!!

[leoniewgnr]

@ourownstory what do you think, can we merge that?

[leoniewgnr]

@ourownstory what do you think, can we merge that?

I'll go ahead and merge this now, I think a lot of users are waiting for it.

[leoniewgnr]

@ourownstory what do you think, can we merge that?

I'll go ahead and merge this now, I think a lot of users are waiting for it.

[leoniewgnr]

@ourownstory what do you think, can we merge that?

I'll go ahead and merge this now, I think a lot of users are waiting for it.

[leoniewgnr]

@noxan this really is amazing, I always had some dependency issues when installing NP with other packages, everything resolved now!

[noxan]

Also wanted to say thank you to @hxyue1 who contributed to this PR kind of behind the scenes and tried several alternative attempts to make this finally work 🙏