Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[major] Training: increase default batch size #1462

Merged
merged 7 commits into from
Nov 6, 2023
Merged

Conversation

ourownstory
Copy link
Owner

To reduce the training time and tendency to overfit, we are inreasing the default batch size.

  • increase batch size 2-fold w.r.t log10(data size)
  • while increasing min and max 2-fold

@codecov
Copy link

codecov bot commented Oct 20, 2023

Codecov Report

Merging #1462 (ad143ff) into main (ee09742) will not change coverage.
Report is 1 commits behind head on main.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #1462   +/-   ##
=======================================
  Coverage   88.32%   88.32%           
=======================================
  Files          38       38           
  Lines        5097     5097           
=======================================
  Hits         4502     4502           
  Misses        595      595           
Files Coverage Δ
neuralprophet/configure.py 90.18% <100.00%> (ø)

@github-actions
Copy link

github-actions bot commented Oct 20, 2023

Model Benchmark

Benchmark Metric main current diff
AirPassengers MAE_val 30.12721 32.007 6.24% ⚠️
AirPassengers RMSE_val 31.01396 33.3204 7.44%
AirPassengers Loss_val 0.00371 0.00428 15.43%
AirPassengers MAE 6.27639 6.06069 -3.44%
AirPassengers RMSE 7.88804 7.66998 -2.76%
AirPassengers Loss 0.00019 0.00019 -0.11%
AirPassengers time 27.61828 15.65 -43.33% 🎉
EnergyPriceDaily MAE_val - 5.9705 -
EnergyPriceDaily RMSE_val - 7.6175 -
EnergyPriceDaily Loss_val - 0.0098 -
EnergyPriceDaily MAE - 6.7706 -
EnergyPriceDaily RMSE - 9.044 -
EnergyPriceDaily Loss - 0.0104 -
EnergyPriceDaily time - 24.61 -
PeytonManning MAE_val 0.34778 0.34903 0.36%
PeytonManning RMSE_val 0.49928 0.50014 0.17%
PeytonManning Loss_val 0.00595 0.00597 0.35%
PeytonManning MAE 0.35123 0.35143 0.06%
PeytonManning RMSE 0.48066 0.48785 1.5%
PeytonManning Loss 0.0046 0.00461 0.27%
PeytonManning time 67.8393 31.81 -53.11% 🎉
YosemiteTemps MAE_val 0.44287 0.66436 50.01%
YosemiteTemps RMSE_val 0.62875 0.95983 52.66%
YosemiteTemps Loss_val 7e-05 0.00016 138.51%
YosemiteTemps MAE 0.80138 1.13161 41.21%
YosemiteTemps RMSE 1.44081 1.95027 35.36%
YosemiteTemps Loss 0.00027 0.00049 83.09%
YosemiteTemps time 189.20297 103.73 -45.18% 🎉
Model training plots

Model Training

PeytonManning

YosemiteTemps

AirPassengers

EnergyPriceDaily

@SimonWittner SimonWittner merged commit 93047ac into main Nov 6, 2023
13 checks passed
@SimonWittner SimonWittner deleted the batchsize-increase branch November 6, 2023 20:14
@ourownstory ourownstory changed the title [Major] increase default batch size [major] increase default batch size Dec 8, 2023
@ourownstory ourownstory changed the title [major] increase default batch size [major] Training: increase default batch size Dec 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants