Add Baseline FRAME Benchmarks #9691

shawntabrizi · 2021-09-04T03:20:20Z

This PR introduces a set of baseline benchmarks to use as a smoke alarm for any major regressions in the performance of the benchmarking pipeline.

shawntabrizi · 2021-09-04T03:20:32Z

/benchmark runtime pallet baseline

shawntabrizi · 2021-09-05T00:22:22Z

/benchmark runtime pallet baseline

parity-benchapp · 2021-09-05T00:22:23Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=baseline --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame//src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

2021-09-05 00:26:33 Running Benchmark:	baseline	hashing	47/50	0/1    
2021-09-05 00:26:38 Running Benchmark:	baseline	storage_read	26/50	0/1    
2021-09-05 00:26:44 Running Benchmark:	baseline	storage_read	38/50	0/1    
2021-09-05 00:26:49 Running Benchmark:	baseline	storage_read	47/50	0/1    
2021-09-05 00:26:54 Running Benchmark:	baseline	storage_write	21/50	0/1    
2021-09-05 00:27:00 Running Benchmark:	baseline	storage_write	35/50	0/1    
2021-09-05 00:27:05 Running Benchmark:	baseline	storage_write	45/50	0/1    
Error: Io(Os { code: 2, kind: NotFound, message: "No such file or directory" })

ERROR: Unable to commit file ./frame//src/weights.rs

shawntabrizi · 2021-09-05T01:23:31Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-09-05T01:23:33Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     0.37
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.368     0.001    0.2%
  200      0.36     0.004    1.1%
  400     0.362     0.004    1.1%
  600     0.382     0.006    1.5%
  800     0.366     0.004    1.0%
 1000     0.366     0.004    1.0%
 1200     0.373     0.003    0.8%
 1400     0.354     0.004    1.1%
 1600      0.38     0.005    1.3%
 1800     0.366     0.005    1.3%
 2000     0.375     0.005    1.3%
 2200     0.379     0.004    1.0%
 2400     0.372     0.003    0.8%
 2600     0.374     0.005    1.3%
 2800     0.366     0.007    1.9%
 3000     0.376     0.006    1.5%
 3200     0.369     0.005    1.3%
 3400     0.376     0.004    1.0%
 3600     0.373     0.007    1.8%
 3800     0.367     0.007    1.9%
 4000     0.376     0.004    1.0%
 4200     0.362     0.004    1.1%
 4400     0.359     0.005    1.3%
 4600     0.371     0.006    1.6%
 4800     0.379     0.005    1.3%
 5000      0.36     0.005    1.3%
 5200     0.368     0.004    1.0%
 5400     0.349     0.005    1.4%
 5600     0.381     0.016    4.1%
 5800     0.377     0.006    1.5%
 6000     0.369     0.004    1.0%
 6200      0.37     0.005    1.3%
 6400     0.362     0.004    1.1%
 6600     0.377     0.005    1.3%
 6800     0.367     0.005    1.3%
 7000     0.367     0.004    1.0%
 7200     0.379     0.009    2.3%
 7400     0.369     0.005    1.3%
 7600     0.371     0.005    1.3%
 7800     0.357     0.005    1.4%
 8000     0.357     0.003    0.8%
 8200     0.366     0.006    1.6%
 8400     0.366     0.007    1.9%
 8600     0.374     0.006    1.6%
 8800     0.371     0.006    1.6%
 9000     0.365     0.004    1.0%
 9200     0.378     0.004    1.0%
 9400     0.378     0.007    1.8%
 9600     0.364     0.006    1.6%
 9800     0.384     0.005    1.3%
10000     0.376     0.009    2.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.369
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.379
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.386     0.007    1.8%
  200     0.382     0.005    1.3%
  400     0.377     0.005    1.3%
  600     0.376     0.005    1.3%
  800      0.38     0.004    1.0%
 1000     0.379     0.005    1.3%
 1200     0.383     0.004    1.0%
 1400     0.376      0.01    2.6%
 1600     0.386     0.008    2.0%
 1800     0.377     0.006    1.5%
 2000      0.39     0.005    1.2%
 2200      0.38     0.006    1.5%
 2400     0.377     0.005    1.3%
 2600     0.371     0.006    1.6%
 2800     0.374     0.007    1.8%
 3000     0.375     0.003    0.8%
 3200     0.377     0.006    1.5%
 3400     0.382     0.005    1.3%
 3600     0.383     0.002    0.5%
 3800     0.379     0.005    1.3%
 4000     0.383     0.006    1.5%
 4200     0.395     0.005    1.2%
 4400     0.375     0.004    1.0%
 4600     0.381     0.003    0.7%
 4800     0.376     0.009    2.3%
 5000     0.373     0.008    2.1%
 5200     0.383     0.005    1.3%
 5400     0.368     0.003    0.8%
 5600     0.366     0.005    1.3%
 5800     0.371     0.005    1.3%
 6000     0.369     0.004    1.0%
 6200     0.374     0.004    1.0%
 6400     0.375     0.005    1.3%
 6600     0.373     0.005    1.3%
 6800     0.371     0.006    1.6%
 7000     0.369     0.003    0.8%
 7200     0.377     0.006    1.5%
 7400     0.384     0.008    2.0%
 7600      0.38     0.005    1.3%
 7800     0.383     0.006    1.5%
 8000     0.374     0.005    1.3%
 8200     0.367     0.004    1.0%
 8400     0.379     0.006    1.5%
 8600      0.37     0.005    1.3%
 8800     0.385     0.005    1.2%
 9000     0.369     0.004    1.0%
 9200     0.375     0.009    2.4%
 9400     0.386     0.006    1.5%
 9600      0.38     0.004    1.0%
 9800     0.383     0.009    2.3%
10000     0.397     0.004    1.0%

Quality and confidence:
param     error
i             0

Model:
Time ~=     0.38
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.376
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.376     0.002    0.5%
  200      0.37     0.004    1.0%
  400     0.381     0.003    0.7%
  600     0.368     0.006    1.6%
  800     0.387     0.006    1.5%
 1000     0.373     0.007    1.8%
 1200     0.362     0.003    0.8%
 1400      0.38     0.004    1.0%
 1600     0.366     0.003    0.8%
 1800     0.373     0.006    1.6%
 2000     0.377     0.008    2.1%
 2200     0.385     0.006    1.5%
 2400     0.376     0.006    1.5%
 2600     0.374     0.005    1.3%
 2800     0.394     0.006    1.5%
 3000     0.384     0.005    1.3%
 3200     0.374     0.007    1.8%
 3400     0.378     0.007    1.8%
 3600     0.364     0.005    1.3%
 3800     0.381     0.008    2.0%
 4000     0.368     0.005    1.3%
 4200      0.38     0.007    1.8%
 4400     0.368     0.003    0.8%
 4600     0.387     0.008    2.0%
 4800     0.372     0.004    1.0%
 5000     0.371     0.003    0.8%
 5200     0.368     0.002    0.5%
 5400     0.382     0.004    1.0%
 5600     0.379     0.005    1.3%
 5800     0.391     0.004    1.0%
 6000     0.375     0.003    0.8%
 6200     0.376     0.005    1.3%
 6400      0.37     0.002    0.5%
 6600     0.388     0.004    1.0%
 6800     0.365     0.003    0.8%
 7000     0.366     0.005    1.3%
 7200     0.364     0.004    1.0%
 7400     0.382     0.007    1.8%
 7600     0.375     0.004    1.0%
 7800     0.367     0.008    2.1%
 8000      0.36     0.004    1.1%
 8200     0.381     0.007    1.8%
 8400     0.377     0.007    1.8%
 8600     0.374     0.006    1.6%
 8800     0.371     0.005    1.3%
 9000     0.374     0.005    1.3%
 9200      0.36     0.004    1.1%
 9400     0.378     0.005    1.3%
 9600     0.377     0.002    0.5%
 9800     0.371     0.006    1.6%
10000     0.384     0.006    1.5%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.377
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.371
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.368     0.004    1.0%
  200      0.38     0.003    0.7%
  400     0.377     0.005    1.3%
  600     0.368     0.006    1.6%
  800      0.38     0.004    1.0%
 1000     0.366     0.004    1.0%
 1200      0.37     0.008    2.1%
 1400     0.368     0.005    1.3%
 1600     0.374     0.006    1.6%
 1800     0.374     0.003    0.8%
 2000     0.364     0.006    1.6%
 2200     0.356     0.004    1.1%
 2400     0.364     0.004    1.0%
 2600     0.368     0.008    2.1%
 2800      0.38     0.009    2.3%
 3000     0.368     0.003    0.8%
 3200     0.377     0.008    2.1%
 3400     0.374     0.003    0.8%
 3600      0.36     0.003    0.8%
 3800     0.369     0.006    1.6%
 4000     0.369     0.005    1.3%
 4200     0.384     0.006    1.5%
 4400     0.372     0.003    0.8%
 4600     0.363     0.005    1.3%
 4800     0.367     0.006    1.6%
 5000     0.373     0.004    1.0%
 5200     0.375     0.005    1.3%
 5400     0.364     0.005    1.3%
 5600     0.362     0.004    1.1%
 5800     0.372     0.005    1.3%
 6000     0.371     0.004    1.0%
 6200     0.376     0.004    1.0%
 6400     0.371     0.005    1.3%
 6600     0.369     0.005    1.3%
 6800      0.37     0.004    1.0%
 7000      0.38     0.003    0.7%
 7200     0.358     0.005    1.3%
 7400     0.368     0.004    1.0%
 7600     0.379     0.007    1.8%
 7800     0.371     0.004    1.0%
 8000     0.376     0.004    1.0%
 8200      0.38     0.004    1.0%
 8400     0.375     0.003    0.8%
 8600     0.371     0.003    0.8%
 8800     0.359     0.005    1.3%
 9000     0.364     0.005    1.3%
 9200     0.362     0.004    1.1%
 9400      0.37     0.003    0.8%
 9600     0.366     0.005    1.3%
 9800     0.373     0.006    1.6%
10000     0.368     0.005    1.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.372
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    3.641
    + i     0.39
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.975     0.022    2.2%
  200     80.17     0.066    0.0%
  400     160.1     0.118    0.0%
  600     238.3     0.104    0.0%
  800     317.8     0.676    0.2%
 1000       396      4.81    1.2%
 1200     470.1       7.7    1.6%
 1400     547.7     6.111    1.1%
 1600     633.7     0.543    0.0%
 1800     697.6     1.646    0.2%
 2000     780.5     11.71    1.5%
 2200     856.5     5.622    0.6%
 2400     930.1     0.708    0.0%
 2600      1019     15.55    1.5%
 2800      1093     12.62    1.1%
 3000      1171     14.54    1.2%
 3200      1246     11.25    0.9%
 3400      1334     13.68    1.0%
 3600      1418     12.82    0.9%
 3800      1486     15.65    1.0%
 4000      1573     16.02    1.0%
 4200      1650     12.16    0.7%
 4400      1727     14.79    0.8%
 4600      1803     13.26    0.7%
 4800      1879     14.12    0.7%
 5000      1955     14.52    0.7%
 5200      2043     7.306    0.3%
 5400      2122     2.741    0.1%
 5600      2194     10.91    0.4%
 5800      2268     12.07    0.5%
 6000      2351     11.93    0.5%
 6200      2427     8.662    0.3%
 6400      2506     1.076    0.0%
 6600      2584     2.329    0.0%
 6800      2662     4.094    0.1%
 7000      2739     4.561    0.1%
 7200      2823     15.04    0.5%
 7400      2900     10.71    0.3%
 7600      2974     3.557    0.1%
 7800      3051     7.839    0.2%
 8000      3137     11.74    0.3%
 8200      3205      3.98    0.1%
 8400      3287     9.836    0.2%
 8600      3363     10.98    0.3%
 8800      3449     12.17    0.3%
 9000      3527     12.05    0.3%
 9200      3605     14.45    0.4%
 9400      3694     13.51    0.3%
 9600      3770      12.1    0.3%
 9800      3835     10.31    0.2%
10000      3912     12.02    0.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.449
    + i    0.392
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i     5.34
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.368     0.005    1.3%
   20     96.02     0.692    0.7%
   40     190.1     0.352    0.1%
   60     286.6     0.739    0.2%
   80       378     0.511    0.1%
  100     475.5     0.963    0.2%
  120     577.2     1.047    0.1%
  140       685     12.08    1.7%
  160     803.5     7.341    0.9%
  180     872.5     9.042    1.0%
  200     972.5     3.019    0.3%
  220      1079     9.667    0.8%
  240      1189     11.55    0.9%
  260      1323      14.9    1.1%
  280      1413     13.53    0.9%
  300      1504     10.72    0.7%
  320      1627     7.031    0.4%
  340      1731     9.574    0.5%
  360      1810     10.38    0.5%
  380      1932      12.7    0.6%
  400      2033     7.556    0.3%
  420      2133     13.55    0.6%
  440      2251     10.67    0.4%
  460      2381     8.524    0.3%
  480      2457     4.419    0.1%
  500      2569     9.058    0.3%
  520      2678     12.92    0.4%
  540      2817      15.1    0.5%
  560      2883     10.04    0.3%
  580      3020     6.962    0.2%
  600      3143     12.01    0.3%
  620      3224     15.19    0.4%
  640      3381     15.42    0.4%
  660      3431     10.61    0.3%
  680      3555     14.15    0.3%
  700      3642     10.34    0.2%
  720      3780      5.67    0.1%
  740      3874     11.49    0.2%
  760      3956     15.06    0.3%
  780      4075     19.84    0.4%
  800      4190     17.44    0.4%
  820      4296     11.98    0.2%
  840      4448     25.15    0.5%
  860      4544     18.94    0.4%
  880      4632     20.01    0.4%
  900      4838     10.57    0.2%
  920      4883     13.05    0.2%
  940      5001     10.76    0.2%
  960      5084      12.3    0.2%
  980      5218     16.95    0.3%
 1000      5392     26.69    0.4%

Quality and confidence:
param     error
i         0.005

Model:
Time ~=        0
    + i    5.363
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:20)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    4.289
    + i    11.81
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.358      0.01    2.7%
   20     242.7     0.547    0.2%
   40     477.1      0.98    0.2%
   60     718.8     13.56    1.8%
   80     952.2     13.34    1.4%
  100      1182     12.94    1.0%
  120      1429     13.56    0.9%
  140      1664     11.96    0.7%
  160      1888     17.18    0.9%
  180      2132     11.28    0.5%
  200      2371     6.976    0.2%
  220      2594     11.88    0.4%
  240      2856     10.56    0.3%
  260      3083     14.83    0.4%
  280      3303     6.155    0.1%
  300      3562     18.21    0.5%
  320      3782      17.8    0.4%
  340      4017     18.12    0.4%
  360      4247     18.63    0.4%
  380      4481     14.49    0.3%
  400      4730     14.45    0.3%
  420      4953     12.81    0.2%
  440      5182     14.65    0.2%
  460      5437     8.297    0.1%
  480      5671      8.26    0.1%
  500      5925     12.29    0.2%
  520      6176      9.49    0.1%
  540      6361     13.31    0.2%
  560      6600     16.76    0.2%
  580      6856     18.41    0.2%
  600      7086     15.13    0.2%
  620      7329     15.22    0.2%
  640      7546     13.97    0.1%
  660      7762      19.5    0.2%
  680      8033      15.7    0.1%
  700      8278      42.4    0.5%
  720      8508     33.63    0.3%
  740      8727     20.78    0.2%
  760      8984     29.01    0.3%
  780      9211     19.49    0.2%
  800      9402     18.42    0.1%
  820      9677     18.96    0.1%
  840      9905     30.19    0.3%
  860     10160     33.28    0.3%
  880     10390     12.19    0.1%
  900     10660      20.5    0.1%
  920     10880     15.04    0.1%
  940     11150     32.71    0.2%
  960     11370     52.33    0.4%
  980     11630     31.57    0.2%
 1000     11850     19.12    0.1%

Quality and confidence:
param     error
i         0.004

Model:
Time ~=        0
    + i    11.82
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-09-05T01:35:37Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-09-05T01:35:38Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.423
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.416     0.019    4.5%
  200     0.426     0.006    1.4%
  400     0.458     0.011    2.4%
  600      0.43     0.015    3.4%
  800      0.43     0.025    5.8%
 1000     0.404     0.014    3.4%
 1200     0.407     0.007    1.7%
 1400     0.436     0.022    5.0%
 1600     0.417     0.015    3.5%
 1800     0.426     0.016    3.7%
 2000     0.432     0.014    3.2%
 2200     0.438     0.019    4.3%
 2400     0.414     0.006    1.4%
 2600     0.423     0.008    1.8%
 2800     0.401     0.013    3.2%
 3000     0.443     0.017    3.8%
 3200     0.444     0.014    3.1%
 3400     0.419     0.014    3.3%
 3600     0.426     0.015    3.5%
 3800      0.44     0.015    3.4%
 4000     0.425     0.004    0.9%
 4200     0.431     0.022    5.1%
 4400     0.436     0.016    3.6%
 4600     0.429     0.018    4.1%
 4800     0.454     0.014    3.0%
 5000     0.449     0.019    4.2%
 5200     0.434     0.021    4.8%
 5400     0.449     0.026    5.7%
 5600      0.43     0.024    5.5%
 5800     0.427     0.004    0.9%
 6000     0.436     0.017    3.8%
 6200     0.408     0.006    1.4%
 6400     0.434     0.025    5.7%
 6600      0.41     0.018    4.3%
 6800     0.425     0.005    1.1%
 7000     0.421     0.016    3.8%
 7200     0.407     0.009    2.2%
 7400     0.427     0.012    2.8%
 7600     0.435     0.012    2.7%
 7800     0.419     0.015    3.5%
 8000     0.452     0.017    3.7%
 8200      0.43      0.02    4.6%
 8400     0.438     0.017    3.8%
 8600     0.425     0.013    3.0%
 8800     0.424     0.011    2.5%
 9000     0.432     0.006    1.3%
 9200      0.45     0.019    4.2%
 9400     0.433     0.017    3.9%
 9600     0.411     0.012    2.9%
 9800     0.427     0.017    3.9%
10000     0.432     0.021    4.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.427
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.416
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.431     0.024    5.5%
  200     0.407      0.02    4.9%
  400     0.406     0.005    1.2%
  600     0.425     0.023    5.4%
  800     0.421     0.015    3.5%
 1000     0.414     0.007    1.6%
 1200     0.422      0.02    4.7%
 1400     0.448     0.019    4.2%
 1600     0.417     0.009    2.1%
 1800      0.43     0.023    5.3%
 2000     0.403     0.012    2.9%
 2200     0.424      0.02    4.7%
 2400     0.433      0.02    4.6%
 2600     0.422     0.014    3.3%
 2800     0.417     0.028    6.7%
 3000     0.405     0.024    5.9%
 3200     0.403      0.01    2.4%
 3400     0.421     0.016    3.8%
 3600      0.44     0.017    3.8%
 3800     0.442     0.021    4.7%
 4000     0.391     0.007    1.7%
 4200     0.425     0.012    2.8%
 4400     0.428     0.008    1.8%
 4600     0.423     0.019    4.4%
 4800     0.424     0.013    3.0%
 5000     0.396     0.008    2.0%
 5200     0.414      0.01    2.4%
 5400     0.433     0.023    5.3%
 5600     0.414     0.026    6.2%
 5800     0.399     0.012    3.0%
 6000     0.394     0.004    1.0%
 6200     0.427     0.014    3.2%
 6400     0.382     0.005    1.3%
 6600     0.419     0.022    5.2%
 6800     0.411     0.015    3.6%
 7000     0.408     0.023    5.6%
 7200     0.397     0.006    1.5%
 7400     0.415     0.018    4.3%
 7600      0.41     0.015    3.6%
 7800     0.439     0.018    4.1%
 8000     0.434     0.024    5.5%
 8200     0.416     0.017    4.0%
 8400      0.42     0.013    3.0%
 8600     0.416     0.021    5.0%
 8800     0.401     0.008    1.9%
 9000     0.398     0.016    4.0%
 9200     0.401      0.01    2.4%
 9400     0.405     0.005    1.2%
 9600     0.424     0.031    7.3%
 9800     0.411     0.006    1.4%
10000     0.417     0.021    5.0%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.423
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.415
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.431     0.017    3.9%
  200     0.415     0.013    3.1%
  400     0.408     0.014    3.4%
  600     0.439     0.013    2.9%
  800     0.421     0.015    3.5%
 1000     0.419     0.007    1.6%
 1200     0.417     0.012    2.8%
 1400     0.415     0.019    4.5%
 1600     0.416     0.022    5.2%
 1800     0.379     0.004    1.0%
 2000     0.463     0.013    2.8%
 2200     0.416      0.02    4.8%
 2400     0.426     0.022    5.1%
 2600     0.417     0.008    1.9%
 2800     0.421     0.003    0.7%
 3000     0.432     0.017    3.9%
 3200     0.405     0.009    2.2%
 3400     0.415     0.018    4.3%
 3600     0.425      0.02    4.7%
 3800     0.418     0.015    3.5%
 4000     0.386     0.012    3.1%
 4200     0.411     0.022    5.3%
 4400     0.424     0.015    3.5%
 4600     0.423      0.02    4.7%
 4800      0.43     0.017    3.9%
 5000      0.43     0.015    3.4%
 5200     0.394     0.008    2.0%
 5400     0.432     0.017    3.9%
 5600     0.411     0.008    1.9%
 5800     0.426     0.012    2.8%
 6000     0.424     0.008    1.8%
 6200     0.419     0.004    0.9%
 6400     0.411     0.006    1.4%
 6600     0.403     0.006    1.4%
 6800     0.442     0.031    7.0%
 7000     0.387     0.005    1.2%
 7200     0.412     0.012    2.9%
 7400     0.423     0.022    5.2%
 7600     0.427     0.017    3.9%
 7800     0.428     0.018    4.2%
 8000     0.412     0.008    1.9%
 8200     0.415     0.002    0.4%
 8400     0.426     0.021    4.9%
 8600     0.415     0.011    2.6%
 8800     0.411     0.012    2.9%
 9000     0.432     0.024    5.5%
 9200     0.406     0.011    2.7%
 9400     0.444     0.015    3.3%
 9600     0.431     0.021    4.8%
 9800     0.425     0.011    2.5%
10000      0.44     0.016    3.6%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.418
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.417
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.431     0.007    1.6%
  200     0.411     0.009    2.1%
  400     0.409     0.007    1.7%
  600     0.416     0.009    2.1%
  800      0.42     0.015    3.5%
 1000     0.434     0.016    3.6%
 1200     0.421     0.022    5.2%
 1400     0.413     0.006    1.4%
 1600     0.417     0.011    2.6%
 1800     0.403     0.007    1.7%
 2000     0.425     0.013    3.0%
 2200     0.409     0.007    1.7%
 2400     0.419     0.011    2.6%
 2600     0.422     0.007    1.6%
 2800     0.396     0.012    3.0%
 3000      0.43     0.019    4.4%
 3200     0.411     0.006    1.4%
 3400     0.423      0.02    4.7%
 3600     0.432     0.017    3.9%
 3800     0.415      0.01    2.4%
 4000      0.39      0.01    2.5%
 4200     0.416     0.005    1.2%
 4400     0.423     0.012    2.8%
 4600     0.425     0.003    0.7%
 4800     0.428     0.018    4.2%
 5000     0.416     0.012    2.8%
 5200     0.406     0.004    0.9%
 5400     0.415     0.014    3.3%
 5600     0.425     0.013    3.0%
 5800      0.41     0.012    2.9%
 6000      0.41     0.011    2.6%
 6200     0.436     0.022    5.0%
 6400     0.405     0.005    1.2%
 6600     0.438     0.031    7.0%
 6800     0.413     0.005    1.2%
 7000     0.428     0.005    1.1%
 7200      0.43     0.027    6.2%
 7400     0.436     0.014    3.2%
 7600      0.42     0.008    1.9%
 7800     0.392     0.009    2.2%
 8000     0.416     0.011    2.6%
 8200     0.438     0.018    4.1%
 8400     0.417     0.011    2.6%
 8600     0.422      0.02    4.7%
 8800      0.43     0.022    5.1%
 9000     0.414     0.008    1.9%
 9200     0.422     0.017    4.0%
 9400     0.408      0.01    2.4%
 9600     0.419      0.01    2.3%
 9800     0.423     0.006    1.4%
10000     0.415     0.004    0.9%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.417
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    4.794
    + i    0.391
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     1.006     0.013    1.2%
  200     80.39      0.05    0.0%
  400     159.6     0.079    0.0%
  600     238.9     0.145    0.0%
  800     318.4     0.357    0.1%
 1000     396.3     2.511    0.6%
 1200     468.6     4.214    0.8%
 1400     558.8     0.125    0.0%
 1600     626.1     5.893    0.9%
 1800     699.6     1.575    0.2%
 2000     784.9     13.29    1.6%
 2200     855.9     3.943    0.4%
 2400     939.9      12.4    1.3%
 2600      1019     15.58    1.5%
 2800      1109     14.89    1.3%
 3000      1177     16.22    1.3%
 3200      1266      12.6    0.9%
 3400      1347     6.652    0.4%
 3600      1416     16.72    1.1%
 3800      1503     12.83    0.8%
 4000      1572      14.8    0.9%
 4200      1652      11.7    0.7%
 4400      1733        13    0.7%
 4600      1804     15.36    0.8%
 4800      1881     15.82    0.8%
 5000      1958     15.51    0.7%
 5200      2042     12.98    0.6%
 5400      2115     16.81    0.7%
 5600      2198     14.29    0.6%
 5800      2284     3.506    0.1%
 6000      2366     8.129    0.3%
 6200      2429     11.45    0.4%
 6400      2523     22.13    0.8%
 6600      2598     19.52    0.7%
 6800      2680     9.702    0.3%
 7000      2744     11.01    0.4%
 7200      2837     12.34    0.4%
 7400      2899     2.399    0.0%
 7600      2997     11.75    0.3%
 7800      3063      5.04    0.1%
 8000      3152     12.42    0.3%
 8200      3222     13.88    0.4%
 8400      3300     10.47    0.3%
 8600      3365     17.53    0.5%
 8800      3473     16.72    0.4%
 9000      3529      15.4    0.4%
 9200      3609     10.41    0.2%
 9400      3690     13.09    0.3%
 9600      3753      8.94    0.2%
 9800      3848     13.47    0.3%
10000      3921     9.514    0.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=     2.73
    + i    0.392
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    5.685
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.411     0.007    1.7%
   20     99.71     0.164    0.1%
   40     198.8     0.622    0.3%
   60     302.5     0.492    0.1%
   80     402.1     3.752    0.9%
  100     504.2     1.706    0.3%
  120     620.6     5.918    0.9%
  140       724     12.03    1.6%
  160     831.6     5.467    0.6%
  180     930.9     11.69    1.2%
  200      1052     13.71    1.3%
  220      1163     12.48    1.0%
  240      1271     3.229    0.2%
  260      1365     3.025    0.2%
  280      1504     9.269    0.6%
  300      1597     14.43    0.9%
  320      1705     16.77    0.9%
  340      1858     6.884    0.3%
  360      1928     15.33    0.7%
  380      2061     14.98    0.7%
  400      2158     8.789    0.4%
  420      2299      10.8    0.4%
  440      2391     10.25    0.4%
  460      2556      15.3    0.5%
  480      2610     12.62    0.4%
  500      2736     12.99    0.4%
  520      2865      13.5    0.4%
  540      3016     14.76    0.4%
  560      3076     11.22    0.3%
  580      3204     15.44    0.4%
  600      3331     17.54    0.5%
  620      3420     17.86    0.5%
  640      3585     14.53    0.4%
  660      3658     11.43    0.3%
  680      3780     15.56    0.4%
  700      3922     13.04    0.3%
  720      4041     7.776    0.1%
  740      4121     20.56    0.4%
  760      4236     10.27    0.2%
  780      4338      14.5    0.3%
  800      4441     13.83    0.3%
  820      4574     21.46    0.4%
  840      4716     17.72    0.3%
  860      4812     28.67    0.5%
  880      4925     34.37    0.6%
  900      5126     11.42    0.2%
  920      5222     23.14    0.4%
  940      5326     15.06    0.2%
  960      5420     23.21    0.4%
  980      5559     17.55    0.3%
 1000      5683     29.85    0.5%

Quality and confidence:
param     error
i         0.005

Model:
Time ~=        0
    + i    5.705
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:20)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    5.686
    + i     12.3
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.398     0.005    1.2%
   20     252.6     0.678    0.2%
   40     494.8     1.014    0.2%
   60     744.3     6.991    0.9%
   80     988.1     14.24    1.4%
  100      1239     16.09    1.2%
  120      1494     11.01    0.7%
  140      1740     11.58    0.6%
  160      1968     16.15    0.8%
  180      2221     10.52    0.4%
  200      2463     6.663    0.2%
  220      2710     13.02    0.4%
  240      2997     10.53    0.3%
  260      3254     4.827    0.1%
  280      3445     8.517    0.2%
  300      3710     11.24    0.3%
  320      3959     17.81    0.4%
  340      4175     16.57    0.3%
  360      4435     16.75    0.3%
  380      4671      11.7    0.2%
  400      4932     20.26    0.4%
  420      5172     11.88    0.2%
  440      5485     30.49    0.5%
  460      5665     17.03    0.3%
  480      5910     22.44    0.3%
  500      6121     12.04    0.1%
  520      6402     17.09    0.2%
  540      6678     21.19    0.3%
  560      6908     19.43    0.2%
  580      7121     17.87    0.2%
  600      7357     26.07    0.3%
  620      7628     18.62    0.2%
  640      7856     24.26    0.3%
  660      8169     24.63    0.3%
  680      8383     29.72    0.3%
  700      8586     19.57    0.2%
  720      8829     20.91    0.2%
  740      9096     17.62    0.1%
  760      9379     29.75    0.3%
  780      9555     23.29    0.2%
  800      9820     17.51    0.1%
  820     10070     28.44    0.2%
  840     10310        27    0.2%
  860     10570     18.25    0.1%
  880     10800     25.69    0.2%
  900     11130     31.58    0.2%
  920     11390     31.14    0.2%
  940     11610     24.53    0.2%
  960     11880     21.36    0.1%
  980     12100     31.28    0.2%
 1000     12370     31.13    0.2%

Quality and confidence:
param     error
i         0.005

Model:
Time ~=    4.011
    + i    12.31
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-09-05T03:28:28Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-09-05T03:28:30Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.381
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.385      0.01    2.5%
  200     0.378     0.005    1.3%
  400     0.365     0.006    1.6%
  600      0.38     0.003    0.7%
  800     0.366     0.005    1.3%
 1000     0.385     0.008    2.0%
 1200     0.383     0.005    1.3%
 1400     0.383     0.005    1.3%
 1600     0.384     0.004    1.0%
 1800     0.388     0.008    2.0%
 2000     0.387     0.005    1.2%
 2200     0.403     0.005    1.2%
 2400     0.377     0.001    0.2%
 2600     0.385     0.006    1.5%
 2800     0.385     0.009    2.3%
 3000      0.38     0.006    1.5%
 3200     0.389     0.007    1.7%
 3400     0.377     0.006    1.5%
 3600     0.375     0.005    1.3%
 3800     0.378     0.007    1.8%
 4000     0.396     0.007    1.7%
 4200     0.383     0.004    1.0%
 4400     0.396     0.005    1.2%
 4600     0.392     0.008    2.0%
 4800     0.392     0.007    1.7%
 5000     0.386     0.006    1.5%
 5200      0.38     0.003    0.7%
 5400     0.387     0.008    2.0%
 5600     0.384     0.003    0.7%
 5800     0.397     0.005    1.2%
 6000     0.381     0.004    1.0%
 6200     0.385     0.005    1.2%
 6400     0.373     0.008    2.1%
 6600     0.405     0.003    0.7%
 6800     0.401     0.006    1.4%
 7000       0.4     0.004    1.0%
 7200     0.384      0.01    2.6%
 7400      0.39     0.007    1.7%
 7600     0.391     0.003    0.7%
 7800      0.38     0.004    1.0%
 8000     0.385     0.004    1.0%
 8200     0.402     0.002    0.4%
 8400     0.374     0.003    0.8%
 8600     0.385     0.005    1.2%
 8800     0.382     0.004    1.0%
 9000     0.389     0.005    1.2%
 9200     0.385     0.005    1.2%
 9400     0.382     0.005    1.3%
 9600     0.378     0.005    1.3%
 9800     0.385     0.005    1.2%
10000     0.388     0.005    1.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.382
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.395
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.394     0.005    1.2%
  200     0.398     0.005    1.2%
  400     0.394     0.005    1.2%
  600     0.384     0.004    1.0%
  800     0.396     0.004    1.0%
 1000     0.398     0.003    0.7%
 1200      0.39     0.005    1.2%
 1400     0.394     0.003    0.7%
 1600     0.401     0.005    1.2%
 1800     0.405     0.004    0.9%
 2000     0.386     0.004    1.0%
 2200     0.387     0.003    0.7%
 2400      0.39     0.005    1.2%
 2600     0.402     0.004    0.9%
 2800     0.389     0.003    0.7%
 3000     0.399     0.003    0.7%
 3200     0.382     0.004    1.0%
 3400     0.392     0.006    1.5%
 3600     0.393     0.006    1.5%
 3800     0.407     0.006    1.4%
 4000     0.405     0.004    0.9%
 4200     0.392     0.006    1.5%
 4400     0.389     0.006    1.5%
 4600     0.397     0.003    0.7%
 4800     0.391     0.004    1.0%
 5000     0.406     0.008    1.9%
 5200     0.385     0.005    1.2%
 5400     0.388     0.009    2.3%
 5600     0.403     0.003    0.7%
 5800       0.4     0.003    0.7%
 6000     0.399     0.006    1.5%
 6200       0.4     0.005    1.2%
 6400     0.379     0.003    0.7%
 6600     0.387     0.004    1.0%
 6800     0.396     0.005    1.2%
 7000     0.382     0.005    1.3%
 7200     0.394     0.002    0.5%
 7400     0.382     0.004    1.0%
 7600     0.398     0.004    1.0%
 7800     0.394     0.003    0.7%
 8000     0.387     0.002    0.5%
 8200     0.408     0.006    1.4%
 8400     0.397      0.01    2.5%
 8600     0.386     0.008    2.0%
 8800     0.387     0.002    0.5%
 9000     0.402     0.005    1.2%
 9200     0.398     0.004    1.0%
 9400     0.373     0.004    1.0%
 9600     0.387     0.006    1.5%
 9800     0.395     0.003    0.7%
10000     0.389     0.005    1.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.396
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.386
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.382     0.006    1.5%
  200     0.382     0.006    1.5%
  400     0.387     0.005    1.2%
  600      0.41     0.007    1.7%
  800      0.37     0.003    0.8%
 1000     0.378     0.002    0.5%
 1200     0.381     0.004    1.0%
 1400     0.398     0.006    1.5%
 1600     0.383     0.008    2.0%
 1800     0.408     0.006    1.4%
 2000     0.379     0.003    0.7%
 2200     0.372     0.004    1.0%
 2400     0.399     0.007    1.7%
 2600     0.384     0.004    1.0%
 2800     0.383     0.005    1.3%
 3000     0.378     0.005    1.3%
 3200     0.378     0.002    0.5%
 3400     0.388     0.005    1.2%
 3600     0.395     0.007    1.7%
 3800     0.366     0.003    0.8%
 4000     0.389     0.003    0.7%
 4200      0.39     0.005    1.2%
 4400     0.404     0.004    0.9%
 4600     0.391     0.005    1.2%
 4800     0.381     0.005    1.3%
 5000     0.404     0.004    0.9%
 5200     0.398     0.008    2.0%
 5400     0.394     0.005    1.2%
 5600     0.391     0.004    1.0%
 5800     0.382     0.004    1.0%
 6000     0.398     0.009    2.2%
 6200     0.388     0.008    2.0%
 6400     0.385     0.006    1.5%
 6600     0.396     0.005    1.2%
 6800     0.386     0.009    2.3%
 7000     0.381     0.006    1.5%
 7200     0.394     0.004    1.0%
 7400     0.402     0.006    1.4%
 7600      0.39     0.003    0.7%
 7800     0.387     0.004    1.0%
 8000      0.39     0.003    0.7%
 8200     0.394     0.005    1.2%
 8400      0.37     0.008    2.1%
 8600     0.395     0.006    1.5%
 8800     0.382     0.002    0.5%
 9000     0.392     0.003    0.7%
 9200     0.374     0.005    1.3%
 9400     0.406     0.006    1.4%
 9600     0.393     0.004    1.0%
 9800      0.39     0.005    1.2%
10000     0.385     0.005    1.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.386
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.382
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0      0.38     0.008    2.1%
  200     0.374     0.003    0.8%
  400     0.364     0.003    0.8%
  600     0.374     0.005    1.3%
  800     0.385     0.003    0.7%
 1000      0.39     0.004    1.0%
 1200     0.379     0.005    1.3%
 1400     0.367     0.004    1.0%
 1600      0.37     0.004    1.0%
 1800     0.382     0.005    1.3%
 2000      0.39     0.005    1.2%
 2200     0.401     0.003    0.7%
 2400     0.376     0.003    0.7%
 2600     0.387     0.007    1.8%
 2800     0.366     0.003    0.8%
 3000     0.385     0.004    1.0%
 3200     0.405     0.005    1.2%
 3400     0.388     0.005    1.2%
 3600     0.392     0.005    1.2%
 3800     0.412     0.006    1.4%
 4000     0.381     0.006    1.5%
 4200     0.402     0.006    1.4%
 4400     0.396     0.007    1.7%
 4600     0.368     0.004    1.0%
 4800     0.384     0.006    1.5%
 5000      0.39     0.004    1.0%
 5200     0.396     0.007    1.7%
 5400     0.386     0.009    2.3%
 5600     0.399     0.005    1.2%
 5800     0.371     0.008    2.1%
 6000     0.413     0.005    1.2%
 6200     0.406     0.005    1.2%
 6400     0.392     0.006    1.5%
 6600     0.381     0.005    1.3%
 6800     0.401     0.003    0.7%
 7000     0.394     0.008    2.0%
 7200     0.382     0.004    1.0%
 7400     0.375     0.004    1.0%
 7600     0.379     0.003    0.7%
 7800     0.381     0.006    1.5%
 8000      0.38     0.006    1.5%
 8200     0.402     0.004    0.9%
 8400     0.393     0.006    1.5%
 8600     0.405     0.006    1.4%
 8800     0.365     0.004    1.0%
 9000     0.401     0.004    0.9%
 9200      0.38     0.003    0.7%
 9400     0.391     0.006    1.5%
 9600     0.377     0.003    0.7%
 9800     0.394     0.003    0.7%
10000     0.381     0.003    0.7%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.382
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.303
    + i    0.392
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     1.013     0.011    1.0%
  200     80.82     0.218    0.2%
  400     160.6     0.098    0.0%
  600     239.2     0.146    0.0%
  800     311.7     0.199    0.0%
 1000       392     0.991    0.2%
 1200     476.3     4.986    1.0%
 1400     549.5     5.093    0.9%
 1600     622.9     1.306    0.2%
 1800     705.8     12.28    1.7%
 2000     790.1     16.85    2.1%
 2200     868.8     12.17    1.4%
 2400     937.5     6.564    0.7%
 2600      1015     11.38    1.1%
 2800      1100     5.885    0.5%
 3000      1176     13.87    1.1%
 3200      1258     13.71    1.0%
 3400      1346     11.62    0.8%
 3600      1416     13.74    0.9%
 3800      1496     15.58    1.0%
 4000      1577     13.85    0.8%
 4200      1655     12.35    0.7%
 4400      1727     13.41    0.7%
 4600      1820     5.533    0.3%
 4800      1898     3.794    0.1%
 5000      1961     13.94    0.7%
 5200      2048      12.2    0.5%
 5400      2118     14.48    0.6%
 5600      2209     14.22    0.6%
 5800      2296     13.15    0.5%
 6000      2370     5.347    0.2%
 6200      2433     14.62    0.6%
 6400      2529     11.91    0.4%
 6600      2594     15.19    0.5%
 6800      2674     3.345    0.1%
 7000      2749     5.833    0.2%
 7200      2839     9.031    0.3%
 7400      2910     10.38    0.3%
 7600      2992     12.29    0.4%
 7800      3067     9.893    0.3%
 8000      3187     6.666    0.2%
 8200      3227      13.8    0.4%
 8400      3293     2.738    0.0%
 8600      3379     16.66    0.4%
 8800      3467     14.86    0.4%
 9000      3538     13.03    0.3%
 9200      3621      8.15    0.2%
 9400      3695     9.876    0.2%
 9600      3770     8.549    0.2%
 9800      3883     11.47    0.2%
10000      3931     10.89    0.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.394
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    5.428
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.386     0.007    1.8%
   20     95.78     0.159    0.1%
   40     195.4     0.792    0.4%
   60       289     0.844    0.2%
   80       383     1.351    0.3%
  100     479.8     1.967    0.4%
  120     590.5     8.282    1.4%
  140     688.1     2.242    0.3%
  160     788.6     1.191    0.1%
  180       891     13.46    1.5%
  200     993.8     3.031    0.3%
  220      1109     13.67    1.2%
  240      1213     10.43    0.8%
  260      1325     10.06    0.7%
  280      1423     10.98    0.7%
  300      1526     9.547    0.6%
  320      1631     5.747    0.3%
  340      1760     14.01    0.7%
  360      1839     9.796    0.5%
  380      1968     8.019    0.4%
  400      2051     10.98    0.5%
  420      2172     7.748    0.3%
  440      2276        12    0.5%
  460      2429     12.54    0.5%
  480      2465     13.59    0.5%
  500      2596     11.36    0.4%
  520      2740     5.867    0.2%
  540      2849     15.27    0.5%
  560      2945     19.42    0.6%
  580      3073     16.26    0.5%
  600      3195     17.34    0.5%
  620      3296     10.71    0.3%
  640      3386     10.38    0.3%
  660      3460     21.87    0.6%
  680      3596     16.03    0.4%
  700      3718      12.2    0.3%
  720      3859     20.86    0.5%
  740      3932     15.35    0.3%
  760      4065     18.82    0.4%
  780      4175     19.65    0.4%
  800      4230     16.96    0.4%
  820      4384     12.65    0.2%
  840      4517     21.59    0.4%
  860      4605     22.07    0.4%
  880      4720     19.63    0.4%
  900      4876     16.32    0.3%
  920      4971     24.48    0.4%
  940      5098     13.31    0.2%
  960      5177     18.36    0.3%
  980      5301      17.6    0.3%
 1000      5375     19.44    0.3%

Quality and confidence:
param     error
i         0.005

Model:
Time ~=        0
    + i    5.445
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:20)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    7.574
    + i    12.05
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.378     0.006    1.5%
   20     247.3     0.758    0.3%
   40     485.7      2.79    0.5%
   60     732.6     9.156    1.2%
   80     971.3     15.53    1.5%
  100      1210     15.31    1.2%
  120      1451     13.12    0.9%
  140      1691     13.99    0.8%
  160      1936     10.54    0.5%
  180      2180     16.69    0.7%
  200      2416     11.22    0.4%
  220      2652     16.56    0.6%
  240      2906     13.29    0.4%
  260      3146     17.88    0.5%
  280      3388     10.89    0.3%
  300      3629     17.57    0.4%
  320      3862     11.95    0.3%
  340      4103     13.59    0.3%
  360      4354     9.282    0.2%
  380      4589     8.769    0.1%
  400      4889     4.024    0.0%
  420      5074     16.17    0.3%
  440      5335     12.86    0.2%
  460      5577     12.53    0.2%
  480      5821      17.6    0.3%
  500      6028     9.408    0.1%
  520      6274     20.84    0.3%
  540      6736     126.1    1.8%
  560      6772     21.12    0.3%
  580      6972     12.58    0.1%
  600      7229     24.95    0.3%
  620      7451     24.54    0.3%
  640      7723     33.28    0.4%
  660      7957     32.77    0.4%
  680      8178     20.29    0.2%
  700      8427      18.6    0.2%
  720      8646     15.03    0.1%
  740      8896     34.92    0.3%
  760      9142     20.47    0.2%
  780      9466     41.38    0.4%
  800      9593     26.03    0.2%
  820      9892      22.8    0.2%
  840     10110     40.21    0.3%
  860     10350      32.2    0.3%
  880     10630     19.72    0.1%
  900     10900     37.09    0.3%
  920     11120     24.68    0.2%
  940     11380     29.35    0.2%
  960     11610     33.58    0.2%
  980     11850     68.32    0.5%
 1000     12090     18.35    0.1%

Quality and confidence:
param     error
i         0.007

Model:
Time ~=    8.442
    + i    12.06
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-09-05T03:39:49Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-09-05T03:39:50Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.419
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.394     0.004    1.0%
20000     0.416     0.005    1.2%
40000      0.42     0.006    1.4%
60000      0.42     0.008    1.9%
80000     0.414     0.007    1.6%
100000     0.438     0.005    1.1%
120000     0.419     0.008    1.9%
140000     0.418     0.005    1.1%
160000     0.425     0.006    1.4%
180000     0.423     0.006    1.4%
200000     0.436     0.009    2.0%
220000     0.414     0.005    1.2%
240000     0.416     0.006    1.4%
260000      0.42     0.009    2.1%
280000     0.421     0.008    1.9%
300000     0.414     0.006    1.4%
320000     0.423      0.01    2.3%
340000     0.424     0.006    1.4%
360000     0.423     0.009    2.1%
380000     0.407     0.005    1.2%
400000      0.42     0.007    1.6%
420000     0.415     0.004    0.9%
440000     0.411     0.005    1.2%
460000     0.424     0.007    1.6%
480000     0.438     0.009    2.0%
500000     0.428     0.008    1.8%
520000     0.416     0.006    1.4%
540000     0.414     0.007    1.6%
560000     0.416     0.006    1.4%
580000     0.414     0.005    1.2%
600000     0.407     0.006    1.4%
620000     0.425      0.01    2.3%
640000     0.425     0.005    1.1%
660000     0.415     0.008    1.9%
680000     0.422     0.007    1.6%
700000     0.407     0.003    0.7%
720000      0.41     0.007    1.7%
740000     0.409     0.006    1.4%
760000     0.418     0.006    1.4%
780000     0.405     0.008    1.9%
800000     0.418     0.007    1.6%
820000     0.419     0.002    0.4%
840000     0.433     0.006    1.3%
860000     0.425     0.006    1.4%
880000     0.403     0.006    1.4%
900000     0.407     0.003    0.7%
920000      0.41     0.006    1.4%
940000     0.414     0.008    1.9%
960000     0.415     0.004    0.9%
980000     0.434     0.008    1.8%
1000000     0.418     0.007    1.6%

Quality and confidence:
param     error
i             0

Model:
Time ~=     0.42
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.414
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.419     0.006    1.4%
20000     0.408     0.007    1.7%
40000     0.422     0.002    0.4%
60000     0.416     0.004    0.9%
80000     0.421     0.008    1.9%
100000     0.403     0.003    0.7%
120000     0.411     0.008    1.9%
140000     0.417     0.008    1.9%
160000     0.409     0.004    0.9%
180000     0.409     0.004    0.9%
200000     0.415     0.004    0.9%
220000     0.416     0.008    1.9%
240000     0.408     0.003    0.7%
260000     0.418     0.008    1.9%
280000     0.401     0.008    1.9%
300000     0.404     0.008    1.9%
320000     0.409     0.005    1.2%
340000     0.411      0.01    2.4%
360000      0.42     0.004    0.9%
380000      0.41     0.005    1.2%
400000      0.41     0.008    1.9%
420000     0.409     0.008    1.9%
440000     0.415     0.005    1.2%
460000     0.416     0.007    1.6%
480000     0.409     0.009    2.2%
500000     0.413     0.005    1.2%
520000     0.402     0.003    0.7%
540000     0.407     0.007    1.7%
560000     0.405     0.005    1.2%
580000     0.399     0.008    2.0%
600000     0.399     0.001    0.2%
620000     0.401     0.004    0.9%
640000     0.402     0.003    0.7%
660000     0.405     0.005    1.2%
680000      0.41     0.006    1.4%
700000       0.4     0.007    1.7%
720000     0.414     0.006    1.4%
740000     0.406      0.01    2.4%
760000     0.413     0.005    1.2%
780000     0.401     0.006    1.4%
800000     0.402     0.003    0.7%
820000     0.407     0.006    1.4%
840000     0.406     0.006    1.4%
860000     0.413     0.008    1.9%
880000     0.406     0.007    1.7%
900000     0.403     0.006    1.4%
920000     0.401     0.004    0.9%
940000     0.405     0.007    1.7%
960000     0.405     0.004    0.9%
980000     0.421     0.009    2.1%
1000000     0.387     0.002    0.5%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.415
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.408
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0       0.4     0.005    1.2%
20000     0.409      0.01    2.4%
40000     0.413     0.007    1.6%
60000     0.405     0.005    1.2%
80000     0.404     0.008    1.9%
100000     0.405     0.004    0.9%
120000      0.41     0.003    0.7%
140000     0.408     0.007    1.7%
160000     0.406     0.007    1.7%
180000     0.415     0.006    1.4%
200000     0.419      0.01    2.3%
220000     0.405     0.005    1.2%
240000     0.404     0.008    1.9%
260000     0.419     0.007    1.6%
280000     0.405     0.008    1.9%
300000     0.423     0.005    1.1%
320000     0.412      0.01    2.4%
340000     0.402     0.004    0.9%
360000     0.402     0.007    1.7%
380000     0.406     0.006    1.4%
400000     0.404     0.007    1.7%
420000     0.428     0.006    1.4%
440000      0.41     0.005    1.2%
460000     0.402     0.005    1.2%
480000     0.409     0.007    1.7%
500000     0.417     0.004    0.9%
520000     0.413     0.009    2.1%
540000     0.411     0.006    1.4%
560000     0.422     0.003    0.7%
580000     0.418     0.006    1.4%
600000     0.421     0.008    1.9%
620000     0.424     0.012    2.8%
640000     0.416     0.005    1.2%
660000     0.417     0.009    2.1%
680000     0.404     0.008    1.9%
700000     0.421     0.005    1.1%
720000     0.417     0.005    1.1%
740000     0.414     0.005    1.2%
760000     0.394     0.005    1.2%
780000     0.409     0.006    1.4%
800000     0.414     0.009    2.1%
820000     0.411     0.004    0.9%
840000       0.4     0.009    2.2%
860000     0.419     0.005    1.1%
880000     0.418     0.008    1.9%
900000     0.425      0.01    2.3%
920000     0.419      0.01    2.3%
940000     0.418     0.006    1.4%
960000     0.401     0.008    1.9%
980000     0.409     0.007    1.7%
1000000     0.406     0.006    1.4%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.409
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.428
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.414     0.005    1.2%
20000     0.427      0.01    2.3%
40000     0.417     0.002    0.4%
60000     0.427     0.004    0.9%
80000     0.422     0.009    2.1%
100000     0.435     0.003    0.6%
120000     0.434     0.008    1.8%
140000     0.432     0.005    1.1%
160000     0.434     0.006    1.3%
180000     0.426     0.005    1.1%
200000     0.429     0.005    1.1%
220000     0.427     0.007    1.6%
240000     0.436     0.007    1.6%
260000      0.42     0.004    0.9%
280000     0.437     0.009    2.0%
300000     0.437     0.004    0.9%
320000     0.428     0.007    1.6%
340000     0.432     0.004    0.9%
360000     0.441     0.004    0.9%
380000     0.437     0.009    2.0%
400000     0.429     0.007    1.6%
420000     0.431      0.01    2.3%
440000     0.434     0.009    2.0%
460000     0.433     0.004    0.9%
480000     0.444     0.008    1.8%
500000     0.435     0.008    1.8%
520000     0.435     0.006    1.3%
540000     0.437     0.006    1.3%
560000     0.435     0.008    1.8%
580000     0.423     0.005    1.1%
600000     0.427     0.003    0.7%
620000     0.422     0.003    0.7%
640000     0.431     0.004    0.9%
660000     0.424     0.004    0.9%
680000     0.432     0.008    1.8%
700000      0.43     0.005    1.1%
720000     0.435     0.007    1.6%
740000     0.438     0.006    1.3%
760000      0.43     0.011    2.5%
780000      0.44     0.004    0.9%
800000      0.43     0.007    1.6%
820000     0.427     0.006    1.4%
840000     0.424     0.003    0.7%
860000     0.436     0.008    1.8%
880000     0.433     0.006    1.3%
900000     0.436     0.005    1.1%
920000     0.437     0.004    0.9%
940000     0.433     0.007    1.6%
960000     0.429     0.009    2.0%
980000     0.435     0.004    0.9%
1000000     0.435     0.005    1.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.429
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    7.566
    + i    0.396
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     1.073     0.007    0.6%
 2000     795.1     11.66    1.4%
 4000      1590      15.6    0.9%
 6000      2390     13.91    0.5%
 8000      3174     9.911    0.3%
10000      3967      11.3    0.2%
12000      4761     14.13    0.2%
14000      5562      15.2    0.2%
16000      6359     14.19    0.2%
18000      7125     20.52    0.2%
20000      7919     21.54    0.2%
22000      8728     17.16    0.1%
24000      9516     22.49    0.2%
26000     10290     10.75    0.1%
28000     11100     20.31    0.1%
30000     11890     30.64    0.2%
32000     12680     23.05    0.1%
34000     13470     23.48    0.1%
36000     14280      24.6    0.1%
38000     15040     24.27    0.1%
40000     15810     31.63    0.1%
42000     16650     14.78    0.0%
44000     17410     28.56    0.1%
46000     18200     17.33    0.0%
48000     19020     25.06    0.1%
50000     19780     21.47    0.1%
52000     20550     19.89    0.0%
54000     21340     33.33    0.1%
56000     22160      31.6    0.1%
58000     22950     22.36    0.0%
60000     23730     22.86    0.0%
62000     24540     40.23    0.1%
64000     25420     74.33    0.2%
66000     26140     25.67    0.0%
68000     26940     35.04    0.1%
70000     27730     25.27    0.0%
72000     28530     16.58    0.0%
74000     29280     43.07    0.1%
76000     30120     52.36    0.1%
78000     30880     40.08    0.1%
80000     31830     170.7    0.5%
82000     32540      24.1    0.0%
84000     33290      35.8    0.1%
86000     34060     30.23    0.0%
88000     34870     50.09    0.1%
90000     35670     48.64    0.1%
92000     36480     45.39    0.1%
94000     37200     30.39    0.0%
96000     38000     33.95    0.0%
98000     38810     46.03    0.1%
100000     39620     38.76    0.0%

Quality and confidence:
param     error
i             0

Model:
Time ~=    1.059
    + i    0.396
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    5.507
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0      0.41     0.006    1.4%
   20     97.38     0.351    0.3%
   40     194.5     0.286    0.1%
   60     295.9     1.402    0.4%
   80     391.8     0.881    0.2%
  100       497     1.723    0.3%
  120     608.9     7.986    1.3%
  140     702.2     2.709    0.3%
  160     813.2     8.224    1.0%
  180     915.7     3.766    0.4%
  200      1013     6.161    0.6%
  220      1109     12.44    1.1%
  240      1220     2.685    0.2%
  260      1346     4.776    0.3%
  280      1462     9.687    0.6%
  300      1551     7.899    0.5%
  320      1665     11.11    0.6%
  340      1783     9.898    0.5%
  360      1886     14.87    0.7%
  380      1947     7.961    0.4%
  400      2110     7.861    0.3%
  420      2182     13.06    0.5%
  440      2276     9.499    0.4%
  460      2452     6.532    0.2%
  480      2573      11.6    0.4%
  500      2671     17.37    0.6%
  520      2777      11.5    0.4%
  540      2880     10.16    0.3%
  560      3075      25.7    0.8%
  580      3138     11.04    0.3%
  600      3189     12.24    0.3%
  620      3292     12.11    0.3%
  640      3423      11.1    0.3%
  660      3538     9.197    0.2%
  680      3664     17.81    0.4%
  700      3786     14.08    0.3%
  720      3902     18.15    0.4%
  740      3998     16.98    0.4%
  760      4132     15.15    0.3%
  780      4236     17.63    0.4%
  800      4346     10.74    0.2%
  820      4436     12.28    0.2%
  840      4592     18.42    0.4%
  860      4659     10.35    0.2%
  880      4771      12.2    0.2%
  900      4909     17.35    0.3%
  920      5076     30.28    0.5%
  940      5146     25.15    0.4%
  960      5275     29.35    0.5%
  980      5411     17.75    0.3%
 1000      5465     13.75    0.2%

Quality and confidence:
param     error
i         0.005

Model:
Time ~=        0
    + i    5.527
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:20 w:20)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    3.585
    + i    12.14
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0       0.4     0.003    0.7%
   20     252.2      2.85    1.1%
   40     489.6     1.401    0.2%
   60     737.9     13.16    1.7%
   80     966.8      1.62    0.1%
  100      1216     16.29    1.3%
  120      1469     15.19    1.0%
  140      1705     16.53    0.9%
  160      1943     14.23    0.7%
  180      2201     13.14    0.5%
  200      2432     9.749    0.4%
  220      2670      8.29    0.3%
  240      2920     5.908    0.2%
  260      3166     14.19    0.4%
  280      3401     10.66    0.3%
  300      3649     9.125    0.2%
  320      3886     8.894    0.2%
  340      4114     18.04    0.4%
  360      4377      11.4    0.2%
  380      4624     25.98    0.5%
  400      4871     7.191    0.1%
  420      5091     7.552    0.1%
  440      5342     13.27    0.2%
  460      5600     13.97    0.2%
  480      5839     24.38    0.4%
  500      6067     14.44    0.2%
  520      6311      11.8    0.1%
  540      6572     19.57    0.2%
  560      6830     21.28    0.3%
  580      7065     23.43    0.3%
  600      7276     23.79    0.3%
  620      7515     15.51    0.2%
  640      7755     13.88    0.1%
  660      8033     18.09    0.2%
  680      8261     33.28    0.4%
  700      8498     14.32    0.1%
  720      8748     17.32    0.1%
  740      8965     13.72    0.1%
  760      9247      29.7    0.3%
  780      9452     30.58    0.3%
  800      9692     17.77    0.1%
  820      9940     22.19    0.2%
  840     10180     42.28    0.4%
  860     10440     23.47    0.2%
  880     10670     21.66    0.2%
  900     10970      22.6    0.2%
  920     11180     30.77    0.2%
  940     11420     26.25    0.2%
  960     11710     34.63    0.2%
  980     11930     16.16    0.1%
 1000     12160     11.48    0.0%

Quality and confidence:
param     error
i         0.003

Model:
Time ~=    1.823
    + i    12.15
              µs

Reads = 0 + (1 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

frame/benchmarking/src/baseline.rs

gui1117

looks good to me,
some nits above

emostov · 2021-09-21T03:37:19Z

bin/node-template/runtime/src/lib.rs

@@ -500,6 +505,7 @@ impl_runtime_apis! {
 			let mut batches = Vec::<BenchmarkBatch>::new();
 			let params = (&config, &whitelist);

+			add_benchmark!(params, batches, frame_benchmarking, BaselineBench::<Runtime>);


is the idea with adding it to the node-template that we want new substrate users to get into the habit of using this baseline benchmark pallet in their project?

sure, if we use it, they should too. And it is pretty free with no impact on the runtime built without the benchmarking flag.

emostov

LGTM

what is the planned workflow for triggering running these baselines? Is it just whenever we think things are off then we can run the baseline benchmarks? Or do we want to run these at some regular interval?

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-10-29T23:39:27Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-10-29T23:39:29Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.337
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.323     0.003    0.9%
20000     0.323     0.007    2.1%
40000     0.354     0.014    3.9%
60000     0.345     0.004    1.1%
80000     0.324     0.008    2.4%
100000     0.328     0.008    2.4%
120000     0.342     0.009    2.6%
140000     0.336     0.005    1.4%
160000     0.334     0.004    1.1%
180000     0.348     0.006    1.7%
200000     0.353     0.005    1.4%
220000     0.351     0.008    2.2%
240000     0.351     0.012    3.4%
260000     0.346     0.006    1.7%
280000     0.348     0.003    0.8%
300000     0.341     0.008    2.3%
320000     0.334     0.005    1.4%
340000     0.341     0.008    2.3%
360000     0.343     0.004    1.1%
380000     0.348     0.003    0.8%
400000      0.32     0.008    2.5%
420000     0.345     0.006    1.7%
440000     0.323     0.006    1.8%
460000     0.328      0.01    3.0%
480000     0.347     0.006    1.7%
500000     0.338     0.006    1.7%
520000      0.34     0.007    2.0%
540000     0.343     0.013    3.7%
560000     0.348     0.011    3.1%
580000     0.348     0.006    1.7%
600000     0.357     0.006    1.6%
620000     0.326      0.01    3.0%
640000     0.346     0.005    1.4%
660000      0.34     0.004    1.1%
680000     0.344     0.003    0.8%
700000     0.336     0.004    1.1%
720000     0.336     0.003    0.8%
740000     0.344     0.009    2.6%
760000     0.349     0.006    1.7%
780000     0.342     0.006    1.7%
800000     0.354     0.004    1.1%
820000     0.332     0.014    4.2%
840000     0.334     0.006    1.7%
860000     0.348     0.009    2.5%
880000     0.353     0.005    1.4%
900000     0.333     0.008    2.4%
920000      0.35     0.006    1.7%
940000     0.342     0.006    1.7%
960000     0.331     0.008    2.4%
980000     0.359     0.008    2.2%
1000000     0.344     0.007    2.0%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.338
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.341
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.338     0.006    1.7%
20000      0.35     0.003    0.8%
40000     0.341     0.005    1.4%
60000     0.349     0.004    1.1%
80000     0.333      0.01    3.0%
100000     0.349     0.008    2.2%
120000     0.355     0.006    1.6%
140000     0.335     0.005    1.4%
160000     0.339     0.005    1.4%
180000     0.326     0.005    1.5%
200000     0.342     0.007    2.0%
220000     0.342     0.005    1.4%
240000      0.34     0.004    1.1%
260000     0.337     0.005    1.4%
280000     0.338     0.006    1.7%
300000     0.338     0.011    3.2%
320000     0.333     0.005    1.5%
340000     0.344     0.004    1.1%
360000     0.341     0.007    2.0%
380000     0.344     0.009    2.6%
400000     0.333     0.004    1.2%
420000      0.34     0.004    1.1%
440000     0.336     0.007    2.0%
460000     0.336     0.007    2.0%
480000     0.345     0.004    1.1%
500000     0.358     0.007    1.9%
520000     0.334     0.004    1.1%
540000     0.338     0.004    1.1%
560000      0.34     0.007    2.0%
580000     0.346     0.006    1.7%
600000      0.33     0.004    1.2%
620000     0.336     0.007    2.0%
640000     0.334     0.009    2.6%
660000     0.337     0.002    0.5%
680000     0.341     0.005    1.4%
700000     0.343     0.006    1.7%
720000     0.325     0.007    2.1%
740000     0.344     0.007    2.0%
760000     0.324     0.008    2.4%
780000     0.355     0.008    2.2%
800000     0.336     0.006    1.7%
820000      0.34     0.006    1.7%
840000     0.331      0.01    3.0%
860000     0.351     0.006    1.7%
880000     0.331     0.007    2.1%
900000     0.356     0.005    1.4%
920000     0.323     0.007    2.1%
940000     0.348     0.005    1.4%
960000     0.352     0.005    1.4%
980000     0.349     0.008    2.2%
1000000     0.345     0.004    1.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.341
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.338
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.339     0.005    1.4%
20000     0.337     0.008    2.3%
40000     0.334     0.007    2.0%
60000     0.338      0.01    2.9%
80000     0.341     0.008    2.3%
100000     0.337     0.004    1.1%
120000     0.317     0.006    1.8%
140000     0.338     0.008    2.3%
160000      0.33     0.005    1.5%
180000     0.336     0.008    2.3%
200000     0.344     0.004    1.1%
220000     0.344     0.007    2.0%
240000     0.329      0.01    3.0%
260000     0.349     0.006    1.7%
280000     0.364     0.006    1.6%
300000     0.343     0.011    3.2%
320000     0.334     0.007    2.0%
340000     0.341     0.004    1.1%
360000     0.328     0.006    1.8%
380000     0.348     0.004    1.1%
400000     0.342     0.008    2.3%
420000     0.347     0.005    1.4%
440000      0.35     0.006    1.7%
460000     0.333     0.009    2.7%
480000     0.352     0.009    2.5%
500000     0.331     0.011    3.3%
520000     0.327     0.007    2.1%
540000     0.332     0.009    2.7%
560000     0.334     0.004    1.1%
580000     0.347     0.005    1.4%
600000     0.337     0.007    2.0%
620000     0.334     0.008    2.3%
640000     0.349     0.004    1.1%
660000     0.332     0.004    1.2%
680000     0.331     0.004    1.2%
700000     0.344     0.006    1.7%
720000     0.346     0.004    1.1%
740000     0.348     0.004    1.1%
760000     0.338     0.005    1.4%
780000     0.345     0.004    1.1%
800000      0.33     0.008    2.4%
820000     0.346     0.004    1.1%
840000     0.336     0.004    1.1%
860000     0.345     0.008    2.3%
880000     0.337     0.004    1.1%
900000      0.34     0.005    1.4%
920000     0.345     0.007    2.0%
940000     0.348     0.006    1.7%
960000     0.336     0.009    2.6%
980000     0.343     0.008    2.3%
1000000     0.334     0.006    1.7%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.338
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.336
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.341     0.006    1.7%
20000     0.333     0.009    2.7%
40000     0.343     0.006    1.7%
60000     0.332     0.008    2.4%
80000     0.332     0.004    1.2%
100000     0.338     0.007    2.0%
120000     0.332     0.008    2.4%
140000     0.328     0.005    1.5%
160000     0.347     0.007    2.0%
180000     0.323     0.007    2.1%
200000     0.332     0.005    1.5%
220000     0.334     0.005    1.4%
240000     0.337     0.009    2.6%
260000     0.331     0.006    1.8%
280000     0.324     0.007    2.1%
300000     0.334     0.003    0.8%
320000     0.314     0.006    1.9%
340000      0.34     0.007    2.0%
360000     0.351     0.005    1.4%
380000      0.34     0.005    1.4%
400000     0.338     0.003    0.8%
420000     0.329     0.007    2.1%
440000     0.339     0.004    1.1%
460000     0.341     0.003    0.8%
480000     0.333     0.003    0.9%
500000     0.339     0.003    0.8%
520000     0.324     0.007    2.1%
540000      0.34     0.008    2.3%
560000     0.331     0.008    2.4%
580000     0.356     0.004    1.1%
600000     0.339     0.005    1.4%
620000     0.347     0.007    2.0%
640000     0.334     0.008    2.3%
660000     0.318     0.004    1.2%
680000     0.352     0.006    1.7%
700000     0.331     0.007    2.1%
720000     0.341     0.003    0.8%
740000     0.352     0.008    2.2%
760000     0.346     0.009    2.6%
780000     0.348     0.002    0.5%
800000     0.337     0.005    1.4%
820000     0.331     0.005    1.5%
840000     0.338     0.005    1.4%
860000     0.321     0.006    1.8%
880000     0.334     0.005    1.4%
900000     0.333     0.007    2.1%
920000     0.317     0.005    1.5%
940000     0.335     0.008    2.3%
960000     0.349     0.007    2.0%
980000     0.329     0.004    1.2%
1000000     0.322     0.006    1.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.336
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    4.352
    + i    0.366
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.962     0.012    1.2%
 2000     729.3     3.914    0.5%
 4000      1480     16.83    1.1%
 6000      2209        13    0.5%
 8000      2943     3.854    0.1%
10000      3676     10.39    0.2%
12000      4397     8.793    0.1%
14000      5146     22.96    0.4%
16000      5871     13.93    0.2%
18000      6601     18.64    0.2%
20000      7347     21.72    0.2%
22000      8065     19.58    0.2%
24000      8786     25.36    0.2%
26000      9531     19.78    0.2%
28000     10260     24.59    0.2%
30000     10980      16.3    0.1%
32000     11720     25.87    0.2%
34000     12450     20.34    0.1%
36000     13210     16.61    0.1%
38000     13920     23.95    0.1%
40000     14650     25.26    0.1%
42000     15390     21.82    0.1%
44000     16120     47.73    0.2%
46000     17100     3.552    0.0%
48000     17590     22.21    0.1%
50000     18320     29.03    0.1%
52000     19080     53.96    0.2%
54000     19770     29.49    0.1%
56000     20510     32.78    0.1%
58000     21220     21.68    0.1%
60000     21970     25.09    0.1%
62000     22720     28.58    0.1%
64000     23450     35.68    0.1%
66000     24310       125    0.5%
68000     24960     41.85    0.1%
70000     25680     33.72    0.1%
72000     26400     38.53    0.1%
74000     27130     48.66    0.1%
76000     28150     170.7    0.6%
78000     28580     26.46    0.0%
80000     29310     32.08    0.1%
82000     30060     41.92    0.1%
84000     30760     33.83    0.1%
86000     31500     20.22    0.0%
88000     32300     21.95    0.0%
90000     33000     65.68    0.1%
92000     33690      36.3    0.1%
94000     34430      49.2    0.1%
96000     35220     33.07    0.0%
98000     35910     23.62    0.0%
100000     36700     47.27    0.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=    4.779
    + i    0.367
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    2.831
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.349     0.006    1.7%
   20     48.46     0.268    0.5%
   40     97.15      0.38    0.3%
   60       146       1.3    0.8%
   80     193.4     0.755    0.3%
  100     240.3     1.077    0.4%
  120     293.4     0.894    0.3%
  140     342.8     1.421    0.4%
  160       395     1.968    0.4%
  180     444.9     1.469    0.3%
  200     497.1     2.458    0.4%
  220     553.7     8.882    1.6%
  240     612.8     9.126    1.4%
  260     665.7     3.703    0.5%
  280       725       6.5    0.8%
  300     775.5      3.54    0.4%
  320     823.6      4.27    0.5%
  340     874.6     2.763    0.3%
  360     941.8      7.89    0.8%
  380     996.5     7.697    0.7%
  400      1055     11.97    1.1%
  420      1117      11.7    1.0%
  440      1179     11.63    0.9%
  460      1227      12.8    1.0%
  480      1298     7.928    0.6%
  500      1342     9.287    0.6%
  520      1406     6.553    0.4%
  540      1476     12.45    0.8%
  560      1503     5.428    0.3%
  580      1557     12.25    0.7%
  600      1627     8.225    0.5%
  620      1691     10.77    0.6%
  640      1723      8.54    0.4%
  660      1782      6.32    0.3%
  680      1872     12.28    0.6%
  700      1939     12.88    0.6%
  720      1974     5.612    0.2%
  740      2035     8.284    0.4%
  760      2092     8.158    0.3%
  780      2174     10.56    0.4%
  800      2199     15.77    0.7%
  820      2251     14.78    0.6%
  840      2340     7.862    0.3%
  860      2382     15.96    0.6%
  880      2471     11.92    0.4%
  900      2516     16.21    0.6%
  920      2580     11.36    0.4%
  940      2653     9.966    0.3%
  960      2728     9.825    0.3%
  980      2770     9.523    0.3%
 1000      2797     10.33    0.3%

Quality and confidence:
param     error
i         0.003

Model:
Time ~=        0
    + i    2.844
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.658
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0      0.33     0.006    1.8%
   20     12.28     0.108    0.8%
   40      25.7     0.231    0.8%
   60     38.53     0.152    0.3%
   80     51.19     0.124    0.2%
  100     63.62     0.605    0.9%
  120     76.16     0.104    0.1%
  140     88.98     0.225    0.2%
  160     101.7     0.199    0.1%
  180     114.8     0.231    0.2%
  200     127.9      0.26    0.2%
  220     140.3     0.334    0.2%
  240     153.8     0.278    0.1%
  260     166.9      0.17    0.1%
  280     179.4     0.178    0.0%
  300     192.2     0.259    0.1%
  320     205.6     0.457    0.2%
  340     217.7     0.252    0.1%
  360     231.9     0.274    0.1%
  380     242.7     0.322    0.1%
  400     257.6     0.416    0.1%
  420     275.6       4.3    1.5%
  440     282.6     0.343    0.1%
  460     296.8      3.27    1.1%
  480     307.6     0.406    0.1%
  500     321.6     0.587    0.1%
  520     338.6     2.673    0.7%
  540     349.8     0.715    0.2%
  560     362.9     0.491    0.1%
  580     375.2     0.801    0.2%
  600     387.7      1.93    0.4%
  620     403.6     0.779    0.1%
  640     417.6     2.288    0.5%
  660     428.6     0.679    0.1%
  680     441.6     0.615    0.1%
  700     455.4     1.772    0.3%
  720     468.3     2.695    0.5%
  740     484.4     4.878    1.0%
  760     496.3     2.919    0.5%
  780     509.7      1.02    0.2%
  800       524     2.946    0.5%
  820       537     0.904    0.1%
  840     555.3     6.257    1.1%
  860     565.1     1.825    0.3%
  880     580.8     3.357    0.5%
  900     591.1     0.371    0.0%
  920     611.4     8.096    1.3%
  940     625.9     9.942    1.5%
  960       632     1.489    0.2%
  980       644     1.475    0.2%
 1000     658.5     1.086    0.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.661
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

…tytech/substrate into shawntabrizi-baseline-bench

shawntabrizi · 2021-10-29T23:48:48Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-10-29T23:48:50Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.335
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.333     0.008    2.4%
20000     0.326     0.004    1.2%
40000     0.331     0.006    1.8%
60000     0.328     0.007    2.1%
80000     0.327     0.005    1.5%
100000     0.342     0.005    1.4%
120000     0.352     0.007    1.9%
140000     0.331     0.006    1.8%
160000     0.345     0.003    0.8%
180000     0.314     0.004    1.2%
200000     0.313     0.005    1.5%
220000     0.327     0.005    1.5%
240000     0.332     0.007    2.1%
260000      0.32     0.007    2.1%
280000     0.335     0.009    2.6%
300000     0.353     0.006    1.6%
320000     0.337     0.011    3.2%
340000     0.349     0.004    1.1%
360000     0.352     0.002    0.5%
380000     0.337     0.004    1.1%
400000     0.339     0.002    0.5%
420000     0.342     0.007    2.0%
440000     0.345     0.004    1.1%
460000     0.354     0.004    1.1%
480000     0.346     0.006    1.7%
500000     0.343     0.004    1.1%
520000     0.344     0.006    1.7%
540000     0.341     0.006    1.7%
560000     0.339     0.009    2.6%
580000     0.329     0.004    1.2%
600000     0.327     0.005    1.5%
620000     0.333     0.005    1.5%
640000     0.342     0.004    1.1%
660000     0.363     0.005    1.3%
680000     0.334     0.004    1.1%
700000     0.341     0.006    1.7%
720000     0.342     0.008    2.3%
740000     0.338     0.006    1.7%
760000     0.321     0.007    2.1%
780000     0.328     0.004    1.2%
800000     0.349     0.005    1.4%
820000     0.333     0.006    1.8%
840000     0.333     0.004    1.2%
860000     0.338     0.004    1.1%
880000     0.338     0.004    1.1%
900000     0.344     0.006    1.7%
920000     0.333     0.005    1.5%
940000      0.34     0.006    1.7%
960000     0.336     0.004    1.1%
980000     0.341     0.005    1.4%
1000000     0.323     0.006    1.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.335
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.324
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0      0.32     0.009    2.8%
20000     0.328     0.008    2.4%
40000      0.31     0.003    0.9%
60000     0.317     0.005    1.5%
80000     0.319     0.005    1.5%
100000      0.32     0.009    2.8%
120000     0.329     0.007    2.1%
140000     0.341     0.006    1.7%
160000      0.32     0.007    2.1%
180000     0.329     0.004    1.2%
200000     0.335     0.003    0.8%
220000     0.333     0.009    2.7%
240000     0.344     0.007    2.0%
260000     0.335     0.004    1.1%
280000     0.343     0.006    1.7%
300000     0.338     0.008    2.3%
320000     0.327     0.003    0.9%
340000     0.334      0.01    2.9%
360000     0.321     0.004    1.2%
380000     0.312     0.005    1.6%
400000     0.322     0.008    2.4%
420000     0.335     0.004    1.1%
440000     0.333     0.005    1.5%
460000     0.339     0.005    1.4%
480000     0.336     0.006    1.7%
500000     0.327      0.01    3.0%
520000     0.331     0.009    2.7%
540000     0.326     0.004    1.2%
560000     0.325     0.007    2.1%
580000     0.331     0.006    1.8%
600000     0.333     0.008    2.4%
620000     0.324     0.009    2.7%
640000     0.313     0.006    1.9%
660000     0.337     0.005    1.4%
680000     0.337     0.007    2.0%
700000     0.334     0.002    0.5%
720000     0.335     0.008    2.3%
740000     0.325     0.005    1.5%
760000     0.339     0.002    0.5%
780000     0.333     0.003    0.9%
800000     0.334     0.004    1.1%
820000     0.332     0.003    0.9%
840000     0.339     0.007    2.0%
860000     0.347     0.004    1.1%
880000     0.337     0.007    2.0%
900000      0.33     0.002    0.6%
920000     0.348     0.008    2.2%
940000     0.324     0.008    2.4%
960000     0.334     0.004    1.1%
980000      0.34     0.007    2.0%
1000000     0.333     0.006    1.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.325
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     0.33
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.334     0.006    1.7%
20000     0.335     0.004    1.1%
40000     0.327     0.004    1.2%
60000     0.341     0.005    1.4%
80000     0.326     0.007    2.1%
100000     0.325     0.007    2.1%
120000     0.331     0.007    2.1%
140000     0.328     0.005    1.5%
160000     0.336     0.006    1.7%
180000     0.315     0.004    1.2%
200000     0.333     0.006    1.8%
220000     0.324     0.003    0.9%
240000     0.323     0.004    1.2%
260000     0.332     0.006    1.8%
280000     0.333     0.006    1.8%
300000     0.339     0.003    0.8%
320000     0.328     0.006    1.8%
340000     0.329     0.009    2.7%
360000     0.312     0.007    2.2%
380000     0.313     0.006    1.9%
400000     0.325     0.007    2.1%
420000     0.328     0.006    1.8%
440000     0.319     0.006    1.8%
460000     0.334     0.005    1.4%
480000      0.33     0.004    1.2%
500000     0.323     0.004    1.2%
520000     0.342     0.005    1.4%
540000     0.327     0.005    1.5%
560000     0.324     0.004    1.2%
580000     0.323     0.004    1.2%
600000     0.327     0.007    2.1%
620000     0.316     0.006    1.8%
640000     0.324     0.002    0.6%
660000     0.331     0.005    1.5%
680000     0.324     0.006    1.8%
700000     0.305     0.007    2.2%
720000     0.327     0.003    0.9%
740000     0.321     0.006    1.8%
760000     0.322     0.009    2.7%
780000     0.339     0.003    0.8%
800000     0.319     0.006    1.8%
820000     0.313     0.004    1.2%
840000     0.334     0.004    1.1%
860000     0.321     0.003    0.9%
880000     0.318     0.003    0.9%
900000     0.329     0.005    1.5%
920000     0.323     0.007    2.1%
940000     0.322     0.005    1.5%
960000     0.318     0.003    0.9%
980000      0.33     0.004    1.2%
1000000     0.322     0.004    1.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.331
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     0.33
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.336     0.009    2.6%
20000     0.326     0.004    1.2%
40000     0.329     0.006    1.8%
60000      0.32     0.003    0.9%
80000     0.329     0.006    1.8%
100000     0.318     0.005    1.5%
120000     0.342     0.007    2.0%
140000     0.341     0.005    1.4%
160000      0.32     0.005    1.5%
180000     0.328     0.007    2.1%
200000     0.325     0.007    2.1%
220000     0.343     0.006    1.7%
240000     0.321     0.006    1.8%
260000     0.321     0.006    1.8%
280000     0.325     0.005    1.5%
300000      0.32     0.008    2.5%
320000     0.333     0.005    1.5%
340000     0.345     0.007    2.0%
360000     0.352     0.008    2.2%
380000     0.333     0.006    1.8%
400000     0.326     0.005    1.5%
420000     0.328     0.006    1.8%
440000     0.332     0.007    2.1%
460000     0.328     0.009    2.7%
480000     0.327     0.009    2.7%
500000     0.345     0.009    2.6%
520000     0.347     0.005    1.4%
540000     0.335     0.008    2.3%
560000     0.331     0.006    1.8%
580000     0.319     0.003    0.9%
600000     0.335     0.007    2.0%
620000     0.329     0.004    1.2%
640000     0.325     0.008    2.4%
660000     0.325     0.003    0.9%
680000     0.315     0.007    2.2%
700000     0.326     0.005    1.5%
720000     0.325     0.004    1.2%
740000     0.316     0.005    1.5%
760000     0.321     0.006    1.8%
780000     0.327     0.005    1.5%
800000     0.315     0.004    1.2%
820000      0.33     0.004    1.2%
840000     0.322     0.003    0.9%
860000      0.32     0.007    2.1%
880000     0.327     0.006    1.8%
900000     0.321     0.003    0.9%
920000      0.34     0.006    1.7%
940000     0.334     0.004    1.1%
960000      0.32     0.008    2.5%
980000     0.329     0.002    0.6%
1000000     0.332     0.006    1.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.332
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    36140
    + i    0.838
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     36200        49    0.1%
    2     35940     306.7    0.8%
    4     35620       524    1.4%
    6     36280      39.8    0.1%
    8     35210     518.6    1.4%
   10     36180     79.57    0.2%
   12     35650       490    1.3%
   14     36110     185.4    0.5%
   16     36010     414.6    1.1%
   18     35670     535.3    1.5%
   20     36000     243.7    0.6%
   22     35910     489.5    1.3%
   24     35770       526    1.4%
   26     35850     472.7    1.3%
   28     36130     143.3    0.3%
   30     36120     186.5    0.5%
   32     36010     269.1    0.7%
   34     36140     94.69    0.2%
   36     35930     381.6    1.0%
   38     36250     115.1    0.3%
   40     36270     55.95    0.1%
   42     36020     233.2    0.6%
   44     36190     318.1    0.8%
   46     36300     41.27    0.1%
   48     36370     325.8    0.8%
   50     36290      51.6    0.1%
   52     35970     430.5    1.1%
   54     36070     426.8    1.1%
   56     35940     522.1    1.4%
   58     36180     269.5    0.7%
   60     36260     89.01    0.2%
   62     35810       555    1.5%
   64     35520     584.3    1.6%
   66     36190     90.09    0.2%
   68     35810     517.5    1.4%
   70     36090     299.3    0.8%
   72     35490     616.8    1.7%
   74     35620     547.6    1.5%
   76     35950     325.1    0.9%
   78     36080     271.3    0.7%
   80     36170     101.4    0.2%
   82     35680     647.2    1.8%
   84     35560     565.9    1.5%
   86     36130     294.1    0.8%
   88     36110     418.1    1.1%
   90     36520     67.41    0.1%
   92     36530     98.61    0.2%
   94     35870     326.5    0.9%
   96     35840     477.1    1.3%
   98     35700     567.7    1.5%
  100     35650     533.3    1.4%

Quality and confidence:
param     error
i         0.703

Model:
Time ~=    35980
    + i    0.072
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    2.794
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.335     0.005    1.4%
   20     47.68     0.336    0.7%
   40     96.58     0.236    0.2%
   60     142.7     1.116    0.7%
   80     190.8      0.85    0.4%
  100       238     0.388    0.1%
  120       289     1.014    0.3%
  140       341     2.327    0.6%
  160     389.7     4.166    1.0%
  180     439.2     1.537    0.3%
  200     496.7     6.966    1.4%
  220     555.1     11.23    2.0%
  240     605.3     2.845    0.4%
  260     660.1     3.198    0.4%
  280     710.4      8.24    1.1%
  300     765.7     8.297    1.0%
  320     826.6     13.66    1.6%
  340     884.4     6.885    0.7%
  360     924.7     5.879    0.6%
  380       985     7.061    0.7%
  400      1029     11.75    1.1%
  420      1105     9.899    0.8%
  440      1136     5.636    0.4%
  460      1218     12.22    1.0%
  480      1280      6.93    0.5%
  500      1337     12.04    0.9%
  520      1366     6.986    0.5%
  540      1420     6.741    0.4%
  560      1488     8.394    0.5%
  580      1552     14.78    0.9%
  600      1600     8.985    0.5%
  620      1659      8.07    0.4%
  640      1743     5.647    0.3%
  660      1800     10.08    0.5%
  680      1845     10.84    0.5%
  700      1895     13.38    0.7%
  720      1949     10.18    0.5%
  740      1991     7.717    0.3%
  760      2052     8.131    0.3%
  780      2130     12.28    0.5%
  800      2192      8.06    0.3%
  820      2214      10.3    0.4%
  840      2298     9.507    0.4%
  860      2363     12.65    0.5%
  880      2419     7.756    0.3%
  900      2493     15.99    0.6%
  920      2559      9.49    0.3%
  940      2614     11.99    0.4%
  960      2667     8.913    0.3%
  980      2751     13.63    0.4%
 1000      2791     7.909    0.2%

Quality and confidence:
param     error
i         0.004

Model:
Time ~=        0
    + i    2.807
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.649
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.341     0.004    1.1%
   20     12.14     0.086    0.7%
   40     25.36     0.105    0.4%
   60     37.78     0.119    0.3%
   80     51.33     0.073    0.1%
  100     62.35     0.124    0.1%
  120     75.77     0.385    0.5%
  140     87.98     0.171    0.1%
  160     101.1     0.252    0.2%
  180     113.7     0.241    0.2%
  200     127.3      0.12    0.0%
  220     140.1     0.184    0.1%
  240     153.3     0.318    0.2%
  260     166.3     0.277    0.1%
  280     178.8     0.418    0.2%
  300     191.9     0.482    0.2%
  320     204.7     0.383    0.1%
  340     218.1     0.176    0.0%
  360       230     0.445    0.1%
  380     241.4     0.334    0.1%
  400     256.1     0.464    0.1%
  420     266.5     0.414    0.1%
  440     280.2     0.528    0.1%
  460     293.4     0.704    0.2%
  480     306.9      0.72    0.2%
  500     322.7      3.71    1.1%
  520     331.6     0.599    0.1%
  540     346.8     2.144    0.6%
  560     360.5     3.508    0.9%
  580     370.5     0.798    0.2%
  600     386.1     1.858    0.4%
  620     400.1     0.816    0.2%
  640     412.3     0.753    0.1%
  660     425.2     0.972    0.2%
  680       437     0.368    0.0%
  700       450     0.577    0.1%
  720       464     3.205    0.6%
  740       475     0.458    0.0%
  760     488.3     1.153    0.2%
  780       502     0.357    0.0%
  800       517     1.329    0.2%
  820     529.6     0.491    0.0%
  840     547.6     6.371    1.1%
  860     557.1     0.461    0.0%
  880     573.9     0.674    0.1%
  900     586.2     0.824    0.1%
  920       603     4.509    0.7%
  940     613.7     1.975    0.3%
  960     629.7     5.987    0.9%
  980     643.4     9.151    1.4%
 1000     652.4     1.405    0.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.653
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-10-29T23:58:25Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-10-29T23:58:27Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.347
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.337     0.005    1.4%
20000     0.351     0.005    1.4%
40000     0.337     0.006    1.7%
60000     0.359     0.006    1.6%
80000     0.349     0.008    2.2%
100000     0.341     0.002    0.5%
120000     0.354     0.006    1.6%
140000     0.338     0.005    1.4%
160000      0.35     0.007    2.0%
180000     0.346     0.004    1.1%
200000     0.353     0.005    1.4%
220000     0.352     0.008    2.2%
240000     0.354     0.008    2.2%
260000     0.345     0.003    0.8%
280000      0.35     0.005    1.4%
300000     0.351     0.004    1.1%
320000     0.351     0.004    1.1%
340000     0.353     0.005    1.4%
360000     0.347     0.003    0.8%
380000      0.34     0.006    1.7%
400000     0.359      0.01    2.7%
420000     0.347     0.005    1.4%
440000     0.339     0.007    2.0%
460000     0.343     0.006    1.7%
480000     0.341     0.006    1.7%
500000     0.342     0.005    1.4%
520000     0.351     0.004    1.1%
540000     0.348     0.003    0.8%
560000     0.344     0.004    1.1%
580000     0.355     0.006    1.6%
600000      0.35     0.005    1.4%
620000     0.352     0.005    1.4%
640000     0.336     0.005    1.4%
660000     0.352     0.004    1.1%
680000     0.353     0.005    1.4%
700000     0.349     0.007    2.0%
720000     0.348     0.009    2.5%
740000     0.345     0.005    1.4%
760000     0.355     0.003    0.8%
780000      0.35     0.006    1.7%
800000     0.363     0.004    1.1%
820000      0.35     0.007    2.0%
840000     0.348     0.007    2.0%
860000     0.355     0.008    2.2%
880000     0.354     0.006    1.6%
900000     0.349     0.005    1.4%
920000     0.347     0.007    2.0%
940000     0.354     0.003    0.8%
960000     0.346     0.006    1.7%
980000     0.348     0.005    1.4%
1000000     0.344     0.005    1.4%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.347
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     0.35
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.337     0.005    1.4%
20000     0.343     0.004    1.1%
40000      0.34     0.004    1.1%
60000      0.35     0.007    2.0%
80000     0.351     0.005    1.4%
100000      0.35     0.004    1.1%
120000     0.346     0.006    1.7%
140000     0.346     0.008    2.3%
160000     0.354     0.005    1.4%
180000     0.352     0.006    1.7%
200000     0.361     0.005    1.3%
220000     0.354     0.009    2.5%
240000     0.356     0.007    1.9%
260000     0.361     0.005    1.3%
280000     0.352      0.01    2.8%
300000     0.349     0.006    1.7%
320000      0.36     0.006    1.6%
340000     0.355     0.003    0.8%
360000     0.357     0.005    1.4%
380000     0.368     0.008    2.1%
400000     0.355     0.003    0.8%
420000     0.343     0.003    0.8%
440000     0.347     0.003    0.8%
460000     0.348     0.005    1.4%
480000     0.341     0.006    1.7%
500000     0.337     0.007    2.0%
520000      0.35     0.004    1.1%
540000     0.353     0.006    1.6%
560000     0.348     0.006    1.7%
580000     0.354     0.006    1.6%
600000     0.347     0.005    1.4%
620000     0.358     0.004    1.1%
640000     0.356     0.004    1.1%
660000     0.344     0.005    1.4%
680000     0.352     0.004    1.1%
700000     0.348     0.006    1.7%
720000     0.351     0.006    1.7%
740000     0.354     0.003    0.8%
760000     0.351     0.006    1.7%
780000     0.354     0.005    1.4%
800000     0.344     0.005    1.4%
820000     0.345     0.005    1.4%
840000     0.358     0.002    0.5%
860000     0.352     0.005    1.4%
880000     0.349     0.003    0.8%
900000     0.365     0.006    1.6%
920000     0.347     0.006    1.7%
940000     0.355     0.007    1.9%
960000     0.361     0.009    2.4%
980000     0.351     0.004    1.1%
1000000     0.334     0.005    1.4%

Quality and confidence:
param     error
i             0

Model:
Time ~=     0.35
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.342
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0      0.34     0.007    2.0%
20000     0.335     0.006    1.7%
40000     0.343     0.011    3.2%
60000     0.333     0.006    1.8%
80000     0.335     0.006    1.7%
100000     0.344     0.003    0.8%
120000     0.343     0.004    1.1%
140000     0.338     0.009    2.6%
160000      0.33     0.003    0.9%
180000     0.343     0.006    1.7%
200000     0.346     0.005    1.4%
220000     0.333     0.004    1.2%
240000      0.34     0.004    1.1%
260000      0.34     0.005    1.4%
280000     0.342     0.006    1.7%
300000     0.345     0.007    2.0%
320000      0.33     0.004    1.2%
340000     0.347     0.003    0.8%
360000     0.351     0.005    1.4%
380000     0.345     0.002    0.5%
400000     0.345     0.007    2.0%
420000     0.343     0.003    0.8%
440000     0.354     0.004    1.1%
460000     0.339     0.006    1.7%
480000     0.337     0.004    1.1%
500000     0.333     0.007    2.1%
520000     0.352     0.008    2.2%
540000     0.348     0.004    1.1%
560000     0.335     0.003    0.8%
580000     0.344     0.003    0.8%
600000     0.343     0.004    1.1%
620000     0.345     0.004    1.1%
640000      0.34     0.002    0.5%
660000     0.346     0.004    1.1%
680000     0.347     0.004    1.1%
700000      0.34     0.008    2.3%
720000     0.332     0.004    1.2%
740000     0.352     0.004    1.1%
760000     0.349     0.006    1.7%
780000     0.335     0.003    0.8%
800000     0.345     0.004    1.1%
820000     0.335     0.008    2.3%
840000     0.336     0.004    1.1%
860000     0.337     0.004    1.1%
880000     0.338     0.004    1.1%
900000     0.345     0.005    1.4%
920000     0.331     0.002    0.6%
940000     0.348     0.008    2.2%
960000     0.333     0.004    1.2%
980000     0.351     0.009    2.5%
1000000     0.341     0.004    1.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.341
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.336
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.334     0.007    2.0%
20000     0.332     0.004    1.2%
40000     0.341     0.004    1.1%
60000     0.328     0.003    0.9%
80000     0.334     0.007    2.0%
100000     0.339     0.002    0.5%
120000     0.333     0.006    1.8%
140000     0.337     0.005    1.4%
160000     0.337     0.004    1.1%
180000      0.34      0.01    2.9%
200000     0.334     0.004    1.1%
220000     0.331     0.008    2.4%
240000     0.339     0.003    0.8%
260000      0.34     0.007    2.0%
280000     0.346     0.003    0.8%
300000     0.339     0.005    1.4%
320000     0.342     0.004    1.1%
340000     0.329     0.006    1.8%
360000     0.335     0.004    1.1%
380000     0.334     0.007    2.0%
400000     0.345     0.007    2.0%
420000     0.338     0.006    1.7%
440000     0.341     0.007    2.0%
460000      0.35     0.004    1.1%
480000     0.337     0.005    1.4%
500000     0.342     0.005    1.4%
520000     0.327     0.006    1.8%
540000     0.332     0.004    1.2%
560000     0.346     0.005    1.4%
580000     0.333     0.005    1.5%
600000     0.336     0.003    0.8%
620000     0.332     0.005    1.5%
640000      0.34     0.006    1.7%
660000     0.353      0.01    2.8%
680000     0.326     0.004    1.2%
700000     0.333     0.004    1.2%
720000     0.328     0.008    2.4%
740000     0.338     0.006    1.7%
760000     0.332     0.005    1.5%
780000     0.346     0.002    0.5%
800000     0.331     0.002    0.6%
820000     0.336     0.004    1.1%
840000      0.33     0.004    1.2%
860000     0.341     0.004    1.1%
880000     0.346     0.004    1.1%
900000     0.353     0.009    2.5%
920000     0.352     0.008    2.2%
940000     0.352     0.005    1.4%
960000     0.331     0.007    2.1%
980000     0.339     0.005    1.4%
1000000     0.335     0.003    0.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.336
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    35620
    + i    0.405
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     36260     64.32    0.1%
    2     36220     38.98    0.1%
    4     35560     52.36    0.1%
    6     35520     43.98    0.1%
    8     35710     107.1    0.2%
   10     35520     63.38    0.1%
   12     35550     66.41    0.1%
   14     35520     35.83    0.1%
   16     36110     368.3    1.0%
   18     35510     60.41    0.1%
   20     35590     67.75    0.1%
   22     35640     47.14    0.1%
   24     35660     167.1    0.4%
   26     36030     363.1    1.0%
   28     35780     73.85    0.2%
   30     35650     73.57    0.2%
   32     35600     67.38    0.1%
   34     35640     51.41    0.1%
   36     35750     70.38    0.1%
   38     35670     20.97    0.0%
   40     35690      27.9    0.0%
   42     35510     46.57    0.1%
   44     35640     71.34    0.2%
   46     35590     26.73    0.0%
   48     35950     468.8    1.3%
   50     35500     26.35    0.0%
   52     35510     48.36    0.1%
   54     35510     49.36    0.1%
   56     35500     41.44    0.1%
   58     35560     32.53    0.0%
   60     35500     42.34    0.1%
   62     35600     54.76    0.1%
   64     35540        46    0.1%
   66     35490     46.58    0.1%
   68     35510     51.47    0.1%
   70     35540     40.21    0.1%
   72     36200     24.82    0.0%
   74     36160     33.38    0.0%
   76     36210     59.23    0.1%
   78     35550      46.8    0.1%
   80     35600     49.01    0.1%
   82     35910     292.5    0.8%
   84     36160     128.2    0.3%
   86     36060     61.25    0.1%
   88     36090     52.64    0.1%
   90     35710     52.37    0.1%
   92     35630     56.21    0.1%
   94     35580      68.5    0.1%
   96     36000      45.7    0.1%
   98     35520     32.48    0.0%
  100     35640     93.69    0.2%

Quality and confidence:
param     error
i         0.405

Model:
Time ~=    35690
    + i    0.634
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    2.805
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.336     0.003    0.8%
   20     48.74     0.168    0.3%
   40     96.37     0.337    0.3%
   60     141.6     1.228    0.8%
   80     190.4     0.783    0.4%
  100       237     0.613    0.2%
  120     291.5     0.272    0.0%
  140       340     0.842    0.2%
  160     390.6     0.828    0.2%
  180     441.4     1.607    0.3%
  200     491.9     1.746    0.3%
  220     548.5     1.697    0.3%
  240     608.6     2.794    0.4%
  260     659.1     7.448    1.1%
  280     713.8     6.898    0.9%
  300     766.1     4.186    0.5%
  320     837.1     11.67    1.3%
  340     875.9      2.83    0.3%
  360       934     11.89    1.2%
  380     990.4     7.267    0.7%
  400      1032     8.592    0.8%
  420      1098     12.26    1.1%
  440      1152      11.4    0.9%
  460      1217     8.983    0.7%
  480      1284     10.79    0.8%
  500      1335     11.26    0.8%
  520      1365     7.486    0.5%
  540      1431     11.18    0.7%
  560      1479     5.428    0.3%
  580      1555     9.019    0.5%
  600      1617     9.087    0.5%
  620      1670     8.009    0.4%
  640      1726      8.16    0.4%
  660      1786     9.521    0.5%
  680      1836     5.606    0.3%
  700      1897     9.587    0.5%
  720      1955     11.18    0.5%
  740      1994     20.59    1.0%
  760      2071     18.27    0.8%
  780      2145      8.16    0.3%
  800      2199     6.928    0.3%
  820      2238      7.91    0.3%
  840      2308     13.32    0.5%
  860      2375     16.72    0.7%
  880      2436     16.53    0.6%
  900      2492      7.53    0.3%
  920      2572     15.73    0.6%
  940      2622     22.05    0.8%
  960      2686     7.832    0.2%
  980      2782     18.97    0.6%
 1000      2807     6.397    0.2%

Quality and confidence:
param     error
i         0.004

Model:
Time ~=        0
    + i    2.823
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.689
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.336     0.005    1.4%
   20     12.83     0.082    0.6%
   40     26.62     0.175    0.6%
   60     38.77      0.24    0.6%
   80     51.79     0.092    0.1%
  100      64.7     0.323    0.4%
  120     78.75     0.602    0.7%
  140     91.71     0.368    0.4%
  160     104.7     0.379    0.3%
  180     117.8     0.522    0.4%
  200     132.3     0.597    0.4%
  220     147.5      0.94    0.6%
  240     158.8     0.616    0.3%
  260     175.3       2.6    1.4%
  280     187.5     0.578    0.3%
  300     198.8     0.728    0.3%
  320     214.7     1.793    0.8%
  340     225.8     1.028    0.4%
  360       239     0.995    0.4%
  380     250.4     0.374    0.1%
  400     265.8     0.766    0.2%
  420     280.4     1.492    0.5%
  440       295     3.075    1.0%
  460     307.9     2.094    0.6%
  480       321     1.091    0.3%
  500     334.3     0.967    0.2%
  520     347.1     1.954    0.5%
  540     360.9     1.422    0.3%
  560     375.1     1.282    0.3%
  580       392     2.391    0.6%
  600     406.6     2.433    0.5%
  620     418.6     2.211    0.5%
  640     433.6     2.693    0.6%
  660     450.5     3.886    0.8%
  680     460.9     2.262    0.4%
  700     474.3     2.824    0.5%
  720     489.5     2.042    0.4%
  740     504.3     4.108    0.8%
  760     516.3     2.842    0.5%
  780       536     9.176    1.7%
  800       550     5.734    1.0%
  820     568.6     9.932    1.7%
  840     575.9     2.249    0.3%
  860     589.5     3.557    0.6%
  880     606.3     3.052    0.5%
  900     618.7     2.133    0.3%
  920     640.6     7.187    1.1%
  940     648.1     3.248    0.5%
  960     664.5     2.584    0.3%
  980     677.9     7.578    1.1%
 1000       695     2.241    0.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.694
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-10-30T00:13:48Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-10-30T00:13:50Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.342
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0      0.32     0.005    1.5%
20000     0.354     0.008    2.2%
40000     0.342     0.004    1.1%
60000     0.335     0.003    0.8%
80000     0.341     0.006    1.7%
100000     0.347     0.008    2.3%
120000     0.341     0.006    1.7%
140000     0.338     0.005    1.4%
160000     0.343     0.004    1.1%
180000     0.343     0.004    1.1%
200000     0.346     0.005    1.4%
220000     0.338     0.004    1.1%
240000     0.338     0.005    1.4%
260000     0.325     0.008    2.4%
280000     0.342     0.004    1.1%
300000     0.337     0.003    0.8%
320000     0.349     0.004    1.1%
340000     0.344     0.004    1.1%
360000     0.348     0.008    2.2%
380000     0.332     0.004    1.2%
400000     0.342     0.006    1.7%
420000     0.341     0.005    1.4%
440000     0.345     0.005    1.4%
460000     0.344     0.004    1.1%
480000     0.339     0.006    1.7%
500000     0.344     0.007    2.0%
520000     0.338     0.007    2.0%
540000     0.357     0.005    1.4%
560000     0.348     0.004    1.1%
580000     0.351     0.003    0.8%
600000      0.33     0.005    1.5%
620000     0.341     0.004    1.1%
640000      0.35     0.004    1.1%
660000     0.343     0.004    1.1%
680000     0.336     0.006    1.7%
700000     0.346     0.008    2.3%
720000     0.348     0.005    1.4%
740000     0.356     0.007    1.9%
760000     0.335     0.007    2.0%
780000     0.345     0.005    1.4%
800000     0.328     0.008    2.4%
820000     0.333     0.003    0.9%
840000     0.339     0.004    1.1%
860000     0.336     0.008    2.3%
880000     0.335     0.008    2.3%
900000     0.326     0.002    0.6%
920000     0.337     0.006    1.7%
940000      0.33     0.006    1.8%
960000     0.339     0.002    0.5%
980000      0.34     0.004    1.1%
1000000     0.341     0.008    2.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.342
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.333
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.333     0.005    1.5%
20000     0.345     0.004    1.1%
40000     0.324     0.005    1.5%
60000     0.327     0.007    2.1%
80000     0.318     0.005    1.5%
100000     0.332     0.008    2.4%
120000     0.329     0.009    2.7%
140000     0.336     0.008    2.3%
160000     0.327     0.005    1.5%
180000     0.337     0.011    3.2%
200000     0.334     0.007    2.0%
220000      0.34     0.006    1.7%
240000     0.347     0.006    1.7%
260000     0.329     0.004    1.2%
280000      0.35     0.005    1.4%
300000     0.324     0.006    1.8%
320000     0.332     0.003    0.9%
340000     0.348     0.007    2.0%
360000     0.332     0.006    1.8%
380000     0.336     0.008    2.3%
400000      0.34     0.007    2.0%
420000     0.337     0.007    2.0%
440000     0.336     0.008    2.3%
460000     0.336     0.005    1.4%
480000     0.326     0.005    1.5%
500000     0.346     0.005    1.4%
520000     0.339     0.005    1.4%
540000     0.331     0.006    1.8%
560000     0.335     0.007    2.0%
580000     0.331     0.006    1.8%
600000     0.345     0.003    0.8%
620000     0.334     0.005    1.4%
640000     0.333     0.004    1.2%
660000     0.331     0.005    1.5%
680000     0.333     0.004    1.2%
700000     0.323     0.004    1.2%
720000     0.327     0.005    1.5%
740000      0.33     0.005    1.5%
760000     0.331     0.006    1.8%
780000      0.33     0.006    1.8%
800000     0.331     0.004    1.2%
820000     0.325     0.007    2.1%
840000     0.338     0.004    1.1%
860000     0.338     0.004    1.1%
880000     0.331     0.004    1.2%
900000     0.346     0.004    1.1%
920000     0.337     0.009    2.6%
940000     0.353     0.004    1.1%
960000     0.342     0.008    2.3%
980000     0.331     0.003    0.9%
1000000     0.332     0.005    1.5%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.333
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.324
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.335     0.006    1.7%
20000      0.32     0.003    0.9%
40000     0.323     0.007    2.1%
60000     0.317     0.003    0.9%
80000     0.336     0.005    1.4%
100000     0.331     0.005    1.5%
120000     0.322     0.005    1.5%
140000     0.328     0.006    1.8%
160000     0.325     0.005    1.5%
180000     0.322     0.006    1.8%
200000     0.327     0.003    0.9%
220000     0.324     0.006    1.8%
240000      0.32     0.003    0.9%
260000     0.322     0.003    0.9%
280000     0.322     0.008    2.4%
300000     0.325     0.005    1.5%
320000     0.322     0.008    2.4%
340000     0.311     0.006    1.9%
360000     0.317     0.004    1.2%
380000     0.325     0.005    1.5%
400000      0.32     0.005    1.5%
420000     0.324     0.003    0.9%
440000     0.315     0.005    1.5%
460000     0.321     0.005    1.5%
480000     0.325     0.005    1.5%
500000     0.319     0.005    1.5%
520000     0.321     0.003    0.9%
540000     0.352     0.007    1.9%
560000     0.312     0.008    2.5%
580000     0.329     0.007    2.1%
600000     0.328     0.009    2.7%
620000     0.334     0.004    1.1%
640000     0.328     0.004    1.2%
660000     0.318     0.003    0.9%
680000     0.326     0.007    2.1%
700000     0.336     0.006    1.7%
720000     0.318     0.006    1.8%
740000     0.322     0.005    1.5%
760000     0.333     0.003    0.9%
780000     0.319     0.006    1.8%
800000     0.332     0.007    2.1%
820000     0.331     0.004    1.2%
840000     0.335     0.006    1.7%
860000     0.309     0.005    1.6%
880000     0.324     0.006    1.8%
900000     0.323     0.004    1.2%
920000     0.318     0.002    0.6%
940000     0.328     0.005    1.5%
960000     0.325     0.005    1.5%
980000     0.333     0.003    0.9%
1000000     0.327     0.006    1.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.324
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.325
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.335     0.006    1.7%
20000      0.33     0.005    1.5%
40000     0.321     0.004    1.2%
60000      0.33     0.006    1.8%
80000     0.321     0.007    2.1%
100000     0.324     0.009    2.7%
120000     0.324     0.003    0.9%
140000     0.318     0.007    2.2%
160000     0.329     0.002    0.6%
180000      0.33     0.007    2.1%
200000     0.332     0.004    1.2%
220000      0.32     0.005    1.5%
240000     0.324     0.004    1.2%
260000     0.327     0.005    1.5%
280000     0.335     0.007    2.0%
300000     0.324     0.008    2.4%
320000     0.319     0.006    1.8%
340000     0.327     0.007    2.1%
360000     0.325     0.005    1.5%
380000     0.327     0.005    1.5%
400000     0.326     0.006    1.8%
420000     0.327     0.005    1.5%
440000     0.334     0.007    2.0%
460000     0.338     0.006    1.7%
480000     0.319     0.006    1.8%
500000     0.328     0.007    2.1%
520000     0.329     0.005    1.5%
540000     0.324     0.003    0.9%
560000     0.324     0.006    1.8%
580000     0.331     0.005    1.5%
600000     0.331     0.005    1.5%
620000     0.333     0.007    2.1%
640000     0.331     0.003    0.9%
660000     0.351     0.005    1.4%
680000     0.331     0.004    1.2%
700000     0.336     0.005    1.4%
720000     0.329     0.005    1.5%
740000     0.342     0.007    2.0%
760000     0.327     0.004    1.2%
780000     0.339     0.007    2.0%
800000     0.345     0.006    1.7%
820000     0.344     0.006    1.7%
840000     0.334     0.007    2.0%
860000      0.33     0.007    2.1%
880000     0.336     0.003    0.8%
900000     0.324     0.006    1.8%
920000     0.326     0.006    1.8%
940000     0.332     0.005    1.5%
960000     0.336     0.005    1.4%
980000     0.328     0.003    0.9%
1000000     0.325     0.004    1.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.325
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    35100
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     35230     50.09    0.1%
    2     35170     31.47    0.0%
    4     35070      44.5    0.1%
    6     35020      46.9    0.1%
    8     35060     59.39    0.1%
   10     34980     31.95    0.0%
   12     35030     45.34    0.1%
   14     34990     46.63    0.1%
   16     35030      44.7    0.1%
   18     35200     34.64    0.0%
   20     35200     50.76    0.1%
   22     35440     201.4    0.5%
   24     35180     35.29    0.1%
   26     35190     31.39    0.0%
   28     35180     62.46    0.1%
   30     35020     34.07    0.0%
   32     34990     51.32    0.1%
   34     35060     50.12    0.1%
   36     35100     30.29    0.0%
   38     35080      76.9    0.2%
   40     35000     36.79    0.1%
   42     35040     45.04    0.1%
   44     35100     58.61    0.1%
   46     35030     29.65    0.0%
   48     35020      50.2    0.1%
   50     35020     26.17    0.0%
   52     35020     38.37    0.1%
   54     35040     48.03    0.1%
   56     35070     52.41    0.1%
   58     35120      51.2    0.1%
   60     35070     49.92    0.1%
   62     35040     45.17    0.1%
   64     35080     54.16    0.1%
   66     35010     44.52    0.1%
   68     35070     64.47    0.1%
   70     35020     50.35    0.1%
   72     35060     39.37    0.1%
   74     35030     28.36    0.0%
   76     35050     45.32    0.1%
   78     35020     49.24    0.1%
   80     35020     26.31    0.0%
   82     35040        74    0.2%
   84     35050     47.05    0.1%
   86     35010     48.65    0.1%
   88     35010     47.19    0.1%
   90     35050     40.95    0.1%
   92     35070     67.83    0.1%
   94     35790     32.87    0.0%
   96     35020     57.15    0.1%
   98     35050      33.2    0.0%
  100     35020     73.84    0.2%

Quality and confidence:
param     error
i          0.21

Model:
Time ~=    35100
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    2.783
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.331     0.007    2.1%
   20     47.99     0.218    0.4%
   40     94.42     0.558    0.5%
   60     140.6     0.271    0.1%
   80       189     0.738    0.3%
  100     237.9     0.715    0.3%
  120       289     1.173    0.4%
  140     337.6     1.269    0.3%
  160     386.9     0.667    0.1%
  180     435.2     2.662    0.6%
  200     489.3     1.401    0.2%
  220     546.5      1.45    0.2%
  240     608.8     7.059    1.1%
  260     657.9     2.718    0.4%
  280     709.5     3.889    0.5%
  300     754.7     3.371    0.4%
  320     814.1     10.49    1.2%
  340     877.9     8.142    0.9%
  360     923.9     9.218    0.9%
  380     987.4     8.772    0.8%
  400      1032     10.95    1.0%
  420      1093     9.475    0.8%
  440      1151     6.863    0.5%
  460      1213      12.5    1.0%
  480      1265     7.496    0.5%
  500      1329     10.61    0.7%
  520      1353     5.562    0.4%
  540      1415       6.8    0.4%
  560      1474     8.394    0.5%
  580      1536     7.682    0.5%
  600      1603     10.67    0.6%
  620      1657     7.295    0.4%
  640      1706     6.101    0.3%
  660      1753     6.243    0.3%
  680      1876     11.69    0.6%
  700      1929     7.815    0.4%
  720      1945     7.481    0.3%
  740      1994     7.838    0.3%
  760      2065     14.32    0.6%
  780      2122     10.87    0.5%
  800      2185     14.35    0.6%
  820      2209     14.14    0.6%
  840      2285     8.752    0.3%
  860      2359     15.65    0.6%
  880      2395     10.34    0.4%
  900      2471     10.38    0.4%
  920      2531     7.779    0.3%
  940      2594     15.17    0.5%
  960      2665     15.57    0.5%
  980      2761     14.02    0.5%
 1000      2787     12.99    0.4%

Quality and confidence:
param     error
i         0.004

Model:
Time ~=        0
    + i      2.8
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.653
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.328     0.005    1.5%
   20     12.31     0.047    0.3%
   40     25.37      0.16    0.6%
   60     37.91     0.135    0.3%
   80     49.81     0.113    0.2%
  100     62.65     0.566    0.9%
  120     75.77     0.155    0.2%
  140     88.12     0.191    0.2%
  160     100.9     0.176    0.1%
  180     113.2     0.116    0.1%
  200     126.7     0.145    0.1%
  220     139.9     0.201    0.1%
  240     152.8     0.213    0.1%
  260     166.5       0.2    0.1%
  280     178.3     0.365    0.2%
  300     190.5     0.223    0.1%
  320       204     0.214    0.1%
  340       216     0.398    0.1%
  360     229.9     0.342    0.1%
  380     241.3     0.303    0.1%
  400     254.3     0.406    0.1%
  420     266.5     0.378    0.1%
  440     280.8     0.853    0.3%
  460     291.7     0.315    0.1%
  480     306.2     0.331    0.1%
  500     321.5     6.049    1.8%
  520     331.8     1.171    0.3%
  540     347.5     1.116    0.3%
  560     358.9     0.526    0.1%
  580       371     0.786    0.2%
  600     387.3     5.078    1.3%
  620     400.3      0.54    0.1%
  640     413.2     0.503    0.1%
  660       426     0.689    0.1%
  680     444.6     9.161    2.0%
  700     450.1     0.654    0.1%
  720     464.3       0.8    0.1%
  740     476.5       0.6    0.1%
  760     493.1     0.642    0.1%
  780     511.5     9.702    1.8%
  800     523.6     7.967    1.5%
  820     534.7     4.728    0.8%
  840       549     5.278    0.9%
  860     560.8     4.703    0.8%
  880     580.4     10.63    1.8%
  900     588.5     4.055    0.6%
  920     611.7     13.95    2.2%
  940       617     4.063    0.6%
  960     627.2     0.946    0.1%
  980     642.8     10.05    1.5%
 1000       653     1.827    0.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.658
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-10-30T11:54:55Z

/benchmark runtime pallet frame_benchmarking

parity-benchapp · 2021-10-30T11:54:57Z

Benchmark Runtime Pallet for branch "shawntabrizi-baseline-bench" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_benchmarking", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.337
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.336     0.004    1.1%
20000     0.345     0.007    2.0%
40000     0.333     0.007    2.1%
60000     0.348     0.004    1.1%
80000     0.332     0.005    1.5%
100000     0.344     0.004    1.1%
120000     0.345     0.008    2.3%
140000     0.341     0.006    1.7%
160000     0.341     0.003    0.8%
180000      0.34     0.005    1.4%
200000     0.345     0.006    1.7%
220000     0.335     0.004    1.1%
240000     0.321     0.008    2.4%
260000     0.334     0.006    1.7%
280000     0.351     0.003    0.8%
300000     0.346     0.003    0.8%
320000     0.336      0.01    2.9%
340000     0.344     0.009    2.6%
360000     0.334     0.005    1.4%
380000     0.343     0.008    2.3%
400000     0.321     0.011    3.4%
420000     0.337     0.005    1.4%
440000     0.347     0.005    1.4%
460000     0.336     0.004    1.1%
480000     0.334     0.006    1.7%
500000     0.347     0.003    0.8%
520000     0.355     0.006    1.6%
540000     0.345     0.007    2.0%
560000      0.35      0.01    2.8%
580000     0.343     0.007    2.0%
600000     0.334     0.007    2.0%
620000     0.353     0.008    2.2%
640000     0.352     0.006    1.7%
660000     0.339     0.005    1.4%
680000     0.341     0.004    1.1%
700000      0.35     0.004    1.1%
720000     0.361     0.004    1.1%
740000     0.344     0.004    1.1%
760000     0.348     0.005    1.4%
780000     0.357     0.005    1.4%
800000     0.335     0.009    2.6%
820000     0.341     0.003    0.8%
840000     0.333     0.003    0.9%
860000     0.353     0.008    2.2%
880000     0.353     0.007    1.9%
900000     0.356     0.006    1.6%
920000     0.337     0.005    1.4%
940000     0.354     0.009    2.5%
960000     0.357     0.009    2.5%
980000     0.348     0.011    3.1%
1000000     0.346     0.008    2.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.337
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.341
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.354      0.01    2.8%
20000     0.355     0.014    3.9%
40000     0.339     0.007    2.0%
60000     0.342     0.008    2.3%
80000     0.329     0.005    1.5%
100000      0.34     0.004    1.1%
120000      0.35     0.017    4.8%
140000     0.342      0.01    2.9%
160000     0.341     0.009    2.6%
180000      0.35     0.005    1.4%
200000     0.337     0.007    2.0%
220000     0.344     0.003    0.8%
240000      0.34     0.006    1.7%
260000      0.34     0.007    2.0%
280000     0.328     0.005    1.5%
300000      0.33     0.008    2.4%
320000      0.35     0.007    2.0%
340000     0.332     0.008    2.4%
360000     0.326     0.004    1.2%
380000     0.329     0.003    0.9%
400000     0.329     0.003    0.9%
420000     0.339     0.006    1.7%
440000     0.342     0.005    1.4%
460000     0.348     0.008    2.2%
480000     0.333     0.007    2.1%
500000     0.337     0.003    0.8%
520000     0.364     0.011    3.0%
540000     0.345      0.01    2.8%
560000     0.336     0.003    0.8%
580000     0.358     0.007    1.9%
600000      0.34     0.004    1.1%
620000     0.335     0.005    1.4%
640000     0.347     0.011    3.1%
660000      0.33     0.006    1.8%
680000     0.338     0.007    2.0%
700000     0.335     0.005    1.4%
720000     0.333     0.004    1.2%
740000     0.329     0.005    1.5%
760000     0.346     0.009    2.6%
780000     0.349     0.008    2.2%
800000     0.348     0.005    1.4%
820000     0.346     0.007    2.0%
840000     0.331     0.003    0.9%
860000     0.337     0.008    2.3%
880000     0.341     0.009    2.6%
900000     0.316     0.005    1.5%
920000     0.338     0.007    2.0%
940000      0.33     0.009    2.7%
960000      0.36     0.015    4.1%
980000     0.342      0.01    2.9%
1000000     0.323     0.008    2.4%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.343
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.338
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.352     0.012    3.4%
20000     0.332     0.005    1.5%
40000     0.335     0.006    1.7%
60000     0.343     0.011    3.2%
80000     0.338     0.004    1.1%
100000     0.337     0.005    1.4%
120000      0.35     0.009    2.5%
140000      0.34     0.003    0.8%
160000     0.339     0.004    1.1%
180000     0.336     0.004    1.1%
200000     0.341     0.004    1.1%
220000     0.333     0.007    2.1%
240000      0.33     0.004    1.2%
260000     0.333     0.003    0.9%
280000     0.341     0.009    2.6%
300000     0.334     0.007    2.0%
320000     0.354     0.007    1.9%
340000     0.341     0.005    1.4%
360000      0.33     0.003    0.9%
380000     0.337     0.003    0.8%
400000     0.345     0.009    2.6%
420000     0.337      0.01    2.9%
440000     0.343     0.009    2.6%
460000     0.338     0.005    1.4%
480000     0.349      0.01    2.8%
500000     0.358     0.011    3.0%
520000     0.342     0.007    2.0%
540000     0.342     0.006    1.7%
560000     0.329     0.005    1.5%
580000     0.331      0.01    3.0%
600000     0.337     0.006    1.7%
620000     0.337     0.004    1.1%
640000     0.335     0.005    1.4%
660000     0.355      0.01    2.8%
680000     0.329     0.003    0.9%
700000     0.338     0.009    2.6%
720000     0.328     0.008    2.4%
740000     0.336     0.005    1.4%
760000      0.35      0.01    2.8%
780000     0.344     0.009    2.6%
800000     0.332     0.007    2.1%
820000     0.338     0.006    1.7%
840000     0.346     0.008    2.3%
860000     0.332     0.006    1.8%
880000     0.329      0.01    3.0%
900000     0.349     0.007    2.0%
920000     0.346     0.006    1.7%
940000     0.352     0.012    3.4%
960000     0.343     0.006    1.7%
980000     0.347     0.009    2.5%
1000000     0.326     0.005    1.5%

Quality and confidence:
param     error
i             0

Model:
Time ~=     0.34
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.346
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.348     0.007    2.0%
20000     0.351     0.008    2.2%
40000     0.338     0.003    0.8%
60000     0.338     0.007    2.0%
80000      0.35     0.003    0.8%
100000     0.331     0.003    0.9%
120000     0.349     0.005    1.4%
140000     0.365     0.006    1.6%
160000     0.345     0.005    1.4%
180000     0.346     0.011    3.1%
200000      0.34     0.002    0.5%
220000     0.344     0.007    2.0%
240000     0.339     0.008    2.3%
260000     0.364     0.005    1.3%
280000     0.356     0.006    1.6%
300000     0.343     0.008    2.3%
320000     0.349     0.004    1.1%
340000     0.329     0.008    2.4%
360000     0.344     0.005    1.4%
380000     0.352     0.006    1.7%
400000      0.34     0.007    2.0%
420000     0.347     0.003    0.8%
440000     0.345     0.005    1.4%
460000     0.332     0.004    1.2%
480000     0.347     0.006    1.7%
500000     0.342     0.003    0.8%
520000     0.349     0.006    1.7%
540000     0.335     0.007    2.0%
560000     0.359     0.004    1.1%
580000     0.342     0.005    1.4%
600000     0.349     0.005    1.4%
620000     0.344     0.007    2.0%
640000     0.342     0.005    1.4%
660000     0.336     0.005    1.4%
680000     0.342     0.006    1.7%
700000     0.344     0.005    1.4%
720000     0.336     0.004    1.1%
740000     0.366     0.005    1.3%
760000     0.332     0.005    1.5%
780000     0.348     0.008    2.2%
800000     0.344     0.004    1.1%
820000     0.329     0.004    1.2%
840000     0.352     0.005    1.4%
860000     0.338     0.004    1.1%
880000     0.343     0.007    2.0%
900000     0.354     0.004    1.1%
920000     0.342     0.002    0.5%
940000     0.338     0.005    1.4%
960000     0.351     0.005    1.4%
980000      0.34     0.002    0.5%
1000000     0.346     0.005    1.4%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.346
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    35450
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     35470     41.65    0.1%
    2     35490     39.29    0.1%
    4     35490     49.72    0.1%
    6     35470     42.59    0.1%
    8     35450     17.49    0.0%
   10     35460     49.37    0.1%
   12     35370     65.42    0.1%
   14     35370     63.09    0.1%
   16     35370     42.95    0.1%
   18     35370     78.45    0.2%
   20     35460     63.17    0.1%
   22     35350     34.09    0.0%
   24     35350     47.09    0.1%
   26     35360     48.89    0.1%
   28     35470     62.31    0.1%
   30     35400     46.91    0.1%
   32     35390     35.26    0.0%
   34     35460     45.72    0.1%
   36     35580     43.27    0.1%
   38     35520        35    0.0%
   40     35560     121.2    0.3%
   42     35440     44.85    0.1%
   44     35400     50.05    0.1%
   46     35450     42.19    0.1%
   48     35370     57.08    0.1%
   50     35440     50.61    0.1%
   52     35380      38.6    0.1%
   54     35360     28.78    0.0%
   56     35440     53.51    0.1%
   58     35460     60.26    0.1%
   60     35450     51.81    0.1%
   62     35430     60.46    0.1%
   64     35420     36.06    0.1%
   66     35530     39.49    0.1%
   68     35420     56.21    0.1%
   70     35440     56.19    0.1%
   72     35400     35.57    0.1%
   74     35360     53.67    0.1%
   76     35420     39.94    0.1%
   78     35400     81.32    0.2%
   80     35410     40.92    0.1%
   82     35450     37.39    0.1%
   84     35370     47.94    0.1%
   86     35420     33.28    0.0%
   88     35420     45.95    0.1%
   90     35430     55.45    0.1%
   92     35330      28.2    0.0%
   94     35420     48.22    0.1%
   96     35390     48.22    0.1%
   98     35420     58.45    0.1%
  100     35380     71.05    0.2%

Quality and confidence:
param     error
i         0.111

Model:
Time ~=    35440
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    2.836
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.332     0.004    1.2%
   20     49.29     0.198    0.4%
   40     95.63     0.657    0.6%
   60     145.2     0.512    0.3%
   80     193.2     0.519    0.2%
  100     245.5      0.59    0.2%
  120     293.8     1.157    0.3%
  140     348.1     2.074    0.5%
  160     398.6      3.55    0.8%
  180     459.2     0.884    0.1%
  200     505.1     3.692    0.7%
  220     560.1     8.481    1.5%
  240     619.2     3.584    0.5%
  260     681.5     9.053    1.3%
  280     729.2      8.17    1.1%
  300     768.6     3.921    0.5%
  320     828.5     2.822    0.3%
  340     893.2     3.303    0.3%
  360     943.2     10.69    1.1%
  380     998.4     6.569    0.6%
  400      1036      5.68    0.5%
  420      1116     14.46    1.2%
  440      1180     12.42    1.0%
  460      1253     8.452    0.6%
  480      1283      8.47    0.6%
  500      1352     16.05    1.1%
  520      1403     6.242    0.4%
  540      1457     16.16    1.1%
  560      1532     8.055    0.5%
  580      1575     6.513    0.4%
  600      1637     11.16    0.6%
  620      1692     9.694    0.5%
  640      1775     19.91    1.1%
  660      1818     11.81    0.6%
  680      1873     9.723    0.5%
  700      1923     12.16    0.6%
  720      1984     8.062    0.4%
  740      2021     9.371    0.4%
  760      2102      12.6    0.5%
  780      2157        12    0.5%
  800      2244     8.822    0.3%
  820      2266     13.71    0.6%
  840      2328     15.62    0.6%
  860      2403     12.21    0.5%
  880      2450     17.68    0.7%
  900      2528     11.21    0.4%
  920      2610      12.3    0.4%
  940      2655     13.45    0.5%
  960      2720     15.34    0.5%
  980      2762      8.91    0.3%
 1000      2836     17.66    0.6%

Quality and confidence:
param     error
i         0.003

Model:
Time ~=        0
    + i    2.851
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.658
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.326     0.004    1.2%
   20     12.33     0.077    0.6%
   40     25.51     0.258    1.0%
   60     37.29     0.096    0.2%
   80     49.93     0.141    0.2%
  100     62.74     0.268    0.4%
  120     75.95     0.098    0.1%
  140     88.68     0.212    0.2%
  160     101.1     0.219    0.2%
  180     113.7     0.247    0.2%
  200     126.8     0.364    0.2%
  220     142.4     0.768    0.5%
  240     156.9     1.526    0.9%
  260     167.5     0.235    0.1%
  280     179.4     0.223    0.1%
  300     191.8     0.279    0.1%
  320     204.9     0.348    0.1%
  340     218.4      0.41    0.1%
  360     230.6      0.81    0.3%
  380       244      3.56    1.4%
  400     256.8     0.273    0.1%
  420     268.3     0.332    0.1%
  440     282.9      3.71    1.3%
  460     296.9     3.804    1.2%
  480     307.4     0.455    0.1%
  500     320.7     0.419    0.1%
  520     334.8     1.106    0.3%
  540     348.7     0.516    0.1%
  560     361.8     0.592    0.1%
  580     375.2     0.669    0.1%
  600     390.5     5.247    1.3%
  620     402.5     0.856    0.2%
  640     420.4      8.85    2.1%
  660     430.2         1    0.2%
  680     444.4     6.757    1.5%
  700     453.2      0.73    0.1%
  720     470.8     5.038    1.0%
  740     479.3     1.009    0.2%
  760       498     7.105    1.4%
  780     512.2     5.485    1.0%
  800     525.3     3.195    0.6%
  820     536.4     0.895    0.1%
  840     548.4     0.754    0.1%
  860       566     6.349    1.1%
  880     582.1      9.12    1.5%
  900     593.2     1.245    0.2%
  920     606.9     4.878    0.8%
  940     617.8     0.599    0.0%
  960     636.7        11    1.7%
  980     647.5     4.504    0.6%
 1000     661.4     7.988    1.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.662
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

… shawntabrizi-baseline-bench

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

shawntabrizi · 2021-10-30T12:06:03Z

bot merge

paritytech-processbot · 2021-10-30T12:06:12Z

Waiting for commit status.

* create and add baseline * fix import * try a different name * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * increase repeats * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * Update baseline.rs * Update baseline.rs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * improve hash benchmark * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs * cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_benchmarking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/benchmarking/src/weights.rs --template=./.maintain/frame-weight-template.hbs Co-authored-by: Parity Bot <admin@parity.io>

create and add baseline

84f49e4

shawntabrizi added 2 commits September 4, 2021 14:54

fix import

8af0c26

Merge branch 'master' into shawntabrizi-baseline-bench

6874052

try a different name

10497ec

shawntabrizi added B7-runtimenoteworthy C1-low PR touches the given topic and has a low impact on builders. D2-notlive 💤 PR contains changes in a runtime directory that is not deployed to a chain that requires an audit. labels Sep 5, 2021

Parity Bot and others added 2 commits September 5, 2021 03:31

increase repeats

8918244

gui1117 reviewed Sep 15, 2021

View reviewed changes

frame/benchmarking/src/baseline.rs Outdated Show resolved Hide resolved

gui1117 reviewed Sep 15, 2021

View reviewed changes

frame/benchmarking/src/baseline.rs Outdated Show resolved Hide resolved

gui1117 approved these changes Sep 15, 2021

View reviewed changes

emostov reviewed Sep 21, 2021

View reviewed changes

emostov approved these changes Sep 21, 2021

View reviewed changes

Parity Bot and others added 3 commits October 29, 2021 23:43

improve hash benchmark

1d1d101

Merge branch 'shawntabrizi-baseline-bench' of https://github.com/pari…

edfe6b3

…tytech/substrate into shawntabrizi-baseline-bench

Parity Bot added 2 commits October 30, 2021 11:54

Merge branch 'master' of https://github.com/paritytech/substrate into…

9369a10

… shawntabrizi-baseline-bench

paritytech-processbot bot merged commit 040ab40 into master Oct 30, 2021

paritytech-processbot bot deleted the shawntabrizi-baseline-bench branch October 30, 2021 13:02

github-actions bot mentioned this pull request Dec 2, 2021

Update substrate/polkadot/cumulus from v0.9.12 to v0.9.13 moonbeam-foundation/moonbeam#1050

Closed

ghzlatarev mentioned this pull request Dec 6, 2021

[Manta] Integrate v0.9.13 upstream changes Manta-Network/Manta#294

Merged

23 tasks

AurevoirXavier added a commit to darwinia-network/darwinia-common that referenced this pull request Aug 4, 2022

Companion of paritytech/substrate#9691, !

bacbb5a

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Baseline FRAME Benchmarks #9691

Add Baseline FRAME Benchmarks #9691

shawntabrizi commented Sep 4, 2021

shawntabrizi commented Sep 4, 2021

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

gui1117 left a comment •

edited

Loading

emostov Sep 21, 2021

shawntabrizi Oct 29, 2021 •

edited

Loading

emostov left a comment

shawntabrizi commented Oct 29, 2021

parity-benchapp bot commented Oct 29, 2021 •

edited

Loading

shawntabrizi commented Oct 29, 2021

parity-benchapp bot commented Oct 29, 2021 •

edited

Loading

shawntabrizi commented Oct 29, 2021

parity-benchapp bot commented Oct 29, 2021 •

edited

Loading

shawntabrizi commented Oct 30, 2021

parity-benchapp bot commented Oct 30, 2021 •

edited

Loading

shawntabrizi commented Oct 30, 2021

parity-benchapp bot commented Oct 30, 2021 •

edited

Loading

shawntabrizi commented Oct 30, 2021

paritytech-processbot bot commented Oct 30, 2021

Add Baseline FRAME Benchmarks #9691

Add Baseline FRAME Benchmarks #9691

Conversation

shawntabrizi commented Sep 4, 2021

shawntabrizi commented Sep 4, 2021

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 • edited Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 • edited Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 • edited Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 • edited Loading

shawntabrizi commented Sep 5, 2021

parity-benchapp bot commented Sep 5, 2021 • edited Loading

gui1117 left a comment • edited Loading

Choose a reason for hiding this comment

emostov Sep 21, 2021

Choose a reason for hiding this comment

shawntabrizi Oct 29, 2021 • edited Loading

Choose a reason for hiding this comment

emostov left a comment

Choose a reason for hiding this comment

shawntabrizi commented Oct 29, 2021

parity-benchapp bot commented Oct 29, 2021 • edited Loading

shawntabrizi commented Oct 29, 2021

parity-benchapp bot commented Oct 29, 2021 • edited Loading

shawntabrizi commented Oct 29, 2021

parity-benchapp bot commented Oct 29, 2021 • edited Loading

shawntabrizi commented Oct 30, 2021

parity-benchapp bot commented Oct 30, 2021 • edited Loading

shawntabrizi commented Oct 30, 2021

parity-benchapp bot commented Oct 30, 2021 • edited Loading

shawntabrizi commented Oct 30, 2021

paritytech-processbot bot commented Oct 30, 2021

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

parity-benchapp bot commented Sep 5, 2021 •

edited

Loading

gui1117 left a comment •

edited

Loading

shawntabrizi Oct 29, 2021 •

edited

Loading

parity-benchapp bot commented Oct 29, 2021 •

edited

Loading

parity-benchapp bot commented Oct 29, 2021 •

edited

Loading

parity-benchapp bot commented Oct 29, 2021 •

edited

Loading

parity-benchapp bot commented Oct 30, 2021 •

edited

Loading

parity-benchapp bot commented Oct 30, 2021 •

edited

Loading