[QST]Is there any difference between different test data sets of tpc? #5370
-
What is your question? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
The tests you pointed at are based on the TPCH, TPC-DS, and TPCx-BB benchmarks. We set them up in our repository such that tests could be triggered automatically by our CI system. It is really just a way for us to exercise our code regularly, and a convenient way to trigger benchmarks. We don't change the SQL part of the query in any case, but we will adapt the datatypes to get parts of our plugin to work on the GPU. The only type change I am aware of is Decimal to double and BigInt to long. Some benchmarks like TPCx-BB have more than just SQL (some of it is SQL for preprocessing simply to run java code afterwards, which is normally included in a TPCx-BB run), but they are not in active development and the source isn't available to get it up to spec, as it was built for older versions of Spark. We decided to focus on the SQL components of the benchmarks, especially since that is what we are accelerating, and have added other benchmarks that are more actively used today (TPC-DS) for better comparisons. Hope this helps! |
Beta Was this translation helpful? Give feedback.
-
Please reopen in case you have further questions. |
Beta Was this translation helpful? Give feedback.
@Matrix-World
The tests you pointed at are based on the TPCH, TPC-DS, and TPCx-BB benchmarks. We set them up in our repository such that tests could be triggered automatically by our CI system. It is really just a way for us to exercise our code regularly, and a convenient way to trigger benchmarks.
We don't change the SQL part of the query in any case, but we will adapt the datatypes to get parts of our plugin to work on the GPU. The only type change I am aware of is Decimal to double and BigInt to long.
Some benchmarks like TPCx-BB have more than just SQL (some of it is SQL for preprocessing simply to run java code afterwards, which is normally included in a TPCx-BB run), but they are n…