Note: We will enable the leaderboard once the project progresses and enough students are at the point of being able to run on large data. This will be at some point in late October/early November.
The leaderboard shows the best recorded time for each user for all benchmarks cumulatively in the first tab, and for each one of the 7 available benchmarks individually in the following tabs. The CS165 testing suite is comprised of 7 benchmarks. Each benchmark is about: (B1) initial loading follows by inserts, (B2) a complex SQL query, (B3) loading with index creation, (B4) queries using indexes, (B5) shared scans, (B6) loading of files with skewed data and index creation (also used for the joins), and (B7) a complex join query .
The initial data set is comprised of 100M rows for each table. The raw data size of the three tables that are loaded is 10GB.
Aggregate time of all 8 benchmarks.
User | Performance |
---|
Benchmark 1: Load a table of 4 columns.
User | Performance |
---|
Benchmark 2: Execute a single aggregate query.
User | Performance |
---|
Benchmark 3: Load a table of 4 columns, while bulk loading a tree and maintaining a clustered column.
User | Performance |
---|
Benchmark 4: Index probes in both indexes.
User | Performance |
---|
Benchmark 5: Executing shared scans.
User | Performance |
---|
Benchmark 6: Load a table of 4 columns, while bulk loading a tree (data used for the join benchmark).
User | Performance |
---|
Benchmark 7: Performing a join.
User | Performance |
---|
Benchmark 8: Updating the data and the index.
User | Performance |
---|