databricks — Run #129 (2024-11-18)
Overall Score:
72.0%
(40% Scalability Score + 60% Test Score)
(40% Scalability Score + 60% Test Score)
DA-bench Setup for Run #129 — Scalability Score: 100.0% (7 / 7)
See how this tool was set up for the test.
-
Setup Less Than 20 Minutes
-
Connects to Data Warehouse
-
Handles 1TB Table
-
Handles 10+ Tables
-
No Table Structure Changes
-
No SQL Expertise for Setup
DA-bench Results for Run #129 — Test Score: 53.3% (112 / 210)
Data Querying (73 / 120)
18 Correct Answers,
2 Hallucinations
Domain Knowledge (5 / 5)
1 Correct Answer,
0 Hallucinations
| Question | Date Tested | Overall Score | Video Recording |
|---|---|---|---|
|
dk01
|
2024-11-18 | 5 |
Feature Engineering (22 / 40)
6 Correct Answers,
1 Hallucination
| Question | Date Tested | Overall Score | Video Recording |
|---|---|---|---|
|
fe1
|
2024-11-18 | 5 | |
|
fe2
|
2024-11-18 | 5 | |
|
fe3
|
2024-11-18 | 5 | |
|
fe4
|
2024-11-18 | 5 | |
|
fe5
|
2024-11-18 | -5 | |
|
fe6
|
2024-11-18 | 4 | |
|
fe7
|
2024-11-18 | 3 | |
|
fe8
|
2024-11-18 | 0 |
Insight Identification (5 / 25)
1 Correct Answer,
0 Hallucinations
| Question | Date Tested | Overall Score | Video Recording |
|---|---|---|---|
|
ii2
|
2024-11-18 | 5 | |
|
ii5
|
2024-11-18 | 0 | |
|
ii6
|
2024-11-18 | 0 | |
|
ii7
|
2024-11-18 | 0 | |
|
ii8
|
2024-11-18 | 0 |
Learning (5 / 5)
1 Correct Answer,
0 Hallucinations
| Question | Date Tested | Overall Score | Video Recording |
|---|---|---|---|
|
l1
|
2024-11-19 | 5 |
Visualization (2 / 15)
1 Correct Answer,
0 Hallucinations
| Question | Date Tested | Overall Score | Video Recording |
|---|---|---|---|
|
v1
|
2024-11-18 | 0 | |
|
v2
|
2024-11-18 | 2 | |
|
v3
|
2024-11-18 | 0 |