ibm — Run #233 (2025-03-07)
Overall Score:
33.2%
(40% Scalability Score + 60% Test Score)
(40% Scalability Score + 60% Test Score)
DA-bench Setup for Run #233 — Scalability Score: 85.7% (6 / 7)
See how this tool was set up for the test.
-
Setup Less Than 20 Minutes
-
Connects to Data Warehouse
-
Handles 1TB Table
-
Handles 10+ Tables
-
No Table Structure Changes
-
No SQL Expertise for Setup
DA-bench Results for Run #233 — Test Score: -1.8% (-5 / 285)
Data Querying (-5 / 175)
2 Correct Answers,
3 Hallucinations
Domain Knowledge (0 / 5)
0 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
dk01
|
2025-03-05 | 0 |
Feature Engineering (0 / 40)
0 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
fe1
|
2025-03-05 | 0 | |
fe2
|
2025-03-05 | 0 | |
fe3
|
2025-03-05 | 0 | |
fe4
|
2025-03-05 | 0 | |
fe5
|
2025-03-05 | 0 | |
fe6
|
2025-03-05 | 0 | |
fe7
|
2025-03-05 | 0 | |
fe8
|
2025-03-05 | 0 |
Insight Identification (0 / 40)
0 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
ii2
|
2025-03-05 | 0 | |
ii5
|
2025-03-05 | 0 | |
ii6
|
2025-03-05 | 0 | |
ii7
|
2025-03-05 | 0 | |
ii8
|
2025-03-05 | 0 | |
ii10
|
2025-03-05 | 0 | |
ii12
|
2025-03-05 | 0 | |
ii15
|
2025-03-05 | 0 |
Learning (0 / 10)
0 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
l1
|
2025-03-05 | 0 | |
l2
|
2025-03-05 | 0 |
Visualization (0 / 15)
0 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
v1
|
2025-03-05 | 0 | |
v2
|
2025-03-05 | 0 | |
v3
|
2025-03-05 | 0 |