julius — Run #135 (2024-11-21)
Overall Score:
75.9%
(40% Setup Score + 60% Test Score)
(40% Setup Score + 60% Test Score)
DA-bench Setup for Run #135 — Setup Score: 57.1% (4 / 7)
- Setup Less Than 20 Minutes
- Connects to Data Warehouse
- Handles 1TB Table
- No Individual Upload of Files
- No Python for Setup
- No SQL for Setup
DA-bench Results for Run #135 — Test Score: 88.4% (190 / 215)
Data Querying (115 / 120)
23 Correct Answers,
0 Hallucinations
Domain Knowledge (5 / 5)
1 Correct Answer,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
dk01
|
2024-11-21 | 5 |
Feature Engineering (40 / 40)
8 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
fe1
|
2024-11-21 | 5 | |
fe2
|
2024-11-21 | 5 | |
fe3
|
2024-11-21 | 5 | |
fe4
|
2024-11-21 | 5 | |
fe5
|
2024-11-21 | 5 | |
fe6
|
2024-11-21 | 5 | |
fe7
|
2024-11-21 | 5 | |
fe8
|
2024-11-21 | 5 |
Insight Identification (25 / 25)
5 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
ii2
|
2024-11-21 | 5 | |
ii5
|
2024-11-21 | 5 | |
ii6
|
2024-11-21 | 5 | |
ii7
|
2024-11-21 | 5 | |
ii8
|
2024-11-21 | 5 |
Learning (0 / 10)
1 Correct Answer,
1 Hallucination
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
l1
|
2024-11-21 | -5 | |
l2
|
2024-11-21 | 5 |
Visualization (5 / 15)
2 Correct Answers,
1 Hallucination
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
v1
|
2024-11-21 | 5 | |
v2
|
2024-11-21 | -5 | |
v3
|
2024-11-21 | 5 |