snowflake — Run #103 (2024-11-01)
Overall Score:
41.4%
(40% Scalability Score + 60% Test Score)
(40% Scalability Score + 60% Test Score)
DA-bench Setup for Run #103 — Scalability Score: 71.4% (5 / 7)
Scalability score reflects Snowflake's data warehouse functionality, although the setup video demonstrates uploading csvs.
-
Setup Less Than 20 Minutes
-
Connects to Data Warehouse
-
Handles 1TB Table
-
Handles 10+ Tables
-
No Table Structure Changes
-
No SQL Expertise for Setup
DA-bench Results for Run #103 — Test Score: 21.4% (45 / 210)
Data Querying (45 / 145)
14 Correct Answers,
5 Hallucinations
Feature Engineering (10 / 15)
2 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
fe6
|
2024-11-01 | 5 | |
fe7
|
2024-11-01 | 5 | |
fe8
|
2024-11-06 | 0 |
Insight Identification (-5 / 25)
0 Correct Answers,
1 Hallucination
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
ii2
|
2024-11-01 | 0 | |
ii5
|
2024-11-05 | 0 | |
ii6
|
2024-11-05 | 0 | |
ii7
|
2024-11-05 | 0 | |
ii8
|
2024-11-05 | -5 |
Learning (-5 / 10)
0 Correct Answers,
1 Hallucination
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
l1
|
2024-11-05 | -5 | |
l2
|
2024-11-05 | 0 |
Visualization (0 / 15)
0 Correct Answers,
0 Hallucinations
Question | Date Tested | Overall Score | Video Recording |
---|---|---|---|
v1
|
2024-11-05 | 0 | |
v2
|
2024-11-01 | 0 | |
v3
|
2024-11-05 | 0 |