Normalizer-based SQL pattern recognition (planner + query engine + ingest) - #561
Normalizer-based SQL pattern recognition (planner + query engine + ingest)#561hshafqat-art wants to merge 1 commit into
Conversation
detects ClickHouse-specific complex SQL shapes (CTE/window functions, tokenized subqueries, MOAS, multi-aggregate) and rewrites them into simplified queries. Both the planner and the query engine call into this implementation. Also adds ComputedLabelConfig/StatefulTransitionConfig as shared asap_types, wires ingest-time computed-label and stateful-transition execution, and adds the 200-query bgp_jan2024_rrc00 analyst workload.
|
FYI @zzylol |
|
@hshafqat-art This is my understanding of what's in here. Can you confirm if this is correct and complete? 1. SQL pattern-rewrite feature — detecting ClickHouse-specific complex shapes (CTE/window funcs, tokenized subqueries, MOAS, multi-aggregate, bucketed countIf) and rewriting/planning/serving them. Spans 2. CSV ingest: accept ClickHouse 3. Finite CSV-ingest lifecycle fixes — explicit 4. Ingest-routing now enforces 5. BGP query workload. Already taken care of by https://github.com/ProjectASAP/ASAPPlanner/pull/219 |
Also adds ComputedLabelConfig/StatefulTransitionConfig as shared asap_types,
wires ingest-time computed-label and stateful-transition execution, and adds
the 200-query bgp_jan2024_rrc00 analyst workload.