Text-to-SQL EngineOFFLINE RECORDED MODEMeasured results

From question to guarded SQL.

Inspect real evidence, one pipeline decision at a time.

Recorded examples only.
No generation or SQL execution during replay.

Recorded sessionWaiting for recording

Inspect the pipeline

Select a curated example to see its question, schema, SQL, validation and result.

  1. 01Schema selection
  2. 02LLM generation
  3. 03AST validation
  4. 04Safe execution
  5. 05Audit

Stages describe the original evidence. Replay reads a static recording; it does not execute this pipeline or create an audit entry.

Selected schema

Candidate SQL

No recording loaded.

Final safe SQL

No recording loaded.

Validation

The deterministic gate is independent of the model.

Recorded result

No result loaded.

Recording provenance

Measured, including the tradeoffs.

Custom synthetic benchmark. One local model, three repeats.
Not Spider/BIRD. Not a public leaderboard.

Step 10 / 100 questions, including 64 complex questions / qwen3.8:latest
ConfigurationExecution accuracyMedian latencyp95 latency
Full / no retry94.67%20.02 s29.84 s
Pruned / no retry77.33%9.48 s37.91 s
Pruned / retry77.00%9.44 s38.14 s

Pruning effect

-17.33 pp

Smaller context and lower median latency came with substantially lower accuracy and worse p95 latency.

Retry uplift

-0.33 pp

Bounded correction preserves validation, but measured no accuracy improvement. Zero successful corrections in Step 10.

Deterministic enforcement

96/96 adversarial safe outcomes

6/6 unsafe candidates blocked.
0 unsafe SQL executed.
104/104 SQL attacks blocked; 0 unexpected accepts.
48/48 supported-valid queries accepted; 0 false rejects.

Curated successes illustrate behavior, not average performance or pruning superiority. Safety results describe tested inputs under this gate policy, not a guarantee against unknown vulnerabilities. Three repeats do not establish statistical significance.