lila/data-pipeline/tests
lila 37c978e230 implementing phase 3 pipeline: gemini structured output, validation, sqlite staging
Prompt is now a template (fixes the hardcoded en/es leftovers in rules
2, 3, 15, 16, 26, 31). pipeline.ts replaces the pseudocode: wordlist
normalization, skip-already-staged idempotency, batches of 20 against
gemini-3.6-flash with responseSchema, raw responses persisted per batch,
per-entry validation with rejection log, one transaction per word into
db/staging.db. Flags: --langs --pos --max-batches --delay-ms --dry-run.

Smoke run: 40/40 words staged (de+es, one batch each), 0 rejections.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-09 19:04:04 +02:00
..
promptTemplate.test.ts implementing phase 3 pipeline: gemini structured output, validation, sqlite staging 2026-08-09 19:04:04 +02:00
sourceLists.test.ts implementing phase 3 pipeline: gemini structured output, validation, sqlite staging 2026-08-09 19:04:04 +02:00
staging.test.ts implementing phase 3 pipeline: gemini structured output, validation, sqlite staging 2026-08-09 19:04:04 +02:00
validate.test.ts implementing phase 3 pipeline: gemini structured output, validation, sqlite staging 2026-08-09 19:04:04 +02:00