feat(scripts): add Italian CEFR data pipeline

Browse source

- Add extractors for Italian sources: it_m3.xls and italian.json
- Add comparison script (compare-italian.py) to report source overlaps and conflicts
- Add merge script (merge-italian-json.py) with priority order ['italian', 'it_m3']
- Output authoritative dataset to datafiles/italian-merged.json
- Update README to document both English and Italian pipelines

...

This commit is contained in:

lila 2026-04-08 18:32:03 +02:00

parent 59152950d6

commit 3374bd8b20

9 changed files with 208535 additions and 26 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

22076

scripts/data-sources/italian/it_m3-extracted.json Normal file

View file

File diff suppressed because it is too large Load diff

72212

scripts/data-sources/italian/italian-extracted.json Normal file

View file

File diff suppressed because it is too large Load diff