← Back to index
v0.4.0 — Remove Openrouter
[0.4.0] remove openrouter
Removed
- OpenRouter Integration: Removed all OpenRouter API integration and live model benchmarking
- Live API Calls: Eliminated
--model and --run-all flags that required API access
- External Dependencies: Removed dependency on OpenRouter API for benchmarking
Changed
- CLI Interface: Simplified to use only file-based input with
--input flag
- Documentation: Updated README and examples to reflect file-based workflow
- Focus: Repository now exclusively processes pre-generated LLM output files
Added
- Manual Ingestion: Enhanced
--ingest feature for processing multiple model outputs from single file
- File Processing: Streamlined workflow for benchmark evaluation from saved outputs