MODEL CONFIGURATION
Models are selected by purpose, not by name.
An instance holds a set of configured model servers. Each model is registered for one purpose with its own sampling and prompt settings, and the application asks for the active model of a purpose rather than for a particular vendor or version.
- Document processing
- Reads uploaded files where the source needs interpretation rather than plain text extraction, including scanned pages and tables.
- Completion
- Extracts questions and requirements, writes summaries, drafts suggested answers from retrieved sources, and compares items against policy text.
- Embedding
- Converts questions, answers, and document sections into vectors so related material can be found by meaning rather than by wording.
- Reranking
- Reads a question together with each shortlisted candidate and re-scores them, which is more accurate than comparing two independently produced vectors.
Because routing goes through the purpose, any of the four can be replaced without touching the others, and different purposes can be served by different providers. In a self-hosted deployment all four run in your environment and the core deployment can operate air-gapped.