| Ollaya – Ollama for open-source, Jev-style decision models(ollaya.dev) | |
| 604 points by Ardakilic 18 days ago | 145 comments | |
tl;dr: Ollaya is an open-source, Ollama-style local runtime for "decision models" that return typed, calibrated answers (choice, score, yes/no) to questions about text or JSON in a single forward pass, rather than token-by-token generation. It's API-compatible with TypeSafe's Jev (drop-in with the official SDK), bundles open models like winnow, laya, kev, and decider, and runs on macOS, Windows, Linux, and Docker with NVIDIA GPU or CPU. Benchmarks claim winnow:e4b hits 0.722 accuracy at 89ms on an RTX 4090, close to Jev's hosted 0.738. | |
HN Discussion:
| |