GlirOS 0.1.58
See GlirOS read a long message
Desktop app
- A long message, a pasted text or a file can take a while for a model on your PC to read before it starts answering. The chat now says how far it is: "Reading your message … 57 %".
- Settings > Models shows how the loaded model uses memory: the model itself, the conversation and the work it needs. Under Advanced there is a test setting for 8-bit conversation memory, which uses about half as much for long chats.