BestPromptFinder

Show HN: Kalosm an embeddable framework for pre-trained models in Rust

The prompt

Hi everyone, I'm happy to announce the release of Kalosm! [Kalosm]( is a framework for embedded AI in rust. ## What is Kalosm? Kalosm provides a simple interface for pre-trained language, audio, and image models models. To make it easy to use with these models in your application, Kalosm includes a set of integrations other systems like your database or documents. ```rust use kalosm::language::*; #[tokio::main] async fn main() { let mut model = Llama::new_chat(); let mut chat = Chat::builder(&mut model) .with_system_prompt("The assistant will act like a pirate") .build(); loop { chat.add_message(prompt_input("\n> ").unwrap()) .await .unwrap() .to_std_out() .await .unwrap(); } } ``` ## What can you build with Kalosm? Kalosm is designed to be a flexible and powerful tool for building AI into your applications. It is a great fit for any application that uses AI models to process sensitive information where local processing is important. Here are a few examples of applications that are built with Kalosm: - Floneum ( A local open source workflow editor and automation tool that uses Kalosm to provide natural language processing and other AI features. - Kalosm Chat ( A simple chat application that uses Kalosm to run quantized language models. ## Kalosm 0.2 The 0.2 release includes several new features and some performance improvements: - Tasks and Agents - Task Evaluation - Prompt Auto-Tuning - Regex Validation - Surreal Database Integration - RAG improvements - Performance Improvements - New Models If you have any questions, feel free to ask them here, in the discord ( or on GitHub ( To get started with Kalosm, you can follow the quick start guide:

Why this prompt

• 88% found it useful across General

Source

Hacker News

Related Coding prompts