0x1eef @0x1eef@bsd.cafe
Public

Hi everyone,

I'd like to share and announce the release of llm.rb v2.1.0.
The source is available at github.com/llmrb/llm.rb

> What is llm.rb?

llm.rb is a zero-dependency Ruby toolkit for Large Language Models that
includes OpenAI, Gemini, Anthropic, xAI (Grok), zAI, DeepSeek, Ollama,
and LlamaCpp. The toolkit includes full support for chat, streaming,
tool calling, audio, images, files, and structured outputs.

> Example

A simple chatbot that maintains a conversation and streams responses in
real-time:

#!/usr/bin/env ruby
require "llm"

llm = LLM.openai(key: ENV["KEY"])
bot = LLM::Bot.new(llm, stream: $stdout)
loop do
print "> "
bot.chat(gets)
print "\n"
end

Ruby toolkit for multiple Large Language Models (LLMs) - llmrb/llm.rb

GitHub - llmrb/llm.rb: Ruby toolkit for multiple Large Language Models (LLMs)

Ruby toolkit for multiple Large Language Models (LLMs) - llmrb/llm.rb

github.com · GitHub

0
0
0

If you have a fediverse account, you can quote this note from your own instance. Search https://mastodon.bsd.cafe/users/0x1eef/statuses/115674510545616360 on your instance and quote it. (Note that quoting is not supported in Mastodon.)