Prerequisites

Prerequisites

Complete Your first agent before starting. You need an API key for OpenAI or another supported provider.

Install dependencies

jido_ai adds LLM reasoning on top of the core Jido runtime. req_llm is the provider-agnostic transport layer that jido_ai uses underneath.

Mix.install([
  {:jido, "~> 2.0"},
  {:jido_ai, github: "agentjido/jido_ai", branch: "main"},
  {:req_llm, "~> 1.6"}
])

Configure credentials

Set your OpenAI API key. In Livebook, add OPENAI_API_KEY as a Livebook Secret prefixed with LB_. The cell below checks both the Livebook secret and a plain environment variable.

openai_key = System.get_env("LB_OPENAI_API_KEY") || System.get_env("OPENAI_API_KEY")

if openai_key do
  ReqLLM.put_key(:openai_api_key, openai_key)
  :configured
else
  IO.puts("Set OPENAI_API_KEY as a Livebook Secret or environment variable to run the LLM cells.")
  :no_key
end

Define an AI agent

In the previous tutorial you built a deterministic agent with typed state and actions. This tutorial adds LLM reasoning to a Jido agent.

The Jido.AI.Agent macro gives your agent a system prompt, a model, and the full Jido lifecycle. The module below defines a greeter that generates a short welcome message.

defmodule MyApp.Greeter do
  use Jido.AI.Agent,
    name: "greeter",
    description: "Generates a friendly greeting",
    tools: [],
    model: "openai:gpt-4o-mini",
    system_prompt: """
    You are a friendly greeter.
    Generate a short, warm welcome message.
    One or two sentences maximum.
    """
end

model: "openai:gpt-4o-mini" selects a fast, inexpensive model. You can swap in any model string supported by req_llm (for example "anthropic:claude-haiku-4-5"). tools: [] means no external tool calls for now.

Run the agent

Start the agent through Jido.AgentServer and send it a prompt:

{:ok, pid} = Jido.AgentServer.start_link(agent: MyApp.Greeter)
MyApp.Greeter.ask_sync(pid, "Say hello to someone just getting started with Jido.")

If you see a greeting string, your AI integration is working. If you get a provider error, verify that your API key is set correctly.

What happened

Here is the flow you just ran:

1. Jido.AgentServer.start_link/1 spawned a supervised process for your agent.
2. ask_sync/2 sent the prompt to the agent process.
3. The agent’s system prompt and your message were combined and sent to the configured LLM provider via req_llm.
4. The provider response was returned through the agent lifecycle.

Your agent module contains no HTTP calls, no API client code, and no mutable state. The LLM interaction is handled by the runtime. Your agent definition stays declarative and testable.

Using this in a Mix project

When you move from Livebook to a Mix project, add the dependencies to mix.exs and configure the provider key in config/runtime.exs.

mix.exs

defp deps do
  [
    {:jido, "~> 2.0"},
    {:jido_ai, github: "agentjido/jido_ai", branch: "main"},
    {:req_llm, "~> 1.6"}
  ]
end

config/runtime.exs

import Config

config :req_llm, openai_api_key: System.get_env("OPENAI_API_KEY")

Export the key in the shell session where you run your app:

export OPENAI_API_KEY="your-api-key-here"

Next steps

• Build a multi-step orchestration in Build your first workflow.
• Add multi-turn conversation in Build an AI chat agent.
• Explore the full jido_ai surface at jido_ai.