LLM
Managed LLM text generation for your app.
Use LLM when your app needs to generate, rewrite, summarize, translate, classify, or extract text, or provide chat-like replies. Orchard currently runs every request with GPT-5.6 Luna.
No OpenAI account, model setup, or separate API key. Your agent enables LLM, adds the secure server-side call, and Orchard tracks usage and billing in one place. Your app must have server code that can keep its Orchard project API key secret.
When to use LLM
Use LLM whenever your app needs to understand or produce natural language:
- Generate replies, descriptions, or draft content
- Rewrite text in a different tone or format
- Summarize long user-provided text
- Translate text between languages
- Classify messages or extract structured details from text
- Add a chat-like assistant to an app workflow
Text input and output
Your app sends a required text input and may add instructions for behavior, tone, language, or output format. Orchard returns generated text plus the model name and token usage. Multilingual text is supported, so input and output can be Korean, English, Japanese, Spanish, French, Chinese, German, and other languages; quality can vary by language and task.
- Input: text up to 20,000 characters.
- Instructions: optional text up to 4,000 characters.
- Output: generated text, up to 4,096 tokens per request.
- Conversation context: include prior messages in the input when your app needs continuity.
Choose the right service
Use LLM for natural-language text generation. Use Database for records, Storage for files, Auth for login, and Analytics for app activity. Orchard LLM is currently a text-only, one-request runtime. It does not search the live web, accept images or files, generate images, call tools, preserve conversation history automatically, or enforce a JSON schema. Static browser-only apps cannot call it directly because the project API key must remain server-side.
Ask your agent
Paste one of these into your coding agent:
- "Add a server-side LLM reply feature to this support form."
- "Summarize the text a user pastes into this page."
- "Rewrite this user message in a friendly, professional tone."
- "Classify incoming feedback as a bug, request, or question."
- "Extract the company name and requested date from this message."
- "Translate user input into the language selected in this app."
These requests may be written in the builder's language. Your coding agent
should select orchard_llm, enable it for the project,
and use the returned server integration guide.
In your dashboard
You don't create a model account or paste credentials into your app. After your agent enables LLM, you can check:
- Projects → LLM: view status, model, requests, input tokens, cached input, and output tokens; pause or reactivate generation.
- Billing: see included LLM processing, estimated overage, and your account-wide spending cap.
LLM pricing
The Free plan includes $0.20 of LLM processing per billing period. Builder includes $0.40, then charges only for usage above that amount.
- Input: $0.25 per million tokens after the included amount.
- Cached input: $0.025 per million tokens after the included amount.
- Output: $1.50 per million tokens after the included amount.