Welcome to the Hangar Open Beta. Please report any issue you encounter on GitHub!
Avatar for alanlapid

Build structures from a text prompt or a photo with the LLM of your choice: Gemini, Claude, OpenAI or local 0llama.

Report AIConstructor?

AIConstructor

AIConstructor

Modrinth Build

Build Minecraft structures from a text prompt or a photo, using the LLM of your choice.

/aibuild a small wooden sailboat with white sails
/aibuild photo https://example.com/castle.png a castle like this one

The AI designs the build, you get a particle preview in front of you, and after confirming it is placed block by block. Every build can be undone.

  • Paper 26.2 · Java 25
  • Works with Gemini, Claude, any OpenAI-compatible API, and local models (Ollama, LM Studio, vLLM…)
  • Each server uses its own API key. Nothing goes through third-party servers.

Features

  • 4 connectors
    • gemini: Google AI Studio (has a free tier)
    • anthropic: Claude, through the official Anthropic Java SDK
    • openai: OpenAI, OpenRouter, Groq, DeepSeek, Mistral, Together, LM Studio, vLLM, LocalAI… anything that speaks the Chat Completions API
    • ollama: local models through Ollama's native API, no key needed
  • Model rotation. If a model is overloaded or out of quota, the next one in the list is tried automatically. Players see every attempt live.
  • Structured output. The model returns a JSON plan made of shapes (fill, walls, hollow_box, line, cylinder, sphere, pyramid, block). Models without structured output are supported too.
  • Photos as reference for models with vision. Downloads are size-limited and cannot reach private or internal addresses.
  • Safe by default
    • Never overwrites chests, signs or other block entities.
    • Blocked block list (TNT, lava, command blocks, portals…).
    • Size and block limits.
    • Respects WorldGuard regions, including ProtectionStones.
  • Limits per player. Cooldown, plus a daily limit per permission (aiconstructor.limit.<n>). Failed AI calls are not counted.
  • Translatable. Ships with English and Spanish (lang/*.yml, MiniMessage format).

Installation

  1. Drop AIConstructor-x.y.z.jar in plugins/ and start the server once. Paper downloads the Anthropic SDK library automatically on first start.
  2. Edit plugins/AIConstructor/config.yml: choose provider.type, set provider.api-key and provider.models.
  3. Run /aibuild reload.

Provider examples

Gemini (free tier)

provider:
  type: gemini
  api-key: "env:GEMINI_API_KEY"   # or paste the key
  models: [gemini-3.8-flash, gemini-3.7-flash, gemini-3.5-flash]

Claude

provider:
  type: anthropic
  api-key: "env:ANTHROPIC_API_KEY"
  models: [claude-opus-5]

OpenRouter (hundreds of models)

provider:
  type: openai
  base-url: "https://openrouter.ai/api/v1"
  api-key: "env:OPENROUTER_API_KEY"
  models: [openai/gpt-5-mini]

Local with Ollama

provider:
  type: ollama
  base-url: "http://localhost:11434"
  models: [qwen3:14b]
  vision: false        # true only for vision models such as llava / qwen2.5vl

LM Studio / vLLM (OpenAI-compatible, local)

provider:
  type: openai
  base-url: "http://localhost:1234/v1"
  api-key: ""
  models: [your-loaded-model]
  openai:
    response-format: json_schema   # use json_object or none if your server does not support it

Small local models (under ~7B parameters) often produce simple or invalid plans. For good results use a strong model.

Commands

Command Description
/aibuild <prompt> Design a build from a description
/aibuild photo <url> [prompt] Design a build from a photo (direct PNG/JPG/WEBP link)
/aibuild confirm Place the previewed build
/aibuild cancel Discard the preview, or stop a build in progress
/aibuild undo Remove your last build (history of 5 by default)
/aibuild status Uses today, pending build, provider and models
/aibuild reload Reload config, language and system prompt

Aliases: /aiconstructor, /construir.

Permissions

Permission Default Description
aiconstructor.use op Generate builds from text
aiconstructor.photo op Generate builds from photos
aiconstructor.admin op /aibuild reload
aiconstructor.limit.<n> – Daily limit of n builds (highest wins)
aiconstructor.bypass.limits false No cooldown, no daily limit
aiconstructor.bypass.protection false Build inside regions the player could not normally build in

Configuration

See the fully commented config.yml. You can tune the building style by editing plugins/AIConstructor/system_prompt.txt.

Building from source

Requires JDK 25 and Maven:

mvn package

The jar is written to target/.

License

GPL-3.0. You can use, modify and redistribute it; modified versions must stay open source under the same license.

Information

Category
World Management
Published
September 27, 2026
License
0Downloads
0Stars

Pinned Versions

Members

1