Skip to content

Your first model

Nexus needs at least one model before an app can use it. There are two ways to get one. Pick either; you can add the other later.

Run it on your computer Use an online provider
Where it runs This machine The provider’s servers
Prompts leave the machine No Yes
Cost Free after download Billed by the provider
You need Enough memory and disk for the model An API key from the provider

If you did one of these in Getting started, you already have a model. Skip to Check that it works.

A runtime is the engine that runs local models. Nexus installs and manages it for you.

  1. Open Providers, then the Local runtimes tab.
  2. Pick a runtime and click Install, or Start if it’s already installed.
Runtime Use it for
MLX Apple Silicon Macs. Usually the fastest choice on a Mac.
llama.cpp GGUF model files, on any system.
Ollama Models from the Ollama library. Also finds an Ollama you already run.

Already running a model server yourself, such as LM Studio or Ollama? Open the Discovery tab, click Scan this machine, then Add to Nexus next to it. Nexus uses it but won’t start or stop a server it didn’t start.

Local runtimes tab: Nexus Ollama, llama.cpp, MLX and CliProxy running, Apple Foundation Model stopped, with Update, Stop and Start

  1. Open Models, then Featured. These are models picked to work well. Each one says whether it Fits this machine.
  2. Click Download on one that fits your machine.

Or open Search to find any model by name, from Hugging Face or the Ollama library.

Downloads run in the background, two at a time, and pick up again after a restart. Watch them in Activity.

Featured models under Start here, such as Qwen3.5 9B and Gemma 4 12B, with the runtimes they work on, expected speed, size and Download

Have models from Msty Studio, LM Studio or Ollama already? Use Import to link them instead of downloading again. See Models.

  1. Open Providers and click Add provider.
  2. Pick the Provider type: OpenAI, Anthropic, OpenRouter, Amazon Bedrock, Azure OpenAI, or any OpenAI-compatible API.
  3. Paste the provider’s API key.
  4. Under Models shared with apps, keep All models or choose Selected models.
  5. Save, then click Check connection.

The key is stored by this machine’s Runtime, in your system’s secure storage. Nexus never shows it again, never puts it in logs, and never sends it to Msty or to your apps.

Have a Claude, ChatGPT or Google subscription instead of an API key? See Providers: Subscriptions.

  1. Open Models. Your model is in the Library tab.
  2. Click Try in Chat Lab on it, and ask something.

If it answers, Nexus can serve it. Chat Lab shows the speed and which model replied, too.

What you see What to do
A local model won’t load It may not fit in memory. Try a smaller one, or unload other models.
Check connection fails Check the key and, for a compatible API, the address. The provider account must be able to list models.
No models in the Library For a provider, wait for its model list to load, or check Models shared with apps. For a runtime, make sure it’s running.
A download is waiting Another download or a runtime setup may be ahead of it. See Activity.

More fixes: Troubleshooting.

Connect your first app to use the model from your own tools.