Operating a succesful 27B mannequin as a neighborhood AI coding agent used to imply establishing inference servers, configuring endpoints, and connecting the whole lot manually. With Qwen3.8-27B, Ollama, and OpenCode, the method is now remarkably easy.
Qwen3.8-27B is likely one of the native fashions I’ve been most excited to strive. It’s sturdy at coding, reasoning, instrument use, and long-horizon agentic duties, making it an important match for working with advanced initiatives and huge native codebases.
On this information, we are going to flip Qwen3.8-27B into a neighborhood AI coding agent utilizing solely three command strains within the terminal. We’ll set up Ollama, obtain the mannequin, launch it straight in OpenCode, and shortly confirm that it’s working on the GPU.
Earlier than You Begin: Checking Your {Hardware}
Qwen3.8-27B is a big mannequin, so first make certain your machine has sufficient assets.
On Linux or Home windows with NVIDIA drivers put in, run:
nvidia-smi
For this information, we’re utilizing an RTX 3090 with 24 GB of VRAM. Ollama’s Qwen3.8-27B mannequin is round 18 GB, so it could actually match fully on the GPU whereas leaving some VRAM for the context and runtime overhead.
As a basic rule, 24 GB of VRAM is an effective goal if you wish to maintain most or all the mannequin on the GPU. Rising the context window would require extra reminiscence.
In case your GPU doesn’t have sufficient VRAM, Ollama can break up the mannequin between GPU VRAM and system RAM. It is going to nonetheless work, however era might be slower.
I might advocate not less than 32 GB of system RAM, particularly if a part of the mannequin must be offloaded from the GPU.
Operating Qwen3.8-27B in Simply 3 Instructions
Now that the {hardware} is prepared, we are able to set up Ollama, obtain Qwen3.8-27B, and launch it inside OpenCode utilizing simply three terminal instructions.
1. Putting in Ollama
First, set up Ollama, which is able to deal with downloading and serving the mannequin regionally.
curl -fsSL https://ollama.com/set up.sh | sh
2. Beginning Ollama and Downloading Qwen3.8-27B
Subsequent, begin the Ollama server within the background and obtain the Qwen3.8-27B mannequin.
ollama serve & ollama pull qwen3.8:27b
This begins the native Ollama server after which downloads the mannequin recordsdata. Maintain this terminal open so it’s also possible to see the server logs when the mannequin begins working.
3. Launching Qwen3.8-27B in OpenCode
Open a new terminal and launch OpenCode with Qwen3.8-27B already chosen because the mannequin.
ollama launch opencode --model qwen3.8:27b
If OpenCode isn’t put in but, Ollama will immediate you to put in it first.
As soon as the set up is full, the OpenCode TUI will open with Qwen3.8-27B chosen. From right here, you possibly can merely give it a coding process.
For my take a look at, I requested it to construct a easy Python utility. On the primary request, the mannequin takes a little bit longer as a result of Ollama has to load it into reminiscence. You’ll be able to watch this occur within the first terminal.
As soon as loaded, era pace is spectacular.
In my take a look at, it constructed the appliance, examined it, and returned an in depth mission abstract in beneath two minutes.
That is it. Ollama handles the native mannequin, whereas OpenCode supplies the agentic coding atmosphere.
Ultimate Ideas
I do know some individuals will desire llama.cpp as a result of it provides you a lot deeper management over inference, efficiency tuning, quantization, and superior options. However that’s not actually the purpose of this information.
This setup is for newcomers and non-technical customers who merely wish to expertise a robust native coding mannequin with out constructing llama.cpp from supply, configuring servers, or determining lengthy command-line arguments.
With simply three instructions, you put in Ollama, obtain and run Qwen3.8-27B, and launch it straight inside OpenCode.
That’s it. You’ll be able to go from nothing to a completely native AI coding agent in only a few minutes.
Abid Ali Awan (@1abidaliawan) is an authorized knowledge scientist skilled who loves constructing machine studying fashions. Presently, he’s specializing in content material creation and writing technical blogs on machine studying and knowledge science applied sciences. Abid holds a Grasp’s diploma in know-how administration and a bachelor’s diploma in telecommunication engineering. His imaginative and prescient is to construct an AI product utilizing a graph neural community for college kids combating psychological sickness.
Operating a succesful 27B mannequin as a neighborhood AI coding agent used to imply establishing inference servers, configuring endpoints, and connecting the whole lot manually. With Qwen3.8-27B, Ollama, and OpenCode, the method is now remarkably easy.
Qwen3.8-27B is likely one of the native fashions I’ve been most excited to strive. It’s sturdy at coding, reasoning, instrument use, and long-horizon agentic duties, making it an important match for working with advanced initiatives and huge native codebases.
On this information, we are going to flip Qwen3.8-27B into a neighborhood AI coding agent utilizing solely three command strains within the terminal. We’ll set up Ollama, obtain the mannequin, launch it straight in OpenCode, and shortly confirm that it’s working on the GPU.
Earlier than You Begin: Checking Your {Hardware}
Qwen3.8-27B is a big mannequin, so first make certain your machine has sufficient assets.
On Linux or Home windows with NVIDIA drivers put in, run:
nvidia-smi
For this information, we’re utilizing an RTX 3090 with 24 GB of VRAM. Ollama’s Qwen3.8-27B mannequin is round 18 GB, so it could actually match fully on the GPU whereas leaving some VRAM for the context and runtime overhead.
As a basic rule, 24 GB of VRAM is an effective goal if you wish to maintain most or all the mannequin on the GPU. Rising the context window would require extra reminiscence.
In case your GPU doesn’t have sufficient VRAM, Ollama can break up the mannequin between GPU VRAM and system RAM. It is going to nonetheless work, however era might be slower.
I might advocate not less than 32 GB of system RAM, particularly if a part of the mannequin must be offloaded from the GPU.
Operating Qwen3.8-27B in Simply 3 Instructions
Now that the {hardware} is prepared, we are able to set up Ollama, obtain Qwen3.8-27B, and launch it inside OpenCode utilizing simply three terminal instructions.
1. Putting in Ollama
First, set up Ollama, which is able to deal with downloading and serving the mannequin regionally.
curl -fsSL https://ollama.com/set up.sh | sh
2. Beginning Ollama and Downloading Qwen3.8-27B
Subsequent, begin the Ollama server within the background and obtain the Qwen3.8-27B mannequin.
ollama serve & ollama pull qwen3.8:27b
This begins the native Ollama server after which downloads the mannequin recordsdata. Maintain this terminal open so it’s also possible to see the server logs when the mannequin begins working.
3. Launching Qwen3.8-27B in OpenCode
Open a new terminal and launch OpenCode with Qwen3.8-27B already chosen because the mannequin.
ollama launch opencode --model qwen3.8:27b
If OpenCode isn’t put in but, Ollama will immediate you to put in it first.
As soon as the set up is full, the OpenCode TUI will open with Qwen3.8-27B chosen. From right here, you possibly can merely give it a coding process.
For my take a look at, I requested it to construct a easy Python utility. On the primary request, the mannequin takes a little bit longer as a result of Ollama has to load it into reminiscence. You’ll be able to watch this occur within the first terminal.
As soon as loaded, era pace is spectacular.
In my take a look at, it constructed the appliance, examined it, and returned an in depth mission abstract in beneath two minutes.
That is it. Ollama handles the native mannequin, whereas OpenCode supplies the agentic coding atmosphere.
Ultimate Ideas
I do know some individuals will desire llama.cpp as a result of it provides you a lot deeper management over inference, efficiency tuning, quantization, and superior options. However that’s not actually the purpose of this information.
This setup is for newcomers and non-technical customers who merely wish to expertise a robust native coding mannequin with out constructing llama.cpp from supply, configuring servers, or determining lengthy command-line arguments.
With simply three instructions, you put in Ollama, obtain and run Qwen3.8-27B, and launch it straight inside OpenCode.
That’s it. You’ll be able to go from nothing to a completely native AI coding agent in only a few minutes.
Abid Ali Awan (@1abidaliawan) is an authorized knowledge scientist skilled who loves constructing machine studying fashions. Presently, he’s specializing in content material creation and writing technical blogs on machine studying and knowledge science applied sciences. Abid holds a Grasp’s diploma in know-how administration and a bachelor’s diploma in telecommunication engineering. His imaginative and prescient is to construct an AI product utilizing a graph neural community for college kids combating psychological sickness.
