Install DeepSeek in Your Local Computer

Raja — Sun, 02 Feb 2025 11:39:00 +0000

DeepSeek, DeepSeek, DeepSeek... We can here this word from small youtube channels to American President in the recent times. It is open source, I thought Ok We can try this. I see the model have 1.5B version which is not that much efficient but, we can give a try on that ( I don't have GPUs to run the 671B 😅). Let's install 1.5b version in my desktop.

Before the installation, i want to introduce one thing called, OLLAMA which is a software to run any open source large language models in our local system or even in a server. There are some alternatives doing the same job but ollama is very easy to setup and it is too easy to work with.

Setup Ollama

This is an easy process, just go to https://ollama.com/ and donwload it, it is available for Mac, linux and windows, go ahead, download and install it.

Once the installation is done, verify it is installed properly by running the command in your terminal

ollama --version

As you can see, our Ollama installed successfully.

Installing DeepSeek:

Deepseek has various model versions from 1.5B to 671B , you can see the list of available models here

To install DeepSeek in our local machine, open your terminal and run the following command

ollama run deepseek-r1:1.5b

This will pull the deepseek model file and run the model

that's it now it is installed in our local system 🥳🎉

Bonus Tip

Everything looks good for now. But it's kind of boring using the terminal. It will look cool if we have a chatgpt kind of ui right?, I got you. There is an open source repository from OpenWebUI which fulfills our need, so why can't we use that? let's install it.

If you have docker installed, it is a straight forward way.

docker pull ghcr.io/open-webui/open-webui:main
docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main

If you don't have docker installed, don't worry they published this as a pip package, but make sure you have python 3.11 installed. you can run the following command to install webui

pip install open-webui

Once the installation is done, you can run the webapp using the following command

open-webui serve

Now our Chatgpt like webapp is ready
open http://localhost:8080 it will prompt for signup. Once signup is done you can see the Chatgpt like UI

Now we can play with it🥳🥳

If you like my blogs please do follow me on Linkedin and Instagram

Forem: Raja

Install DeepSeek in Your Local Computer

Setup Ollama

Installing DeepSeek:

Bonus Tip