Welcome to my portfolio website šŸ‘‹

I am Ethan, a computer science student @ EPFL. I love programming and will try my best to share my projects here !

How to run Deepseek R1 distilled (or others) locally with Open WebUI, Ollama and Docker compose šŸ‹

Introduction If you’ve been online these last few days, you’ve very probably heard about China’s new LLM model, Deepseek. Often depicted as ChatGPT’s killer, Deepseek sent shockwaves through the internet not only for its performance and cost but also for the fact that the model is open-source. This means that anyone can run the model on their computer for themselves. āš ļø Important Due to hardware limitations, the Deepseek R1 model you’ll run locally after this tutorial will be ā€œdumberā€ compared to the one on Deepseek’s website....

February 1, 2025 Ā· 5 min Ā· 985 words