Host Your Own AI Code Assistant with Docker, Ollama and Continue!
Download Docker Desktop: https://dockr.ly/4fWhlFm
Learn more about Docker Scout: https://dockr.ly/3MhG5dE
This video is sponsored by Docker
Ollama docker-compose file: https://gist.github.com/notthebee/1df...
Docker installation on Debian: https://docs.docker.com/engine/instal...
Follow me:
Mastodon https://tilde.zone/@notthebee
GitHub https://github.com/notthebee
Twitch https://twitch.com/notthebeee
Support the channel:
Patreon / wolfgangschannel
YouTube Members / @wolfgangschannel
Ko-fi (one time donation) https://ko-fi.com/wolfgangschannel
Videos are edited with Davinci Resolve Studio. I use Affinity Photo for thumbnails and Ableton Live for audio editing.
Video gear:
Camera https://geni.us/IdnhpP (Amazon)
Main lens https://geni.us/MF3Ej (Amazon)
Secondary camera https://geni.us/aQ3l (Amazon)
Secondary lens https://geni.us/jh0Oy7Y (Amazon)
Microphone https://geni.us/tgiSqL (Amazon)
Key light https://geni.us/Gi1zE2 (Amazon)
Softbox https://geni.us/F86pM (Amazon)
Secondary light https://geni.us/aciv (Amazon)
Other stuff that I use:
Monitor https://geni.us/KUzcmcP (Amazon)
Monitor arm https://geni.us/Ei4x (Amazon)
Laptop stand https://geni.us/hG7Y39 (Amazon)
Keyboard https://geni.us/KSR6En (Amazon)
Mouse https://geni.us/JpQG (Amazon)
Audio interface https://geni.us/sdhWsC (Amazon)
As an Amazon Associate, I earn from qualifying purchases
Timestamps
00:00 Introduction
01:15 Hardware setup(s)
04:07 Software setup
06:08 Setting up Ollama
08:18 Docker Scout
09:20 Setting up Ollama (cont.)
09:44 Testing the LLMs in Open WebUI
10:41 Testing the code auto-completion
12:00 Power consumption
13:14 Setting up Ollama on the mini PC
14:11 Testing Open WebUI on the mini PC
15:14 Testing the code assistance on the mini PC
16:27 Outro
On this page of the site you can watch the video online Host Your Own AI Code Assistant with Docker, Ollama and Continue! with a duration of hours minute second in good quality, which was uploaded by the user Wolfgang's Channel 24 August 2024, share the link with friends and acquaintances, this video has already been watched 160,823 times on youtube and it was liked by 4.6 thousand viewers. Enjoy your viewing!
