I’m running ollama with llama3.2:1b smollm, all-minilm, moondream, and more. I am able to integrate it with coder/code-server, vscode, vscodium, page assist, cli, and also created a discord ai user.
I’m an infrastructure and automation guy, not a developer so much. Although my field is technically devops.
Now, I hear that some llms have “tools.” How do I use them? How do I find a list of tools for a model?
I don’t think I can simply prompt “Hi llama3.2, list your tools.” Is this part of prompt engineering?
What, do you take a model and retrain it or something?
Anybody able to point me in the right direction?
Very nice rough answer i’ll check it out. . Thank you!
Of my many projects, currently for vs code (to actively exclude microsoft in my infrastructure), I’m using containerized code-server with the vscode-llama extension and a docker client. on my win 10 laptop (sorry, moving off windows at end of win10 support) i mapped the extension’s FIM “on” toggle by nesting a wsl call which nests a docker run --rm command which nests an ephemeral llama-cpp container for the AI calls. Docker engine running in wsl with ports forwarded from host/wsl vm.
Why? Portable, cross-platform and partially ephemeral dev environment with minimal dependencies.
I might even get a terraform tofu module for this eventually.
I have a small attention span 💀.