Tag: llm
Are Open Source LLMs Energy Efficient?
Overview: I use Ollama to run open source LLM models with various data sources to ask questions and include cited sources. If you would like to try this out on your machine (or try out any of the other examples) you can clone the following github repository: https://github.com/jbsoftware-io/gen-ai-starter Model Used: Mistral:7b Data Source: Web (Brave…