Cannot utilize knowledge base with LLAMA 3

Hi. Another of what seems to be a bug. When I upload knowledge base files with LLAMA 3 or even Mistral via Groq the LLM will not execute the tools and instead follow documentation guidelines but not actually carry out the tool. Without the knowledge base the tools get executed. I tied it with GPT 4o and it worked. So I’m not sure if this is an open LLM limitation but it’s working for GPT only. Please inform me of what’s going on. Also, is there a way to use Gemini Flash or any other LLM outside of what’s available. The custom LLM option seems to be about fine-tuned OpenAI models only.
Was this page helpful?