The latest updates to the Ollama 0.3.0 and Llama 3.1 platforms have brought forth a significant enhancement – the ability to utilize external tools within their frameworks. It has already been implemented in the Python version of Langchain. It’s likely that a similar addition will soon be made to the Java-based Langchain4j project, as indicated by issue #1525 on its GitHub page (https://github.com/langchain4j/langchain4j/issues/1525).
For those seeking alternatives in the realm of Java, another viable option exists. The Parakeet4j project has been successfully utilizing tools from Ollama since nearly its release day. This Java solution is detailed in a document on their GitHub page (https://github.com/parakeet-nest/parakeet4j/blob/main/docs/05-function-calling-with-tools.md).