Llama 3.3 70B offers similar performance compared to Llama 3.1 405B model. This model also requires less VRAM, e.g. works well on M4 64GB with a speed of 10 tokens/s. https://ollama.com/library/llama3.3 Right…
Category: Uncategorized
OpenWebUI + Ollama
Models Models keep information about existing models, allow us to modify them by adding functions, tools, system prompts, etc., or even create custom models on existing LLMs like Llama 3.x. It’s worth…
WIP: LLMs
Ollama is my preferred choice, but here I want to gather the alternatives I’ve found. mlx-lm Repo: https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/README.md it’s part of MLX:MLX is an array framework for machine learning research on Apple…
First US laws to ban AI art and gen sites
This was inevitable, but I’m not sure if it’s good the way they want to introduce it. On one hand, IP for human artists will be better protected, and users will be…
Testing the Polish Language Model Bielik: A Detailed Examination
In my recent work, I had the opportunity to test a Polish language model known as Bielik. This model, developed specifically for processing the Polish language, promises significant advancements in natural language…
Recommended reading – 2023-11-24
Virtual Threads in Spring Boot “Virtual Threads in Spring Boot are lightweight and that are managed by the Java Virtual Machine rather than the operating system. Virtual threads aim to simplify concurrent…
Recommended reading – 2023-11-07
Node.js Express Cluster vs Spring Boot: Hello World performance “Node.js Express Cluster vs Spring Boot: Hello World performance. Spring Boot using virtual threads consumes twice as much time as the Express cluster….
Recommended reading – 2023-11-02
Evaluation Driven Development, the Swiss Army Knife for RAG Pipelines “Evaluation Driven Development (EDD) is the Swiss army knife for your RAG pipelines. LlamaIndex offers a comprehensive list of options in its…
Postfix config
Few links helpful to configure postfix on vps server: https://www.hostinger.com/tutorials/how-to-install-and-setup-mail-server-on-ubuntu/ – starting point https://www.dmarcanalyzer.com/spf/how-to-create-an-spf-txt-record/ – missing part to not land in SPAM https://bobcares.com/blog/postfix-encrypt-email/ – missing default encryption (security level) missing DKIM still…
Keycloak on M1 / Tutorials
On M1 the solution for Docker image is to build own one – here is description: https://github.com/docker/for-mac/issues/5310#issuecomment-877653653 Some tutorials:https://www.youtube.com/watch?v=RhvuS1NO76o (in Polish)