-
Bonsai 27 B on old GPU’s
Primarily using Qwen3:8b for analysis on a 3080 Ti GPU, exploring larger models with improved performance. After significant installation challenges with Bonsai:27B, I achieved satisfactory results, balancing memory requirements and processing speed across both GPUs. Read More
-
Speeding Up Ollama
Discuss optimizing performance while managing tasks with limited GPU resources. I implemented a continuous job queue and a web interface to prioritize tasks with the Hermes Agent. Future enhancements include automating document processing and utilizing different models for varied tasks. Read More