Install 27B Local LLM on 16GB Graphics Card
My goal for this project was to install the ‘best’ large language model onto my 16GB GeForce RTX 4080 graphics card. A generic term like ‘best’ gets thrown around far too often, and so I will state for the record it means something different to everyone based on their personal needs.
Read more