Running LLMs Offline

Interested in running a large language model locally? Use this section to document your experience setting up models like Llama or Mistral on a personal computer. Include hardware considerations, performance tips and lessons learned.