From the same member

Videos » Can you run an AI LLM on an old server?

Can you run an AI LLM on an old server?

Posted by admin
Old servers are cheap, especially the memory meaning you can get a lot of RAM at a low cost. Does this make it viable to run AI language models at a low cost? Ollama: https://github.com/jmorganca/ollama Issue relating to AVX: https://github.com/jmorganca/ollama/issues/644 PDF for the server I have: https://www.bargainhardware.co.uk/media/quick-specs/rack-servers/fujitsu_tx200_s6_quick_specs.pdf
Posted Apr 21
click to rate

Embed  |  77 views