The Mozilla organisation have released a way to make Large Language AI’s (think ‘ChatGPT’) into normal single-file .EXE files that will run on Windows, Mac, Linux, etc. Llamafile is open source and available now. Sample .EXE files include WizardCoder-Python-13B. Sadly though it won’t run on Windows, as that OS has a 4Gb limit on the size of .EXE files. So near, yet so far.
Llamafile – runs LLM AIs as a single .exe
04 Monday Dec 2023
Posted in Spotted in the news