minnixMA to The Linux Lugcast PodcastEnglish • 18 days agoExploring Llamafile: Mozilla's Attempt in the World of Open Source AIitsfoss.comexternal-linkmessage-square4arrow-up110arrow-down10
arrow-up110arrow-down1external-linkExploring Llamafile: Mozilla's Attempt in the World of Open Source AIitsfoss.comminnixMA to The Linux Lugcast PodcastEnglish • 18 days agomessage-square4
minus-squareJackGreenEarthlinkfedilinkEnglish1•12 days agoYou can run many 7B models on phones with 8GB RAM
minus-square🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖linkfedilinkEnglish3•11 days agoI find the 7b models dont have the capabilities id like and i cant image the tokens per second would be very good.
minus-squareminnixOPMAlinkEnglish2•11 days agoYeah running it and it actually being useful are two very different things.
You can run many 7B models on phones with 8GB RAM
I find the 7b models dont have the capabilities id like and i cant image the tokens per second would be very good.
Yeah running it and it actually being useful are two very different things.