sabreW4K3@lazysoci.al to Linux@lemmy.ml · 5 months agoJolla's Sailfish OS is moving to a subscription model, new phone (and a privacy-focused AI device) coming soon - Liliputingliliputing.comexternal-linkmessage-square36fedilinkarrow-up1110arrow-down111cross-posted to: linux_lugcast
arrow-up199arrow-down1external-linkJolla's Sailfish OS is moving to a subscription model, new phone (and a privacy-focused AI device) coming soon - Liliputingliliputing.comsabreW4K3@lazysoci.al to Linux@lemmy.ml · 5 months agomessage-square36fedilinkcross-posted to: linux_lugcast
minus-squareDiabolo96@lemmy.dbzer0.comlinkfedilinkarrow-up9arrow-down1·edit-25 months agoThe ai box is 700$ ? Who’s gonna buy it? Anyway, If you anyone want to run local llm on their own phone then try 4bit quantized phi-3.
minus-squareDiabolo96@lemmy.dbzer0.comlinkfedilinkarrow-up2·edit-25 months agohttps://l.opnxng.com/r/LocalLLaMA/comments/1ce4300/phi3_works_under_laylalite_on_android/ Or https://llm.mlc.ai/docs/get_started/quick_start.html
The ai box is 700$ ? Who’s gonna buy it? Anyway, If you anyone want to run local llm on their own phone then try 4bit quantized phi-3.
With what app? How?
https://l.opnxng.com/r/LocalLLaMA/comments/1ce4300/phi3_works_under_laylalite_on_android/
Or
https://llm.mlc.ai/docs/get_started/quick_start.html