lemux
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
minnixMA to The Linux Lugcast PodcastEnglish · 8 months ago

Exploring Llamafile: Mozilla's Attempt in the World of Open Source AI

itsfoss.com

external-link
message-square
4
fedilink
11
external-link

Exploring Llamafile: Mozilla's Attempt in the World of Open Source AI

itsfoss.com

minnixMA to The Linux Lugcast PodcastEnglish · 8 months ago
message-square
4
fedilink
Now Mozilla tries to make running LLMs easier with Llamafile project. Here's my experience with it.
  • 🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee
    link
    fedilink
    English
    arrow-up
    3
    ·
    8 months ago

    I find the 7b models dont have the capabilities id like and i cant image the tokens per second would be very good.

    • minnixOPMA
      link
      fedilink
      English
      arrow-up
      2
      ·
      8 months ago

      Yeah running it and it actually being useful are two very different things.

The Linux Lugcast Podcast

linux_lugcast

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !linux_lugcast@lemux.minnix.dev

website: https://www.linuxlugcast.com/

mumble chat: lugcast.minnix.dev in the lugcast room

email: feedback@linuxlugcast.com

matrix room: https://matrix.to/#/#lugcast:minnix.dev

youtube: https://www.youtube.com/@thelinuxlugcast/videos

peertube: https://nightshift.minnix.dev/c/linux_lugcast/videos

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 2 users / day
  • 1 user / week
  • 2 users / month
  • 175 users / 6 months
  • 9 local subscribers
  • 195 subscribers
  • 671 Posts
  • 317 Comments
  • Modlog
  • mods:
  • minnix
  • Honkeymagoo
  • BE: 0.19.4
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org