• 1 Post
  • 42 Comments
Joined 1 year ago
cake
Cake day: July 1st, 2023

help-circle

  • Hey @brucethemoose hope you don’t mind if I ding you one more time. Today I loaded up with qwen 14b and 32b. Yes, 32B (Q3_KS). I didn’t do much testing with 14B but it spoke well and fast. Was more excited to play with the 32B once I found out it would run to be honest. It just barely makes the mark of tolerable speed just under 2T/s (really more like 1.7 with some context loaded in). I really do mean barely, the people who think 5t/s is slow would eat their heart out. However that reasoning and coherence though? Off the charts. I like the way it speaks more than mistral small too. So wow just wow is all I can say. Can’t believe all the good models that came out in such a short time and leaps made in the past two months. Thank you again for recommending qwen don’t think I would have tried the 32B without your input.



  • Thanks for the recommendation. Today I tried out Mistral Small IQ4_XS in combination with running kobold through a headless terminal environment to squeeze out that last bit of vram. With that, the GPU layers offloaded were able to be bumped up from 28 to 34. The token speed went up from 2.7t/s to 3.7t/s which is like a 50% speed increase. I imagine going to Q3 would get things even faster or allow for a bump in context size.

    I appreciate you recommending Qwen too, ill look into it.








  • I like that I can somewhat recognize usernames across all the lemmy post I comment in. Im not sure if anyone really notices me or recognizes my username and goes ‘Oh hey its smokeydope again’ but I do that for some other active lemmy users and it starts to feel like we are all acquaintances working together to make an interesting experience for eachother and not just competing for attention without adknowledging eachother.



  • I blocked all the news communities for this reason. Just go down your feed and look at the name of the community and if the post or community isnt what you want to see or interested in than block it. Ive been doing that and my feed has improved dramatically. Theres only so much depressing stuff im willing to expose myself to, some people get off on the emotional charge seeing that kind of news, not me though.




  • Glad to have helped you out. Whatever you decide to get, I highly recommend you give Linux Mint a try next. I started with ubuntu, went to mint and haven’t looked back since. Its been my daily driver for half a decade now and has worked absolutely perfectly with every laptop and desktop ive ever owned. My elderly parents use mint without issue every day.

    A quick cheat sheet for understanding computer spec lingo:

    Ram:

    4gb = bare minimum

    8gb = pretty good

    16gb = awesome

    Intel CPU cores:

    duo/two cores = bare minimum

    quad core/four cores = pretty good, most common

    more = awesome

    Intel CPU processor

    i3 = bare minimum

    i5 = pretty good

    i7 = awesome

    Intel CPU processing speed measured in gigahertz ghz

    2.x ghz = average

    3.x ghz = awesome

    hard drive

    HDD = Slower and more limited lifespan but ok, tends to be higher storage space than SSD for cheaper

    SSD = Faster and much longer lifespan, usually only goes up to 256GB but its possible to find 512GB. More expensive than HHDs

    Harddrive Storage Space

    100GB = bare minimum

    256GB = average

    512GB = pretty good

    1TB = Awesome

    Upgrading

    You can have a computer shop upgrade harddrives to a multi terabyte SSD as well as replace the batteries for you if you do your research and provide it for them.

    Another big win for thinkpads is theres lots of documentation on upgrading, and you can order official parts right from lenovo vendors through their website Which is huge for replacing batteries when they degrade to the point of annoyance. Thinkpads have an external battery and an internal one both you can replace to get supposedly about 10 hours of battery life. I get like 3 at this point so I may be considering this option soon. The Linux command TLP can help you get a good estimate on how degraded your batteries are.

    Anyways Good luck!


  • It depends on what you expect your laptop to do. 8gb ram and a 2.4ghz i5 quad core processor is acceptable for almost any computing task out side of playing heavier load video games or specialty IT stuff like LLMs or cryptomining. If your main concern is video games go with the base model steam deck. Also, when you go check out listing for used think pads you will find they contain wildly different specs even if they are the same series. This is because the companies that bought them new X years ago spend some sweet corporate cash on decking them out with the at-the-time highest end options ordered custom from lenovo, and then they throw them in the literal trash a decade later. Some people who dig them out and resell on facebook don’t know a thing about computers and think they are only worth the base options used price.


  • Old thinkpads are the golden standard of Linux compatible laptops, far superior build quality compared to the crap they put out today. Cheap and durable, if a little outdated in specs. TLP is a popular battery management tool that have specific built integration with thinkpads. I managed to snag a couple thinkpads through FB marketplace pre covid for under 200$ each, my daily driver being a t460 made in 2015. i7 quad core processor, 16gb ram, its weakest link is the Intel onboard GPU. The newer thinkpads let you use thunderbolt 3.0 to plug in an external GPU but there’s a trade off between how new a thinkpad is and its build quality. The old ones could be used as body armor plates and probably stop a 50 cal bullet and boot up fine afterwards, the new ones not much