Yes, I know. You’re saying that a 32GB graphics card is millionarie hardware? You’ve got a weird view of the cost of these things.
FaceDeer
Basically a deer with a human face. Despite probably being some sort of magical nature spirit, his interests are primarily in technology and politics and science fiction.
Spent many years on Reddit before joining the Threadiverse as well.
- 0 Posts
- 214 Comments
Plus, the hardware to run a full sized LLM is expensive
It’s a regular gaming PC. Are you going to dismiss all gamers as “millionaires”?
I pay for my electricity. It uses roughly the same amount of power when I’m running an LLM as it would if I was playing a game. It’s negligible.
And contrary to all the breathless headlines about water-guzzling data centers, my computer doesn’t consume any water at all when I run an LLM.
So many of the complaints I see about LLM behaviour can be so easily solved by just adding “don’t behave this way” to the prompt. Most LLM frameworks these days let you add stuff like that to the default system prompt so you don’t even have to remember to do it.
The very first comparison fails, though. I run LLMs locally on my own computer, tokens cost me nothing.
FaceDeer@fedia.ioto Programmer Humor@programming.dev•i love ai in my offline foss softwares that are still in beta1·18 days agoOkay? That’s not what the meme was about, that’s a separate thing.
FaceDeer@fedia.ioto Programmer Humor@programming.dev•i love ai in my offline foss softwares that are still in beta4·18 days agoFortunately FOSS software is often not beholden to companies or profit motives like that, and that’s specifically what this meme is about.
FaceDeer@fedia.ioto Programmer Humor@programming.dev•i love ai in my offline foss softwares that are still in beta14·19 days agoI’m not sure that this meme is using “offline” correctly. I use AI offline, which means I absolutely do know that it’s not going to “go away.” It’s running on my computer, it’s stored on my hard drive. Ten years from now I will still be able to run it regardless of what’s happened in the outside world. I welcome offline AI integration into software, that’s the best way to do it when possible.
FaceDeer@fedia.ioto Programmer Humor@programming.dev•i love ai in my offline foss softwares that are still in beta58·19 days agoCrypto bubble, not bitcoin bubble, don’t move the goalposts.
Okay, where was the crypto bubble, then? The total market capitalization for cryptocurrencies in aggregate had a significant bump in the 2021-2022 timeframe, but it’s since recovered from and far exceeded that so if that was the bubble it didn’t cause any permanent harm. BTC largely follows the overall cryptocurrency market.
As OP said, the crash of cryptocurrency has been exaggerated.
FaceDeer@fedia.ioto Programmer Humor@programming.dev•i love ai in my offline foss softwares that are still in beta64·19 days agoShh, people don’t like to hear that cryptocurrencies are still around and doing just fine.
FaceDeer@fedia.ioto Science Memes@mander.xyz•THE NEXT CLANKER BETTER DO MY GODDAMN DISHES28·1 month agoIt’s there so that all those humans who insist their lives will have no “meaning” without having to work for a living have something to work on for a living.
FaceDeer@fedia.ioto Science Memes@mander.xyz•THE NEXT CLANKER BETTER DO MY GODDAMN DISHES13·1 month agoAlways reminds me of this bit on the Conan O’Brien show.
Is that in Celsius, Fahrenheit, Rankine, Rømer, Réaumur, Delisle, Leiden, or Wedgwood?
Have you tried asking Copilot what it is?
I’m so happy that they put the 1507 borders on. Someone spent some real effort and thought on this completely pointless thing.
The black hole’s visual depiction was fine in that movie, sure. But the way the characters interacted with it still made no sense.
FaceDeer@fedia.ioto Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com•I would still download a car if I could. 🚗134·3 months agoNow make the exact same meme but substitute “AI training” for “piracy” and watch the downvotes flow in.
FaceDeer@fedia.ioto Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com•What is the recommended way to watch the Star Wars series?252·4 months agoI’m a fan of the Machete Order.
There may be some spoilers in that blog post, it’s been a while since I read it, so here it is in summary:
- A New Hope (4)
- Empire Strikes Back (5)
- Attack of the Clones (2)
- Revenge of the Sith (3)
- Return of the Jedi (5)
Phantom Menace is omitted because it’s the weakest of the prequel trilogy and everything that happens in it is summarized at the beginning of Attack of the Clones anyway. If you want to be a completionist then watch it between Empire Strikes Back and Attack of the Clones.
There’s good reasons for following this order, but it’s hard to describe them without spoiling anything. Basically, Lucas assumed you’d watched the original trilogy when he made the prequels, so it’s got a bunch of spoilers in it that the Machete Order preserves quite nicely.
But if you did randomly choose the 0% option, you’d be correct. So if one of the possible answers was 0% the correct answer would be 25%.
Going to be some wild captchas before this is all over.