I've run some local llms (3060, 12g vram), and I daily generate images locally (wouldn't pay for that), but I do pay for a chatgpt subscription. I think it's worth it for my purposes. Responses are way faster and higher quality than any local model I've tried, web search integration, image recognition, mobile app seamless, I use all of those features regularly. Unfortunately I've never ver used POE so I can't compare, sorry.
this post was submitted on 14 Oct 2024
10 points (72.7% liked)
Asklemmy
43591 readers
1202 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy π
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- [email protected]: a community for finding communities
~Icon~ ~by~ ~@Double_[email protected]~
founded 5 years ago
MODERATORS
Don't get chatgpt plus, just get an API token and use one of the desktop apps/CLIs, it's pay as you go and way cheaper unless you're using gpt 4 all day every day or something
Honestly, all of the generative AI subscriptions are pretty fucking steep at this point compared to just running a model locally.
I agree with this. I'm using a 1070ti for image gen and it would be more than capable for handling some LLM stuff. An AMD 7700xt ive found dors well with 7B models on my main rig but im sure you could get away with somthing cheaper or less powerful.
That said, the amount of text you can genrate or the context length of its answers will depend the model you use and the larger the model, the more power it takes.
If youre just messing around with it or want it to review or answer small questions, I'd say a 1070ti like I'm using would be just fine. Some folks use even more budget friendly options. If you got a gaming machine with any semi recent GPU, I'd say go for it. Worst case, you can pay for a subscription later if you really want.
Download gpt4all and you can get an open source model that performs basically as good as any of the paid ones.
I canceled my ChatGPT subscription a month or two ago. It just got completely unreliable. Like someone else said, Claude is way better but theyβre both disappointing at this point. I only subscribed to Claude like last week to help solve an incredibly last minute thing. Not sure Iβm going to stay subscribed.
Claude.ai is quite a bit superior to GPT in my experience. That one, I pay for, and it seems like it's worth it.
Maybe check out Kagi's ultimate tier. They let you swap between some of the different options to see which you might find useful. As a bonus you also get kagi search which can be useful.
FWIW I only ever used those services if they accepted a prepaid credit card. OpenAI didn't accept prepaid cards when I tried, not sure about Poe. Just something to think about.