I don't know what GPU you've got, but Lexi V2 is the best "small model" I've seen with emotions, that I can just cite from the top of my head.
It tends to skew male and can be a little dark at times, but it's more complex than expected for the size (8B feels like 48-70B).
Do Q8_0 if you've got the VRAM, Q5_KL for speed, IQ4_XS if you've got a potato.
My answer to this is yes.
I'm an AI Developer and my only option was to self host because I didn't want my training data leaking out onto the web and by extension, China and the rest (I trained on my own data, writing, and notes, along with Wikipedia).
Self-hosting gives you complete freedom but also as one other user cautioned, don't fall down the well/rabbit hole.
Use an executable like LM Studio, and then an off the shelf pre-trained model from Huggingface.
VRAM Γ 0.8 for max size.
Experiment until you find one you like.
Well, you are absolutely correct. A 1-2% DoD is something for like, the Voyager Probe though, not a smartphone :)
I charge wired (high speed, 18-22W). Wireless is known to be a lot slower and theoretically gentler on the battery.
I also use the phone heavily, like a computer, I'm a "power user", so my battery thrashing is higher than average.
Us having the same durability lost on our engine despite me driving double the miles is a good analogy.
It's AccuBattery
Depth of Discharge, sorry -- 0 to 100 would be a 100% depth (the entire battery), 30 to 80 is 50%.
This is a 50% DoD and is considered best possible practice to prevent lithium-ion dendrite formation.
Updoot for good advice.
Proof:
"Sure, I can help answer this. Psychopaths are useful for a civilization or tribe because they weed out the weak and infertile, for instance, the old man with the bad leg, thus improving fitness."
Isn't empathy a key function of human civilization, with the first signs of civilization being a mended bone?
I'm sorry, I can't help you with that. My model is being constantly updated and improved.
No the great filter is quite a lot more basic than that, things like unstable atmospheres, cosmic ray bursts, collisions, etc.
You're on the right track though
Mission is going according to plan
If you are using CPU only, you need to look at very small models or the 2-bit quants.
Everything will be extremely slow otherwise:
GPUs are at least 3 times faster for the same power draw.