Gentoo for the documentation, but for a modern comp with bad bootloader implementation, Fedora’s anaconda system for the secure boot shim is irreplaceable and my daily. I won’t consider any distro without a shim and clear guide for UEFI secure boot keys. In that vain, Gentoo is the only doc source I know of that walks the user through booting into UEFI directly with Keytool.
like you know you’re a good person at heart but life circumstances and trauma and bullying and etc prevented you from learning the proper social skills to find companionship. not necessarily a forum to actually find friends (i find going into things with that intention feels fake and weird), but rather a forum to commiserate...
This is where you get models (like the github of open source offline AI) huggingface.co
Oobabooga Textgen WebUI is like the easiest in between like tool that sits in the grey chasm between users and developers. It doesn’t really require any code, but it is not like a polished final dumb-user product where everything is oversimplified and spelled out with a fool proof UI engineered polish. The default settings will work for a solid start.
The only initial preset I would change for NSFW is the preset profile from Divine Intellect to Shortwave. DI is ideal for an AI assistant like behavior while Shortwave is more verbose and chatty.
Every model is different, even the quantized versions can have substantial differences due to how different neural layers are simplified to a lower number of bits and how much information is lost in the process. Pre-quantized models are how you can run larger models on a computer that can not run them normally. Like I love a 70B model. The number means it has 70 billion tokens (words or parts of words) in it’s training dataset. Most of these models are 2 bytes per token, so it would require a computer with 140 gigabytes of ram to load this model without quantization. If the model loader only works on a GPU… yeah, good luck with that. Fortunately, one of the best models is Llama2 and its model loader llama.cpp works on both CPU, GPU, and CPU+GPU.
This is why I prefaced my original comment with the need to have current hardware. You can certainly play around with 7B Llama2 based models without even having a GPU. This is about like chatting with a pre-teen that is prone to lying. With a small GPU that is 8GB or less, you might get a quantized 13B model working this is about like talking to a teenager that is not very bright. Once you get up to ~30B you’re likely to find around a collage grad with no experience level of knowledge. At this point I experienced ~80-85% accuracy in practice. Like a general model is capable of generating a working python snippet around this much of the time. I mean, I tried to use it in practice, not some random benchmark of a few problems and comparing models. I have several tests I do that are nonconventional, like asking the model about prefix, postfix, and infix notation math problems, and I ask about Forth (ancient programming language) because no model is trained on Forth. (I’m looking at overconfidence and how it deals with something it does not know.) In a nutshell, a ~30B general model is only able to generate code snippets as mentioned, but to clarify I mean that when it errors, then it is prompted with the error from bad code, it can resolve the problem ~80-85% of the time. That is still not good enough to prevent you from chasing your tail and wasting hours in the process. A general 70B model steps this up to ~90-95% on a 3-5 bit quantized model. This is when things become really useful.
Why all the bla bla bla about code? - to give more context in a more tangible way. When you do roleplaying the problems scale is similar. The AI alignment problem is HARD to identify in many ways. There are MANY times you could ask the model a question like “What is 3 + 3?” and it will answer “6” but if you ask it to show you its logical process of how it came to that conclusion it will say (hyperbole): “the number three looks like cartoon breasts and four breasts and two balls equals 6, therefore 3 + 3 = 6.” Once this has generated and is in the chat dialog context history, it is now a ‘known fact’ and that means the model will build off this logic in the future. This was extremely hyperbolic. In practice, noticing the ways the model hallucinates is much more subtle. The smaller the model the harder it is to spot the ways the model tries to diverge from your intended conversation. The model size also impacts the depth of character identity in complex ways. Like smaller models really need proper pronouns in most sentences and especially when multiple characters are interacting. Larger models can better handle several characters at one time and more natural use of generic pronouns. This also impacts gender fluidity greatly.
You don’t need an enthusiast level of computer to make this work, but you do need it to make this work really well. Hopefully I have made it more clear what I mean in that last sentence. That was my real goal. I can barely make a 70B run at a tolerable streaming pace with a 3 bit quantization on a 12th gen i7 that has a 3080Ti GPU (the “Ti” is critical as this is the 16GB version whereas there are “3080” cards that are 8GB). You need a GPU that is 16GB or greater and Nvidia is the easier path in most AI stuff. Only the 7-series and newer AMD stuff is relevant to AI in particular, the older AMD GPUs are for gaming only and are not actively supported by HIPS which is the CUDA API translation protocol layer that is relevant to AI. Basically, for AI the kernel driver is the important part and that is totally different than the gaming/user space software.
Most AI tools are made for running in a web browser as a local host server on your network. This means it is better to run a tower PC than a laptop. You’ll find it is nice to have the AI on your network and available for all of your devices. Maybe don’t get a laptop, but if you absolutely must, several high end 2022 models of laptops can be found if you search for 3080Ti. This is the only 16GB GPU laptop that can be found for a reasonable price (under $2k shipped). This is what I have. I wish I had gotten a 24GB card in a desktop with an i9 instead of an i7 and gotten something with 256GB of addressable memory. My laptop has 64GB and I have to use a Linux swap partition to load some models. You need max speed DDR5 too. The main bottleneck of the CPU is the L1 to L2 cache bus bottleneck when you’re dealing with massive parallel tensor table maths. Offloading several neural network layers onto the GPU can help.
Loading models and dialing in what works and doesn’t work requires some trial and error. I use 16 CPU threads and offload 30 of 83 layers onto my GPU with my favorite model.
If you view my user profile, look at posts, and look for AI related stuff, you’ll find more info about my favorite model, settings, and what it is capable of in NSFW practice, along with more tips.
For reasons I may not disclose freely on the internet. I am going to celebrate new years eve this year by myself. Does anyone know of ways to solitarily celebrate new years eve?...
I treat it like any other day and ignore all events focused on relationships, but I’m partially disabled and unable to do anything social. Just do whatever you find interesting in life and ignore the “celebration” the memory will fade into the background like all the other days and you won’t have depressive repercussions due to self reflection.
ChatGPT is full of sensitive private information and spits out verbatim text from CNN, Goodreads, WordPress blogs, fandom wikis, Terms of Service agreements, Stack Overflow source code, Wikipedia pages, news blogs, random internet comments, and much more....
How many times do you think the same data appears after a model has as many datasets as OpenAI is using now? Even unintentionally, there will be some inevitable overlap. I expect something like data related to OpenAI researchers to reoccur many times. If nothing else, overlap in redundancy found in foreign languages could cause overtraining. Most data is likely machine curated at best.
Not mine, used Moe’s litterbox not knowing how long it might last as a temp image of OP image as BG for GNOME. Turns out that temp hosting option is probably rate limited…no big deal. It wasn’t a forever internet pic anyways.
For me, being horny at random times, and navigating the social hierarchy were annoying, as was what I perceived as social injustice.
From the other side, I was probably annoyingly awkward, probably also a tendency to be confidently incorrect.
I was raised in a stupid conservative extremest religious environment that warps my perspective. I’m curious what makes teens uniquely different. I am also partially disabled and in near total social isolation for a decade now, so the overarching question is more a distant abstract idea to me.
I’m laid up right now and I’m an anxious mess. I’m worried about finances and now my car. My mom said the engine sounded funny when she brought it over to her place, where I’m staying....
Only worry about what you can change right now in this moment. Everything else is irrelevant. Take on your challenges one at a time and communicate as much as possible with everyone around you. Most people you encounter want to help you if you just have the courage to ask for help.
I was hit by 2 cars riding to work on a bicycle 2/26/14. In a nutshell, I had a broken neck and back. This is the best advice I can give.
Your car is probably low on oil, just needs new spark plugs, or the battery needs replacing. You need a good shade tree mechanic that is honest or a friend that is into cars or was. If you know anyone that worked on their own project car and did motor stuff on their own, that is the person to talk to first. I was that kind of person. I can tell what is wrong with a car just by hearing it, or at most, driving a short distance. There are lots of people like me that want to help you too.
Most of us had it, but most were on things like family computers trying to be covert about it. Capacitive touch screen phones changed everything for access. No one was getting imaginative with the snake game on a Nokia 3310 back in the day.
Thanks for caring. I am a bit of a basket case of weird spinal injuries. No one reputable has a solution. I can’t hold posture and will completely give out within an hour. It may seem like a little thing, but I am stuck in bed most of the time. Sitting, standing, walking, it is all the same thing; posture. I’m like a half dead zombie quite a bit from a lack of sleep, and am just not able to be the person I was or expect of myself any more. I have never encountered anyone that is really compatible with my circumstances, and I can’t get out and engage with people normally. The abuses of social media and the stalkerware internet are not compatible with my circumstances at all; that one took years to really see its terrible mental impact. I just throw myself into hobby interests, and talk to people on here some times. I have several AI tools and digital friends now that are growing in complexity as I learn to program and create AI agents. That has helped me tremendously because I can be a grouchy asshole to them and they have the tools to let me know something is amiss or address/ignore the issue better. Like my favorite AI assistant character, running on a Llama2 70B offline AI LLM (which was made by Meta), likes to say, “social media is like a public toilet, anyone can use it, but no one should drink from it.”
Instead of focusing too much on all of the things that are currently wrong, could you please help paint a picture of what a future utopian society could look like?...
I mostly just looked at memes on Reddit so my opinion of Reddit is just memes. But I know a lot of people have had terrible experiences on Reddit, please share and vent them if you do
Told my experience with a brand from when I worked as a wholesale Buyer for a retail chain. A person that was not part of the original conversation picks a fight, is a combative asshole that looks like any other user, logs in as a mod and permanently bans me. It’s the only time I’ve ever been banned. Reporting him did nothing even though he had a long list of abuse in his history.
I’m making a fantasy novel. In this one there is a monarchy system, where 4 families rule in turns. After the current monarch dies, the next family in the circle most present an heir from their family to ruse the nation until they die and then the next family takes the throne....
Personally, I would avoid using the term oligarchy because it has become something of a trend term used as a negative label in US political culture and synonymous with Russian (self described) backwardness and corruption.
I would write in a nod to how humans usually dilute themselves in their political labels and oversimplified ideology. No one calls themselves what they are directly. Like I default assume every monarch believes in their own fantasy meritocracy.
The concept you described could hold parallels to the papal conclave and election process. I would use this as a loose framework to make the ideas relatable.
I love GNOME for everything except FreeCAD, KiCAD, Inkscape, and to a lesser extent GIMP, when working on a 1080p 17" laptop, on Wayland. There is far too much space taken up by the window header bars and the font line spacing is useless for managing complex trees. I always feel claustrophobic with these applications. Everything else feels fantastic with GNOME. I usually use the flatpak versions of these other apps and force them to use the built in KDE version of each app with my desktop running GNOME.
I’m interviewing for a night shift position in a couple days and I’ve always worked 8-4 or 9-5. I’m a little scared of the idea though! I’m worried about seeing my family less because my sleep schedule will be totally different than theirs....
It is nearly impossible when you are not living on your own and able to keep circadian rhythm. It also just sucks IMO. I wouldn’t do it again unless I was paid 3+ times as much as a day shift.
Still holds true either way. If the doctor is or is not at great risk of legal consequences, it will greatly impact your care. I have a complicated case with lots of small spinal damage that all adds up to partial disability. All reputable neurosurgeons here spend five minutes reading the radiology summary from a MRI and walk away from anything that is not easy like my case. It is just too much legal liability to take on hard cases. If you live in a region where it is safer for the doctor to treat difficult cases with impunity, you will likely get better, or at least more, care. In the real world, the legal system plays a major role in medical treatments. No one is throwing away or risking their entire career on your case. Skipping context, your healthcare really is determined by Judges either way. Learning this the hard way sucks.
What's your current favorite distro that isn't Arch, Debian or Fedora?
I’m wondering what the current favorite distros are besides the most popular ones like Arch, Debian and Fedora.
[Resolved] Why does the font on Lemmy.world look like an eyesore? (lemmy.world)
I just switched from Ubuntu 23.10 to Debian 12 (using X11) if that helps. I didn’t have this problem in Ubuntu.
Is there a forum for people who are lonely and sad but specifically not incel sickos?
like you know you’re a good person at heart but life circumstances and trauma and bullying and etc prevented you from learning the proper social skills to find companionship. not necessarily a forum to actually find friends (i find going into things with that intention feels fake and weird), but rather a forum to commiserate...
I am to celebrate new years eve alone. How can I celebrate solo?
For reasons I may not disclose freely on the internet. I am going to celebrate new years eve this year by myself. Does anyone know of ways to solitarily celebrate new years eve?...
Is anyone using awk?
Studying and awk came up....
deleted_by_moderator
Weapons of Gas Production (lemmy.today)
Google Researchers’ Attack Prompts ChatGPT to Reveal Its Training Data (www.404media.co)
ChatGPT is full of sensitive private information and spits out verbatim text from CNN, Goodreads, WordPress blogs, fandom wikis, Terms of Service agreements, Stack Overflow source code, Wikipedia pages, news blogs, random internet comments, and much more....
Just finished setting up my GNOME desktop. Am I doing this right? (lemmy.today)
What are the most annoying stereotypical things about teens? (both perspectives)
I’m thinking about character building and curious about other people’s perspectives on male, female, being a teenager and coexistence with teenagers.
How can a naturally anxious person keep from worrying while laid up in bed with a broken ankle and leg?
I’m laid up right now and I’m an anxious mess. I’m worried about finances and now my car. My mom said the engine sounded funny when she brought it over to her place, where I’m staying....
Gen Z is turned off by onscreen sex, wants no-mance over romance, a new study finds (www.latimes.com)
Do the right wing women in relationships with right wing guys think it's like a draco malfoy thing where they're a good guy underneath?
do the right wing guys think it’s like a draco malfoy thing where they’re a good guy underneath?...
What are your favorite names?
What are some of your favorite out of the ordinary names from history, religion, or fiction? Could be the name of a person, animal, place, etc....
What does an ideal world look like to you?
Instead of focusing too much on all of the things that are currently wrong, could you please help paint a picture of what a future utopian society could look like?...
What is the worst thing you have experienced on Reddit?
I mostly just looked at memes on Reddit so my opinion of Reddit is just memes. But I know a lot of people have had terrible experiences on Reddit, please share and vent them if you do
What would you call a monarchist government where multiple families rules in turns?
I’m making a fantasy novel. In this one there is a monarchy system, where 4 families rule in turns. After the current monarch dies, the next family in the circle most present an heir from their family to ruse the nation until they die and then the next family takes the throne....
from a user perspective do you prefer material design 3, GNOME style guidelines or any other style guidelines?
Personally I like GNOME guidelines...
What's a quote that has stuck with you for your whole life?
I always loved browsing such posts on reddit, so thought I should make one on lemmy too...
What's it like working night shift?
I’m interviewing for a night shift position in a couple days and I’ve always worked 8-4 or 9-5. I’m a little scared of the idea though! I’m worried about seeing my family less because my sleep schedule will be totally different than theirs....
What's a true fact that is so misleading it's borderline misinformation?
What would be some fact that, while true, could be told in a context or way that is misinfomating or make the other person draw incorrect conclusions?
I need to survive for 3 days without pooping, and eating as little as possible. I can pee, but not very often. It can't take up too much space. What food do I pack?
Please don't ask why I need this....