selfhosted

retrieval4558, 1 year ago in Those who are self hosting at home, what case are you using? (Looking for recommendations)

I use a fractal design node 304. It’s pretty cool, but has all the limitations and problems you would expect from a case that size.

Cyber, 1 year ago in Those who are self hosting at home, what case are you using? (Looking for recommendations)

I have both Fractal Design and SilverStone cases… love them… but the internal layout is not 100% of the consideration

Have a think about airflow and cabling… some of them have weird air flow designs and if you’re putting the machine inside something, or next to something, then that can make more impact on day-to-day use.

For example, I have a Node 304 (not enough drive space for you) because it fits nicely inside Ikea shelving. But the front air flow under the front bezel did mean I keep that machine near the front of the shelf, not pushed back.

And also consider hotswap drive bay caddies that fit smaller drives into large drive bays. Sometimes these have weird power connections, but if you don’t have them do you have enough PSU leads? So, are they absolutely essential? Possibly. Possibly not…

Maybe not the answer you were lookong for, but those are my main considerations now…

jrbaconcheese, 1 year ago in Can I build a NAS out of a desktop? [Request]

Unraid as I understand it will do that

Sims, 1 year ago in How to selfhost a llm?

If low on hw then look into petals or the kobold horde frameworks. Both share models in a p2p fashion afaik.

Petals at least, lets you create private networks, so you could host some of a model on your 24/7 server, some on your laptop CPU and the rest on your laptop GPU - as an example.

Haven’t tried tho, so good luck ;)

SeriousBug, 1 year ago in Those who are self hosting at home, what case are you using? (Looking for recommendations)

I can vouch for the node 804, although I haven’t used the others so I can’t say which is the best.

Aties, 1 year ago in How to selfhost a llm?

I haven’t looked into specific apps, but I have been wanting to try various trained models and figured just self hosting jupyterhub and getting models from hugging face would be a quick and flexible way to do it

SteveDinn, 1 year ago in Those who are self hosting at home, what case are you using? (Looking for recommendations)

I am using a normal desktop case with an external usb-c 8-bay JBOD drive enclosure from Mediasonic. I’m using mdadm to combine the drives with RAID-6. I know I’m not getting the performance that I could with native SATA, but it can still saturate my 1Gbps network, so it’s good enough for serving video, audio, and some other web-based apps.

lemmyng, 1 year ago in Those who are self hosting at home, what case are you using? (Looking for recommendations)

I used a Fractal Design case for a home server in the past. Pretty happy with them.

Gimpydude, 1 year ago in First Nas Build

Here’s my advice. The most important things are that you have a free GPU slot and another PCIE slot on whatever you get. You’re going to want a GPU for transcoding when disk space gets tight. You want the extra PCIE slot for a sas card. Disk shelves are surprisingly cheap, and you can keep adding disk that way. They daisy chain.

As far as the OS, I’m partial to Unraid and Truenas but seriously, anything you are comfortable with will work.

scrubbles, 1 year ago in First Nas Build

Unraid is great, I use it daily. I grew past it in some aspects, but it’s a great starter OS.

Agree with other commenter. Don’t discount backups. Unraid is not a backup. Plan to lose all of your data someday.

bigredgiraffe, 1 year ago in First Nas Build

I don’t use unraid by my advice for everyone is that you can’t have too many backups of data that you really care about, use the 3-2-1 rule at a minimum.

Also, welcome to your new hobby you will love and hate at the same time sometimes :D

pacjo, 1 year ago in Should I use Restic, Borg, or Kopia for container backups?

For me it’s restic with creatic wrapper, apprise for notifications and some bash / systemd scripts to make it all connected.

Everything is in a config file, just as god intended.

c10l, 1 year ago in How to selfhost a llm?

It’s pretty easy with Ollama. Install it, then ollama run mistral-7b (or another model, there’s a few available ootb). ollama.ai

Another option is Llamafile. github.com/Mozilla-Ocho/llamafile

jvrava9, 1 year ago in How to selfhost a llm?

Maybe Serge would fit your use case.

hazeebabee, 1 year ago in How to selfhost a llm?

Sounds like a really cool project, sadly i dont have much knowledge to contribute. Still, what kind of issues have you run into? Any specific errors or problems?