selfhosted

This magazine is from a federated server and may be incomplete. Browse more on the original instance.

Aties, in How to selfhost a llm?

I haven’t looked into specific apps, but I have been wanting to try various trained models and figured just self hosting jupyterhub and getting models from hugging face would be a quick and flexible way to do it

themachine, in Could someone explain how to set up a lemmy instance with ansible for an absolute beginner

You tried what exactly earlier today?

Sheeple, (edited )
@Sheeple@lemmy.world avatar

deleted_by_author

  • Loading...
  • arudesalad,

    No I didn’t

    WhiteOakBayou,

    Needlessly dismissive for someone who needs help. Yes he is probably in over his head but who hasn’t been.

    Sheeple, (edited )
    @Sheeple@lemmy.world avatar

    …that was meant to be a joke. I had a gut feeling I should have used a tone indicator. My bad

    arudesalad,

    I was following the steps on the Lemmy-ansible github page

    RCTreeFiddy,

    And which step in this process did you get stuck, and what were the errors, if any?

    You gotta give us some more info here.

    arudesalad, (edited )

    Step 7. I dont have the errors now but I don’t think I had ansible or ssh set up correctly

    I dont really understand it as this is the first thing I am trying to selfhost other than a minecraft server.

    RCTreeFiddy, (edited )

    SSH may be installed on the pi but may need to be enabled. That was the second to last bullet point in the requirements. The final on being to install Ansible. If you did not get the requirements taken care of, installation will not be successful.

    Please first try to SSH into your pi. Once you have that done, you should install Ansible. After that, you should be able to run the playbook from step 7 and we can proceed from there.

    arudesalad,

    Do I do that from my normal pc? I’ve never used ssh before

    RCTreeFiddy,

    I’m not trying to be mean, but I think you might be trying to jump straight into the deep end before learning to swim. While the commands have been included in the guide in order for you to be able to install this, it really does help to understand what those commands do, and what they mean. I suggest first getting to know your pi a little bit better, learning how to get SSH going on that and then moving on to installing Ansible. There’s information on the raspberry pie website on how to get SSH enabled on your pi.

    arudesalad,

    Alright, thanks for trying to help. Will I need ssh on my main pc to get it to work on my pi?

    RCTreeFiddy, (edited )

    No not really. You first enable it on the raspberry pie. Then you access your raspberry pie from your normal computer by running this command in your command line or shell: ssh user@1.2.3.4 where ‘user’ is your raspberry pi user (pi by default), and ‘1.2.3.4’ is the ip address of the pi.

    muntedcrocodile,
    @muntedcrocodile@lemmy.world avatar

    Bold of u to assumw they are using linux as there main pc os. If they are using windows i beleive it doesnt come with an ssh client.

    PeachMan,
    @PeachMan@lemmy.world avatar

    You can SSH using command line. I do have a Windows Pro license, but I THINK that it’s not exclusive to Pro…

    muntedcrocodile,
    @muntedcrocodile@lemmy.world avatar

    Huh i vagly remember needing putty but i havnt used windows in almost 5years now.

    PeachMan,
    @PeachMan@lemmy.world avatar

    Yeah I also installed putty a long time ago, I forget if it was actually necessary or if I was just afraid of command line back then.

    southsamurai,
    @southsamurai@sh.itjust.works avatar

    Yeah, legit, I’ve messed around with this kind of thing before, and I wouldn’t attempt to run lemmy myself. Major pain in the ass.

    RCTreeFiddy,

    It should already be there if it’s a Win or Linux, you just need to enable SSH on the pi, then you can remote into it by running this from a command line / shell:

    ssh pi@1.2.3.4

    Where ‘pi’ is your user on your pi, and ‘1.2.3.4’ is the IP address or hostname for the pi.

    Just want to add too that installing and hosting something like Lemmy is not really a beginner task. I’m not trying to discourage, quite the opposite. You should just know this will be a challenging endeavor, but will be rewarding once you do complete it, and you will learn a lot in the process.

    arudesalad,

    Also in the comment this one is replying to, I meant to say set up correctly

    themachine,

    And what exactly happens?

    arudesalad,

    I’ve replied to a different comment in this thread about what happened already

    themachine,

    This it should be no issue for you to copy and paste that answer in our conversation.

    PeachMan,
    @PeachMan@lemmy.world avatar

    Lol. It should also be no issue for you to find the comment and read their answer

    CosmicApe,
    @CosmicApe@kbin.social avatar

    They're asking for quite detailed help for a reasonably difficult project, the least they can do is supply all the info to the people trying to help.

    arudesalad,
    themachine,

    If I’m supposed to be reading that top comment I don’t see where you state what your results were. You apparently “had errrors” but neglected to note any down and now “you don’t” have errors.

    turkishmonky, in Those who are self hosting at home, what case are you using? (Looking for recommendations)

    I’m using a NetApp ds4246 to hold 24 drives, and it’s glorious - embrace the rack mount life. Although my computers themselves are all HP Prodesk minis, which are tiny and amazing, 1 u high and can fit two across on a shelf.

    Dalraz,

    I have been looking to do this as well, I’m just not 100% sure how it all connects together. Do you have the disk shelf connect to a server with lots of sas cards?

    turkishmonky,

    You just need one it mode hba sas controller with an external out, and probably a conversion cable from 8088 to netapp’s 8436.

    You can daisy chain shelves if needed, and I think you can use a second sas card for active failover but I haven’t tried it.

    Dalraz,

    Oh, i thought a single sas port could only do 8 sata drives. Interesting

    lemmyvore, in Those who are self hosting at home, what case are you using? (Looking for recommendations)

    Fractal Design, definitely. The model I’m using is no longer made but they have very good ones today too. Look into the Define and Meshify lines. They have models that can utilize the full height of the case for HDD/SSD slots with openings on both sides for maximum ease of cable routing.

    The Define 7 or Meshify 2 is most likely what you want. They only come with 6 HDD brackets included but you can buy more and they have slots for up to 11.

    The R5 is another good choice, I like those brackets more, but it’s not so flexible as the others I mentioned, and the 5.25" bays will most likely go unused and just take up space.

    Don’t get the Node 804, it’s much larger than it seems (check out yt videos) and is cramped and hard to work in.

    humancrayon,
    @humancrayon@sh.itjust.works avatar

    I second the R5 case. I have one for my NAS and it’s been a dream to work in.

    Gormadt,
    @Gormadt@lemmy.blahaj.zone avatar

    I’ve currently got the Meshify C (not the 2) for my main gaming rig and I’ve dug it the whole time I’ve had it; looking at the drive mounting for the Meshify 2 makes me really want it for sure as that looks really convenient

    The more I looked at the Node 804 since I made this post the less I liked it

    NGL I wish their North line of cases had more slots for HDDs

    EncryptKeeper,

    I have the Meshify 2 and I highly recommend it.

    LufyCZ,

    The R5 is amazing, though yeah the 5.25" bays are kinda a waste.

    I found a thingy though that fits into the bay and houses 6 2.5" SSDs, it’s pretty cool!

    lemmyvore,

    Yeah I expect acting as SSD bays could become popular in the future if SSD prices drop low enough. Although they might be M.2 bays by then.

    I have a bunch of old 60 GB 2.5" SSDs around but they’re so small it’s not worth bothering to set up an array of them. Plus they’re more useful individually for stuff like upgrading an old laptop, portable USB storage or installing Windows the one time in three years I need it.

    In the meantime I’ve liberated the 2x HDD cage from a Define C Mini’s shroud and mounted it on the floor in a fan slot.

    Sev5000, in Those who are self hosting at home, what case are you using? (Looking for recommendations)

    Jonsbo N3 sounds like a good fit

    Gormadt,
    @Gormadt@lemmy.blahaj.zone avatar

    If only there was an ATX or mATX version

    Looks hella nice though

    SteveDinn, in Those who are self hosting at home, what case are you using? (Looking for recommendations)
    @SteveDinn@lemmy.ca avatar

    I am using a normal desktop case with an external usb-c 8-bay JBOD drive enclosure from Mediasonic. I’m using mdadm to combine the drives with RAID-6. I know I’m not getting the performance that I could with native SATA, but it can still saturate my 1Gbps network, so it’s good enough for serving video, audio, and some other web-based apps.

    lemmyng, in Those who are self hosting at home, what case are you using? (Looking for recommendations)

    I used a Fractal Design case for a home server in the past. Pretty happy with them.

    zelifcam, (edited ) in First Nas Build
    @zelifcam@lemmy.world avatar

    deleted_by_author

  • Loading...
  • null,

    Well said.

    The spirit of Self-Hosting is trying things and then asking specific questions when you get stuck (stuck includes having no luck using a search engine).

    fahad,

    I apologise for not being clear.

    These are the specs of my NAS build:

    • Node 804 case
    • 16GB DDR4 RAM
    • Seagate IronWolf Pro 2x 4TB
    • 1TB nvme Samsung 970 evo plus
    • Gigabyte H610M S2H V2 Intel H610 LGA1200 DDR4 Micro-ATX Motherboardd
    • DeepCool GAMMAXX GT CPU Cooler A-RGB 120mm PWM Addressable RGB LED Fan Intel AMD
    • 500W EVGA Power Supply Unit / PSU VAT INC
    • Intel core i5-12400t QS 6c/12t Support ASUS ROG Strix B660-I Gaming WiFi LGA1700.
    • I want to store all data onto the NAS, past projects, pics, etc.
    • Set up automatic backups for Windows, Mac
    • Set up media server (Jellyfin) with Arr apps using a VPN (I’m not sure how to set up a VPN with torrent client)
    • Set up headscale to access my NAS from anywhere (also, I can’t find any tutorials).
    • For 3-2-1 backups, I have decided to get an external HDD and use cloud storage.
    • Self-host services such as Nextcloud, Immich and Bitwarden.
    • VMs - Future
    • Web hosting - Future
    • Home assistant - Future

    To be clear, I want to do all that; however, I have never done it before, so that any tutorials would be appreciated.

    By “Dos and Don’ts,” I’m referring to the settings that should be adjusted for optimal performance, security, and privacy.

    Also, any other recommendations would be appreciated.

    HumanPerson,

    Please let me know what you find for jellyfin with arrs and VPN. I have found that the VPN always interferes with jellyfin and other stuff and haven’t been able to figure out gluetun.

    Lem453, (edited )
    
    <span style="color:#323232;">
    </span><span style="color:#63a35c;">version</span><span style="color:#323232;">: </span><span style="color:#183691;">"3.4"
    </span><span style="color:#323232;">
    </span><span style="color:#63a35c;">volumes</span><span style="color:#323232;">:
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">sonarr-config</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">sonarr-config
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.25,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/zfspool1/dockerData/arr-stack/sonarr
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">radarr-config</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">radarr-config
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.25,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/zfspool1/dockerData/arr-stack/radarr
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">prowlarr-config</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">prowlarr-config
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.25,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/zfspool1/dockerData/arr-stack/prowlarr
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">sabnzbd-config</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">sabnzbd-config
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.25,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/zfspool1/dockerData/arr-stack/sabnzbd
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">qbittorrent-config</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">qbittorrent-config
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.25,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/zfspool1/dockerData/arr-stack/qbittorrent
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">media-tv</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">media-tv
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.31,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/mnt/user/media/TV Shows
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">media-movies</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">media-movies
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.31,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/mnt/user/media/Movies
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">media-downloads</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">media-downloads
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">driver_opts</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">type</span><span style="color:#323232;">: </span><span style="color:#183691;">nfs
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">o</span><span style="color:#323232;">: </span><span style="color:#183691;">addr=192.168.37.31,nolock,soft,rw
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">device</span><span style="color:#323232;">: </span><span style="color:#183691;">:/mnt/user/downloads
    </span><span style="color:#323232;">
    </span><span style="color:#63a35c;">networks</span><span style="color:#323232;">:
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">traefik_proxy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">name</span><span style="color:#323232;">: </span><span style="color:#183691;">traefik_proxy
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">external</span><span style="color:#323232;">: </span><span style="color:#0086b3;">true
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">
    </span><span style="color:#63a35c;">services</span><span style="color:#323232;">:
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">arr-stack-gluetun</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">container_name</span><span style="color:#323232;">: </span><span style="color:#183691;">arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">hostname</span><span style="color:#323232;">: </span><span style="color:#183691;">arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">image</span><span style="color:#323232;">: </span><span style="color:#183691;">qmcgaw/gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">deploy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">resources</span><span style="color:#323232;">:
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">limits</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'4'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">4G
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">reservations</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'2'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">1G
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">cap_add</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">NET_ADMIN
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">restart</span><span style="color:#323232;">: </span><span style="color:#183691;">unless-stopped
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">env_file</span><span style="color:#323232;">:
    </span><span style="color:#323232;">       - </span><span style="color:#183691;">../stack.env </span><span style="font-style:italic;color:#969896;">#get mullvad key from here "WIREGUARD_PRIVATE_KEY", "WIREGUARD_ADDRESSES", "SERVER_CITIES"
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">networks</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># only this container needs access to the proxy network. It also doesn't need any ports exposed to access
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># the other services like qbit, etc. Traefik points to this container and because the other services use
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># the service network type they can be accessed through here. 
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">traefik_proxy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">ipv4_address</span><span style="color:#323232;">: </span><span style="color:#0086b3;">172.18.0.6
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">environment</span><span style="color:#323232;">:
    </span><span style="color:#323232;"> 
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">VPN_SERVICE_PROVIDER=private internet access
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">OPENVPN_USER=xxxxxxxxz
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">SERVER_HOSTNAMES=lu.privacy.network
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">TZ=America/Chicago
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">labels</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.enable=true"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.docker.network=traefik_proxy"
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># qbittorrent traefik labels
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-qbittorrent.entrypoints=websecure"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-qbittorrent.rule=Host(`torrent.local.domain.com`)"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-qbittorrent.tls=true"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-qbittorrent.service=arr-stack-qbittorrent"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.services.arr-stack-qbittorrent.loadbalancer.server.port=8085"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-qbittorrent.middlewares=authentik"
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># prowlarr traefik labels
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-prowlarr.entrypoints=websecure"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-prowlarr.rule=Host(`prowlarr.local.domain.com`)"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-prowlarr.tls=true"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-prowlarr.service=arr-stack-prowlarr"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.services.arr-stack-prowlarr.loadbalancer.server.port=9696"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-prowlarr.middlewares=authentik"
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># sabnzbd traefik labels
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sabnzbd.entrypoints=websecure"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sabnzbd.rule=Host(`sabnzbd.local.domain.com`)"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sabnzbd.tls=true"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sabnzbd.service=arr-stack-sabnzbd"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.services.arr-stack-sabnzbd.loadbalancer.server.port=8080"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sabnzbd.middlewares=authentik"
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># sonarr traefik labels
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sonarr.entrypoints=websecure"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sonarr.rule=Host(`sonarr.local.domain.com`)"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sonarr.tls=true"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sonarr.service=arr-stack-sonarr"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.services.arr-stack-sonarr.loadbalancer.server.port=8989"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-sonarr.middlewares=authentik"
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;"># radarr traefik labels
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-radarr.entrypoints=websecure"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-radarr.rule=Host(`radarr.local.domain.com`)"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-radarr.tls=true"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-radarr.service=arr-stack-radarr"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.services.arr-stack-radarr.loadbalancer.server.port=7878"
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">"traefik.http.routers.arr-stack-radarr.middlewares=authentik"
    </span><span style="color:#323232;">    
    </span><span style="color:#323232;">  </span><span style="font-style:italic;color:#969896;"># _____________________________Downloaders__________________________
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">arr-stack-qbittorrent</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">image</span><span style="color:#323232;">: </span><span style="color:#183691;">ghcr.io/linuxserver/qbittorrent:4.6.0
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">container_name</span><span style="color:#323232;">: </span><span style="color:#183691;">arr-stack-qbittorrent
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">network_mode</span><span style="color:#323232;">: </span><span style="color:#183691;">service:arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">volumes</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">qbittorrent-config:/config
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">media-downloads:/downloads:z
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">deploy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">resources</span><span style="color:#323232;">:
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">limits</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'4'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">4G
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">reservations</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'2'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">1G
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">depends_on</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">environment</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">WEBUI_PORT=8085
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">TZ=America/Chicago
    </span><span style="color:#323232;">      
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;">#file permissions need to be the same for all apps
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PUID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PGID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">UMASK_SET=022
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">restart</span><span style="color:#323232;">: </span><span style="color:#183691;">unless-stopped
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">labels</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="font-style:italic;color:#969896;"># Note 1: Default user is admin, pass is adminadmin
    </span><span style="color:#323232;">    </span><span style="font-style:italic;color:#969896;"># Note 2: Tools-> options-> web UI -> bypass localhost and whitelist:
    </span><span style="color:#323232;">    </span><span style="font-style:italic;color:#969896;">#    172.18.0.0/24, torrent.local.domain.com, arr-stack-gluetun
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">arr-stack-sabnzbd</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">image</span><span style="color:#323232;">: </span><span style="color:#183691;">ghcr.io/linuxserver/sabnzbd:4.1.0
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">container_name</span><span style="color:#323232;">: </span><span style="color:#183691;">arr-stack-sabnzbd
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">network_mode</span><span style="color:#323232;">: </span><span style="color:#183691;">service:arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">deploy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">resources</span><span style="color:#323232;">:
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">limits</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'4'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">4G
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">reservations</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'2'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">1G
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">volumes</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">sabnzbd-config:/config
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">media-downloads:/downloads:z
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">depends_on</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">environment</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">TZ=America/Chicago
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;">#file permissions need to be the same for all apps
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PUID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PGID=1000
    </span><span style="color:#323232;">      </span><span style="font-style:italic;color:#969896;">#- UMASK_SET=022
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">restart</span><span style="color:#323232;">: </span><span style="color:#183691;">unless-stopped
    </span><span style="color:#323232;">    
    </span><span style="color:#323232;">  </span><span style="font-style:italic;color:#969896;"># ______________________________Arrs__________________________________
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">arr-stack-prowlarr</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">image</span><span style="color:#323232;">: </span><span style="color:#183691;">ghcr.io/linuxserver/prowlarr:1.9.4
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">container_name</span><span style="color:#323232;">: </span><span style="color:#183691;">arr-stack-prowlarr
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">deploy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">resources</span><span style="color:#323232;">:
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">limits</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'4'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">4G
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">reservations</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'2'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">1G
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">environment</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PUID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PGID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">UMASK=022
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">TZ=America/Chicago 
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">volumes</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">prowlarr-config:/config
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">restart</span><span style="color:#323232;">: </span><span style="color:#183691;">unless-stopped
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">network_mode</span><span style="color:#323232;">: </span><span style="color:#183691;">service:arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">depends_on</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">arr-stack-gluetun
    </span><span style="color:#323232;">     </span><span style="font-style:italic;color:#969896;"># - arr-stack-qbittorrent
    </span><span style="color:#323232;">     </span><span style="font-style:italic;color:#969896;"># - arr-stack-sabnzbd
    </span><span style="color:#323232;"> 
    </span><span style="color:#323232;">    
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">arr-stack-sonarr</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">image</span><span style="color:#323232;">: </span><span style="color:#183691;">ghcr.io/linuxserver/sonarr:3.0.10
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">container_name</span><span style="color:#323232;">: </span><span style="color:#183691;">arr-stack-sonarr
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">deploy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">resources</span><span style="color:#323232;">:
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">limits</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'4'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">4G
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">reservations</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'2'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">1G
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">volumes</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">sonarr-config:/config
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">media-tv:/media/TV Shows
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">media-downloads:/downloads:z </span><span style="font-style:italic;color:#969896;"># this is only needed if qbit-torrent is used. It must be added to remote path in the app(complete foler)
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">environment</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PUID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PGID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">UMASK=022
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">TZ=America/Chicago 
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">restart</span><span style="color:#323232;">: </span><span style="color:#183691;">unless-stopped
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">network_mode</span><span style="color:#323232;">: </span><span style="color:#183691;">service:arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">depends_on</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">arr-stack-gluetun
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">  </span><span style="color:#63a35c;">arr-stack-radarr</span><span style="color:#323232;">:
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">image</span><span style="color:#323232;">: </span><span style="color:#183691;">ghcr.io/linuxserver/radarr:5.0.3
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">container_name</span><span style="color:#323232;">: </span><span style="color:#183691;">arr-stack-radarr
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">deploy</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      </span><span style="color:#63a35c;">resources</span><span style="color:#323232;">:
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">limits</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'4'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">4G
    </span><span style="color:#323232;">        </span><span style="color:#63a35c;">reservations</span><span style="color:#323232;">:
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">cpus</span><span style="color:#323232;">: </span><span style="color:#183691;">'2'
    </span><span style="color:#323232;">          </span><span style="color:#63a35c;">memory</span><span style="color:#323232;">: </span><span style="color:#183691;">1G
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">volumes</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">radarr-config:/config
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">media-movies:/media/Movies
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">media-downloads:/downloads:z </span><span style="font-style:italic;color:#969896;"># this is only needed if qbit-torrent is used. It must be added to remote path in the app(complete foler)
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">environment</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PUID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">PGID=1000
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">UMASK=022
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">TZ=America/Chicago 
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">restart</span><span style="color:#323232;">: </span><span style="color:#183691;">unless-stopped
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">network_mode</span><span style="color:#323232;">: </span><span style="color:#183691;">service:arr-stack-gluetun
    </span><span style="color:#323232;">    </span><span style="color:#63a35c;">depends_on</span><span style="color:#323232;">:
    </span><span style="color:#323232;">      - </span><span style="color:#183691;">arr-stack-gluetun
    </span><span style="color:#323232;">
    </span><span style="color:#323232;">
    </span>
    

    Stuff like this is why I moved my docker from unraid to a VM where I can use docker compose. Docker compose is really the only way to get a clean setup with complex stuff like this. That being said I recommend beginners use unraid. You don’t need a full vpn for torrents, a socks5 proxy will be fine and doesn’t require and special docker settings.

    My setup uses traefik reverse proxy. Internal HTTPS (let’s encrypte wild card) and external HTTPS depending on what I want.

    It uses authentik for single sign on and in this case provides LDAP for jellyfin and also provides web authentication for arr services.

    The glutun container can be configured with any VPN and all services can only access the internet via the VPN.

    My NAS is unraid, my docker host is a VM on proxmox. Media files are stored on HDDs on unraid and everything else is on on the docker SSD. Volumes are connected to where they need to be via NFS shares.

    There are limits for cpu and ram so one container can’t bring everything down.

    The containers themselves all communicate via their own docker network and only the reverse proxy (traefik) allows access to the UI.

    HumanPerson,

    Thank you so much. I have spent so long trying to find this.

    kif,

    Sounds like you’ve done a bunch of research! Since you’re using unRAID, setting up your services shouldn’t be too difficult.

    For your torrents and VPN, there’s a few in the unRAID community store - I’d recommend qBittorrentVPN from Binhex - here’s the documentation for setting up their VPN-enabled containers.

    For Headscale, I don’t have any direct experience but unRAID has a decent Wireguard plugin, and should get you up and running in a pinch.

    And for your self-hosted services (especially Bitwarden) ensure you’re not exposing this on the net, by VPN is the only option I’d recommend. Even so, I prefer to use Bitwarden’s hosting with a family plan, for peace of mind and resiliency. It’s also much easier for my family.

    UnRAID is a great place to start - it allows you to scale cheaply as you need and is easier to fix mistakes. Good luck, and happy homelabbing!

    osarusan,
    @osarusan@kbin.social avatar

    I agree Reddit is toxic. I’d argue reddit actually stopped being Reddit around 2016. But it’s posts like this that clog it all up and are partially why it is the way it is today.

    I gotta agree with this. The toxicity in any reddit thread increases dramatically when the poster pre-emptively complains about all the toxicity they expect to receive. Whereas when you just ask straight without going into a whole speech about comment quality, you get much better replies. Particularly because it's hijacking your own thread; changing it from whatever question you wanted to ask into an analysis of the comments.

    chunkystyles,

    To your point, I clicked on this post hoping to see what OP was going to use and why because I would like to build my own NAS some day. But like you said, this post is a waste of everyone’s time.

    Gimpydude, in First Nas Build

    Here’s my advice. The most important things are that you have a free GPU slot and another PCIE slot on whatever you get. You’re going to want a GPU for transcoding when disk space gets tight. You want the extra PCIE slot for a sas card. Disk shelves are surprisingly cheap, and you can keep adding disk that way. They daisy chain.

    As far as the OS, I’m partial to Unraid and Truenas but seriously, anything you are comfortable with will work.

    FlatFootFox, in First Nas Build
    @FlatFootFox@lemmy.world avatar

    www.serverbuilds.net is a popular website online for folks building NASes at home. They’re fans of Unraid as well. They’ve got a Discord if you’re looking for something more interactive. Worth checking out. 👍

    fahad,

    Thanks.

    The_Shwa,

    Dang I wish I knew about this a month ago, I just built a NAS myself. Thanks for the link!

    fuckwit_mcbumcrumble, in First Nas Build

    What OS are you planning on running? I personally use FreeNAS(TrueNAS) and largely love it. There’s a steep initial learning curve, but it’s not too high.

    I run it in a VM inside of esxi so I don’t need a lot of it’s more advanced features. But I do have a jail with deluge in it to handle my torrents. Deluge isn’t up to the task though so I may migrate to a separate VM with something else, or just make a new jail with a different client.

    null,

    They specified Unraid.

    jelloeater85,
    @jelloeater85@lemmy.world avatar

    Are you me?

    I do the same thing, I pass a HBA through to my VM, works like a charm.

    scrubbles, in First Nas Build
    @scrubbles@poptalk.scrubbles.tech avatar

    Unraid is great, I use it daily. I grew past it in some aspects, but it’s a great starter OS.

    Agree with other commenter. Don’t discount backups. Unraid is not a backup. Plan to lose all of your data someday.

    bigredgiraffe, in First Nas Build

    I don’t use unraid by my advice for everyone is that you can’t have too many backups of data that you really care about, use the 3-2-1 rule at a minimum.

    Also, welcome to your new hobby you will love and hate at the same time sometimes :D

    pacjo, in Should I use Restic, Borg, or Kopia for container backups?

    For me it’s restic with creatic wrapper, apprise for notifications and some bash / systemd scripts to make it all connected.

    Everything is in a config file, just as god intended.

    c10l, in How to selfhost a llm?

    It’s pretty easy with Ollama. Install it, then ollama run mistral-7b (or another model, there’s a few available ootb). ollama.ai

    Another option is Llamafile. github.com/Mozilla-Ocho/llamafile

  • All
  • Subscribed
  • Moderated
  • Favorites
  • selfhosted@lemmy.world
  • localhost
  • All magazines
  • Loading…
    Loading the web debug toolbar…
    Attempt #