Nearly 10k and 400 stars on those respective repos.
A way to run a large language model on any operating system, in any OS, in a simple, local, and privacy respecting manner?
For linux we have docker, but Windows users were starving for a good way to do this, and even on linux, removing the step of configuring docker (or other container runtimes) to work with nvidia, is nice.
And it’s still FOSS stuff they aren’t being paid for, currently. But there are plenty of ways to monetize this.
Here’s an easy one: tie in the the vpn service they have to allow you to access the web ui of the computer running the llamafile remotely. Configure something like end to end encryption or or nat traversal (so not even mozilla can sniff the traffic), and you end up with a private LLM you can access remotely.
With this, maybe they can afford some actual development on firefox, without having to rely on google money.
A lot of money, but not enough to actually to actually do a lot. They keep cutting features their “customers” like. Why?
Because development is expensive.
Google props mozilla up to pretend they don’t have a monopoly on the internet. Just enough money to barely keep up, not enough to truly stay competitive.
Mozilla wants to not rely on google money, so they are trying to expand their products. AI is overhyped, but still useful, and something worth investing in.
It appeals to me for management of a windows machine for a few things:
Lots of machines at once, over winrm. Although ssh is the default, as ansible is linux first.
I don’t have to learn powershell - the shared language means the windows teams and the linux team don’t have to learn eachother’s language. In ansible, it’s very easy to avoid the footguns that come with something like bash, especially after you install the red hat linter, ansible-lint, which warns of ansible’s own footguns.
easy to version control it
premade stuff: the official “modules” are massive and do a lot. There are also community packages: galaxy.ansible.com - of course, you should probably check any stuff you run first. But ansible is very easy to read.
built in secret management. Encrypt secrets, but still be able to use them smoothly with the automation framework.
For just one machine? Task scheduler is probably good enough. 2-3 machines, managed remotely? Ansible is at least worth looking at.
The examples are very helpful, with things like getting a list of ad users. I used that to create a ansible script to shuffle all ad user passwords - while being a a linux lover who hates windows and has literally never touched ad before this.
I’ve been distrohopping for a while now, and eventually I landed on Arch. Part of the reason I have stuck with it is I think I had a balanced introduction, since I was exposed to both praise and criticism. We often discuss our favorite distros, but I think it’s equally important to talk about the ones that didn’t quite hit...
Did you test with different kernels? Them using a custom scheduler that prioritizes desktop applications might cause background things to run slower.
Plus, the use of ananicy (cpu/ram limiter) limits stuff like that as well.
I use cachyos because they set up zram, anf uksmd by defualt. That’s ram compression and deduplication, and it’a pretty powerful in my experience. If you’re using cachyos, then uksmdstats and zramctl can give you an idea of how much you are saving.
I run languagetool locally, and it’s actually really good, but the browser extension is closed source even though I can point it at a local server, I don’t know if it’s logging what I type.
But libreoffice has built in support, which is great.
Yeah, unintentional bugs are much easier to deal with than maliciousness, like replacing the “file upload” button with buy nitro, or discord in the browser’s audio being finnicky (dark pattern you don’t get this problem on element or the discord app.)
Of course, there are unintentional bugs as well, on top of maliciousness.
Hi, I just noticed the existence of LinguaCafe and i really like the idea. So I searched up their website and saw that they are still in early developement. I’d like to learn italian and that is currently an experimental language. So im wondering if there is a better service avaiable right now....
On linux, with kde, there is usually a browser extension preinstalled called plasma integration.
It makes it so that when you search from the KDE equivalent of window’s start menu, you can also search open browser tabs or history.
I close all tabs once I’m done, but when trying to solve a programming/devops related problem, having lots of tabs open lets me see more than one approach to a problem, along with opinions, side by side.
And research in general requires a lot of tabs, in my experience.
Due to my line of work, I find myself having to use both these services frequently, despite avoiding google as much as I can. I see a lot of alternatives out there for internet searching, but when it comes to specific fields, alternatives tend to be scarce.
Mine is Strawberry since it has a ton of options and plays a ton of formats. It’s also (distant) fork of Amarok 1.4 and integrates well with KDE Plasma. I’m curious what other people are using these days. What’s your favorite player?
I got an external hard drive enclosure for the purpose of recovering some of the files from my old laptops hard drive. The hard drive and all of it’s partitions show up in both disks and gparted but it wont mount. When I tried to mount it manually, it gave the error message stating that it can’t read the superblock. I’ve...
Hi friends. I’m new to the whole homeserver. I managed to make a ton of progress very quickly using CasaOS but I’ve been hung up on this for a couple of days now....
That’s why people keep asking you for your nginx config since when you just say nginx, people are expecting that you are using just nginx, and configuring it through text files.
Are they so different that it’s justified to have so many different distributions? So far I guess that different package manager are the reason that divides the linux community. One may be on KDE and one on GNOME but they can use each other’s packages but usually you are bound to one manager
Was watching a twitch streamer learning linux, and chat convinced them to open vim for the first time. Not a single person gave the real answer of how to exit, all joke answers like “Power off,” and it was hilarious.
The Canonical-developed Netplan has served for Linux network configuration on Ubuntu Server and Cloud versions for years. With the recent Ubuntu 23.10 release, Netplan is now being used by default on the desktop. Canonical is committing to fully leveraging Netplan for network configuration with the upcoming Ubuntu 24.04 LTS...
It literally has no benefits, and is only a pain to use.
Actually, it does have one benefit: it integrates with Canonical’s other tech. For example, MAAS uses ot for networking, and I bet lxc uses it somehow.
(There is a learning curve to packaging stuff yourself.)
“Learning curve” is an understatement. Nix is one of the most poorly documented projects I’ve seen, next to openstack. Coming into it with no background in functional programming didn’t help.
But I’ve tried to package other stuff, like quarto, and that was a nightmare. Nixpkgs didn’t have an updated pandoc and I spent an eternity asking around for help, to try to package it. An updated version just got pushed to unstable a few days ago. The same matrix channels I joined to ask for help have been discussing this since then. Props on them for getting it working, but anyone who says that you can easily package anything, is capping. You need to have an understanding of the nix language, nix packaging (both of which are poorly documented), and a rudimentary packaging ecosystem of what you are trying to package.
Don’t even get me started on flakes vs nonflakes.
I still use nix-shell for all my development environments, because it’s the best way for reproducible environments I can share I’ve found.
Considering I know someone, personally, who also made a scientific advancement at a young age, yes, it is possible.
They taught themselves python, then how to inference and train machine learning models, then used image recognition models to detect their sister’s illness, which had visual signs.
They had to get help from someone with a phd to test this on a larger scale, cuz resources, but I absolutely believe a middle/high schooler could do it.
We have a proxmox cluster, which is where this would probably go, but I would prefer a non-integrated solution, rather a single thing I can either put within a proxmox vm (nested virtualization) or on an on premise piece of physical hardware.
You may be interested in nix’s home manager. It allows you to manage all of your home directory configs (dotfiles), as nix code. It has built in rollbacks, and can be git tracked.
You can then find other people’s home manager configs on github.
Hyprland is an open source Wayland compositor based on wlroots, a project I started back in 2017 to make it easier to build good Wayland compositors. It’s a project which is loved by its users for its emphasis on customization and “eye candy” – beautiful graphics and animations, each configuration tailored to the unique...
I’m in the max server limit, 100 right now, and many of those are people who treat discord as github, which is so annoying (but many projects are of questionable legality, like Dan’s palace which makes and distributes completed android and vita ports of other games for free).
One time I got excited since there was announcement for the half life 2 android source port discord. I thought it was a big update or maybe a new game, but what I saw was something like:
the memes channel is for memes, not child porn
It’s just discord that has these issues. Matrix or IRC don’t have these problems. Discord just creates a kind of culture that fosters this stuff.
Mozilla says Apple’s new browser rules are “as painful as possible” for Firefox (www.theverge.com)
Mozilla is unhappy because the use of browser engines other than WebKit will be restricted to the EU, forcing them to develop two different apps....
What software do you wish that existed?
Ansible casually administering hundreds or thousands of devices (lemmy.zip)
(Constructively) What is your least favorite distro & why?
I’ve been distrohopping for a while now, and eventually I landed on Arch. Part of the reason I have stuck with it is I think I had a balanced introduction, since I was exposed to both praise and criticism. We often discuss our favorite distros, but I think it’s equally important to talk about the ones that didn’t quite hit...
All is fair in love and war. (See body for part 2) (mander.xyz)
https://mander.xyz/pictrs/image/1430a6bb-ad83-49cc-9fa3-3dbbff896886.png
Tailchat - The next-generation noIM Application in your own workspace (tailchat.msgbyte.com)
Haven’t seen much of this around, but I’ve spun my own instance up and suffice to say it fits my needs.
Should i host LinguaCafe or are there better alternatives?
Hi, I just noticed the existence of LinguaCafe and i really like the idea. So I searched up their website and saw that they are still in early developement. I’d like to learn italian and that is currently an experimental language. So im wondering if there is a better service avaiable right now....
How many tabs do you have open? (lemmy.sdf.org)
And remember… it’s not a race!
Are there alternatives to google scholar and google patents?
Due to my line of work, I find myself having to use both these services frequently, despite avoiding google as much as I can. I see a lot of alternatives out there for internet searching, but when it comes to specific fields, alternatives tend to be scarce.
What's your favorite music player on Linux? (lemmy.ml)
Mine is Strawberry since it has a ton of options and plays a ton of formats. It’s also (distant) fork of Amarok 1.4 and integrates well with KDE Plasma. I’m curious what other people are using these days. What’s your favorite player?
Is it possible to isolate which GUI programs are seem by a screensharing program in xorg or wayland ?
Think Zoom, Teams, google meet etc...
Terminal Utility Mega list! (sh.itjust.works)
[Browsers]...
What would be the best way for me to recover data from my old laptop's hard drive, which seems to have a bad superblock?
I got an external hard drive enclosure for the purpose of recovering some of the files from my old laptops hard drive. The hard drive and all of it’s partitions show up in both disks and gparted but it wont mount. When I tried to mount it manually, it gave the error message stating that it can’t read the superblock. I’ve...
Help with NGINX? so close...
Hi friends. I’m new to the whole homeserver. I managed to make a ton of progress very quickly using CasaOS but I’ve been hung up on this for a couple of days now....
What's the difference between package manager and why are there so many?
Are they so different that it’s justified to have so many different distributions? So far I guess that different package manager are the reason that divides the linux community. One may be on KDE and one on GNOME but they can use each other’s packages but usually you are bound to one manager
How do I exit vim? (lemmy.ml)
Ubuntu 24.04 LTS Committing Fully To Netplan For Network Configuration (www.phoronix.com)
The Canonical-developed Netplan has served for Linux network configuration on Ubuntu Server and Cloud versions for years. With the recent Ubuntu 23.10 release, Netplan is now being used by default on the desktop. Canonical is committing to fully leveraging Netplan for network configuration with the upcoming Ubuntu 24.04 LTS...
Comparison between NixOS vs blendOS vs Vanilla OS: what to pick and why?
So I’ve recently taken an interest in these three distros:...
US student, 14, wins award for developing soap to treat skin cancer (www.theguardian.com)
Heman Bekele was inspired by Ethiopian workers laboring under the sun, and wanted to help ‘as many people as possible’...
Alternative to docker-tcp-switchboard, but for tcp and virtual machines? (github.com)
docker-tcp-switchboard is pretty good, but it has two problems for me:...
deleted_by_author
Do your best (i.postimg.cc)
Hyprland is a toxic community (drewdevault.com)
Hyprland is an open source Wayland compositor based on wlroots, a project I started back in 2017 to make it easier to build good Wayland compositors. It’s a project which is loved by its users for its emphasis on customization and “eye candy” – beautiful graphics and animations, each configuration tailored to the unique...