• 14 Posts
  • 1.02K Comments
Joined 2 years ago
cake
Cake day: June 13th, 2023

help-circle









  • Nothin’ I’m running, that’s for sure!

    It’s not really that there are services that require that much processing power for a single request; it’s that it’s designed to handle normal requests for hundreds or thousands of users at once.

    I suppose that supporting 0.5TB of RAM means it could deal with quite a big LLM, but any sort of halfway-modern GPU would absolutely run circles around it in terms of tokens per second, on any model that fit in their VRAM.






  • Like a VM virtual disk? Those are exclusive to each VM and can’t be shared, so if you want multiple VMs to access the same data then NFS would be needed.

    But containers with bind mounts don’t have that limitation and multiple containers can access the same data (such as media).

    Just to be clear, are you saying that when you’re using bind-mounted ZFS pools, it’s okay to write from two containers (or both the proxmox host and a container) at the same time?

    Also, I think I managed to accomplish that for a VM by creating a Proxmox Directory pointing to a path in a zpool, adding it to the VM using virtiofs, and mounting it within the VM. I’m not sure if writes from both the VM and the host are safe in that case either, though.





  • Permissive licenses (MIT, BSD) prioritize programmers’ freedom, letting them do whatever they want with the code including keeping their own changes proprietary.

    All variants of GPL are copyleft, which prioritizes end uaers’ freedom to control the software they use.

    LGPL is for people who want the subsystem they’re working on to remain free, but don’t mind it being incorporated into proprietary software.

    GPLv2 is for people who want to preserve users’ rights to control the whole program.

    GPLv3 is resistant to Tivoization, i.e. to preserve users’ rights to actually run the program on the hardware it was intended for.

    AGPL is resistant to circumventing users’ rights by using SaaS instead of letting them run it locally.

    (BTW, everyone who thinks there’s a good reason to prefer GPLv2 over v3 is shortsighted and wrong. GPLv3 vs AGPL is slightly more debatable, but IMO AGPL should generally be preferred, too.)