Alternative clouds are booming as companies seek cheaper access to GPUs

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
GPU Cloud Computing Data Science ollama Deep Learning

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • freebsd-outerbase

    install script for a remote-unlockable FreeBSD system with geli-encrypted root-on-zfs

    • I've got a dedicated machine for $30/month. It's ancient, a xeon L5640 with 16 GB ram, and 1 TB spinning disk, but it's dedicated and it works great. Well actually, the first one stopped working well, and I got a replacement with double those specs for the same price; and the second one is working great. I also run with full disk encryption, because I don't trust their opsec on wiping drives, so that's a bit of a hassle to reboots, I have to get a console with IPMI and put in the disk password, although I saw something [1] last night that inspires me to consider the possibility of automation.

    I recommend shopping at https://lowendbox.com/ and https://lowendtalk.com/categories/offers

    [1] https://github.com/emtiu/freebsd-outerbase

  • ollama-open-webui

    Deploy your very own ChatGPT-Style Web Interface for Ollama 🦙

    • We've got a one-liner for spinning up your own ollama UI. See https://github.com/fly-apps/ollama-open-webui

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • skypilot

    SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

    • Skypilot is worth a mention here:

    https://github.com/skypilot-org/skypilot

    Open source CLI to deploy multiple gpu vm’s on all major cloud providers, with an option to use spot pricing with 1 cheap vm used as a controller to always make sure you have the most inexpensive deployment available with failover and load balancing.

    It’s like beating the cloud providers at their own game I wouldn’t be surprised if they banned it.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • SGLang: Fast and Expressive LLM Inference with RadixAttention for 5x Throughput

    1 project | news.ycombinator.com | 21 Feb 2024

  • Serving Your Private Code Llama-70B with API, Chat, and VSCode Access

    1 project | news.ycombinator.com | 1 Feb 2024

  • A new old kind of R&D lab

    2 projects | news.ycombinator.com | 12 Dec 2023

  • New Recipe: Serving Llama-2 with VLLM's OpenAI-Compatible API Server

    1 project | news.ycombinator.com | 22 Aug 2023

  • Train Your Own Vicuna on Llama-2

    1 project | news.ycombinator.com | 10 Aug 2023