Dual 3090 and NVlink (or not) for 65B models with ooba and 4bit 65B models

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA
hardware-buttons scrape-images linkedin-bot

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • text-generation-webui

    A Gradio web UI for Large Language Models.

    You are using superhot but never tried the second method that sets alpha instead? There is a PR right now and I already merged it: https://github.com/oobabooga/text-generation-webui/pull/2955

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • simple-proxy-for-tavern

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Building a Yoga Assistant using Lyzr SDK

    1 project | dev.to | 1 Jul 2024

  • Ask HN: Freelancer? Seeking freelancer? (July 2024)

    3 projects | news.ycombinator.com | 1 Jul 2024

  • Building a NL2Typescript using Lyzr SDK

    1 project | dev.to | 1 Jul 2024

  • How to Make a Barcode Generator in Python

    1 project | dev.to | 1 Jul 2024

  • RQ: Simple Job Queues for Python

    1 project | news.ycombinator.com | 1 Jul 2024

Did you konow that Python is
the 1st most popular programming language
based on number of metions?