effort

An implementation of bucketMul LLM inference (by kolinko)

Effort Alternatives

Similar projects and alternatives to effort

  • cria

    3 effort VS cria

    Tiny inference-only implementation of LLaMA (by recmo)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better effort alternative or higher similarity.

effort reviews and mentions

Posts with mentions or reviews of effort. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-04-17.
  • Some scientists can't stop using AI to write research papers
    1 project | news.ycombinator.com | 3 May 2024
    My experience is exactly the opposite. AI has way more domain-specific knowledge than any translator I could imagine.

    I recently published effort ( http://kolinko.github.io/effort/ - got to the front page of HN two weeks ago ), and literally everything on that page was rewritten by chatgpt.

    The flow is that I write it however I can, sometimes so badly that even a human professional would have difficulty to understand, then I ask chatgpt to go paragraph by paragraph and rewrite and smoothen out the text.

    You can see how the website was reworked here:

    https://chat.openai.com/share/e/10d7ba3f-f7eb-48cd-9250-d864...

    GPT has way more domain knowledge in my area than most engineer friends I know, not to mention translators, and it managed to not just help with grammar, but with overall explanations I wrote.

    Of course it fails at higher level concepts, and a plenty of things, but still - I can get more quality output from him in an hour than by working a week with a dedicated translator/editor.

  • Show HN: Speeding up LLM inference 2x times (possibly)
    3 projects | news.ycombinator.com | 17 Apr 2024
    I think it was somewhere around that tag:

    https://github.com/kolinko/effort/releases/tag/5.0-last-mixt...

    Cannot rerun easily any more, because the underlying model/weight names changed in the meantime. It doesn't help that Mixtral's published .safetensor files seem messed up, and I needed to hack a conversion from pytorch - it added an extra layer of confusion into the project.

Stats

Basic effort repo stats
3
192
9.7
9 days ago

kolinko/effort is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of effort is Swift.

Popular Comparisons


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com