Java llm

Open-source Java projects categorized as llm
Edit details
Topics: Java generative-ai openai AI large-language-models
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 12 Java llm Projects

  • langstream

    LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka. (by LangStream)

    • Project mention: FLaNK Stack Weekly 16 October 2023 | dev.to | 2023-10-17

  • starwhale

    an MLOps/LLMOps platform

    • Project mention: Show HN: Starwhale – An open source MLOps/LLMOps Platform | news.ycombinator.com | 2024-01-30

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • quantizr

    Quanta is an open-source CMS with ChatGPT and Social Media (Fediverse) features

  • ollama4j

    Java library for interacting with Ollama server.

    • Project mention: FLaNK Stack 26 February 2024 | dev.to | 2024-02-26

  • quarkus-langchain4j

    Quarkus Langchain4j extension

    • Project mention: FLaNK AI Weekly 18 March 2024 | dev.to | 2024-03-18

  • llm-apps-java-spring-ai

    Samples showing how to build Java applications powered by Generative AI and LLMs using Spring AI and Spring Boot.

    • Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05

  • apiRAG

    Retrieval Augmented Generation for (semi-)structured data using APIs

    • Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • llm-apps-java-langchain4j

    Samples showing how to build Java applications powered by Generative AI and LLMs using LangChain4j and Spring Boot.

    • Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05

  • amazon-bedrock-with-builder-and-command-patterns

    A simple, yet powerful implementation in Java that allows developers to write a rather straightforward code to create the API requests for the different foundation models supported by Amazon Bedrock.

    • Project mention: How to Build Your Own ChatGPT Clone Using React & AWS Bedrock | dev.to | 2024-05-01

    The second service is what’s going to make our application come alive and give it the AI functionality we need and that service is AWS Bedrock which is their new generative AI service launched in 2023. AWS Bedrock offers multiple models that you can choose from depending on the task you’d like to carry out but for us, we’re going to be making use of Meta’s Llama V2 model, more specifically meta.llama2-70b-chat-v1.

  • jcohere

    jCohere is a java client for accessing the Cohere.ai platform

  • fastbpe

    Java library implementing Byte-Pair Encoding Tokenization (by deepanprabhu)

    • Project mention: Understanding GPT Tokenizers | news.ycombinator.com | 2023-06-08

    Tokenization is very important and I did implement fastbpe in java to understand things - https://github.com/deepanprabhu/fastbpe

  • llm-integration

    spring-starter, which enables semantic search, backed by OpenAI, by couple of lines

    • Project mention: How Can OpenAI Easily Empower Your Current Java Application | /r/OpenAI | 2023-08-17

    The source code of the library and the demo are available at https://github.com/mxn/llm-integration and https://github.com/mxn/llm-integration-demo respectively.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Java llm related posts

  • Devoxx Genie Plugin : an Update

    6 projects | dev.to | 28 May 2024

  • Practical Llama 3 inference implemented in a single Java file

    1 project | news.ycombinator.com | 19 May 2024

  • Practical Llama 3 inference implemented in a single Java file

    1 project | news.ycombinator.com | 18 May 2024

  • Llama3 Inference in Pure Java

    1 project | news.ycombinator.com | 18 May 2024

  • Show HN: Retrieval Augmented Generation for LLMs from APIs with Function Calling

    1 project | news.ycombinator.com | 25 Jan 2024

  • Ask HN: Best Alternatives to OpenAI ChatGPT?

    2 projects | news.ycombinator.com | 22 Nov 2023

  • Langtorch - Building composable LLM applications & workflow with Java.

    1 project | /r/langtorch | 20 Jun 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 1 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source llm projects in Java? This list will help you:

Project Stars
1 langstream 368
2 starwhale 196
3 quantizr 154
4 ollama4j 122
5 quarkus-langchain4j 107
6 llm-apps-java-spring-ai 120
7 apiRAG 32
8 llm-apps-java-langchain4j 12
9 amazon-bedrock-with-builder-and-command-patterns 11
10 jcohere 2
11 fastbpe 2
12 llm-integration 2

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com