grok-1
arroyo
| grok-1 | arroyo | |
|---|---|---|
| 8 | 13 | |
| 48,922 | 3,372 | |
| 1.9% | 2.3% | |
| 5.7 | 9.5 | |
| 9 days ago | 3 days ago | |
| Python | Rust | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
grok-1
-
Maxtext: A simple, performant and scalable Jax LLM
Is t5x an encoder/decoder architecture?
Some more general options.
The Flax ecosystem
https://github.com/google/flax?tab=readme-ov-file
or dm-haiku
https://github.com/google-deepmind/dm-haiku
were some of the best developed communities in the Jax AI field
Perhaps the “trax” repo? https://github.com/google/trax
Some HF examples https://github.com/huggingface/transformers/tree/main/exampl...
Sadly it seems much of the work is proprietary these days, but one example could be Grok-1, if you customize the details. https://github.com/xai-org/grok-1/blob/main/run.py
-
Elon Musk's xAI previews Grok-1.5V, its first multimodal model
Anyone know the system requirements? Anyone even able to run it? In their last release "grok 1" the issues are full of people who can't even run it: https://github.com/xai-org/grok-1/issues
- Grok-1 Weights Published
- Grok-1
- FLaNK AI Weekly 18 March 2024
- X.ai's Grok-1 Model Is Officially Open-Source and Larger Than Expected
- Grok-1 (LLM with 314B parameters) is now source
- Elon drops open source Grok onto the stage
arroyo
- FLaNK AI Weekly 18 March 2024
- Arryo 0.8 released — streaming SQL engine
-
Query Engines: Push vs. Pull
Interesting - I looked into your code a bit. I found your window aggregation library [1]. You may be interested in looking into the Rust implementation of some of the research work I've been a part of [2].
In Flink, I believe the reason they need to implement their own backpressure system is that they multiplex TCP connections. That is, they have multiple logical streams flowing through a single TCP connection. If that's the case, you need to do some work to 1) detect which logical stream is the one that's blocking, and 2) don't block because other logical streams may be able to use the active TCP connection.
Thinking it through, I think what Flink's approach buys is not necessarily better performance, but better just a manageable number of connections. That is, imagine you have a process P1 with operators A, B and C. And then P2 has D, E, F. Now imagine that this is a shuffle, where A, B and C are fully connected to D, E and F. In my old system, you would have 9 TCP connections. In Flink, you will have 1.
[1] https://github.com/ArroyoSystems/arroyo/blob/master/arroyo-w...
- Arroyo
- Show HN: Arroyo – Write SQL on streaming data
- Release v0.3.0 · ArroyoSystems/arroyo - Stream Processing Engine
- Arroyo 0.2 released - Rust stream processing engine, now on Kubernetes
- Distributed stream processing engine written in Rust
- ArroyoSystems/arroyo: Arroyo is a distributed stream processing engine written in Rust
- Arroyo, a new open-source SQL stream processing engine written in Rust
What are some alternatives?
FLaNK-python-processors - Many processors
bytewax - Python Stream Processing
rnote - Sketch and take handwritten notes.
risingwave - SQL stream processing, analytics, and management. We decouple storage and compute to offer instant failover, dynamic scaling, speedy bootstrapping, and efficient joins.
pytorch-image-models - The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
Benthos - Fancy stream processing made operationally mundane [Moved to: https://github.com/redpanda-data/connect]
sqlglot - Python SQL Parser and Transpiler
cli - Railway CLI
quarto-cli - Open-source scientific and technical publishing system built on Pandoc.
feldera - Feldera Continuous Analytics Platform
openvino_notebooks - 📚 Jupyter notebook tutorials for OpenVINO™
timely-dataflow - A modular implementation of timely dataflow in Rust