-
hamilton
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
1) I've been looking into [Metaflow](https://metaflow.org/), which connects nicely to AWS, does a lot of heavy lifting for you, including scheduling.
Otherwise, I'm biased here, but check out https://github.com/dagworks-inc/hamilton - it could be your universal layer that expresses how things should flow, that is orchestration system agnostic, which would make it easy to migrate between systems easily.
Related posts
-
[D] ML Devs: What are your biggest pain-points when it comes to your data pipeline (i.e. collection, storage, processing, standardizing, etc.)? How do you currently solve them?
-
A quick comparison: Streamlit, Dash, Reflex and Rio
-
Streamlit: Créer des apps en Python très simplement
-
Create a Python app easily with Streamlit
-
AI Strategy Guide: How to Scale AI Across Your Business