Experiences with workflow managers implemented in Haskell (funflow, porcupine, bioshake, ?)

This page summarizes the projects mentioned and recommended in the original post on /r/haskell

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • awesome-pipeline

    A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

  • There are a billion of them out there (https://github.com/pditommaso/awesome-pipeline), so the decision which one to choose is not exactly easy. Most of my colleagues rely on Nextflow and Snakemake, so I should consider these, but before I start to learn an entirely new language I wanted to explore the Haskell ecosystem for possible solutions. Strong typing should in theory be a perfect match for a pipeline manager. And having this in Haskell would simplify replacing some of my R code with Haskell eventually.

  • funflow

    Functional workflows

  • Funflow: https://github.com/tweag/funflow

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • porcupine-core

    Express parametrable, composable and portable data pipelines (by YPares)

  • Porcupine: https://github.com/tweag/porcupine

  • bioshake

    Bioinformatics pipelines with Haskell and Shake

  • Bioshake: https://github.com/PapenfussLab/bioshake

  • bionix

    Functional highly reproducible bioinformatics pipelines

  • I wasn't satisfied with this and wanted the software to be managed too, so we ended up working on BioNix (https://github.com/PapenfussLab/bionix) which does both pipeline execution and software management. This is nice because it makes everything extremely reproducible and removes a lot of the pain of dealing with setting up software etc at various HPC facilities. The down side is Nix isn't typed, so the typing aspect of bioshake was ported on the back of a ADT implementation in Nix, and at least for my work it has caught a fair few mistakes. Of course this isn't Haskell so it doesn't satisfy your criteria, just though it's worth a mention.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Is there anything like funflow for rust?

    2 projects | /r/rust | 20 Oct 2022
  • Need a reason to start Haskell learning

    1 project | /r/haskell | 6 Nov 2021
  • Creators of Argo CD Release New OSS Project Kargo for Next Gen Gitops

    3 projects | news.ycombinator.com | 18 Sep 2023
  • Launch HN: DAGWorks – ML platform for data science teams

    7 projects | news.ycombinator.com | 7 Mar 2023
  • Any good resources for R for bioinformatics

    2 projects | /r/labrats | 17 Nov 2022