Backpropagation and Accelerate

• backprop

  2 177 3.8 Haskell

  Heterogeneous automatic differentiation ("backpropagation") in Haskell

• ad

  6 365 5.9 Haskell

  Automatic Differentiation

I’ll also link the ad package here in case someone can speak to its value over backprop https://github.com/ekmett/ad

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• accelerate-ad

  1 21 10.0 Haskell

  Combinatory automatic differentiation in Haskell for heterogeneous computing.

Now back to your question. I have a bit of experience with backprop and accelerate but it's neither recent nor with both of them at once. Accelerate has two layers of abstraction. There are Exp and Acc that build an AST. After compiling them with llvm-native or llvm-ptx backend you enter another layer of abstraction – functions Array -> Array -> ... -> Array. How much automatic you want AD to be? Automatic differentiation AST of Exps and Accs is going to be hard and backprop has nothing to help you here. There was a google summer of code project on this topic. As I understand, it ran short of completion.

Suggest a related project