Skip to content

ERDOS v0.3.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@pschafhalter pschafhalter released this 21 Jul 23:36
· 234 commits to master since this release

New Features

  • Visualize dataflow graph using DOT files (#71).
  • Add general dataflow operators (#85, #93).
  • Time-versioned state (#95).
  • Shut down and reset nodes and dataflows (#74, #114)
  • Profiling in python (#78).

Major API Changes

  • Operators must implement the Operator trait (#77).
  • Expose name and id properties in Python operators (#79).
  • Must provide operator configs (#81).

Implementation Changes

  • Zero-copy communication for sending messages within a node, and faster message sending across nodes (#119).
  • Order events created upon message receipt with a lattice to control parallelism and safe execution (#103).
  • Introduce a control plane connecting nodes for internal communication (#59, #62).
    • Use control plane to ensure that all operators are set up before executing dataflow (#59).
  • Enable processing callbacks in parallel (#108).
  • Verify that corresponding types in new() and connect() match (#67).
  • Avoid busy-looping (#103).