Arc and Arcon
Research into a common representation for batch and stream analytics, connected to the Arcon runtime through Kompact.
Motivation and approach
Analytics pipelines often combine batch and streaming computations across different systems. Arc explored a common intermediate representation: a shared form in which a compiler could express both kinds of computation and reason about them together.
Arc describes computation, while the related Arcon project provides a streaming runtime.
My contribution
I worked on Arc and co-authored the 2019 paper. My connection to the related Arcon runtime was mainly through Kompact, which Arcon used.
Outcome and current status
The work resulted in the Arc and Arcon papers published in 2019. Neither project is maintained or developed any longer.