Scotty
Efficient and General Open-Source Window Aggregation
for Stream Processing Systems
Scotty is an open-source framework for efficient window aggregation for out-of-order stream processing.

Features

Scotty provides several features.

High performance window aggregation with stream slicing.

Processes out-of-order streams.

Scalability

Scales to thousands of concurrent windows.

Aggregate Sharing among all concurrent windows.

Window Types

Supports diverse window types, including Tumbling, Sliding, and Session Windows.

Provides connectors to several open-source stream processing systems.

Maven Central

Scotty is published on Maven Central.


<dependency>
  <groupId>stream.scotty</groupId>
    <artifactId>scotty</artifactId>
  <version>0.4</version>
</dependency>
            

Connectors

Scotty provides connectors to several open-source stream processing systems.

Main Publications

Scotty is presented in three main publications.

TODS 2021
Scotty: General and Efficient Open-Source Window Aggregation for Stream Processing Systems
Jonas Traub, Philipp M. Grulich, Alejandro Rodríguez Cuéllar, Sebastian Breß, Asterios Katsifodimos, Tilmann Rabl, Volker Markl
EDBT 2019
Efficient Window Aggregation with General Stream Slicing
Jonas Traub, Philipp M. Grulich, Alejandro Rodríguez Cuéllar, Sebastian Breß, Asterios Katsifodimos, Tilmann Rabl, Volker Markl
ICDE 2018
Scotty: Efficient Window Aggregation for out-of-order Stream Processing
Jonas Traub, Philipp M. Grulich, Alejandro Rodríguez Cuéllar, Sebastian Breß, Asterios Katsifodimos, Tilmann Rabl, Volker Markl