Pluggable Time Series Engine in Pinot

[ankitsultana]

Note: This PR is only for reference. The official PRs will be raised against apache/pinot.

Full code-changes for a working Pluggable Time Series Engine in Pinot.

The corresponding design is here: https://docs.google.com/document/d/1SBDDf71QZINYUjAbRSWguNMfbrWRGfdcF1JPi8SJZlM/edit#heading=h.x0u7nkovr9kp

I will be raising smaller PRs against apache/pinot soon.

You can use this branch to run a Quickstart on your local for demonstration purposes.

Steps for Running Time Series Quickstart

Step-1: Build project and start the quickstart:

$ mvn install package -DskipTests -Pbin-dist  # build project
$ JAVA_OPTS="-Xmx8G -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=1044" ./build/bin/pinot-admin.sh QuickStart -type TIME_SERIES  # start quickstart. debugger can be attached at 1044.

Step-2: Start a local grafana server and configure a new Prometheus Datasource. Use http://localhost:8000/timeseries in the "Prometheus server URL" field and select "engine=example" in the custom query parameters. You can also disable metrics lookup since the example time-series engine I support is a toy language and not PromQL.

Related Links:

• Design doc: https://docs.google.com/document/d/1SBDDf71QZINYUjAbRSWguNMfbrWRGfdcF1JPi8SJZlM/edit#heading=h.x0u7nkovr9kp
• Pinot OSS Issue: [Proposal] Generic Time Series Engine in Pinot apache/pinot#13760
• Official PRs: TBD

[ankitsultana]

All of these changes were merged to apache/pinot