Proteus is a database engine designed for today's heterogeneous environments. Proteus adapts to variable data, hardware and workloads through a combination of GPU acceleration, data virtualization, and adaptive scheduling.

Adaptive HTAP through Elastic Resource Scheduling

SIGMOD 2020. A. Raza, P. Chrysogelos, A. Anadiotis, A. Ailamaki

Abstract

Modern Hybrid Transactional/Analytical Processing (HTAP) systems use an integrated data processing engine that performs analytics on fresh data, which are ingested from a transactional engine. HTAP systems typically consider data freshness at design time, and are optimized for a fixed range of freshness requirements, addressed at a performance cost for either OLTP or OLAP. The data freshness and the performance requirements of both engines, however, may vary with the workload.

We approach HTAP as a scheduling problem, addressed at runtime through elastic resource management. We model an HTAP system as a set of three individual engines: an OLTP, an OLAP and a Resource and Data Exchange (RDE) engine. We devise a scheduling algorithm which traverses the HTAP design spectrum through elastic resource management, to meet the workload data freshness requirements. We propose an in-memory system design which is non-intrusive to the current state-of-art OLTP and OLAP engines, and we use it to evaluate the performance of our approach. Our evaluation shows that the performance benefit of our system for OLAP queries increases over time, reaching up to 50% compared to static schedules for 100 query sequences, while maintaining a small, and controlled, drop in the OLTP throughput.

@inproceedings{DBLP:conf/sigmod/RazaCAA20,
  author    = {Aunn Raza and
               Periklis Chrysogelos and
               Angelos{-}Christos G. Anadiotis and
               Anastasia Ailamaki},
  editor    = {David Maier and
               Rachel Pottinger and
               AnHai Doan and
               Wang{-}Chiew Tan and
               Abdussalam Alawini and
               Hung Q. Ngo},
  title     = {Adaptive {HTAP} through Elastic Resource Scheduling},
  booktitle = {Proceedings of the 2020 International Conference on Management of
               Data, {SIGMOD} Conference 2020, online conference [Portland, OR, USA],
               June 14-19, 2020},
  pages     = {2043--2054},
  publisher = {{ACM}},
  year      = {2020},
  url       = {https://doi.org/10.1145/3318464.3389783},
  doi       = {10.1145/3318464.3389783},
  timestamp = {Wed, 04 May 2022 13:02:28 +0200},
  biburl    = {https://dblp.org/rec/conf/sigmod/RazaCAA20.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}