Javascript must be enabled to continue!
SRCE: A Workload-Shift-Robust Cardinality Estimation Framework
View through CrossRef
Cardinality estimation is crucial for query optimization, as it directly affects plan selection and query cost. Traditional methods based on simplified assumptions fail to capture complex correlations in real-world data. Existing learning-based cardinality estimators are typically trained on fixed query distributions and tend to overfit historical predicate combinations and join patterns, leading to severe accuracy degradation when facing unseen workloads.To address this challenge, we propose SRCE, a cardinality estimation framework explicitly designed to be robust to workload shift. SRCE tackles workload shift from both semantic and structural perspectives. It leverages the monotonicity property of query predicates to generate logic-consistent supervision signals, enabling low-cost training data augmentation without additional query executions and improving generalization to unseen predicate combinations. Additionally, SRCE employs graph convolutional networks to model join structures and initializes join node with histogram-based statistics, allowing the estimator to generalize across previously unseen join patterns. To further enhance the model’s robustness, a self-attention mechanism is introduced to perform query-context-aware, dimension-wise reweighting of the concatenated query representation. Extensive experiments on real-world benchmarks demonstrate that SRCE consistently outperforms existing methods, delivering superior estimation accuracy and query performance across both conventional and workload-shifted scenarios.
Title: SRCE: A Workload-Shift-Robust Cardinality Estimation Framework
Description:
Cardinality estimation is crucial for query optimization, as it directly affects plan selection and query cost.
Traditional methods based on simplified assumptions fail to capture complex correlations in real-world data.
Existing learning-based cardinality estimators are typically trained on fixed query distributions and tend to overfit historical predicate combinations and join patterns, leading to severe accuracy degradation when facing unseen workloads.
To address this challenge, we propose SRCE, a cardinality estimation framework explicitly designed to be robust to workload shift.
SRCE tackles workload shift from both semantic and structural perspectives.
It leverages the monotonicity property of query predicates to generate logic-consistent supervision signals, enabling low-cost training data augmentation without additional query executions and improving generalization to unseen predicate combinations.
Additionally, SRCE employs graph convolutional networks to model join structures and initializes join node with histogram-based statistics, allowing the estimator to generalize across previously unseen join patterns.
To further enhance the model’s robustness, a self-attention mechanism is introduced to perform query-context-aware, dimension-wise reweighting of the concatenated query representation.
Extensive experiments on real-world benchmarks demonstrate that SRCE consistently outperforms existing methods, delivering superior estimation accuracy and query performance across both conventional and workload-shifted scenarios.
Related Results
Network Host Cardinality Estimation Based on Artificial Neural Network
Network Host Cardinality Estimation Based on Artificial Neural Network
Cardinality estimation plays an important role in network security. It is widely used in host cardinality calculation of high-speed network. However, the cardinality estimation alg...
Nurse Workload and Missed Nursing Care in Neonatal Intensive Care Units
Nurse Workload and Missed Nursing Care in Neonatal Intensive Care Units
Importance
High nurse workload can compromise quality of care in neonatal intensive care units, leading to preventable harm and worsening clinical outcomes.
...
Managing Cardinality in Observability Data: Practical Strategies for Sustainable Monitoring
Managing Cardinality in Observability Data: Practical Strategies for Sustainable Monitoring
This article explores the challenges of managing cardinality in observability data within modern distributed systems. Cardinality - the number of unique values in fields such as me...
Storage Workload Identification
Storage Workload Identification
Storage workload identification is the task of characterizing a workload in a storage system (more specifically, network storage system—NAS or SAN) and matching it with the previou...
Analysis of the Effect of Working Hours on Mental Workload Using the Subjective Workload Assessment Technique Method
Analysis of the Effect of Working Hours on Mental Workload Using the Subjective Workload Assessment Technique Method
This research contains a study of the effect of working hours on mental workload using the Subjective Workload Assessment Technique (SWAT) method. Workload is a consequence of acti...
Performance Vs. Workload Matrix of Primary Flight Training: Exploratory Study
Performance Vs. Workload Matrix of Primary Flight Training: Exploratory Study
Workload is a well-established metric to evaluate how pilots meet their task demands in flight. Workload is intertwined with human performance. Existing literature did not classify...
COMPREHENSIVE METHOD OF ENERGY-EFFICIENT WORKLOAD PROCESSING IN THE INFORMATION AND COMMUNICATION NETWORK
COMPREHENSIVE METHOD OF ENERGY-EFFICIENT WORKLOAD PROCESSING IN THE INFORMATION AND COMMUNICATION NETWORK
Background. Peculiarities of the workload in a modern information and communication network (ICN) determine specific requirements for energy efficiency, performance and availabilit...
Workload of diagnostic radiologists in the foreseeable future based on recent scientific advances: growth expectations and role of artificial intelligence
Workload of diagnostic radiologists in the foreseeable future based on recent scientific advances: growth expectations and role of artificial intelligence
Abstract
Objective
To determine the anticipated contribution of recently published medical imaging literature, including artificial intelligence (AI...

