Javascript must be enabled to continue!
Enabling Pinning Strategies for Stream Processing Applications on Multicores
View through CrossRef
Abstract
Data stream processing (DSP) applications consist of data-flow graphs of operators that process data streams. These operators run as dedicated threads, either in parallel or concurrently, on computing platforms with multi-core CPUs. The decision of where to run threads of parallel programs, specifically which CPU core of the underlying architecture to use, is known as thread pinning, and it can significantly affect the application’s throughput. For DSP applications, finding an efficient pinning can be challenging as it depends on information about the data-flow structure, operator types, and communication patterns. Although thread pinning is a low-level optimization available in several parallel programming frameworks , DSP frameworks typically do not allow users to configure thread pinning, leaving the decision to the Operating System. This paper extends the WindFlow DSP library, and its FastFlow-based parallel runtime system, to expose thread pinning mechanisms through a usable API. The effectiveness of this approach is demonstrated through extensive evaluations of four applications, using six custom pinning strategies on a high-end server.
Springer Science and Business Media LLC
Title: Enabling Pinning Strategies for Stream Processing Applications on Multicores
Description:
Abstract
Data stream processing (DSP) applications consist of data-flow graphs of operators that process data streams.
These operators run as dedicated threads, either in parallel or concurrently, on computing platforms with multi-core CPUs.
The decision of where to run threads of parallel programs, specifically which CPU core of the underlying architecture to use, is known as thread pinning, and it can significantly affect the application’s throughput.
For DSP applications, finding an efficient pinning can be challenging as it depends on information about the data-flow structure, operator types, and communication patterns.
Although thread pinning is a low-level optimization available in several parallel programming frameworks , DSP frameworks typically do not allow users to configure thread pinning, leaving the decision to the Operating System.
This paper extends the WindFlow DSP library, and its FastFlow-based parallel runtime system, to expose thread pinning mechanisms through a usable API.
The effectiveness of this approach is demonstrated through extensive evaluations of four applications, using six custom pinning strategies on a high-end server.
Related Results
Lahar simulation using Laharz_py program for the Mt. Halla volcano, Jeju, Korea
Lahar simulation using Laharz_py program for the Mt. Halla volcano, Jeju, Korea
This study using Laharz_py program, was performed schematic prediction
on the impact area of lahar hazards at the Mt. Halla volcano, Jeju
island volcanic field, Korea. In order to ...
Riparian and in-stream controls on nutrient concentrations along a headwater forested stream
Riparian and in-stream controls on nutrient concentrations along a headwater forested stream
Abstract. Headwater streams have a strong capacity to transform and retain nutrients, and thus, a longitudinal decrease in stream nutrient concentrations would be expected from in-...
Along-stream evolution of Gulf Stream volume transport and water properties from underwater glider observations
Along-stream evolution of Gulf Stream volume transport and water properties from underwater glider observations
<p>The Gulf Stream is the western boundary current in the subtropical North Atlantic and a principal component of the upper limb of the Atlantic Meridional Overturnin...
Supracondylar Humerus Fracture in Children: A Retrospective Study
Supracondylar Humerus Fracture in Children: A Retrospective Study
Introduction: The most typical kind of distal humeral fracture in children is a supracondylar fracture of the humerus. Depending on the neurovascular injury and Gartland classifica...
Pin the loop taut: a one-player topologame
Pin the loop taut: a one-player topologame
Abstract
We introduce a 1-player game called pin the loop and analyse its complexity. A loop is a generic immersion of the circle in a surface, considered up to isotopy. A ...
Subglacial Conditions of the Kamb Ice Stream and its Response to Environmental Change
Subglacial Conditions of the Kamb Ice Stream and its Response to Environmental Change
<p>The Siple Coast ice streams, which drain the West Antarctic Ice Sheet into the Ross Ice Shelf, are susceptible to temporal changes in flow dynamics. The Kamb Ice Stream on...
Geochemical Survey of Stream Sediments and Stream Water for Ion-Adsorption Type Rare Earth Deposits (IAREDs): A Pilot Study in Jiaping IARED, Guangxi, South China
Geochemical Survey of Stream Sediments and Stream Water for Ion-Adsorption Type Rare Earth Deposits (IAREDs): A Pilot Study in Jiaping IARED, Guangxi, South China
Rare earth elements (REEs) are critical mineral resources that play a pivotal role in modern technology and industry. Currently, the global supply of light rare earth elements (LRE...
Flux Pinning of the Stress Field in Y1-xLnxBa2Cu3O7-δ
Flux Pinning of the Stress Field in Y1-xLnxBa2Cu3O7-δ
Our experimental results of flux pinning effects in Y1-
x
Ln
x
...

