Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Gridding crowd-sourced weather data: is quality control required?

View through CrossRef
Context. For monitoring, analysing and forecasting the impact of weather and climate change on society, we see an increasing need for high-quality, high-resolution gridded weather and climate services. The official networks of the National Meteorological and Hydrological Services (NMHS) sample part of the land-use excluding, for example, urban areas, which motivated us to include third-party data which does sample urban areas.  We have provided the results in real-time as well as historical gridded data services.Approach. By including a statistical, simplified model of the observation error in our gridding approach (i.e. multi-fidelity regression Kriging), we did not include any advanced quality control (QC) of the crowd-sourced data. This might sound surprising in the context of weather and climate data,but is consistent with approaches in other scientific disciplines (e.g. marine engineering, aerospace engineering).Results. In this study, we investigate the quantitative effect of state-of-the-art quality control on the accuracy of gridded services, by analysing hourly temperature observations in The Netherlands for the year 2023. Our results indicate that quality control of crowd-sourced weather data can potentially increase the accuracy of straightforward – and commonly used – nearest-neighbour approximation, but generally deteriorates the accuracy of more advanced gridded services. This finding indicates that using strict QC procedures to turn crowd-sourced data into a dataset with similar fidelity as the NMHS-sourced data is not the way to go. Therefore, we do indeed continue to blend first-party data, crowd-sourced data and land-use data without applying any advanced quality control to the crowd-sourced data.Ecosystem. We emphasize that crowd-sourced weather data only improves services when it is blended with a high-quality network of NMHS data and possibly with land-use data. In other words, the availability of crowd-sourced data does not remove the need for high-quality NMHS observation networks. Therefore, we do not intend to present crowd-sourced data as a stand-alone product; rather, it lives in an integrated ecosystem.
Title: Gridding crowd-sourced weather data: is quality control required?
Description:
Context.
For monitoring, analysing and forecasting the impact of weather and climate change on society, we see an increasing need for high-quality, high-resolution gridded weather and climate services.
The official networks of the National Meteorological and Hydrological Services (NMHS) sample part of the land-use excluding, for example, urban areas, which motivated us to include third-party data which does sample urban areas.
 We have provided the results in real-time as well as historical gridded data services.
Approach.
By including a statistical, simplified model of the observation error in our gridding approach (i.
e.
multi-fidelity regression Kriging), we did not include any advanced quality control (QC) of the crowd-sourced data.
This might sound surprising in the context of weather and climate data,but is consistent with approaches in other scientific disciplines (e.
g.
marine engineering, aerospace engineering).
Results.
In this study, we investigate the quantitative effect of state-of-the-art quality control on the accuracy of gridded services, by analysing hourly temperature observations in The Netherlands for the year 2023.
Our results indicate that quality control of crowd-sourced weather data can potentially increase the accuracy of straightforward – and commonly used – nearest-neighbour approximation, but generally deteriorates the accuracy of more advanced gridded services.
This finding indicates that using strict QC procedures to turn crowd-sourced data into a dataset with similar fidelity as the NMHS-sourced data is not the way to go.
Therefore, we do indeed continue to blend first-party data, crowd-sourced data and land-use data without applying any advanced quality control to the crowd-sourced data.
Ecosystem.
We emphasize that crowd-sourced weather data only improves services when it is blended with a high-quality network of NMHS data and possibly with land-use data.
In other words, the availability of crowd-sourced data does not remove the need for high-quality NMHS observation networks.
Therefore, we do not intend to present crowd-sourced data as a stand-alone product; rather, it lives in an integrated ecosystem.

Related Results

Evolution and Impact of Crowd funding in India
Evolution and Impact of Crowd funding in India
Crowd funding is a digital financing model through which individuals, entrepreneurs, or businesses secure funds from a large number of contributors, typically via the Internet. Thi...
Crowd Density Estimation via Global Crowd Collectiveness Metric
Crowd Density Estimation via Global Crowd Collectiveness Metric
Drone-captured crowd videos have become increasingly prevalent in various applications in recent years, including crowd density estimation via measuring crowd collectiveness. Tradi...
A Lesson Plan for Teaching Computational Thinking Using a Weather Forecaster Robot
A Lesson Plan for Teaching Computational Thinking Using a Weather Forecaster Robot
Weather and weather forecasting are closely related to our daily lives. TV weather forecasting programs are common worldwide. Producing such a program requires a team with various ...
Bibliometric analysis of sharing economy logistics and crowd logistics
Bibliometric analysis of sharing economy logistics and crowd logistics
Purpose This study aims to review the literature on sharing economy logistics and crowd logistics to answer the three following questions: How is the literature on sharing economy ...
A deep crowd density classification model for Hajj pilgrimage using fully convolutional neural network
A deep crowd density classification model for Hajj pilgrimage using fully convolutional neural network
This research enhances crowd analysis by focusing on excessive crowd analysis and crowd density predictions for Hajj and Umrah pilgrimages. Crowd analysis usually analyzes the numb...
Modeling crowd emotion from emergent event video
Modeling crowd emotion from emergent event video
AbstractIn emergency situation, mass panic often causes more causalities than the disaster itself. The crowd emotional model could be used to simulate how crowd behavior in emergen...
Second Wind: Extending the official wind gust records with citizen science observations
Second Wind: Extending the official wind gust records with citizen science observations
<p>Extreme wind gusts have severe socio-economic impacts, so any source of extra information on this variable is invaluable for mitigating associated damages and&...
Fair Allocation in Crowd-Sourced Systems
Fair Allocation in Crowd-Sourced Systems
In this paper, we address the problem of fair sharing of the total value of a crowd-sourced network system between major participants (founders) and minor participants (crowd) usin...

Back to Top