Toggle Main Menu Toggle Search

Open Access padlockePrints

An OGSA-DAI and OGSA-DQP-based Federated Database Infrastructure for the MESSAGE Project

Lookup NU author(s): Visalakshmi Suresh



MESSAGE is a large collaborative e-Science project funded jointly by the EPSRC and Department for Transport that has developed an infrastructure for the capture, management, analysis and visualisation of pollution data. The project consists of five academic partners providing input in the areas of transport, e-Science, positioning/communications and sensor technology and also has the support of 19 industrial partners. MESSAGE has developed and implemented a three-layer e-Science architecture to handle the capture and storage of sensor data and to make this data accessible for running modelling and analysis processes and for visualisation. The sensor and data layers of the architecture handle data sampled by heterogeneous sensor devices, pre-processing of this data where necessary, and storage of the data to a distributed heterogeneous database infrastructure. The data layer also contains data marts that are populated with processed, applicationspecific data and may include third-party data that is integrated with the raw sensor data to support applications that reside within the application layer. The application layer of the architecture supports a variety of applications, data feeds and visualisations that make both historic and live sensor data available to end-users and programmatic consumers that wish to integrate the data into their own applications and services. One of the significant challenges faced by the MESSAGE project has been managing access to potentially vast quantities of stored sensor data distributed across a complex heterogeneous database infrastructure. This paper presents the federated database infrastructure designed and deployed as part of MESSAGE and presents performance tests carried out to evaluate the infrastructure and compare it to alternate database access methods

Publication metadata

Author(s): Cohen J, Calleja M, Grant A, Hayes M, Hume A, Suresh V

Publication type: Conference Proceedings (inc. Abstract)

Publication status: Published

Conference Name: eScience All Hands Meeting 2009

Year of Conference: 2009

Pages: 3

Date deposited: 24/09/2010