VISTA data flow system: overview

James P. Emerson; Mike J. Irwin; Jim Lewis; Simon Hodgkin; Dafydd Evans; Peter Bunclark; Richard McMahon; Nigel C. Hambly; Robert G. Mann; Ian Bond; Eckhard Sutorius; Michael Read; Peredur Williams; Andrew Lawrence; Malcolm Stewart

VISTA data flow system: overview

James P. Emerson, Mike J. Irwin, Jim Lewis, Simon Hodgkin, Dafydd Evans, Peter Bunclark, Richard McMahon, Nigel C. Hambly, Robert G. Mann, Ian Bond, Eckhard Sutorius, Michael Read, Peredur Williams, Andrew Lawrence, Malcolm Stewart

School of Physics and Astronomy

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Data from the two IR survey cameras WFCAM (at UKIRT in the northern hemisphere) and VISTA (at ESO in the southern hemisphere) can arrive at rates approaching 1.4 TB/night for of order 10 years. Handling the data rates on a nightly basis, and the volumes of survey data accumulated over time each present new challenges. The approach adopted by the UK's VISTA Data Flow System (for WFCAM & VISTA data) is outlined, emphasizing how the design will meet the end-to-end requirements of the system, from on-site monitoring of the quality of the data acquired, removal of instrumental artefacts, astrometric and photometric calibration, to accessibility of curated and user-specified data products in the context of the Virtual Observatory. Accompanying papers by Irwin et al and Hambly et al detail the design of the pipeline and science archive aspects of the project.

Original language	English
Title of host publication	Optimizing Scientific Return for Astronomy through Information Technologies
Pages	401-410
Volume	5493
Publication status	Published - 1 Sep 2004

Publication series

Name	Proceedings of the SPIE

Access to Document

http://adsabs.harvard.edu/abs/2004SPIE.5493..401E

Cite this

Emerson, J. P., Irwin, M. J., Lewis, J., Hodgkin, S., Evans, D., Bunclark, P., McMahon, R., Hambly, N. C., Mann, R. G., Bond, I., Sutorius, E., Read, M., Williams, P., Lawrence, A., & Stewart, M. (2004). VISTA data flow system: overview. In Optimizing Scientific Return for Astronomy through Information Technologies (Vol. 5493, pp. 401-410). (Proceedings of the SPIE). http://adsabs.harvard.edu/abs/2004SPIE.5493..401E

@inproceedings{5af3035301fd4165b1f7f61aed38d236,

title = "VISTA data flow system: overview",

abstract = "Data from the two IR survey cameras WFCAM (at UKIRT in the northern hemisphere) and VISTA (at ESO in the southern hemisphere) can arrive at rates approaching 1.4 TB/night for of order 10 years. Handling the data rates on a nightly basis, and the volumes of survey data accumulated over time each present new challenges. The approach adopted by the UK's VISTA Data Flow System (for WFCAM & VISTA data) is outlined, emphasizing how the design will meet the end-to-end requirements of the system, from on-site monitoring of the quality of the data acquired, removal of instrumental artefacts, astrometric and photometric calibration, to accessibility of curated and user-specified data products in the context of the Virtual Observatory. Accompanying papers by Irwin et al and Hambly et al detail the design of the pipeline and science archive aspects of the project.",

author = "Emerson, {James P.} and Irwin, {Mike J.} and Jim Lewis and Simon Hodgkin and Dafydd Evans and Peter Bunclark and Richard McMahon and Hambly, {Nigel C.} and Mann, {Robert G.} and Ian Bond and Eckhard Sutorius and Michael Read and Peredur Williams and Andrew Lawrence and Malcolm Stewart",

year = "2004",

month = sep,

day = "1",

language = "English",

volume = "5493",

series = "Proceedings of the SPIE",

pages = "401--410",

booktitle = "Optimizing Scientific Return for Astronomy through Information Technologies",

}

Emerson, JP, Irwin, MJ, Lewis, J, Hodgkin, S, Evans, D, Bunclark, P, McMahon, R, Hambly, NC , Mann, RG, Bond, I, Sutorius, E, Read, M, Williams, P, Lawrence, A & Stewart, M 2004, VISTA data flow system: overview. in Optimizing Scientific Return for Astronomy through Information Technologies. vol. 5493, Proceedings of the SPIE, pp. 401-410. <http://adsabs.harvard.edu/abs/2004SPIE.5493..401E>

TY - GEN

T1 - VISTA data flow system: overview

AU - Emerson, James P.

AU - Irwin, Mike J.

AU - Lewis, Jim

AU - Hodgkin, Simon

AU - Evans, Dafydd

AU - Bunclark, Peter

AU - McMahon, Richard

AU - Hambly, Nigel C.

AU - Mann, Robert G.

AU - Bond, Ian

AU - Sutorius, Eckhard

AU - Read, Michael

AU - Williams, Peredur

AU - Lawrence, Andrew

AU - Stewart, Malcolm

PY - 2004/9/1

Y1 - 2004/9/1

N2 - Data from the two IR survey cameras WFCAM (at UKIRT in the northern hemisphere) and VISTA (at ESO in the southern hemisphere) can arrive at rates approaching 1.4 TB/night for of order 10 years. Handling the data rates on a nightly basis, and the volumes of survey data accumulated over time each present new challenges. The approach adopted by the UK's VISTA Data Flow System (for WFCAM & VISTA data) is outlined, emphasizing how the design will meet the end-to-end requirements of the system, from on-site monitoring of the quality of the data acquired, removal of instrumental artefacts, astrometric and photometric calibration, to accessibility of curated and user-specified data products in the context of the Virtual Observatory. Accompanying papers by Irwin et al and Hambly et al detail the design of the pipeline and science archive aspects of the project.

AB - Data from the two IR survey cameras WFCAM (at UKIRT in the northern hemisphere) and VISTA (at ESO in the southern hemisphere) can arrive at rates approaching 1.4 TB/night for of order 10 years. Handling the data rates on a nightly basis, and the volumes of survey data accumulated over time each present new challenges. The approach adopted by the UK's VISTA Data Flow System (for WFCAM & VISTA data) is outlined, emphasizing how the design will meet the end-to-end requirements of the system, from on-site monitoring of the quality of the data acquired, removal of instrumental artefacts, astrometric and photometric calibration, to accessibility of curated and user-specified data products in the context of the Virtual Observatory. Accompanying papers by Irwin et al and Hambly et al detail the design of the pipeline and science archive aspects of the project.

M3 - Conference contribution

VL - 5493

T3 - Proceedings of the SPIE

SP - 401

EP - 410

BT - Optimizing Scientific Return for Astronomy through Information Technologies

ER -

VISTA data flow system: overview

Abstract

Publication series

Access to Document

Fingerprint

Cite this