ProvMark: A Provenance Expressiveness Benchmarking System

Sheung Chi Chan; James Cheney; Pramod Bhatotia; Thomas Pasquier; Ashish Gehani; Hassaan Irshad; Lucian Carata; Margo Seltzer

doi:10.1145/3361525.3361552

ProvMark: A Provenance Expressiveness Benchmarking System

Sheung Chi Chan, James Cheney, Pramod Bhatotia, Thomas Pasquier, Ashish Gehani, Hassaan Irshad, Lucian Carata, Margo Seltzer

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract / Description of output

System level provenance is of widespread interest for applications such as security enforcement and information protection. However, testing the correctness or completeness of provenance capture tools is challenging and currently done manually. In some cases there is not even a clear consensus about what behavior is correct. We present an automated tool, ProvMark, that uses an existing provenance system as a black box and reliably identifies the provenance graph structure recorded for a given activity, by a reduction to subgraph isomorphism problems handled by an external solver. ProvMark is a beginning step in the much needed area of testing and comparing the expressiveness of provenance systems. We demonstrate ProvMark's usefuless in comparing three capture systems with different architectures and distinct design philosophies.

Original language	English
Title of host publication	Middleware '19 Proceedings of the 20th International Middleware Conference
Publisher	ACM
Pages	268-279
Number of pages	14
ISBN (Print)	978-1-4503-7009-7
DOIs	https://doi.org/10.1145/3361525.3361552
Publication status	Published - 31 Dec 2019
Event	20th ACM/IFIP International Middleware Conference - Davis, United States Duration: 9 Dec 2019 → 13 Dec 2019 http://2019.middleware-conference.org/

Conference

Conference	20th ACM/IFIP International Middleware Conference
Abbreviated title	Middleware 2019
Country/Territory	United States
City	Davis
Period	9/12/19 → 13/12/19
Internet address	http://2019.middleware-conference.org/

Keywords / Materials (for Non-textual outputs)

provenance
benchmarking
subgraph isomorphism

Access to Document

10.1145/3361525.3361552Licence: All Rights Reserved

ProvMark_CHAN_DoA120919_AFVAccepted author manuscript, 902 KBLicence: All Rights Reserved

https://arxiv.org/abs/1909.11187Licence: All Rights Reserved
https://dl.acm.org/doi/10.1145/3361525.3361552Licence: All Rights Reserved

Turing Fellowship
Cheney, J.
UK-based charities
1/09/18 → 31/08/20
Project: Research
Skye-A programming language bridging theory and practice for scientific data curation
Cheney, J.
EU government bodies
1/09/16 → 28/02/23
Project: Research
A Diagnostics Approach to Persistent Threat Detection (ADAPT)
Cheney, J.
Non-EU other
26/06/15 → 30/06/19
Project: Research

Cite this

@inproceedings{02fb5dee3d654f04a7bb7f7ab3dc7e15,

title = "ProvMark: A Provenance Expressiveness Benchmarking System",

abstract = "System level provenance is of widespread interest for applications such as security enforcement and information protection. However, testing the correctness or completeness of provenance capture tools is challenging and currently done manually. In some cases there is not even a clear consensus about what behavior is correct. We present an automated tool, ProvMark, that uses an existing provenance system as a black box and reliably identifies the provenance graph structure recorded for a given activity, by a reduction to subgraph isomorphism problems handled by an external solver. ProvMark is a beginning step in the much needed area of testing and comparing the expressiveness of provenance systems. We demonstrate ProvMark's usefuless in comparing three capture systems with different architectures and distinct design philosophies. ",

keywords = "provenance, benchmarking, subgraph isomorphism",

author = "Chan, {Sheung Chi} and James Cheney and Pramod Bhatotia and Thomas Pasquier and Ashish Gehani and Hassaan Irshad and Lucian Carata and Margo Seltzer",

note = "To appear, Middleware 2019; 20th ACM/IFIP International Middleware Conference, Middleware 2019 ; Conference date: 09-12-2019 Through 13-12-2019",

year = "2019",

month = dec,

day = "31",

doi = "10.1145/3361525.3361552",

language = "English",

isbn = "978-1-4503-7009-7",

pages = "268--279",

booktitle = "Middleware '19 Proceedings of the 20th International Middleware Conference",

publisher = "ACM",

url = "http://2019.middleware-conference.org/",

}

Chan, SC, Cheney, J, Bhatotia, P, Pasquier, T, Gehani, A, Irshad, H, Carata, L & Seltzer, M 2019, ProvMark: A Provenance Expressiveness Benchmarking System. in Middleware '19 Proceedings of the 20th International Middleware Conference. ACM, pp. 268-279, 20th ACM/IFIP International Middleware Conference, Davis, California, United States, 9/12/19. https://doi.org/10.1145/3361525.3361552

TY - GEN

T1 - ProvMark

T2 - 20th ACM/IFIP International Middleware Conference

AU - Chan, Sheung Chi

AU - Cheney, James

AU - Bhatotia, Pramod

AU - Pasquier, Thomas

AU - Gehani, Ashish

AU - Irshad, Hassaan

AU - Carata, Lucian

AU - Seltzer, Margo

N1 - To appear, Middleware 2019

PY - 2019/12/31

Y1 - 2019/12/31

N2 - System level provenance is of widespread interest for applications such as security enforcement and information protection. However, testing the correctness or completeness of provenance capture tools is challenging and currently done manually. In some cases there is not even a clear consensus about what behavior is correct. We present an automated tool, ProvMark, that uses an existing provenance system as a black box and reliably identifies the provenance graph structure recorded for a given activity, by a reduction to subgraph isomorphism problems handled by an external solver. ProvMark is a beginning step in the much needed area of testing and comparing the expressiveness of provenance systems. We demonstrate ProvMark's usefuless in comparing three capture systems with different architectures and distinct design philosophies.

AB - System level provenance is of widespread interest for applications such as security enforcement and information protection. However, testing the correctness or completeness of provenance capture tools is challenging and currently done manually. In some cases there is not even a clear consensus about what behavior is correct. We present an automated tool, ProvMark, that uses an existing provenance system as a black box and reliably identifies the provenance graph structure recorded for a given activity, by a reduction to subgraph isomorphism problems handled by an external solver. ProvMark is a beginning step in the much needed area of testing and comparing the expressiveness of provenance systems. We demonstrate ProvMark's usefuless in comparing three capture systems with different architectures and distinct design philosophies.

KW - provenance

KW - benchmarking

KW - subgraph isomorphism

U2 - 10.1145/3361525.3361552

DO - 10.1145/3361525.3361552

M3 - Conference contribution

SN - 978-1-4503-7009-7

SP - 268

EP - 279

BT - Middleware '19 Proceedings of the 20th International Middleware Conference

PB - ACM

Y2 - 9 December 2019 through 13 December 2019

ER -

ProvMark: A Provenance Expressiveness Benchmarking System

Abstract / Description of output

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Fingerprint

Projects

Turing Fellowship

Skye-A programming language bridging theory and practice for scientific data curation

A Diagnostics Approach to Persistent Threat Detection (ADAPT)

Cite this