Verifying ACID compliance is an essential part of database benchmarking, because the
integrity of performance results can be undermined as the performance benefits of
operating with weaker safety guarantees (at the potential cost of correctness) are
well known. Traditionally, benchmarks have specified a number of tests to validate
ACID compliance. However, these tests have been formulated in the context of relational
database systems and SQL, whereas our scope of benchmarking are systems for graph
data, many of which are non-relational. This paper presents a set of data model-agnostic
ACID compliance tests for the LDBC (Linked Data Benchmark Council) Social Network
Benchmark suite's Interactive (SNB-I) workload, a transaction processing benchmark
for graph databases. We test all ACID properties with a particular emphasis on isolation,
covering 10 transaction anomalies in total. We present results from implementing the
test suite on 5 database systems.
