Database Benchmark: Unterschied zwischen den Versionen

Aus Geoinformation HSR
Wechseln zu: Navigation, Suche
(Guidelines)
K (About Database Performance Benchmarking)
 
(10 dazwischenliegende Versionen desselben Benutzers werden nicht angezeigt)
Zeile 1: Zeile 1:
See also:
+
Synonym: Database Contest.
* >>> [[HSR Texas Geo Database Benchmark]] <<<
 
  
== About Database Performance Benchmarking... ==
+
See also: "Performance-Vergleich von PostgreSQL, SQLite, db4o und MongoDB" [http://wiki.hsr.ch/Datenbanken/wiki.cgi?SeminarDatenbanksystemeHS1112 Seminar Database Systems Autumn 2011/2012], Master of Science in Engineering, HSR.
 +
 
 +
== Spatial Database Benchmarks ==
 +
* [[HSR Texas Geo Database Benchmark]]
 +
** Comparing PostGIS, SpatiaLite and Geocouch
 +
** Comparing PostGIS with Lucene/Solr [http://wiki.hsr.ch/Datenbanken/SeminarDBS1ThemaWolski Seminar Database Systems Autumn 2013/2014], Master of Science in Engineering, HSR.
 +
* Spatial Overlay/Clipping:
 +
** "ArcGIS vs QGIS etc Clipping Contest Rematch revisited": [http://courses.neteler.org/arcgis-vs-qgis-etc-clipping-contest-rematch-revisited/]
 +
** Clipping Contest with Spatialite: [https://www.gaia-gis.it/fossil/libspatialite/wiki?name=benchmark-4.0]
 +
 
 +
== About Database Performance Benchmarking ==
  
 
Existing DB-Benchmarks:
 
Existing DB-Benchmarks:
* TPC-C for OLTP benchmarks.
+
* TPC-C for OLTP benchmarks [https://en.wikipedia.org/wiki/Transaction_Processing_Performance_Council].
* TPC-R & TPC-H (formerly TPC-DS) for data warehouse & decision support systems.
+
** TPC-R & TPC-H (formerly TPC-DS) for data warehouse & decision support systems.
* TPC-W benchmark for Web-based systems.
+
** TPC-W benchmark for Web-based systems.
* "The Engineering Database Benchmark".
+
* "The Engineering Database Benchmark" [http://research.microsoft.com/en-us/um/people/gray/benchmarkhandbook/chapter7.pdf].  
* Open Source Database Benchmark
+
* "Open Source Database Benchmark" [http://osdb.sourceforge.net/].
* PolePosition open source database benchmark [http://www.polepos.org/]
+
* PolePosition open source database benchmark [http://www.polepos.org/].
  
 
== Guidelines ==
 
== Guidelines ==
  
 
A database performance benchmark hast to consider following different aspects:
 
A database performance benchmark hast to consider following different aspects:
# Kalt- und Warmstart, und beim Warmstart ist der Unterschied zwischen der 1. Query und der 2. Query besonders interessant (Caching der DB selber).
+
# Cold and warm start (beware that in case of warm start chaching will take place!).
# Equality und Range Queries.
+
# Equality and Range Queries.
# Query-Resultsets, die ein Tupel liefen und solche die über die Hälfte der DB zurückliefern.
+
# Query-Result Sets, which respond with one tupel or which respond more than half of the tupels in the dataset.
 
# Single User versus Multi-user.
 
# Single User versus Multi-user.
  
Software (Scritps) zur Automatisierung von Benchmarks:
+
Software (Scritps) for benchmark automation:
 
* [http://wiki.hsr.ch/Datenbanken/files/db-benchmark_mott.zip PostgreSQL hstore Benchmark] - Benchmarking in Python by Michel Ott, 2011.
 
* [http://wiki.hsr.ch/Datenbanken/files/db-benchmark_mott.zip PostgreSQL hstore Benchmark] - Benchmarking in Python by Michel Ott, 2011.
 
* [http://www.postgresql.org/docs/devel/static/pgbench.html pgbench] - Benchmark tool for PostgreSQL.
 
* [http://www.postgresql.org/docs/devel/static/pgbench.html pgbench] - Benchmark tool for PostgreSQL.
  
== Weblinks ==
+
== Weblinks / References ==
  
 
* "The Engineering Database Benchmark", Rick Cattell, [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.89.1518&rep=rep1&type=pdf PDF].  
 
* "The Engineering Database Benchmark", Rick Cattell, [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.89.1518&rep=rep1&type=pdf PDF].  
 
* [http://osdb.sourceforge.net/ Open Source Database Benchmark]
 
* [http://osdb.sourceforge.net/ Open Source Database Benchmark]
* http://www.delicious.com/sfkeller/database+benchmark
+
* http://www.delicious.com/sfkeller/database+benchmark and http://www.delicious.com/tag/database,benchmark/alltime

Aktuelle Version vom 16. September 2015, 00:44 Uhr

Synonym: Database Contest.

See also: "Performance-Vergleich von PostgreSQL, SQLite, db4o und MongoDB" Seminar Database Systems Autumn 2011/2012, Master of Science in Engineering, HSR.

Spatial Database Benchmarks

About Database Performance Benchmarking

Existing DB-Benchmarks:

  • TPC-C for OLTP benchmarks [3].
    • TPC-R & TPC-H (formerly TPC-DS) for data warehouse & decision support systems.
    • TPC-W benchmark for Web-based systems.
  • "The Engineering Database Benchmark" [4].
  • "Open Source Database Benchmark" [5].
  • PolePosition open source database benchmark [6].

Guidelines

A database performance benchmark hast to consider following different aspects:

  1. Cold and warm start (beware that in case of warm start chaching will take place!).
  2. Equality and Range Queries.
  3. Query-Result Sets, which respond with one tupel or which respond more than half of the tupels in the dataset.
  4. Single User versus Multi-user.

Software (Scritps) for benchmark automation:

Weblinks / References