Dynamic distributed dimensional data model (D4M) database and computation system

Jeremy Kepner; William Arcand; William Bergeron; Nadya Bliss; Robert Bond; Chansup Byun; Gary Condon; Kenneth Gregson; Matthew Hubbell; Jonathan Kurz; Andrew McCabe; Peter Michaleas; Andrew Prout; Albert Reuther; Antonio Rosa; Charles Yee

doi:10.1109/ICASSP.2012.6289129

Dynamic distributed dimensional data model (D4M) database and computation system

Jeremy Kepner, William Arcand, William Bergeron, Nadya Bliss, Robert Bond, Chansup Byun, Gary Condon, Kenneth Gregson, Matthew Hubbell, Jonathan Kurz, Andrew McCabe, Peter Michaleas, Andrew Prout, Albert Reuther, Antonio Rosa, Charles Yee

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

83 Scopus citations

Abstract

A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language "SQL" databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.

Original language	English (US)
Title of host publication	2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings
Pages	5349-5352
Number of pages	4
DOIs	https://doi.org/10.1109/ICASSP.2012.6289129
State	Published - 2012
Externally published	Yes
Event	2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Kyoto, Japan Duration: Mar 25 2012 → Mar 30 2012

Publication series

Name	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
ISSN (Print)	1520-6149

Other

Other	2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012
Country/Territory	Japan
City	Kyoto
Period	3/25/12 → 3/30/12

Keywords

associative array
database
fuzzy algebra
linear algebra
tuple store

ASJC Scopus subject areas

Software
Signal Processing
Electrical and Electronic Engineering

Access to Document

10.1109/ICASSP.2012.6289129

Cite this

Kepner, J., Arcand, W., Bergeron, W., Bliss, N., Bond, R., Byun, C., Condon, G., Gregson, K., Hubbell, M., Kurz, J., McCabe, A., Michaleas, P., Prout, A., Reuther, A., Rosa, A., & Yee, C. (2012). Dynamic distributed dimensional data model (D4M) database and computation system. In 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings (pp. 5349-5352). Article 6289129 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). https://doi.org/10.1109/ICASSP.2012.6289129

Dynamic distributed dimensional data model (D4M) database and computation system. / Kepner, Jeremy; Arcand, William; Bergeron, William et al.
2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings. 2012. p. 5349-5352 6289129 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kepner, J, Arcand, W, Bergeron, W, Bliss, N, Bond, R, Byun, C, Condon, G, Gregson, K, Hubbell, M, Kurz, J, McCabe, A, Michaleas, P, Prout, A, Reuther, A, Rosa, A & Yee, C 2012, Dynamic distributed dimensional data model (D4M) database and computation system. in 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings., 6289129, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, pp. 5349-5352, 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012, Kyoto, Japan, 3/25/12. https://doi.org/10.1109/ICASSP.2012.6289129

Kepner J, Arcand W, Bergeron W, Bliss N, Bond R, Byun C et al. Dynamic distributed dimensional data model (D4M) database and computation system. In 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings. 2012. p. 5349-5352. 6289129. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). doi: 10.1109/ICASSP.2012.6289129

@inproceedings{4150df02c693414684af3d60266031f2,

title = "Dynamic distributed dimensional data model (D4M) database and computation system",

abstract = "A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language {"}SQL{"} databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.",

keywords = "associative array, database, fuzzy algebra, linear algebra, tuple store",

author = "Jeremy Kepner and William Arcand and William Bergeron and Nadya Bliss and Robert Bond and Chansup Byun and Gary Condon and Kenneth Gregson and Matthew Hubbell and Jonathan Kurz and Andrew McCabe and Peter Michaleas and Andrew Prout and Albert Reuther and Antonio Rosa and Charles Yee",

year = "2012",

doi = "10.1109/ICASSP.2012.6289129",

language = "English (US)",

isbn = "9781467300469",

series = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

pages = "5349--5352",

booktitle = "2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings",

note = "2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 ; Conference date: 25-03-2012 Through 30-03-2012",

}

TY - GEN

T1 - Dynamic distributed dimensional data model (D4M) database and computation system

AU - Kepner, Jeremy

AU - Arcand, William

AU - Bergeron, William

AU - Bliss, Nadya

AU - Bond, Robert

AU - Byun, Chansup

AU - Condon, Gary

AU - Gregson, Kenneth

AU - Hubbell, Matthew

AU - Kurz, Jonathan

AU - McCabe, Andrew

AU - Michaleas, Peter

AU - Prout, Andrew

AU - Reuther, Albert

AU - Rosa, Antonio

AU - Yee, Charles

PY - 2012

Y1 - 2012

N2 - A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language "SQL" databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.

AB - A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language "SQL" databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.

KW - associative array

KW - database

KW - fuzzy algebra

KW - linear algebra

KW - tuple store

UR - http://www.scopus.com/inward/record.url?scp=84867585940&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867585940&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2012.6289129

DO - 10.1109/ICASSP.2012.6289129

M3 - Conference contribution

AN - SCOPUS:84867585940

SN - 9781467300469

T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

SP - 5349

EP - 5352

BT - 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings

T2 - 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012

Y2 - 25 March 2012 through 30 March 2012

ER -

Dynamic distributed dimensional data model (D4M) database and computation system

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this