Computing Publications

Publications Home » iSWoM: The incremental Storage Wo...

iSWoM: The incremental Storage Workload Model using Hidden Markov Models

Tiberiu Chis, Peter G. Harrison

Conference or Workshop Paper
20th International Conference on Analytical and Stochastic Modelling Techniques and Applications (ASMTA '13)
July, 2013
Lecture Notes in Computer Science
Volume 7984
pp.127–141
Springer Berlin / Heidelberg
DOI 10.1007/978-3-642-39408-9_10
Abstract

We propose a storage workload model able to process discrete time series incrementally, continually updating its parameters with the availability of new data. More specifically, a Hidden Markov Model (HMM) with an adaptive Baum-Welch algorithm is trained on two raw traces: a NetApp network trace consisting of timestamped I/O commands and a Microsoft trace also with timestamped entries containing reads and writes. Each of these traces is analyzed statistically and HMM parameters are inferred, from which a fluid input model with rates modulated by a Markov chain is derived. We generate new data traces using this Markovian fluid, workload model. To validate our parsimonious model, we compare statistics of the raw and generated traces and use the Viterbi algorithm to produce representative sequences of the hidden states. The incremental model is measured against both the standard model (parameterized on the whole dataset) and the raw data trace.

Keywords
Performance Modelling and Analysis
Statistical analysis
Stochastic Modelling
AESOP
PDF of full publication (120 kilobytes)
(need help viewing PDF files?)
BibTEX file for the publication
N.B.
Conditions for downloading publications from this site.
 

pubs.doc.ic.ac.uk: built & maintained by Ashok Argent-Katwala.