ebooks logo journals logo reference works logo abstract databases logo
bullet  SIGN IN Register | Why Register? | Got a Voucher? alerts   marked lists   shopping cart 

informaworld

HOME   |   SEARCH   |   BROWSE
    Issues List       Latest Issue       Volume 10 Issue 6       Subscribe       Article       Related articles      
<< firstfirst   < prevprev   Table of contentstoc   next >next   last >>last
Publisher Logo Publication Cover
Search within this journal

TIME SERIES ANALYSIS AND PREDICTION USING GATED EXPERTS WITH APPLICATION TO ENERGY DEMAND FORECASTS 

Author: Andreas S. Weigend
DOI: 10.1080/088395196118443
Publication Frequency: 10 issues per year
Published in: journal Applied Artificial Intelligence, Volume 10, Issue 6 December 1996 , pages 583 - 624
Formats available: PDF (English)
Article Requests: Order Reprints : Request Permissions
View Article: View Article (PDF) View Article (PDF)


Abstract

In the analysis and prediction of real world systems two of the key problems are nonstation arity (often in the form of switching between regimes) and overfitting (particularly serious for noisy processes). This article addresses these problems using gated experts consisting of a nonlinear gating network and several also nonlinear competing experts. Each expert learns to predict the conditional mean and each expert adapts its width to match the noise level in its regime. The gating network learns to predict the probability of each expert given the input. This article focuses on the case where the gating network bases its decision on infor mation from the inputs. This can be contrasted to hidden Markov models where the decision is based on the previous state s i e on the output of the gating network at the previous time step as well as to averaging over several predictors. In contrast, gated experts soft partition the input space. This article discusses the underlying statistical assumptions, derives the weight update rules and compares the performance of gated experts to standard methods on three time series: 1 - a computer generated series obtained by randomly switching between two nonlinear processes; 2 - a time series from the Santa Fe Time Series Competition the light intensity of a laser in chaotic state; and 3 - the daily electricity demand of France (a real world multivariate problem with structure on several timescales). The main results are (1) the gating network correctly discovers the different regimes of the process (2) the widths associated with each expert are important for the segmentation task and they can be used to characterize the subprocesses and (3) there is less overfitting compared to single networks homogeneous multilayer perceptrons since the experts learn to match their variances to the local noise levels. This can be viewed as matching the local complexity of the model to the local complexity of the data.
Bookmark with:
  • CiteULike
  • Del.icio.us
  • BibSonomy
  • Connotea
  • More bookmarks
Privacy Policy | Terms & Conditions | Accessibility | RSS
FAQs in: English . Français . Español . 中文(简体和繁體)
© 2010 Informa plc