ebooks logo journals logo reference works logo abstract databases logo
bullet  SIGN IN Register | Why Register? | Got a Voucher? alerts   marked lists   shopping cart 

informaworld

HOME   |   SEARCH   |   BROWSE
    Issues List       Latest Issue       Forthcoming Articles       Volume 12 Issue 3 & 4       Subscribe       Article       Cited By       Related articles      
<< firstfirst   < prevprev   Table of contentstoc   next >next   last >>last
Publisher Logo Publication Cover
Search within this journal

Context-free and context-sensitive dynamics in recurrent neural networks 

Authors: Mikael Bodeacuten a; Janet Wiles a
Affiliation:   a Department of Computer Science and Electrical Engineering, University of Queensland, QLD 4072, Australia.
DOI: 10.1080/095400900750060122
Publication Frequency: 4 issues per year
Published in: journal Connection Science, Volume 12, Issue 3 & 4 December 2000 , pages 197 - 210
Formats available: PDF (English)
Article Requests: Order Reprints : Request Permissions
View Article: View Article (PDF) View Article (PDF)


Abstract

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for anbncn, a context-sensitive language. The additional difficulty with anbncn, compared with the context-free language anbn, consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.
Keywords: Context-FREE; Grammar; Context-SENSITIVE; Grammar; Dynamical; System; Language; Learning; Recurrent; Neural; Network; Recursive; Structure
view citations (2)
Bookmark with:
  • CiteULike
  • Del.icio.us
  • BibSonomy
  • Connotea
  • More bookmarks
Privacy Policy | Terms & Conditions | Accessibility | RSS
FAQs in: English . Français . Español . 中文(简体和繁體)
© 2010 Informa plc