The Parallel Transfer of Task Knowledge Using Dynamic Learning Rates Based on a Measure of Relatedness
Author:
Daniel L. Silver
DOI:
10.1080/095400996116929
Publication Frequency:
4 issues per year
Subjects:
Cognitive Artificial Intelligence.;
Cognitive Psychology;
Cognitive Science;
Computational Linguistic & Language Recognition;
Connectionism/Neural Nets;
Cybernetics;
Formats available:
PDF
(English)
View Article:
View Article (PDF)
Abstract
With a distinction made between two forms of task knowledge transfer, 'representational' and 'functional', eta MTL, a modified version of the multiple task learning (MTL) method of functional (parallel) transfer, is introduced. The eta MTL method employs a separate learning rate, etak, for each task output node k. etak varies as a function of a measure of relatedness, Rk, between the kth task and the primary task of interest. Results of experiments demonstrate the ability of eta MTL to dynamically select the most related source task(s) for the functional transfer of prior domain knowledge. The eta MTL method of learning is nearly equivalent to standard MTL when all parallel tasks are sufficiently related to the primary task, and is similar to single task learning when none of the parallel tasks are related to the primary task.
|
| Keywords: Artificial Neural Networks; Learning To Learn; Knowledge-based Inductive Bias; Task Relatedness; Task Knowledge Transfer; Parallel Learning |
| view citations (1) |

Download Citation

CiteULike
Del.icio.us
BibSonomy
Connotea