This paper develops recursive kernel estimators for the probability density and the regression function of nonlinear and nonstationary time series. The resulting method is characterized by two smoothing coefficients (the bandwidth and the discounting rate of observations) that may be selected with a prediction error criterion. Statistical properties are investigated under a null hypothesis of stationarity and asymptotic elimination of the discounting. Simulation experiments on complex processes show the ability of the method in estimating time-varying nonlinear regression functions.