THE SIMULTANEOUS APPROXIMATION ORDER BY NEURAL NETWORKS WITH A SQUASHING FUNCTION

- Journal title : Bulletin of the Korean Mathematical Society
- Volume 46, Issue 4, 2009, pp.701-712
- Publisher : The Korean Mathematical Society
- DOI : 10.4134/BKMS.2009.46.4.701

Title & Authors

THE SIMULTANEOUS APPROXIMATION ORDER BY NEURAL NETWORKS WITH A SQUASHING FUNCTION

Hahm, Nahm-Woo;

Hahm, Nahm-Woo;

Abstract

In this paper, we study the simultaneous approximation to functions in [0, 1] by neural networks with a squashing function and the complexity related to the simultaneous approximation using a Bernstein polynomial and the modulus of continuity. Our proofs are constructive.

Keywords

simultaneous approximation;Bernstein polynomial;squashing function;neural network;

Language

English

References

1.

R. M. Burton and H. G. Dehling, Universal approximation in p-mean by neural networks, Neural Networks 11 (1998), 661–667

2.

P. Cardaliaguet and G. Euvrard, Approximation of a function and its derivative with a neural network, Neural Networks 5 (1992), 207–220

3.

R. A. DeVore and G. G. Lorentz, Constructive Approximation, Springer Verlag, Heidelberg, 1993

4.

A. R. Gallant and H. White, On learning the derivatives of an unknown mapping with multilayer feedforward networks, Lett. Math. Phys. 5 (1992), 129–138

5.

B. Gao and Y. Xu, Univariant approximation by superpositions of a sigmoidal function, J. Math. Anal. Appl. 178 (1993), no. 1, 221–226

6.

Y. Ito, Simultaneous Lp-approximations of polynomials and dervatives on the whole space, Arti. Neural Networks Conf. (1999), 587–592

7.

G. Lewicki and G. Marino, Approximation of functions of finite variation by superpositions of a sigmoidal function, Appl. Math. Lett. 17 (2004), no. 10, 1147–1152

8.

F. Li and Z. Xu, The essential order of simultaneous approximation for neural networks, Appl. Math. Comput. 194 (2007), no. 1, 120–127

9.

X. Li, Simultaneous approximation of a multivariate functions and their derivatives by neural networks with one hidden layer, Neurocomputing 12 (1996), 327–343

10.

G. G. Lorentz, Bernstein Polynomials, Chelsea, Engelwood Cliffs, 1986

11.

B. Malakooti and Y. Q. Zhou, Approximation polynomial functions by feedforward artificial neural networks : capacity analysis and design, Appl. Math. and Comp. 90 (1998), 27–51

12.

M. V. Medvedeva, On sigmoidal functions, Moscow Univ. Math. Bull. 53 (1998), no. 1, 16–19

13.

H. N. Mhaskar and N. Hahm, Neural networks for functional approximation and system identification, Neural Computation 9 (1997), no. 1, 143–159

14.

D. E. Rumelhart, G. E. Hinton, and R. J. Williams, Parallel Distributed Processing : explorations in the microstructure of cognition, MIT Press, Massachusetts, 1986