Artificial neural networks. A review from physical and mathematical points of view

 Access to full text

 Full (PDF)

1. [ALR] M. Aizenman, J. Lebowitz and D. Ruelle, Some rigorous results on the Sherrington-Kirkpatrick model, Com. Math. Phys. Vol. 112, 1987, pp. 3-20. Zbl1108.82312MR904135
2. [A] D.J. Amit, Modeling Brain Function, Cambridge Univ. Press. Cambridge, 1988. Zbl0709.92001MR1025121
3. [AGS1] D.J. Amit, H. Gutfreund and H. Sompolinsky, Spin-glass models of neural networks, Phys. Rev., Vol. A32, 1985, pp. 1007-1018. MR797031
4. [AGS] D.J. Amit, H. Gutfreund and H. Sompolinsky, Statistical Mechanics of Neural Networks near Saturation, Ann. of Phys., Vol. 173, 1987, pp. 30-67. 
5. [BG1] A. Bovier and V. Gayrard, Rigorous bounds on the storage capacity of the dilute Hopfield model, J. Stat. Phys., Vol. 69, 1992, pp. 597-627. Zbl0900.82064MR1193852
6. [BG2] A. Bovier and V. Gayrard, Rigorous results on the thermodynamics of the dilute Hopfield model, J. Stat. Phys., Vol. 69, 1993, pp. 597-627. Zbl0900.82064MR1193852
7. [BGP1] A. Bovier, V. Gayrard and P. Picco, Gibbs states of the Hopfield model in the regime of perfect memory, to appear in Prob. Theor. Rel. Fields, 1995. Zbl0810.60094MR1305586
8. [BGP2] A. Bovier, V. Gayrard and P. Picco, Large deviation principles for the Hopfield and the Kac-Hopfield model, to appear in Probability Theory and relatedfields, 1995. Zbl0826.60090
9. [BGP3] A. Bovier, V. Gayrard and P. Picco, Gibbs states for the Hopfield model with extensively many patterns, to appear in J.S.P., 1995. Zbl1081.82570MR1325589
10. [CT] B. Cheng and D.M. Titterington, Neural Networks: A Review from a Statistical Perspective, Statistical Science, Vol. 9, 1994, pp. 2-54. Zbl0955.62589MR1278678
11. [Co] F. Comets, Large deviation estimates for a conditional probability distribution. Applications to random Gibbs measures, Prob. Theor. Rel. Fields, Vol. 80, 1989, pp. 407-432. Zbl0638.60037MR976534
12. [COP] M. Cassandro, E. Orlandi and E. Presutti, Interfaces and typical Gibbs configurations for one-dimensional Kac potentials, Prob. Theor. Rel. Fields, Vol. 96, 1993, pp. 57-96. Zbl0791.60096MR1222365
13. [E] R.S. Ellis, Entropy, large deviations, and statistical mechanics, Springer-Verlag, Berlin, 1985. Zbl0566.60097MR793553
14. [FMP] P. Ferrari, S. Martinez and P. Picco, A lower bound for the memory capacity in the Hopfield-Potts model, J. Stat. Phys., Vol. 66, 1991, pp. 1643-1651. Zbl0890.68110MR1156420
15. [FP1] L.A. Pastur and A.L. Figotin, Exactly soluble model of a spin glass, Sov. J. Low Temp. Phys., Vol. 3(6), 1977, pp. 378-383. 
16. [FP2] L.A. Pastur and A.L. Figotin, On the theory of disordered spin systems, Theor. Math. Phys., Vol. 35, 1978, pp. 403-414. MR503349
17. [FP3] L.A. Pastur and A.L. Figotin, Infinite range limit for a class of disordered spin systems, Theor. Math. Phys., Vol. 51, 1982, pp. 564-569. MR674787
18. [Gay] V. Gayrard, The thermodynamics limit of the q-state Potts-Hopfield model with infinitely many patterns, J. Stat. Phys., Vol. 68, 1992, pp. 977-1011. Zbl0900.92011MR1180270
19. [Gar] E. Gardner, The space of interactions in neural network models, J. Phys. A: Math. Gen., Vol. 21, 1988, pp. 257-270. MR939730
20. [GD] E. Gardner and B. Derrida, Optimal storage properties of neural network models, J. Phys. A: Math. Gen., Vol. 21, 1988, pp. 271-284. MR939731
21. [GFP] E. Goles, F. Fogelman-Soulie and D. Pellegrin, Decreasing energy functons as a tool for studying threshold networks, Discrete App. Math., Vol. 12, 1985, pp. 261-277. Zbl0585.94018MR813974
22. [GM] E. Goles and S. Martinez, Neural and automata networks. Dynamical behavior and applications, Kluwer Ac. Pub. Dordrecht, Boston, London, 1990. MR1047470
23. [GK] D. Grensing and K. Kühn, On classical spin-glass models, J. Phys. Paris, Vol. 48, 1987, pp. 713-721. MR896188
24. [GTA] M. Griniasty, M. Tsodyks and D.J. Amit, Neural Comp., Vol. 5, 1993, pp. 1-17. 
25. [He] D.O. Hebb, The organisation of behavior, J. Willey & Son, New York, 1949. 
26. [Ho] J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. USA, Vol. 79, 1982, pp. 2554- 2558. MR652033
27. [KS] I. Kanter and H. Sompolinsky, Associative recall of memory without errors, Phys. Rev. A, Vol. 35, 1987, pp. 380-392. 
28. [Ko] H. Koch, A free energy bound for the Hopfield model, J. Phys. A: Math Gen., Vol. 26, 1993, pp. L353-L355. Zbl0775.82008MR1212003
29. [Koh] T. Kohonen, Self-organisation and associative memory, Springer Verlag, Berlin, 1984. Zbl0528.68062MR728946
30. [KP] H. Koch and J. Piasko, Some rigorous results on the Hopfield neural network model, J. Stat. Phys., Vol. 55, 1989, pp. 903-928. Zbl0716.92003MR1002477
31. [KUH] M. Kac, G. Uhlenbec and P.C. Hemmer, On the van der Waals theory of vapour-liquid equilibrium. I. Discussion of a one-dimensional model, J. Math. Phys., Vol. 4, 1963, pp. 216-228; II. Discussion of the distribution functions, J. Math. Phys., Vol. 4, 1963, pp. 229-247; III. Discussion of the critical region, J. Math. Phys., Vol. 5, 1964, pp. 60-74. Zbl0938.82517MR148416
32. [KPa] J. Komlos and R. Paturi, Convergence results in an associative memory model, Neural Network., Vol. 1, 1988, pp. 239-250. 
33. [LP] J. Lebowitz and O. Penrose, Rigorous treatment of the Van der Waals Maxwell theory of the liquid-vapour transition, J. Math. Phys., Vol. 7, 1966, pp. 98-113. Zbl0938.82520MR187835
34. [LeC1] Y. Le Cun, B. Boser, J.S. Denker, D. Henderson, R.E. Howard, W. Hubbard and L.D. Jackel, Backpropagation applied to handwritten Zip code recognition, Neural Computation, Vol. 1, 1989, pp. 541-551. 
35. [LeC2] Y. Le Cun, B. Boser, J.S. Denker, D. Henderson, R.E. Howard, W. Hubbard and L.D. Jackel, Handwritten digit recognition with a backpropagation network, Advances in Neural Information Processing Systems II (D. S. Touretzky, eds.), Morgan Kaufmann, San Mateo, CA, 1990, pp. 396-404. 
36. [L] Y.C. Lee, G. Doolen, H.H. Chen, G.Z. Sun, T. Maxwell, H.Y. Lee and C.L. Giles, Machine learning using a higher order correlaton network, Physica D, Vol. 22, 1987, pp. 276-867. MR878166
37. [Lo] D. Loukianova, Capacité de mémoire dans le modèle de Hopfield, C. R. Acad. Sc. Paris, Serie 1, Vol. 31, 1994, pp. 157-160. Zbl0794.92002MR1260330
38. [McE] R.J. McEliece, E.C. Posner, E.R. Rodemich and S.S. Venkatesh, The capacity of the Hopfield associative memory, IEEE Trans. Inform. Theory, Vol. 33, 1987, pp. 461-482. Zbl0631.94016MR901677
39. [McCP] W.S. Mcculloch and W.A. Pitts, A logical calculus of the ideas immanent in nervous activity, Bul. Math. Biophysics, Vol. 5, 1943, pp. 115-133. Zbl0063.03860MR10388
40. [M] S. Martinez, Temuco summer school. To appear, 1992. 
41. [MP] M. Minsky and S. Papert, Perceptrons, MIT Press, Cambridge MA, 1969. 
42. [MNT] M. Mézard, J.P. Nadal and G. Toulouse, Solvable models of working memories, J. Phys. Paris, Vol. 47, 1986, pp. 1457-1462. MR930410
43. [MPV] M. Mézard, G. Parisi and M. Virasoro, Spin Glass Theory and Beyond, World Scientific, Singapore, 1987. Zbl0992.82500MR1026102
44. [Mi] Y. Miyashita, Neuronal correlate of visual associative long-term memory in primate temporal cortex, Nature, Vol. 335, 1988, p. 817. 
45. [Mo1] R. Monasson, Properties of neural networks storing spatially correlated patterns, J. Phys. A: Math. Gen., Vol. 25, 1992, pp. 3701-3720. Zbl0791.68140MR1172070
46. [Mo2] R. Monasson, Storage of spatially correlated patterns in auto-associative memories, J. Phys. Paris, Vol. 3, 1993, pp. 1141-1152. 
47. [N] C.M. Newman, Memory capacity in neural network models: rigorous lower bounds, Neural Networks, Vol. 1, 1988, pp. 223-238. 
48. [PST] L. Pastur, M. Shcherbina and B. Tirozzi, The replica symmetric solution without the replica trick for the Hopfield model, J. Stat. Phys., Vol. 74, 1994, pp. 1161-1183. Zbl0835.60092MR1268789
49. [PGD] L. Personnaz, I. Guyon and G. Dreyfus, Information storage and retrivial in Spin-glass like neural networks, J. Phys. Lett., Vol. 49, 1985, pp. 359-365. 
50. [ST] E. Scacciatelli and B. Tirozzi, Fluctuation of the free energy in the Hopfield model, J. Stat. Phys., Vol. 67, 1992, pp. 981-1008. Zbl0925.82163MR1170083
51. [ShT] M. Shcherbina and B. Tirozzi, The free energy for a class of Hopfield models, J. Stat. Phys., Vol. 72, 1992, pp. 113-125. Zbl1097.82551MR1233028
52. [TL] W. Tarkowski and M. Lewenstein, Storage of sets of correlated data in neural network memories, J. Phys A: Math. Gen., Vol. 26, 1993, pp. 2453-2469. Zbl0788.68118MR1234407

1. Matthias Löwe, Franck Vermet, Capacity bounds for the CDMA system and a neural network: a moderate deviations approach