Capacity bounds for the CDMA system and a neural network: a moderate deviations approach

Matthias Löwe; Franck Vermet

ESAIM: Probability and Statistics (2009)

  • Volume: 13, page 343-362
  • ISSN: 1292-8100

Abstract

top
We study two systems that are based on sums of weakly dependent Bernoulli random variables that take values ± 1 with equal probabilities. We show that already one step of the so-called soft decision parallel interference cancellation, used in the third generation of mobile telecommunication CDMA, is able to considerably increase the number of users such a system can host. We also consider a variant of the well-known Hopfield model of neural networks. We show that this variant proposed by Amari and Yanai [CITE] has a larger storage capacity than the original model. Both situations lead to the question of the moderate deviations behavior of a sum of weakly dependent Bernoulli random variables. We prove a moderate deviations principle for such a sum on the appropriate scale.

How to cite

top

Löwe, Matthias, and Vermet, Franck. "Capacity bounds for the CDMA system and a neural network: a moderate deviations approach." ESAIM: Probability and Statistics 13 (2009): 343-362. <http://eudml.org/doc/250671>.

@article{Löwe2009,
abstract = { We study two systems that are based on sums of weakly dependent Bernoulli random variables that take values ± 1 with equal probabilities. We show that already one step of the so-called soft decision parallel interference cancellation, used in the third generation of mobile telecommunication CDMA, is able to considerably increase the number of users such a system can host. We also consider a variant of the well-known Hopfield model of neural networks. We show that this variant proposed by Amari and Yanai [CITE] has a larger storage capacity than the original model. Both situations lead to the question of the moderate deviations behavior of a sum of weakly dependent Bernoulli random variables. We prove a moderate deviations principle for such a sum on the appropriate scale. },
author = {Löwe, Matthias, Vermet, Franck},
journal = {ESAIM: Probability and Statistics},
keywords = {Moderate deviations; large deviations; neural networks; storage capacity; Hopfield model; code division multiple access (CDMA) systems; parallel interference cancellation; moderate deviations; Hopfield network; code division multiple access- CDMA- systems; parallel interface cancellation},
language = {eng},
month = {7},
pages = {343-362},
publisher = {EDP Sciences},
title = {Capacity bounds for the CDMA system and a neural network: a moderate deviations approach},
url = {http://eudml.org/doc/250671},
volume = {13},
year = {2009},
}

TY - JOUR
AU - Löwe, Matthias
AU - Vermet, Franck
TI - Capacity bounds for the CDMA system and a neural network: a moderate deviations approach
JO - ESAIM: Probability and Statistics
DA - 2009/7//
PB - EDP Sciences
VL - 13
SP - 343
EP - 362
AB - We study two systems that are based on sums of weakly dependent Bernoulli random variables that take values ± 1 with equal probabilities. We show that already one step of the so-called soft decision parallel interference cancellation, used in the third generation of mobile telecommunication CDMA, is able to considerably increase the number of users such a system can host. We also consider a variant of the well-known Hopfield model of neural networks. We show that this variant proposed by Amari and Yanai [CITE] has a larger storage capacity than the original model. Both situations lead to the question of the moderate deviations behavior of a sum of weakly dependent Bernoulli random variables. We prove a moderate deviations principle for such a sum on the appropriate scale.
LA - eng
KW - Moderate deviations; large deviations; neural networks; storage capacity; Hopfield model; code division multiple access (CDMA) systems; parallel interference cancellation; moderate deviations; Hopfield network; code division multiple access- CDMA- systems; parallel interface cancellation
UR - http://eudml.org/doc/250671
ER -

References

top
  1. B. Aazhang and M.K. Varanasi, Multistage detection in asynchronous code division multiple acces communications. IEEE Trans. Commun.38 (1990) 509–519.  
  2. S. Amariand and H.-F. Yanai, Auto-associative memory with two-stage dynamics of nonmonotonic neurons. IEEE Trans. Neural Networks7 (1996) 803–815.  
  3. R.K. Bahr and J.S. Sadowski, Direct-sequence spread-spectrum multiple-access communications with random signature sequences: A large deviations analysis. IEEE Trans. Inform. Theory37 (1991) 514–527.  
  4. A. Ben-Israel and A. Charnes, Contribution to the theory of generalized inverses. J. SIAM11 (1963) 667–699.  
  5. A. Bovier, Sharp upper bounds for perfect retrieval in the Hopfield model. J. Appl. Probab.36 (1999) 941–950.  
  6. A. Bovier, Statistical mechanics of disordered system: A mathematical perspective. Cambridge Series in Statistical and Probabilistic Mathematics 18. Cambridge University Press (2006).  
  7. A. Bovier and V. Gayrard, Hopfield models as a generalized mean field model, preprint. In Mathematics of spin glasses and neural networks, A. Bovier and P. Picco (Eds.). Progress in Probability, Birkhäuser (1998).  
  8. R.M. Buehrer and B.D. Woerner, Analysis of adaptive multistage interference cancellation for CDMA using an improved Gaussian approximation. IEEE Trans. Commun.44 (1996) 1308–1329.  
  9. R.M. Buehrer, A. Kaul, S. Striglis and B.D. Woerner, Analysis of DS-CDMA parallel interference cancellation with phase and timing errors. IEEE JSAC14 (1996) 1522–1535.  
  10. B. Crespi, Storage capacity of non-monotonic neurons. Neural Networks12 (1999) 1377–1389.  
  11. P. de Jong, A Central Limit Theorem for Generalized Multilinear Forms. J. Multiv. Anal.34 (1990) 275–289.  
  12. G. Dreyfus, I. Guyon and L. Personnaz, Information storage and retrieval in spin-glass like neural networks. J. Phys. Lett.46 (1985) L359–L365.  
  13. G. Dreyfus, I. Guyon and L. Personnaz, Collective computational properties of neural networks: New learning mechanisms. Phys. Rev. A34 (1986) 4217–4228.  
  14. P. Eichelsbacher and M. Löwe, A large deviation principle for m-variate von Mises-statistics and U-statistics. J. Theoret. Probab.8 (1995) 807–824.  
  15. P. Eichelsbacher and M. Löwe, Moderate deviations for i.i.d. random variables. ESAIM: PS7 (2003) 209–218.  
  16. J.M. Holtzman, A simple, accurate method to calculate spread spectrum multiple-access error probabilities. IEEE Trans. Commun.40 (1992) 461–464.  
  17. J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA79 (1982) 2554–2558.  
  18. M. Juntti, Multiuser demodulation for DS-CDMA systems in fading channels, Ph.D. thesis, University of Oulu, Finland, 1998.  
  19. I. Kanter and H. Sampolinski, Associative recall of memory without errors. Phys. Rev. A35 (1987) 380–392.  
  20. M.J. Klok, G. Hooghiemstra, T. Ojanperä and R. Prasad, A novel technique for DS-CDMA system performance evaluation. VTC'99 spring, Houston, USA (1999).  
  21. K. Kobayashi, On the capacity of a neuron with a nonmonotone output function. Network2 (1991) 237–243.  
  22. W. König and P. Mörters, Brownian intersection local times: Upper tail asymptotics and thick points. Ann. Probab.30 (2002) 1605–1656.  
  23. M. Latva-aho, Advanced receivers for wideband CDMA systems, Ph.D. thesis, University of Oulu, Finland, 1999.  
  24. J.S. Lehnert and M.B. Pursley, Error probabilities for binary direct sequence spread-spectrum communications with random signature sequences. IEEE Trans. Commun.COM-35 (1987) 87–98.  
  25. J.S. Lehnert and R.K. Morrow, Bit-to-bit-error dependence in slotted DS/SSMA packet systems with random signature sequences. IEEE Trans. Commun.COM-37 (1989) 1052–1061.  
  26. M. Löwe, On the storage capacity of Hopfield models with weakly correlated patterns. Ann. Appl. Probab.8 (1999) 1216–1250.  
  27. M. Löwe and F. Vermet, The storage capacity of the Hopfield model and moderate deviations. Statist. Probab. Lett.75 (2005) 237–248.  
  28. M. Löwe and F. Vermet, The Capacity of q-state Potts neural networks with parallel retrieval dynamics. Statist. Probab. Lett.77 (2007) 1505–1514.  
  29. Mathematical aspects of spin glasses and neural networks, in A. Bovier and P. Picco (Eds.). Progress in Probability, Birkhäuser, Boston (1998).  
  30. R. McEliece, E. Posner, E. Rodemich and S. Venkatesh, The capacity of the Hopfield associative memory. IEEE Trans. Inform. Theory33 (1987) 461–482.  
  31. S.K. Mitra and C.R. Rao, Generalized inverse of matrices and its applications. Wiley, New York (1971).  
  32. M. Morita, Associative memory with nonmonotone dynamics. Neural Networks6 (1993) 115–126.  
  33. M. Morita, S. Yoshizawa and K. Nakano, Analysis and improvement of the dynamics of autocorrelation associative memory. Trans. Inst. Electron. Inform. Commun. Eng. JpnJ73-D-II (1990) 232–242.  
  34. N. Nishimori and I. Opris, Retrieval process of an associative memory with nonmonotonic input-output function. IEEE Int. Conf. Neural Networks1 (1993) 353–358.  
  35. G. Palm, Memory capacities of local rules for synaptic modification. Concepts Neurosci.2 (1991) 97–128.  
  36. L.A. Pastur and A.L. Figotin, Exactly soluble model of a spin-glas. Sov. J. Low Temp. Phys.3 (1977) 378–383.  
  37. D. Petritis, Thermodynamic formalism of neural computing; Nonlinear Phenomena of Complex Systems, volume 2, pp. 86–146. Kluwer Acad. Publ., Dordrecht (1996).  
  38. P. Picco, Artificial neural networks. A review from Physical and Mathematical point of view. Ann. Inst. H. Poincaré, Section A 64 (1996) 289–307.  
  39. R. Prasad, CDMA for wireless personal communications. Artech House (1996).  
  40. E. Rio, Théorie asymptotique des processus aléatoires faiblement dépendants. Springer (Ed.), Paris (2000).  
  41. M.O. Sunay and P.J. Mclane, Calculating error probabilities for DS CDMA systems: When not to use the Gaussian approximation. IEEE Globecom3 (1996) 1744–1749.  
  42. R. van der Hofstad and M.J. Klok, Improving the performance of third-generation wireless communication systems. Adv. Appl. Probab.36 (2004) 1046–1084.  
  43. R. van der Hofstad, G. Hooghiemstra and M.J. Klok, Large deviations for code division multiple access systems. SIAM J. Appl. Math.62 (2002) 1044–1065.  
  44. R. van der Hofstad, M. Löwe and F. Vermet, The effect of system load on the existence of bit-errors in CDMA with and without parallel interference cancelation. IEEE Trans. Inform. Theory52 (2006) 4733–4741.  
  45. F. Vermet, Étude asymptotique d'un réseau neuronal : le modèle de mémoire associative de Hopfield, Ph.D. thesis, University of Rennes 1, France, 1994.  

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.