Conceptual base of feature selection consulting system

Pavel Pudil; Jana Novovičová; Petr Somol; Radek Vrňata

Kybernetika (1998)

  • Volume: 34, Issue: 4, page [451]-460
  • ISSN: 0023-5954

Abstract

top
The paper briefly reviews recent advances in the methodology of feature selection (FS) and the conceptual base of a consulting system for solving FS problems. The reasons for designing a kind of expert or consulting system which would guide a less experienced user are outlined. The paper also attempts to provide a guideline which approach to choose with respect to the extent of a priori knowledge of the problem. The methods discussed here form the core of the software package being developed for solving FS problem. Two basic approaches are reviewed and the conditions under which they should be used are specified. One approach involves the use of the computationally effective Floating search methods. The alternative approach trades off the requirement for a priori information for the requirement of sufficient data to represent the distributions involved. Owing to its nature it is particularly suitable for cases when the underlying probability distributions are not unimodal. The approach attempts to achieve simultaneous feature selection and decision rule inference. According to the criterion adopted there are two variants allowing the selection of features either for optimal representation or discrimination.

How to cite

top

Pudil, Pavel, et al. "Conceptual base of feature selection consulting system." Kybernetika 34.4 (1998): [451]-460. <http://eudml.org/doc/33377>.

@article{Pudil1998,
abstract = {The paper briefly reviews recent advances in the methodology of feature selection (FS) and the conceptual base of a consulting system for solving FS problems. The reasons for designing a kind of expert or consulting system which would guide a less experienced user are outlined. The paper also attempts to provide a guideline which approach to choose with respect to the extent of a priori knowledge of the problem. The methods discussed here form the core of the software package being developed for solving FS problem. Two basic approaches are reviewed and the conditions under which they should be used are specified. One approach involves the use of the computationally effective Floating search methods. The alternative approach trades off the requirement for a priori information for the requirement of sufficient data to represent the distributions involved. Owing to its nature it is particularly suitable for cases when the underlying probability distributions are not unimodal. The approach attempts to achieve simultaneous feature selection and decision rule inference. According to the criterion adopted there are two variants allowing the selection of features either for optimal representation or discrimination.},
author = {Pudil, Pavel, Novovičová, Jana, Somol, Petr, Vrňata, Radek},
journal = {Kybernetika},
keywords = {feature selection; a priori information; feature selection; a priori information},
language = {eng},
number = {4},
pages = {[451]-460},
publisher = {Institute of Information Theory and Automation AS CR},
title = {Conceptual base of feature selection consulting system},
url = {http://eudml.org/doc/33377},
volume = {34},
year = {1998},
}

TY - JOUR
AU - Pudil, Pavel
AU - Novovičová, Jana
AU - Somol, Petr
AU - Vrňata, Radek
TI - Conceptual base of feature selection consulting system
JO - Kybernetika
PY - 1998
PB - Institute of Information Theory and Automation AS CR
VL - 34
IS - 4
SP - [451]
EP - 460
AB - The paper briefly reviews recent advances in the methodology of feature selection (FS) and the conceptual base of a consulting system for solving FS problems. The reasons for designing a kind of expert or consulting system which would guide a less experienced user are outlined. The paper also attempts to provide a guideline which approach to choose with respect to the extent of a priori knowledge of the problem. The methods discussed here form the core of the software package being developed for solving FS problem. Two basic approaches are reviewed and the conditions under which they should be used are specified. One approach involves the use of the computationally effective Floating search methods. The alternative approach trades off the requirement for a priori information for the requirement of sufficient data to represent the distributions involved. Owing to its nature it is particularly suitable for cases when the underlying probability distributions are not unimodal. The approach attempts to achieve simultaneous feature selection and decision rule inference. According to the criterion adopted there are two variants allowing the selection of features either for optimal representation or discrimination.
LA - eng
KW - feature selection; a priori information; feature selection; a priori information
UR - http://eudml.org/doc/33377
ER -

References

top
  1. Boekee D. E., Lubbe J. C. A. Van der, 10.1016/0031-3203(79)90047-5, Pattern Recognition 11 (1979), 252–360 (1979) MR0553356DOI10.1016/0031-3203(79)90047-5
  2. Devijver P., Kittler J., Pattern Recognition: A Statistical Approach, Prentice 1982 Zbl0542.68071MR0692767
  3. Ferri F. J., Pudil P., Hatef M., Kittler J., Comparative study of techniques for large–scale feature selection, In: Pattern Recognition in Practice IV (E. S. Gelsema and L. N. Kanal, eds.), Elsevier 1994, pp. 403–413 (1994) 
  4. Kittler J., Feature selection and extraction, Handbook of Pattern Recognition and Image Processing (T. Y. Young and K. S. Fu, eds.), Academic Press, New York 1986, pp. 60–81 (1986) 
  5. Narendra P. M., Fukunaga K., 10.1109/TC.1977.1674939, IEEE Trans. Computers C-26 (1977), 917–922 (1977) DOI10.1109/TC.1977.1674939
  6. Novovičová J., Pudil P., Kittler J., Feature selection based on divergence for empirical class densities, In: Proc. of the 9th Scandinavian Conf. on Image Analysis, Uppsala 1995 
  7. Novovičová J., Pudil P., Kittler J., 10.1109/34.481557, IEEE Trans. Pattern Recognition Machine Intelligence 18 (1996), 2, 218–223 (1996) DOI10.1109/34.481557
  8. Novovičová J., Pudil P., Feature selection and classification by modified model with latent structure, In: Dealing With Complexity: Neural Network Approach. Springer Verlag, Berlin 1997, pp. 126–140 (1997) 
  9. Pudil P., Bláha S., Novovičová J., PREDITAS – software package for solving pattern recognition and diagnostic problems, In: Proc. BPRA 4th Internat. Conference on Pattern Recognition, Cambridge (J. Kittler, ed.), Springer–Verlag, Berlin 1988, pp. 146–152 (1988) 
  10. Pudil P., Novovičová J., Choakjarernwanit N., Kittler J., 10.1016/0167-8655(93)90147-6, Pattern Recognition Lett. 14 (1993), 11, 841–847 (1993) Zbl0802.68118DOI10.1016/0167-8655(93)90147-6
  11. Pudil P., Novovičová J., Choakjarernwanit N., Kittler J., The Max–Min approach to feature selection: Its foundations and potential, Indian J. Pure Appl. Math. 24 (1994), 11, 69–81 (1994) 
  12. Pudil P., Novovičová J., Kittler J., Automatic machine learning of decision rule for classification problems in image analysis, In: Proceedings of BMVC ’93 – the 4th British Machine Vision Conference, 1993 
  13. Pudil P., Novovičová J., Kittler J., 10.1016/0262-8856(94)90072-8, Image and Vision Computing 12 (1994), 3, 193–198 (1994) DOI10.1016/0262-8856(94)90072-8
  14. Pudil P., Ferri F., Novovičová J., Kittler J., Floating search methods for feature selection with nonmonotonic criterion functions, In: Proc. of the 12th IAPR Intern. Conf. on Pattern Recognition, Jerusalem 1994, IEEE Comp. Society Press, pp. 279–283 (1994) 
  15. Pudil P., Novovičová J., Kittler J., 10.1016/0167-8655(94)90127-9, Pattern Recognition Lett. 15 (1994), 1119–1125 (1994) DOI10.1016/0167-8655(94)90127-9
  16. Pudil P., Novovičová J., Choakjarerwanit N., Kittler J., 10.1016/0031-3203(94)00009-B, Pattern Recognition 28 (1995), 9, 1389–1397 (1995) DOI10.1016/0031-3203(94)00009-B
  17. P.Pudil J.Novovičová, Ferri F. J., Methods of dimensionality reduction in statistical pattern recognition, In: Proceedings of the IEEE European Workshop CMP’94, Prague 1994, Institute of Information Theory and Automation, pp. 185–198 (1994) 
  18. Siedlecki W., Sklansky J., 10.1142/S0218001488000145, Internat. J. Pattern Recognition and Artificial Intelligence 2 (1988), 2, 197–220 (1988) DOI10.1142/S0218001488000145
  19. Zongker D., Jain A., Algorithms for feature selection: An evaluation, In: Proceedings of 13th International Conference on Pattern Recognition, Vienna 1996, Vol. II, Track B, pp. 18–22 (1996) 

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.