УДК: 612.82, 159.931, 004.93'12, 004.932
Classification and recognition of images of animate and inanimate objects
Full text «Opticheskii Zhurnal»
Full text on elibrary.ru
Publication in Journal of Optical Technology
Моисеенко Г.А., Шелепин Ю.Е., Хараузов А.К., Пронин С.В., Чихман В.Н., Вахрамеева О.А. Классификация и распознавание изображений живой и неживой природы // Оптический журнал. 2015. Т. 82. № 10. С. 53–64.
Moiseenko G.A., Shelepin Yu.E., Kharauzov A.K., Pronin S.V., Chikhman V.N., Vakhrameeva O.A. Classification and recognition of images of animate and inanimate objects [in Russian] // Opticheskii Zhurnal. 2015. V. 82. № 10. P. 53–64.
G. A. Moiseenko, Yu. E. Shelepin, A. K. Kharauzov, S. V. Pronin, V. N. Chikhman, and O. A. Vakhrameeva, "Classification and recognition of images of animate and inanimate objects," Journal of Optical Technology. 82(10), 685-693 (2015). https://doi.org/10.1364/JOT.82.000685
The work of an operator in solving two classification problems when working with one image alphabet is studied. From ninety visual stimuli, half of the images contained animate objects, and the other half contained inanimate objects. The first task was to classify the images according to a semantic attribute—whether they contained an animate or inanimate object. This alphabet of stimuli was then subjected to wavelet filtering in a low- and high-spatial-frequency region, regardless of semantic significance. The second task was to classify the stimuli according to a physical attribute—a blurred or unblurred object in the image. Electrophysiological monitoring of the operator’s work—recording of the induced visual potentials from the entire surface of the head—made it possible to detect that, from the beginning of the stimulation until the organization of the motor response, parallel processing of the observed signal occurs according to the different semantic and physical attributes. The responses of the temporal and frontal sections of the brain associated with the semantics of the images are distinguished, even under those conditions in which the subject’s task was to classify the physical properties of an image of an object.
visual search, categorization, image recognition, induced brain potentials, wavelet filtering
Acknowledgements:This investigation was carried out as part of the financing of the scientific research project “Technology for optimizing and restoring human cognitive functions by a virtual medium” (Project No. 14-15-00918 of the Russian Scientific Foundation at the I. P. Pavlov Institute of Physiology, Russian Academy of Sciences).
OCIS codes: 100.499, 330.5000, 330.5020
References:1. S. E. Zdor and V. B. Shirokov, Optical Search and Recognition (Nauka, Moscow, 1973).
2. N. P. Travnikova, The Efficiency of Visual Search (Mashinostroenie, Moscow, 1985).
3. Ya. A. Fomin, Pattern Recognition: Theory and Application (FAZIS, Moscow 2012).
4. R. C. Gonzalez and R. E. Woods, Digital Image Processing (Prentice Hall, Upper Saddle River, N.J., 2002; Tekhnosfera, Moscow, 2005).
5. N. N. Krasil’nikov, Digital Image Processing (Vuzovskaya Kniga, Moscow, 2001).
6. V. A. Soı˘fer, ed., Methods of Computer Image Processing (Fizmatlit, Moscow, 2001).
7. A. A. Potapov, ed., The Latest Methods of Image Processing (Fizmatlit, Moscow, 2008).
8. L. G. Shapiro and G. C. Stockman, Computer Vision (Prentice-Hall, Englewood Cliffs, N.J., 2001; Binom. Laboratoriya Znaniı˘, Moscow, 2006).
9. Yu. I. Zhuravlev, “Recognition, classification, prediction,” in Mathematical Methods and Their Application (Nauka, Moscow, 1989), pp. 5–72.
10. V. R. Lutsiv and I. A. Malyshev, “Image structural analysis in the tasks of automatic navigation of unmanned vehicles and inspection of Earth surface,” Proc. SPIE 8897, 88970F (2013).
11. R. O. Malashin and V. R. Lutsiv, “Restoring a silhouette of the hand in the problem of recognizing gestures by adaptive morphological filtering of a binary image,” J. Opt. Technol. 80, 685 (2013) [Opt. Zh. 80, No. 11, 54 (2013)].
12. D. A. Forsyth and J. Ponce, Computer Vision: A Modern Approach (Prentice Hall, New York, 2003; Williams, Moscow, 2004).
13. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification and Scene Analysis, Part 1, Pattern Classification (John Wiley & Sons, N.Y., 1997), pp. 1–41.
14. M. M. Miroshnikov, V. A. Lisovskiı˘, and E. V. Filippov, Iconics in Physiology and Medicine (Nauka, Leningrad, 1987).
15. Yu. I. Zhuravlev, V. V. Ryazanov, and O. V. Sen’ko, Recognition, Mathematical Methods, Software System, Practical Applications (FAZIS, Moscow, 2006).
16. S. A. Evdokimov, M. V. Pronina, G. Yu. Polyakova, V. A. Ponomarev, Yu. I. Polyakov, and Yu. D. Kropotov, “Analysis of the independent components caused by the potentials of patients with established diagnoses of schizophrenia, obsessive–compulsive and depressive disorder,” Zh. Vyssh. Nervn. Deyatel. 64, 500 (2014).
17. V. M. Bondarko, M. V. Danilova, N. N. Krasil’nikov, L. I. Leushina, A. A. Nevskaya, and Yu. E. Shelepin, Three-Dimensional Vision (Nauka, St. Petersburg, 1999).
18. Yu. D. Kropotov, Quantitative EEG, Cognitive Induced Potentials of the Human Brain and Neurotherapy (Izd. A. Yu. Zaslavskiı˘, Donetsk, 2010).
19. A. Keil, S. Debener, G. Gration, M. Junghoefer, E. S. Kapperman, S. J. Luck, P. Luu, G. A. Miller, and C. M. Yee, “Committee report: publication guidelines and recommendations for studies using electroencephalography and magnetoencephalography,” Psychophysiology 51, 1 (2014).
20. S. V. Murav’eva, A. A. Deshkovich, and Yu. E. Shelepin, “Magno- and parvosystems of man and selective breakdown of their operation,” Ross. Fiziol. Zh. 94, 637 (2008).
21. Y. E. Shelepin, M. V. Danilova, A. K. Harauzov, Y. D. Kropotov, and A. V. Sevostianov, “Attention and preattentive vision,” in Abstracts of Thirty-Third International Congress of Physiological Sciences (St. Petersburg, 1997), p. 80.
22. O. P. Marchenko, “Electric potentials of the brain associated with categorization of the causes of animated and inanimate objects,” Éksp. Psikhol. 3, No. 1, 5 (2010).
23. M. Craddock, J. Martinovic, and M. M. Müller, “Task and spatial frequency modulations of object processing: an EEG Study,” PLoS ONE 8, No. 7, e70293 (2013).
24. Yu. E. Shelepin, V. A. Fokin, A. K. Kharauzov, S. V. Pronin, and V. N. Chikhman, “Localization of the decision-making center when perceiving the shape of visual stimuli,” Dok. Akad. Nauk. 429, 835 (2009).
25. Yu. E. Shelepin, V. A. Fokin, S. V. Men’shikova, O. V. Borachuk, S. A. Koskin, A. V. Sokolov, S. V. Pronin, A. K. Kharauzov, P. P. Vasil’ev, and O. A. Vakhrameeva, “Methods of iconics and methods of mapping the brain in estimating the functional state of the visual system,” Sens. Sist. 28, No. 2, 63 (2014).
26. M. Kometer, A. Schmidt, L. Jancke, and F. X. Vollenweider, “Activation of serotonin 2A receptors underlies the psilocybin-induced effects on oscillations, N170 visual-evoked potentials and visual hallucinations,” J. Neurosci. 33, 10544 (2013).
27. Yu. D. Kropotov, M. V. Pronina, Yu. I. Polyakov, and V. A. Ponomarev, “Functional biomarkers in the diagnostics of mental illness: cognitive induced potentials,” Fiziol. Chel. 39, No. 1, 14 (2013).
28. C. C. Duncan, “Event-related brain potentials: a window on information processing in schizophrenia,” Schizophr. Bull. 14, No. 2, 199 (1968).
29. A.-M. Brouwer, B. Reuderink, and J. Vincent, M. A. J. van Gerven, and J. B. F. van Erp, “Distinguishing between target and nontarget fixations in a visual search task using fixation-related potentials,” J. Vis. 13, No. 17, 1 (2013).
30. C. A. Joyce, P. G. Schyns, F. Gosselin, G. W. Cottrell, and B. Rossion, “Early selection of diagnostic facial information in the human visual cortex,” Vis. Res. 46, 800 (2006).
31. K. Tanaka, “Inferotemporal cortex and object vision,” Annu. Rev. Neurosci. 19, 109 (1996).
32. A. M. Ivanitskiı˘, Brain Mechanisms for Evaluating Signals (Meditsina, Moscow, 1976).
33. E. Kokurina, Natal’ya Bekhtereva. The Code of Life (Boslen, Moscow, 2015).
34. Yu. E. Shelepin, O. V. Borachuk, S. V. Pronin, A. K. Kharauzov, P. P. Vasil’ev, and V. A. Fokin, “The face and nonverbal means of communication,” Peterburg Psikhol. Zh. No. 9, 1 (2014).