Color distribution functions of multilayer multispectral matrix photodetectors after interpolation

Publication in Journal of Optical Technology

For Russian citation (Opticheskii Zhurnal):

Жбанова В.Л. Функции распределения цвета в многослойных мультиспектральных матричных фотоприемниках при интерполировании // Оптический журнал. 2022. Т. 89. № 11. С. 44–53. http://doi.org/10.17586/1023-5086-2022-89-11-44-53

Zhbanova V.L. Color distribution functions of multilayer multispectral matrix photodetectors after interpolation [in Russian] // Opticheskii Zhurnal. 2022. V. 89. № 11. P. 44–53. http://doi.org/10.17586/1023-5086-2022-89-11-44-53

For citation (Journal of Optical Technology):

V. L. Zhbanova, "Color distribution functions of multilayer multispectral matrix photodetectors after interpolation," Journal of Optical Technology. 89(11), 670-676 (2022). https://doi.org/10.1364/JOT.89.000670

Abstract:

Subject of study. This study investigated patterns developed for color separation systems based on multilayer sensors to detect radiation in the visible and infrared spectral ranges. Three systems were considered where only half of the sensors comprised a layer sensitive to infrared radiation and a system where each sensor comprised an infrared radiation registration layer. The patterns consisted of various combinations of up to two red, green, blue, or infrared layers in one cell. Aim of study. The study aimed to determine the color distribution function during interpolation in the developed patterns for various combinations of layers. Method. Based on an algorithm for determining modulation transfer functions, the color distribution functions over the image were determined using the nearest neighbor interpolation method. Consequently, the functions obtained for the standard Bayer and developed multilayer patterns with the same cell parameters and having an arrangement similar to a checkerboard pattern were compared. Main results. The obtained functions naturally exhibited an oscillatory character. The systems with frequently repeating layers of one part of the spectrum were the most stable. Furthermore, color distribution functions superior to those of Bayer patterns were obtained when the developed patterns were used in a checkerboard pattern for color interpolation using the nearest neighbor method. Moreover, the application of a different order in the pattern may result in poorer color distribution functions. Practical significance. Color distribution functions are useful when choosing a pattern for specific purposes (e.g., for better color resolution in the green part of the visible spectrum or infrared range. The development of multispectral patterns based on four sensors within a bilayer system inevitably results in a decrease in the distribution functions of certain colors. Thus, this should be considered in the production of such color separation systems. Moreover, the results of the study can be useful for specialists in the field of digital technology, matrix photodetectors, and image processing.

Keywords:

multispectral, infrared radiation, matrix photodetector, multilayer sensor, modulation transfer function, interpolation, optical transfer function

Acknowledgements:

The research was supported by the grant of RSF No. 21-79-00012, https://rscf.ru/project/21-79-00012/

OCIS codes: 110.4234, 110.4850

References:

1. N. I. Soroka and G. A. Krivinchenko, Telemechanics (Izdate’stvo Belorusskogo Gosudarstvennogo Universiteta, Minsk, 2005).
2. V. A. Solomatin and V. L. Zhbanova, “Influence of photodetectorarray patterns on spatial-frequency response,” J. Opt. Technol. 88(12), 722–728 (2021) [Opt. Zh. 88(12), 59–67 (2021)].
3. V. V. Tikhonychev and A. A. Danilin, “Influence of color interpolation on the spatial-frequency properties of the matrix receiver of optical radiation” (2009), http://zhurnal.ape.relarn.ru/articles/2009/101.pdf.
4. A. Franco, Ya. Riesen, M. Despeisse, and N. Wyrsch, “High spatial resolution of thin-film-on-ASIC particle detectors,” IEEE Trans. Nucl. Sci. 59(5), 2614–2621 (2012).
5. P. M. Hubel, J. Liu, and R. J. Guttosch, “Spatial frequency response of color image sensors: Bayer color filters and Foveon X3,” Proc. SPIE 5301 (2004).
6. R. B. Merrill, “Color separation in an active pixel pit imaging array using a triple-well structure,” US patent 5965875 (1999).

7. P. Rieve, M. Walder, K. Seibel, J. Prima, and A. Mirhamed, “TFA image sensor with stability-optimized photodiode,” US patent 7701023 (2010).
8. V. L. Zhbanova, “Development and research of optoelectronic color separation systems for matrix photodetectors,” Ph.D. thesis (MIIGAiK, Moscow, 2016).
9. P. Stotko, M. Weinmann, and R. Klein, “Albedo estimation for real-time 3D reconstruction using RGB-D and IR data,” ISPRS J. Photogramm. Remote Sens. 150, 213–225 (2019).
10. Y. Nonaka, D. Yoshida, S. Kitamura, T. Yokota, M. Hasegawa, and K. Ootsu, “Monocularcolor-IR imaging system applicable for various light environments,” in 2018 IEEE International Conference on Consumer Electronics (2018).
11. V. A. Solomatin, Yu. B. Parvulyusov, and V. L. Zhbanova, “Spatial-frequency characteristics of photo matrices for colour image,” J. Phys. Conf. Ser. 1679, 022038 (2020).
12. V. L. Zhbanova, Yu. B. Parvulyusov, and V. A. Solomatin, “Multispectral matrix silicon photodetectors with the IR range registration,” J. Phys. Conf. Ser. 1679, 022039 (2020).
13. J. E. Adams, Jr., J. F. Hamilton, Jr., and M. O’Brien, “Interpolation of panchromatic and color pixels,” US patent 7830430 (2010).
14. M. V. Gashnikov, “Adaptive interpolation based on optimization of a decision rule in a multidimensional feature space,” Comput. Opt. 44(1), 101–108 (2020).
15. G. Zapryanov and I. Nikolova, “Comparative study of demosaicing algorithms for Bayer and pseudo-random Bayer color filter arrays,” in International Scientific Conference on Computer Science (2008), pp. 133–139.
16. J. Li, “A solution method for image distortion correction model based on bilinear interpolation,” Comput. Opt. 43(1), 99–104 (2019).
17. Yu. B. Parvulyusov and V. L. Zhbanova, “Analysis of the effect of color interpolation on the spatial-frequency properties of a matrix photodetector,” Izv. Vuzov Geod. Aerofotos’emka (3), 135–140 (2016).