Overview of the detection and tracking methods of the lab animals
DOI:
https://doi.org/10.20535/SRIT.2308-8893.2022.1.10Keywords:
object tracking, object detection, algorithm, video, frame, image, background, foreground, experiment, color space, thresholding, background estimation, segmentationAbstract
This article presents an overview of several most common techniques and approaches for object detection and tracking. Today, the tracking task is a very common problem and it can appear in many aspects of our life. One particular case of using object tracking techniques can appear during a lab animal behavior study. Different experimental conditions and the need of certain data collection can require some special tracking techniques. Thus, a set of general approaches to object tracking techniques were considered, and their functionality and possibilities were tested in a real life experiment. In this paper, their basis and main aspects are presented. The experiment has demonstrated the advantages and disadvantages of the studied methods. Considering this, conclusions and recommendations to their usage cases were made.
References
A.R. Smith, “Color Gamut Transform Pairs”, in SIGGRAPH '78: Proceedings of the 5th annual conference on Computer graphics and interactive techniques, pp. 12–19, 1978. doi:10.1145/800248.807361.
W.K. Pratt, Digital Image Processing; 4th edition. Wiley-Interscience, A John Wiley & Sons, Inc., Publication, 2007, 807 p.
X. Zhao, S. Yan, and Q. Gao, “An Algorithm for Tracking Multiple Fish Based on Biological Water Quality Monitoring”, IEEE Access, vol. 7, pp. 15018–15026, January 2019. doi:10.1109/ACCESS.2019.2895072.
J. Delcourt, M. Denoel, M. Ylieff, and P. Poncin, “Video multitracking of fish behaviour: A synthesis and future perspectives”, Fish and Fisheries, vol. 14, no. 2, pp. 186–204, June 2013. doi:10.1111/j.1467-2979.2012.00462.x.
H.E.-D. Mohamed et al. “MSR-YOLO: Method to Enhance Fish Detection and Tracking”, The 11th International Conference on Ambient Systems, Networks and Technologies (ANT), April 6–9, 2020, Warsaw, Poland.
P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, “Contour Detectionand Hierarchical Image Segmentation”, IEEE TPAMI, vol. 33, no. 5, pp. 898–916, 2011. doi: 10.1109/TPAMI.2010.161.
S. Beucher, “The Watershed Transformation Applied to Image Segmentation”, Scanning microscopy, vol. 6, July 2000, 26 p.
R. Brunelli, Template Matching Techniques in Computer Vision. Theory and Practice. Wiley, 2009, 339 p.
Dr. A.S. Khedher, Dr. A.M. Alkababji, and O. Hadi, “Improving the Reliability of Object Recognition Based On Template Matching”, AL Rafdain Engineering Journal, Computer Science, pp. 81–88, 2015.
Template Matching. Available: https://docs.opencv.org/3.4/de/da9tutorial_template_ matching.html
D.G. Lowe, “Object recognition from local scale-invariant features”, International Conference on Computer Vision – ICCV, 1999, vol. 2, pp. 1150–1157.
H. Kong, H.C. Akakin, and S.E. Sarma, “A Generalized Laplacian of Gaussian Filter for Blob Detection and Its Applications”, IEEE Transactions on Cybernetics, vol. 43, no. 6, pp. 1719–1733, January 2013. doi: 10.1109/TSMCB.2012.2228639.
L. Assirati, N.R. Silva, L. Berton, A.A. Lopes, and O.M. Bruno, “Performing edge detection by Difference of Gaussians using q-Gaussian kernels”, 2nd International Conference on Mathematical Modeling in Physical Sciences 2013, Journal of Physics, Conference Series 490(2014) 012020, IOP Publishing, 2014, 4 p. doi: 10.1088/1742-6596/490/1/012020.
T. Lindeberg, “Scale Invariant Feature Transform”, Scholarpedia, vol. 7, no. 5: 10491, 2012, 17 p. doi: 10.4249/scholarpedia.10491.
H. Bay, T. Tuytelaars, and L.V. Gool, “SURF: Speeded up robust features”, in Proceedings of the 9th European conference on Computer Vision, vol. 1, 2006, 14 p. doi: 10.1007/11744023_32.
N. Dalal and B. Triggs, “Histograms of oriented gradients for human detection”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR ’05), San Diego, United States, vol. 1, pp. 886–893, June 2005. doi: 0.1109/CVPR.2005.177.
T. Kobayashi, A. Hidaka, and T. Kurita, “Selection of Histograms of Oriented Gradients Features for Pedestrian Detection”, Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13–16, 2007, Revised Selected Papers, Part II, pp. 598–607. doi: 10.1007/978-3-540-69162-4_62.
P. Viola and M. Jones, “Rapid Object Detection using a Boosted Cascade of Simple Features”, IEEE Conference on Computer Vision Pattern Recognition, vol. 1, 2001. doi: I-511.10.1109/CVPR.2001.990517.
H. Hunud, A. Kadouf, and Y.M. Mustafah, “Colour-based Object Detection and Tracking for Autonomous Quadrotor UAV”, 2013 IOP Conf. Ser.: Mater. Sci. Eng., vol. 53, 2013, 9 p. doi:10.1088/1757-899X/53/1/012086.
V.V. Moroz and M.A. Shvandt, “Study of movement and behavior of laboratory animals by methods of object detection and tracking”, Herald of the National Technical University “KhPI”, Series of “Informatics and Modeling”, Kharkiv: NTU “KhPI”, Kharkiv, vol. 13, no. 1338, pp. 93–103, 2019. doi: 10.20998/2411-0558.2019.13.09.
A.M. Raid, W.M. Khedr, M.A. El-dosuky, and Mona Aoud, “Image restoration based on morphological operations”, International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), vol. 4, no. 3, 2014, pp. 9–21. doi: 10.5121/ijcseit.2014.4302.
S. Ravi and A.M. Khan, “Morphological Operations for Image Processing: Understanding and its Applications”, in NCVSComs-13 Conference Proceedings, 2015, pp. 17–19.
Y. Zhang, “Pathological Brain Detection based on wavelet entropy and Hu moment invariants”, Bio-Medical Materials and Engineering, no. 26, pp. 1283–1290, 2015.
P. Joshi, D.M. Escrivá, and V. Godoy, OpenCV By Example. Birmingham: Packt Publishing Ltd, 2016, 297 p.
M. Nixon and A. Aguado, Feature Extraction & Image Processing for Computer Vision; 3d ed. London: Elsevier Ltd, 2012, 623 p.
S.-C.S. Cheung and C. Kamath, “Robust Background Subtraction with Foreground Validation for Urban Traffic Video”, EURASIP Journal on Applied Signal Processing, vol. 14, pp. 2330–2340, Hindawi Publishing Corporation, 2005.
M.A. Alawi, O.O. Khalifa, and M.D.R. Islam, “Performance Comparison of Background Estimation Algorithms for Detecting Moving Vehicle”, World Applied Sciences Journal 21 (Mathematical Applications in Engineering), IDOSI Publications, 2013, pp. 109–114. doi: 10.5829/idosi.wasj.2013.21.mae.99934.
S. Mallick, Simple Background Estimation in Videos using OpenCV (C++/Python). 2019. Available: https://learnopencv.com/simple-background-estimation-in-videos-using-opencv-c-python/.
Y. Cheng, “Mean Shift, Mode Seeking, and Clustering”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 790–799, August 1995.
D. Comaniciu and P. Meer, “Mean Shift: A Robust Approach Toward Feature Space Analysis”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603–619, May 2002. doi: 10.1109/34.1000236.
G. Bradski, “Computer Vision Face Tracking For Use in a Perceptual User Interface”, Archived 2012-04-17 at the Wayback Machine, Intel Technology Journal, no. Q2, 1998.
B. Lucas and T. Kanade, “An iterative image registration technique with an application to stereo vision”, in Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI ’81), pp. 674–679.
A. Radgui, C. Demonceaux, E. Mouaddib, D. Aboutajdine, and M. Rziza, “An adapted Lucas–Kanade’s method for optical flow estimation in catadioptric images”, The 8th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras - OMNIVIS, Marseille: France, Marseille, 2008, 12 p.
Optical Flow. Available: https://docs.opencv.org/3.4/d4/dee/tutorial_optical_ flow.html.
G. Farneback, “Two-Frame Motion Estimation Based on Polynomial Expansion”, Lecture Notes in Computer Science, 8 p., 2003.
C. Veenman, M. Reinders, and E. Backer, “Resolving motion correspondence for densely moving points”, IEEE Transactions on Pattern Analysis Machine Intelligence, vol. 23, no. 1, pp. 54–72, 2001. doi: 10.1109/34.899946.
A. Salarpour, A. Salarpour, M. Fathi, and M.H. Dezfoulian, “Vehicle tracking using Kalman filter and features”, Signal and Image Processing: An International Journal (SIPIJ), vol. 2, no. 2, pp. 45–67, 2011. doi: 10.5121/sipij.2011.2201.
S. Dan, Zh. Baojun, and T. Linbo, “A Tracking Algorithm Based on SIFT and Kalman Filter”, in Proceedings The 2nd International Conference on Computer Application and System Modeling, 2012, pp. 1563–1566.
F. Gunnarsson, N. Bergman, U. Forssell, J. Jansson, R. Karlsson, and P.J. Nordlund, “Particle Filters for Positioning, Navigation and Tracking”, IEEE Transactions on Signal Processing, vol. 2, no. 2, pp. 425–437, 2002.
S. Mallick, Object Tracking using OpenCV (C++/Python). 2017. Available: https://learnopencv.com/object-tracking-using-opencv-cpp-python/.
Z. Kalal, K. Mikolajczyk, and J. Matas, “Forward-Backward Error: Automatic Detection of Tracking Failures”, in Proceedings of International Conference on Pattern Recognition, 23-26 August, 2010, Istambul, Turkey, 4 p. doi: 10.1109/ICPR.2010.675.
Z. Kalal, K. Mikolajczyk, and J. Matas, “Tracking-Learning-Detection”, in Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 6, no. 1, 2010, 14 p.
S. Zhou, Y. Peng, K. Gong, and L. Shu, “An Improved TLD Tracking Algorithm for Fast-moving Object”, International Conference on Computer Science, Electronics and Communication Engineering (CSECE 2018), Advances in Computer Science Research, vol. 80, pp. 69–73.
D.S. Bolme, J.R. Beveridge, B.A. Draper, and Y.M. Lui, “Visual Object Tracking using Adaptive Correlation Filters”, CVPR, 2010, 10 p. doi: 10.1109/CVPR.2010.5539960.
