Background subtraction with adaptive spatio-temporal neighborhood analysis

In the literature, visual surveillance methods based on joint pixel and region analysis for background subtraction are proven to be effective in discovering foreground objects in cluttered scenes. Typically, per-pixel foreground detection is contextualized in a local neighborhood region in order to limit false alarms. However, such methods have an heavy computational cost, depending on the size of the surrounding region considered for each pixel. In this paper, we propose an original and efficient joint pixel-region analysis technique able to automatically select the sampling rate with which pixels in different areas are checked out, while adapting the size of the neighborhood region considered. The algorithm has been validated on standard videos with benchmark tests, proving the goodness of the approach, especially in terms of quality of the detection with respect to the frame rate achieved.