Surveillance systems important in order to increase the safety and security of people . The Systems have applications in various domains like home or bank security, traffic monitoring, defense and in public places like railway stations, malls, airports. The Goal to develop an intelligent real-time surveillance system is increasing the efficiency of the system. To cover a large area, need to install more number of cameras that leads to more number of videos that are to be monitored simultaneously. Cameras are placed in overlap between the field of view of the cameras. Field of view establishing an association between the cameras. Real time surveillance system detects and tracks the objects in motion and provides automatic warning in case of suspicious activities which is unidentified object and restricted zone monitoring. While intelligent environments are often cited as a reason for doing work on visual person-tracking, really making an intelligent environment exposes many real-world problems in visual tracking that must be solved to make the technology practical. In the context of our easy living project in intelligent environments, we created a practical person-tracking system that solves most of the real-world problems. It uses two sets of color stereo cameras for tracking multiple people during live demonstrations in a living room. The stereo images are used for locating people, and the color images are used for maintaining their identit ies. The system runs quickly enough to make the room feel responsive, and it tracks multiple people standing, walking, sitting, occluding, and entering and leaving the space.