Video surveillance is a normal security procedure in the living environments nowadays due to the requirement of continuous cost effective automatic monitoring necessity for the safe and peaceful life structure. The identification and detection of moving persons or objects is a tedious process with the optimal accuracy in dimensions and validity. The essential and required improvements in the entire methodology critically depend upon the image processing approaches with effective care on the image frames. For this goal Image processing plays a vital role in order to handle the video data in proper way for analysis and prediction of performances for the improvement of motion detection in video surveillance system domain results. This paper presents a survey on motion detection analysis for video surveillance system.