This system proposes an improved multi-task cascaded convolutional network-based intelligent fruit and ripening detection method. This method has the capability to make the Automated Robot work in real time with high accuracy. Moreover, based on the relationship between the diversity samples of the dataset and the parameters of neural networks evolution, this paper presents an improved augmented method, a procedure that is based on image fusion to improve the detector performance. The chloroplast is responsible for providing the green color in the plant. Where as the chromoplast its various types of colors in the plant. There is a change from Green to yellow color in most of the fruit. This is due to the overgrowth of the chromoplast by replacement of the chloroplast hence there is feeding of the green color and prominence of the yellow color. The change of color of unripe green fruit from green to red is because of the transformation of chloroplast to chromoplast because in immature stage chloroplast is green in color while on maturation the chloroplast disappears and chromoplast containing carotenoids which impart red color.