The paper presents a new approach for Visual Object Segmentation that keeps the appearance history of the object in an adaptive way, New memory update rule for memory-based VOS algorithm is proposed. New memory update rule for memory-based VOS algorithm is proposed. The method is well motivated and clearly described. There are some important literature missing and the analysis is not complete , e.g. in term of time complexity. All reviewers discussed for several concerns , that have been partially overcame by the rebuttal. After Rebuttal reviewers agree on the fact that the paper is Marginally above the acceptance threshold.