Abstract: A novel residual set lossless compression (RSLC) method of color filter array (CFA) image sequences is presented in the paper. The redundant data between image sequences are compressed by building the image residual set. The images of residual set are channel-separated filtered to compress the redundant data within the image by the designed best reversible filters which can improve the performance of CFA image compression. The experimental results prove that the RSLC method carries the best data compression ratio, the lowest bits per pixel and the highest PSNR performance among the channel-separated filter JPEG method, PNG method and the RSLC method.