Affiliation:
1. The Viterbi Faculty of Electrical and Computer Engineering, Technion-Israel Institute of Technology, Technion City, Haifa 3200003, Israel
Abstract
We extend Ziv and Lempel’s model of finite-state encoders to the realm of lossy compression of individual sequences. In particular, the model of the encoder includes a finite-state reconstruction codebook followed by an information lossless finite-state encoder that compresses the reconstruction codeword with no additional distortion. We first derive two different lower bounds to the compression ratio, which depend on the number of states of the lossless encoder. Both bounds are asymptotically achievable by conceptually simple coding schemes. We then show that when the number of states of the lossless encoder is large enough in terms of the reconstruction block length, the performance can be improved, sometimes significantly so. In particular, the improved performance is achievable using a random-coding ensemble that is universal, not only in terms of the source sequence but also in terms of the distortion measure.
Reference39 articles.
1. Berger, T. (1971). Rate Distortion Theory—A Mathematical Basis for Data Compression, Prentice-Hall Inc.
2. Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, John Wiley & Sons.
3. Gallager, R.G. (1968). Information Theory and Reliable Communication, John Wiley & Sons.
4. Gray, R.M. (1990). Source Coding Theory, Kluwer Academic Publishers.
5. Viterbi, A.J., and Omura, J.K. (1979). Principles of Digital Communication and Coding, McGraw-Hill Inc.