A rate distortion framework for 3D browsing

This paper contains an overview of a novel remote 3D visualization scheme. The scene is represented by a set of scalably compressed views and depth maps stored at server side. The JPIP transmission protocol is exploited to transmit the data in a progressive way while the interactive browsing goes on. The received images are then warped onto the required view and combined together. We develop a model to estimate the distortion in the rendered views and use it both to combine information from multiple views at client side and to select the data that need to be transmitted from the server.