Viewpoint synthesis with enhanced 3D perception

Systems and methods relate to segmenting texture data and depth data of first image data of a first viewpoint into layers; generating respective multiple focal planes (MFPs) for each respective layer; blanking out pixels on the respective MFPs for each respective layer that are occluded by pixels on layers that are closer to a first viewpoint; and generating second image data for a second viewpoint to enable display of the second image data by: shifting and scaling the respective MFPs for each respective layer corresponding to the second viewpoint, wherein layers closer to an origin of the second viewpoint are shifted and scaled more than layers farther from the origin of the second viewpoint; and blanking out pixels on the shifted and scaled respective MFPs for each respective layer that are occluded by pixels on layers that are closer to the second viewpoint.