Method and system for showing remote meeting sites from user-dependent viewpoints

Telepresence sessions may be used which utilize user-centric views of local and remote users. A virtual geometry is defined for two or more telepresence sites. A first telepresence site receives information representing a viewpoint position of a remote user at a second telepresence site, where the viewpoint position may be expressed as a position in the virtual geometry. Cameras (at least some of which may be depth cameras) at the first telepresence site simultaneously capture a plurality of video streams of the first telepresence site. At the first telepresence site, the captured video streams are combined into a panorama video corresponding to a virtual viewpoint based on the viewpoint position of the remote user, and the panorama video is streamed to the second telepresence site.