18-12-2010, 05:15 PM
[attachment=7431]
TELE IMMERSION
OVERVIEW
INTRODUCTION
REQUIREMENTS FOR IMMERSIVE TELECONFERENCE SYSTEM
HOW TELE-IMMERSION WORKS
SHARED TABLE ENVIRONMENT
NOVEL VIEW SYNTESIS
TELE-CUBICLES
COLLABORATION WITH I2 & IPPM
PRESENT RESEARCH
CONCLUSION
INTRODUCTION
NTII TEAM ARE WORKING ON PROJECTS TO HAVE USERS THE SAME PHYSICAL SPACE IN A REAL TIME WORLD,AS IF THEY ARE SITTING IN FRONT OF EACH OTHER IN THE SAME ROOM.
IN THIS REGARD ADVANCED NETWORK & SERVICES PLAYED A VITAL ROLE ,TO BRING THE EXPERTS IN THIS FIELD CLOSE TOGETHER.
THIS TEAM IS LED BY JARON LANIER,WHO WAS THE ONE OF THE PIONEERS IN DEVELOPMENT OF VIRTUAL REALITY.
NTII TEAM STARTED THEIR WORK IN THE MIDDLE OF 1997 AND THE COLLABRATING SCHOOLS WERE BROWN UNIVERSITY,PROVIDENCE NAVAL POSTGUARD SCHOOL,MONTEREY UNIVERSITY OF NORTH CAROLINA,CHAPEL HILL AND UNIVERSITY OF PENNSYLVANIA,PHILADELPHIA.
DEFINITIONS:-
Jason Leigh “The term tele-immersion was first used…….as the title of a workshop….to bring together researchers in distributed computing,collaboration,virtual reality and networking.”
Watsen & Zyla “It enable the interaction between geographically remote participants within a shared,3-D space.”
FIRST FEEL OF TELE-IMMERSION
MAIN AIM OF THE TEAM WAS TO TAKE INTO ACCOUNT THE ULTIMATE SYNETHESIS OF MEDIA TECHNOLOGIES FOR SCANNING AND TRACKING OF 3D ENVIRONMENT.
IT WAS BASED ON VISION BASED 3D RECONSTRUCTION.
THE FIRST EXPERIMENT WAS CONDUCTED IN CHAPEL HILL LED BY THE SCIENTISTS HENRY FUCHS AND GREG WELCH.
IT LINKED CHAPEL HILL,THE UNIVERSITY OF PENNSYLVANIA AND ADVANCED NETWORK &SERVICES AT NEWYORK.
RESEARCHERS CAN PEER INTO THE OFFICE OF THEIR COLLEAGUES HUNDEREDS OF MILES AWAY.
THE APPARATUS OF THE TEST CONSISTED OF TWO LARGE SCREENS,PROJECTION CAMERAS AND HEAD TRACHING GEAR.
ONE SCREEN WAS AT LEFT SIDE OF WELCH AND OTHER WAS ON RIGHT.
THROUGH LEFT WALL WELCH CAN SEE HIS COLLEGEUS AT PHILADELPHIA (UNIVERSITY OF PENNSYLVANIA ) AND THROUGH THE RIGHT AT NEWYORK.HE FELT THAT THEY WERE SITTING ACROSS THE DESK FROM HIM.
WHEN WELCH CHANGED POINT OF VIEW, THE IMAGES SHIFTED IN A NATURAL WAY.
IF HE LEANED IN, IMAGES GOT LARGER, IF HE LEANED OUT, THEY GOT SMALLER. HE COULD EVEN TURN HIS NECK TO LOOK AROUND THE PEOPLE.
REQUIREMENTS FOR IMMERSIVE TELE CONFERENCE SYSTEMS
NECESSARY TO USE A LARGE DISPLAY THAT COVERS ALMOST THE WHOLE VIEWING ANGLE OF THE VISUAL SYSTEM.
ALSO THE LARGE DISPLAY HAS TO BE INTEGRATED INTO THE USUAL WORKSPACE OF AN OFFICE OR A MEETING ROOM.
A DESKTOP-LIKE ARRANGEMENT WITH LARGE FLAT SCREEN LIKE PLASMA DISPLAYS
PERSONS ARE SEAMLESSLY INTEGRATED IN THE SCENE AND DISPLAYED WITH AT LEAST HEAD,SHOULDERS,TORSO AND ARMS IN NATURAL LIFE-SIZE.
ALL VISUAL PARAMETERS OF THE SCENE AND THE DIFFERENT SOURCES HAVE TO BE HARMONISED.
THE PERSPECTIVE OF THE SCENE IS PERMANATLY ADAPTED TO THE CURRENT VIEWPOINT OF THE PERSON IN FRONT OF THE DISPLAY
EYE-CONTACT BETWEEN TWO PARTNERS TALKING TO EACH OTHER HAS TO BE PROVIDED
GAZE FROM ONE PERSON TO ANOTHER HAS TO BE REPRODUCED IN A SUFFICIENT MANNER SUCH THAT EVERYBODY CAN RECOGNISE WHO IS TALKING AT WHOM.
VOICE OF A PERSON MUST CAME FROM THE SAME DIRECTION WHERE HE IS POSITONED ON THE SCREEN.
HOW TELE-IMMERSION WORKS
SHARED TABLE ENVIRONMET
A VERY ATTRACTIVE WAY TO MEET THE ABOVE REQUIREMENTS IS TO FOLLOW THE PRINCIPLE OF A SHARED TABLE ENVIRONMENT.
IT IS BASED ON THE IDEA TO POSITION THE PARTICIPANTS CONSISTENTLY IN A VIRTUAL ENVIRONMENT AROUND A SHARED TABLE.
AT THE TRANSMITTING SIDE THE CONFEREE IN FRONT OF THE DISPLAY IS CAPTURED BY MULTIPLE CAMERAS AND A 3D IMAGE OF THE CONFEREE IS DERIVED FROM THIS MULTIVIEW SET-UP.
THE 3D IMAGES OF ALL PARTICIPATING CONFEREES ARE THEN PLACED VIRTUALLY AROUND A SHARED TABLE.
IDEALLY, THIS IS DONE IN A ISOTROPIC MANNER IN ORDER TO OBTAIN SOCIAL SYMMETRY.
HENCE, IN THE CASE OF THREE-PARTY CONFERENCE THE PARTICIPANTS FORM A EQUILATERAL TRIANGLE. IN THE CASE OF FOUR PARTIES IT WOULD BE A SQUARE, AN EQUILATERAL PENTAGON FOR A FIVE-PARTY SYSTEM, AND SO ON.
AT THE RECEIVING END THE ENTIRELY COMPOSED 3D SCENE IS RENDERED ONTO THE 2D DISPLAY OF THE TERMINAL BY USING A VIRTUAL CAMERA.
THE POSITION OF THE VIRTUAL CAMERA COINCIDES WITH THE CURRENT POSITION OF THE USER'S HEAD.
FOR THIS PURPOSE THE HEAD POSITION IS PERMANENTLY REGISTERED BY HEAD TRACKER AND THE VIRTUAL CAMERA IS MOVED WITH THE HEAD.
GENERATING 3D IMAGES
GENERATING 3D IMAGES(cont)
TELE-CUBICLES
A TELE-CUBICLE IS AN OFFICE THAT CAN APPEAR TO BECOME ONE QUADRANT IN A LARGER SHARED VIRTUAL OFFICE SPACE .
THE APPARATUS CONSISTS OF:
DESK SURFACE (STEREO IMMERSIVE DESK)
TWO WALL SURFACES
TWO OBLIQUE FRONT STEREO PROJECTION SOURCES (MIGHT BE INTEGRATED WITH PROJECTORS)
THE THREE DISPLAY SURFACES MEET, IN THE FORMATION OF A DESK AGAINST A CORNER.
WHEN A TELECUBICLE IS LINKED TO OTHERS ON THE NET, THE WALLS APPEAR TO BE TRANSPARENT PASSAGES TO THE OTHER CUBICLES.
FOUR TELECUBICLES CAN BE JOINED IN VIRTUAL SPACE SO THAT EACH FORMS A QUADRANT OF A LARGER VIRTUAL WHOLE.
THE DESK SURFACES LINE UP TO FORM A LARGE TABLE IN THE MIDDLE OF THE VIRTUAL SHARED ROOM.
THROUGH THE WALLS CAN BE SEEN THE OTHER PARTICIPANTS AS WELL AS PROPS, FURNITURE, AND OTHER PHYSICAL FEATURES OF THEIR ENVIRONMENTS.
VIRTUAL OBJECTS AND DATA CAN BE PASSED THROUGH THE WALLS BETWEEN PARTICIPANTS, AND PLACED ON THE SHARED TABLE IN THE MIDDLE FOR VIEWING.
APPLICATIONS OF TELE-IMMERSION
THE LIST OF APPLICATIONS OF TELE-IMMERSION IS VERY LARGE. SOME OF THEM ARE:
TELE IMMERSION
TELE IMMERSION
OVERVIEW
INTRODUCTION
REQUIREMENTS FOR IMMERSIVE TELECONFERENCE SYSTEM
HOW TELE-IMMERSION WORKS
SHARED TABLE ENVIRONMENT
NOVEL VIEW SYNTESIS
TELE-CUBICLES
COLLABORATION WITH I2 & IPPM
PRESENT RESEARCH
CONCLUSION
INTRODUCTION
NTII TEAM ARE WORKING ON PROJECTS TO HAVE USERS THE SAME PHYSICAL SPACE IN A REAL TIME WORLD,AS IF THEY ARE SITTING IN FRONT OF EACH OTHER IN THE SAME ROOM.
IN THIS REGARD ADVANCED NETWORK & SERVICES PLAYED A VITAL ROLE ,TO BRING THE EXPERTS IN THIS FIELD CLOSE TOGETHER.
THIS TEAM IS LED BY JARON LANIER,WHO WAS THE ONE OF THE PIONEERS IN DEVELOPMENT OF VIRTUAL REALITY.
NTII TEAM STARTED THEIR WORK IN THE MIDDLE OF 1997 AND THE COLLABRATING SCHOOLS WERE BROWN UNIVERSITY,PROVIDENCE NAVAL POSTGUARD SCHOOL,MONTEREY UNIVERSITY OF NORTH CAROLINA,CHAPEL HILL AND UNIVERSITY OF PENNSYLVANIA,PHILADELPHIA.
DEFINITIONS:-
Jason Leigh “The term tele-immersion was first used…….as the title of a workshop….to bring together researchers in distributed computing,collaboration,virtual reality and networking.”
Watsen & Zyla “It enable the interaction between geographically remote participants within a shared,3-D space.”
FIRST FEEL OF TELE-IMMERSION
MAIN AIM OF THE TEAM WAS TO TAKE INTO ACCOUNT THE ULTIMATE SYNETHESIS OF MEDIA TECHNOLOGIES FOR SCANNING AND TRACKING OF 3D ENVIRONMENT.
IT WAS BASED ON VISION BASED 3D RECONSTRUCTION.
THE FIRST EXPERIMENT WAS CONDUCTED IN CHAPEL HILL LED BY THE SCIENTISTS HENRY FUCHS AND GREG WELCH.
IT LINKED CHAPEL HILL,THE UNIVERSITY OF PENNSYLVANIA AND ADVANCED NETWORK &SERVICES AT NEWYORK.
RESEARCHERS CAN PEER INTO THE OFFICE OF THEIR COLLEAGUES HUNDEREDS OF MILES AWAY.
THE APPARATUS OF THE TEST CONSISTED OF TWO LARGE SCREENS,PROJECTION CAMERAS AND HEAD TRACHING GEAR.
ONE SCREEN WAS AT LEFT SIDE OF WELCH AND OTHER WAS ON RIGHT.
THROUGH LEFT WALL WELCH CAN SEE HIS COLLEGEUS AT PHILADELPHIA (UNIVERSITY OF PENNSYLVANIA ) AND THROUGH THE RIGHT AT NEWYORK.HE FELT THAT THEY WERE SITTING ACROSS THE DESK FROM HIM.
WHEN WELCH CHANGED POINT OF VIEW, THE IMAGES SHIFTED IN A NATURAL WAY.
IF HE LEANED IN, IMAGES GOT LARGER, IF HE LEANED OUT, THEY GOT SMALLER. HE COULD EVEN TURN HIS NECK TO LOOK AROUND THE PEOPLE.
REQUIREMENTS FOR IMMERSIVE TELE CONFERENCE SYSTEMS
NECESSARY TO USE A LARGE DISPLAY THAT COVERS ALMOST THE WHOLE VIEWING ANGLE OF THE VISUAL SYSTEM.
ALSO THE LARGE DISPLAY HAS TO BE INTEGRATED INTO THE USUAL WORKSPACE OF AN OFFICE OR A MEETING ROOM.
A DESKTOP-LIKE ARRANGEMENT WITH LARGE FLAT SCREEN LIKE PLASMA DISPLAYS
PERSONS ARE SEAMLESSLY INTEGRATED IN THE SCENE AND DISPLAYED WITH AT LEAST HEAD,SHOULDERS,TORSO AND ARMS IN NATURAL LIFE-SIZE.
ALL VISUAL PARAMETERS OF THE SCENE AND THE DIFFERENT SOURCES HAVE TO BE HARMONISED.
THE PERSPECTIVE OF THE SCENE IS PERMANATLY ADAPTED TO THE CURRENT VIEWPOINT OF THE PERSON IN FRONT OF THE DISPLAY
EYE-CONTACT BETWEEN TWO PARTNERS TALKING TO EACH OTHER HAS TO BE PROVIDED
GAZE FROM ONE PERSON TO ANOTHER HAS TO BE REPRODUCED IN A SUFFICIENT MANNER SUCH THAT EVERYBODY CAN RECOGNISE WHO IS TALKING AT WHOM.
VOICE OF A PERSON MUST CAME FROM THE SAME DIRECTION WHERE HE IS POSITONED ON THE SCREEN.
HOW TELE-IMMERSION WORKS
SHARED TABLE ENVIRONMET
A VERY ATTRACTIVE WAY TO MEET THE ABOVE REQUIREMENTS IS TO FOLLOW THE PRINCIPLE OF A SHARED TABLE ENVIRONMENT.
IT IS BASED ON THE IDEA TO POSITION THE PARTICIPANTS CONSISTENTLY IN A VIRTUAL ENVIRONMENT AROUND A SHARED TABLE.
AT THE TRANSMITTING SIDE THE CONFEREE IN FRONT OF THE DISPLAY IS CAPTURED BY MULTIPLE CAMERAS AND A 3D IMAGE OF THE CONFEREE IS DERIVED FROM THIS MULTIVIEW SET-UP.
THE 3D IMAGES OF ALL PARTICIPATING CONFEREES ARE THEN PLACED VIRTUALLY AROUND A SHARED TABLE.
IDEALLY, THIS IS DONE IN A ISOTROPIC MANNER IN ORDER TO OBTAIN SOCIAL SYMMETRY.
HENCE, IN THE CASE OF THREE-PARTY CONFERENCE THE PARTICIPANTS FORM A EQUILATERAL TRIANGLE. IN THE CASE OF FOUR PARTIES IT WOULD BE A SQUARE, AN EQUILATERAL PENTAGON FOR A FIVE-PARTY SYSTEM, AND SO ON.
AT THE RECEIVING END THE ENTIRELY COMPOSED 3D SCENE IS RENDERED ONTO THE 2D DISPLAY OF THE TERMINAL BY USING A VIRTUAL CAMERA.
THE POSITION OF THE VIRTUAL CAMERA COINCIDES WITH THE CURRENT POSITION OF THE USER'S HEAD.
FOR THIS PURPOSE THE HEAD POSITION IS PERMANENTLY REGISTERED BY HEAD TRACKER AND THE VIRTUAL CAMERA IS MOVED WITH THE HEAD.
GENERATING 3D IMAGES
GENERATING 3D IMAGES(cont)
TELE-CUBICLES
A TELE-CUBICLE IS AN OFFICE THAT CAN APPEAR TO BECOME ONE QUADRANT IN A LARGER SHARED VIRTUAL OFFICE SPACE .
THE APPARATUS CONSISTS OF:
DESK SURFACE (STEREO IMMERSIVE DESK)
TWO WALL SURFACES
TWO OBLIQUE FRONT STEREO PROJECTION SOURCES (MIGHT BE INTEGRATED WITH PROJECTORS)
THE THREE DISPLAY SURFACES MEET, IN THE FORMATION OF A DESK AGAINST A CORNER.
WHEN A TELECUBICLE IS LINKED TO OTHERS ON THE NET, THE WALLS APPEAR TO BE TRANSPARENT PASSAGES TO THE OTHER CUBICLES.
FOUR TELECUBICLES CAN BE JOINED IN VIRTUAL SPACE SO THAT EACH FORMS A QUADRANT OF A LARGER VIRTUAL WHOLE.
THE DESK SURFACES LINE UP TO FORM A LARGE TABLE IN THE MIDDLE OF THE VIRTUAL SHARED ROOM.
THROUGH THE WALLS CAN BE SEEN THE OTHER PARTICIPANTS AS WELL AS PROPS, FURNITURE, AND OTHER PHYSICAL FEATURES OF THEIR ENVIRONMENTS.
VIRTUAL OBJECTS AND DATA CAN BE PASSED THROUGH THE WALLS BETWEEN PARTICIPANTS, AND PLACED ON THE SHARED TABLE IN THE MIDDLE FOR VIEWING.
APPLICATIONS OF TELE-IMMERSION
THE LIST OF APPLICATIONS OF TELE-IMMERSION IS VERY LARGE. SOME OF THEM ARE:
