My Thesis - isl2.cp.eng.chula.ac.th

My Thesis - isl2.cp.eng.chula.ac.th

DEVELOPMENT OF A STEREOSCOPIC PROJECTION SYSTEM Thesis Proposal 1 V 2..2 INTRODUCTION TO 3D PROJECTION SYSTEMS 3D APPLICATIONS Medical Scientific Engineering Education Entertainment Military

Advertising 2 INTRODUCTION TO 3D PROJECTION SYSTEMS BUDGET FOR THE EXAMPLE SYSTEMS System Type Price (Bath) Volumetric 3D Display Volumetric 42-3D6W01 42" Wow

Autostereoscopic 59,600 HMD 55,920 i-visor FX601 Duality X3 (+ Cyviz Xpo 1024x768) 4,800,000 Polarizing 1,232,800

Mirage S+2K Shutter Glass 2,387,800 InFocus DepthQ NuVision + 2 pairs of 60GX glasses Shutter Glass 254,800 From www.inition.co.uk 3 PROJECT PREFACE

If you want a Stereoscopic System, But you have small budget. What is our alternative? 4 PROJECT PREFACE PROBLEM Commercial 3D stereoscopic systems are too expensive for average users because they require a customized projector. 245,800 Bath!!!

40,000 Bath , OK!! 5 PROJECT PREFACE IDEA If we can adapt a common projector to project 3D stereopsis without modifying them, the cost of the system can be reduced. 40,000 Bath , OK!! 6

PROJECT PREFACE OBJECTIVE The objective of this project is to develop a shutter-glass based stereoscopic upgrade kit for an off-the-shelf DLP projector. 40,000 Bath , OK!! 7 TYPE OF DISPLAYS 3D Display Autostereoscopic Stereoscopic Volumetric

Stereoscopic 8 VOLUMETRIC 9 PRINCIPLE OF STEREOSCOPIC Invented By Charles Wheatstone in 1838. Stereopsis is depth perception from binocular visions through exploitation of parallax. Use two correspondence images to create an illusion of depth. 3D Display Autostereoscopic

Stereoscopic Stereoscopic Volumetric 10 AUTOSTEREOSCOPIC Lenticular lens Sweeping light source 11 STEREOSCOPIC HMD (Head Mounted Display) 2-Color Anaglyph

Polarizing Glass Stereoscopic Display Technology Shutter Glass ChromaDepth AnaChrome 12 STEREOSCOPIC HMD HMD (Head Mounted Display) Disadvantage Low Resolution

Heavy ,Inconvenient Expensive ($1399-$145,000) 13 STEREOSCOPIC 2-COLOR ANAGLYPH 2-Color Anachrome anaglyph is an Anaglyph Variant Use Anaglyph two ofonly color in filters. the border of object,

and preserve the color in the center object. Advantage This technique can reduce color distortion. Simple Disadvantage Color Distortion 14 STEREOSCOPIC

CHROMADEPTH Use prism. Advantage Can be viewed without glasses. Disadvantage ChromaDepth Colorless

15 STEREOSCOPIC POLARIZING GLASS Advantage Polarized eyeglasses are cheap.

Disadvantage Not feasible to use with LCD projector. Viewers need to keep their head level to prevent left and right channels bleedover the opposite channel. Need a polarization preserving screen. 16 STEREOSCOPIC SHUTTER GLASS Create 3D Stereoscopic illusion by Switching projected picture for left and right eyes continuously.

The appeared image and shutter glasses have to be synchronize. 17 STEREOSCOPIC SHUTTER GLASS Shutter Glass Mechanical Shutter

18 Left Eye Right Eye 3D SYSTEMS COMPARISON TABLE Color Distortion HMD Anaglyph AnaChrome ChromaDepth

No (But Low Res) Medium Low High Polarizing No Shutter Glass No Cost Medium

Cheap Cheap Cheap Expensive (2 Projector) Medium (1 Projector) 19 TRACKING SYSTEM Raw Data Position & Orientation Post Recognition Measurement Data Fusion Projection Matrix Calculation

20 TRACKING SYSTEM Ultrasonic Electromagnetic Optical LaserTracker System Mechanical Tracker Marker Face Recognition 21 TRACKING SYSTEM Position Tracker System

Mechanical Tracker Ultrasonic Electromagnetic Optical Laser Marker Face Recognition 22 CONCEPT OF THE PROPOSED SYSTEM CONCLUSION

Commercial stereoscpic uses special custom made projector. Commercial Stereoscopic is Expensive. We can reduce cost if we can use a common off the shelf projector. Because, The shutter glass and appeared picture isnt sync. There are synchronization Problem when integrating common projector to We can fix this problem by building synchronization kit. 23

CONCEPT OF THE PROPOSED SYSTEM SYNCHRONIZATION PROBLEM The problem is , When we use common projector in projecting 3D stereoscopic signal, the projected picture isnt synchronized with the shutter glasses. Cause of problems The mechanism of DLP Projector Micromirror and its operation.

Color Wheel External Box Display Shutter Glass Shutter Glass Sync 24 CONCEPT OF THE PROPOSED SYSTEM CAUSE OF PROBLEM, DLP TECHNOLOGY DLP (Digital Lighting Processor) DMD (Digital Micromirror Device)

MEMS (Micro Electro-Mechanism) 25 CONCEPT OF THE PROPOSED SYSTEM SOLUTION The cause of the problem The interval in digital lighting processor causes the appeared frame on the screen delayed. Ghosting Effect Frame Dropped

Rainbow Effect, Especially on DLP Projector. Solution Change synchronization source from graphic card output signal to the marker on appeared picture on the screen. Dongle Shutter Glass Sync Display External Box Graphic Card Shutter Glass Sync Shutter Glass Sync 26

PROPOSED SYSTEM Com : Computer MIB : Marker Insertion Box Proj : Projector Tcam :Tracker Camera ODD : Opto Detection Device ShtCnt : Shutter glasses Control 27 PROPOSED SYSTEM COMPONENT DETAILS Components that have to be developed. MIB : Marker Insertion Box

Insert the marker in projected picture. There is switch on the box for reset, If the pictures from left and right eyes were swapped. ODD : Opto Detector Device Detect the appearance of the synchronization marker on screen, And transmit signal to the shutter glasses control box if there were a marker appeared. Easy to attached on Left-top of the screen. 28 PROPOSED SYSTEM COMPONENT DETAILS

ShtCnt : Shutter glasses Control Synchronize shutter glasses timing to the picture by detecting signal from ODD. Can slice timing from synchronization signal by using digital PLL. Tcam : Tracker Camera Track viewer head position by the shutter glasses attached camera. Locate head position by looking at the implanted LED marker on the screen. Can be fused with angular acceleration sensor. 29 PROPOSED SYSTEM

BUY OR BUILD Off the Shelf Tracking System Marker Insertion Box Proposed 3D Display System Developed Components Computer with

Stereosco pic Renderer DLP Projector Opto Detection Device Shutter Shutter Glass Glasses Controller 30 PROPOSED SYSTEM

BUDGET COMPARISON Proposed System Customized 31 * Tracker :InterSense IS-1200 VisTracker * Computer and Software are omited PROPOSED SYSTEM IMPLEMENTATION PLAN Proposed 3D Display System Display

Shut Synchronizationter Mar ker Inser tion Box Opto Glas s Cont rolle r Tracker

IR Tracker Tracking Software 32 PROPOSED SYSTEM MIB : FUNCTION Synchronization System Marker Insertion Box Opto Device(ODD)

The Detector inserted marker will be appear on top-left of the Shutter screen.Glass Controller ODD 33 PROPOSED SYSTEM MIB : IMPLEMENTATION Synchronization System Marker Insertion Box

Opto Detector Device(ODD) VSync Pixel Clock Generator Shutter Glass Controller Counting Circuit Horizontal HSync Counting Circuit Vertical Switch (a) Compare-Horizontal Compare-Vertical Comparator (b)

FPGA (c) (d) Marker VGA Source To Projector Switch 34 PROPOSED SYSTEM ODD

Synchronization System Frame Marker Insertion Opto Detector Device(ODD) Shutter Glass Controller Shutter Glass Controller Computer (WinSGL Scheme) 35

PROPOSED SYSTEM ODD : WINSGL Synchronization System Fix Frame-Dropped Problem. Long Delayed - Frame Synchronization SoftGenlock Short Delayed Signal Synchronization

Hardware GenLock (SGI / GeForce (SLI) / nVidia) Software (WinSGL) 36 PROPOSED SYSTEM SHUTTER GLASSES CONTROLLER Synchronization System Frame Marker Insertion Opto Detector Device(ODD) Shutter Glass Controller PLL

Implemented on Microcontroller. Shutter Glass Time Base N ODD Increase / Decrease Time base Sequential Circuit Glass Control

37 PROPOSED SYSTEM SHUTTER GLASSES CONTROL LCD Technology in shutter glasses Problem in controlling Shutter Glass Spectrum Transparency Ghosting Effect : LCD Responding 38 CONTROL

LCD TECHNOLOGY IN SHUTTER GLASSES LCD TN TFT (Liquid Crystal Display) (Twisted Nematic) (Transistor Film Transistor) 39 PROPOSED SYSTEM : SHUTTER GLASSES CONTROL LCD TECHNOLOGY IN SHUTTER GLASSES LCD TN

TFT (Liquid Crystal Display) (Twisted Nematic) (Transistor Film Transistor) Twist Direction Bipolarity Capacitance 40 Dead Band PROPOSED SYSTEM : SHUTTER GLASSES CONTROL GHOSTING EFFECT Slow response. LCD molecular momentum and capacitance.

Can be reduced by adding an Interval between control sequences. Proposed by Kunz ,2001 41 PROPOSED SYSTEM : SHUTTER GLASSES CONTROL IMPLEMENTATION PLAN Dead Band Generator PLL Shutter Glass

Time Base N ODD Increase / Decrease Time base Sequential Circuit Bipolar Generator Glass Control 42 PROPOSED SYSTEM

TRACKING SYSTEM Synchronization System Frame Marker Insertion Dongle, Snap on screen Device Shutter Glass Controller Head Tracker IR Marker Implanted Screen & IR Camera Vision Base Tracking

Software 43 PROPOSED SYSTEM TRACKING SYSTEM Vision based tracker system. Integrate angular acceleration sensor for a better respond. 44 PROPOSED SYSTEM : TRACKING SYSTEM IMPLEMENTATION Head Tracker

IR Marker Implanted Screen & IR Camera Vision Based Tracking Software Localization based on correspondences from the features in known environment. 45 PROJECT SCHEDULE Synchronization System ODD & Shutter Glass Controller Development MIB Improvement Tracking

Implement of Vision Tracker Software Building IR Marker Implanted Projector Screen Paper Works Publish Paper Conclusions System Testing 46 CONCLUSIONS I will Build a stereoscopic upgrading kit for DLP projector Opto

Integration of Tracking System A Marker Insertion Box Rendering Application Example IR Marker Implanted Screen Shutter Glass Controller Vision Based Tracking Software System Capability Display 3D object and with corrected volume. User will see objects at stationary position floating in the screen. 47 Thank you 48

The End 49 PROJECTS SCHEDULE 50 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : WINDOWS TIMMER What is WinSGL time base. And, How precision it is?

The WinSGL Timming retrieves from QueryPerformanceCounter Function. The time base frequency can retrieve from QueryPerformanceFrequency Function. Each computer has different timer resolution. For Example the timer resolution of this computer is 1/3579545 Hz = 0.279 uS 51

PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : CHANGING GRAPHIC CARD SIGNAL STRUCTURE Changing of output VGA signal timing structure may cause the monitor malfunction. From Waschbusch, 2006 experiments. So, The most suitable method in changing timing without distortion of picture is the changing of vertical front porch. 52

PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : CHANGING GRAPHIC CARD SIGNAL STRUCTURE Frame Structure Line Structure 53 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING OpenGL has stereoscopic rendering capability. Programmer can select which buffer to render using

glDrawBuffer(); Stereoscopic rendering buffer alias. GL_BACK_LEFT or GL_BACK_RIGHT There are 2 process in rendering stereoscopic on OpenGL 1. Select rendering buffer GL_BACK_LEFT or GL_BACK_RIGHT Ex glDrawBuffer(GL_BACK_LEFT); 2. Change projection matrix of left or right projection.

Ex gluLookAt(camera.vp.x + r.x, camera.vp.y + r.y, camera.vp.z + r.z, camera.vp.x + r.x + camera.vd.x, camera.vp.y + r.y + camera.vd.y, camera.vp.z + r.z + camera.vd.z, camera.vu.x, camera.vu.y, camera.vu.z); 54 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING The Difference of Symmetric & Asymmetric Frustum rendering In Toed-In camera which is an incorrect rendering of stereo image, Use Symmetric Frustum ,This incorrect create stress of depth perception. (Lacotte,1995)

Screen Left Camera Right Camera Projective Plane 55 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING A correct rendering use Asymmetric Frustum, which change the camera axis perpendicular to screen. Screen = Projective Plane

Left Camera Right Camera 56 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING Parallax Positive Parallax Zero Parallax Negative Parallax

Screen = Projective Plane Screen = Projective Plane Screen = Projective Plane Left Camera Left Camera Left Camera Right Camera Right Camera Right Camera

57 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : GENLOCK Can Sync Display Signal. Using Special Hardware. Very expensive. 58 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : SOFTGENLOCK Proposed by Schaeffer, 2000 Using LAN, Long Delay time. Able to Sync Rendering Sequence of multiple Displays. Guarantee 100 ms

Cannot Sync in Signal Level 59 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : SOFTGENLOCK Proposed by Allard, 2002 Using LAN (Myrinet) , 50uS Guarantee. System needs Real Time OS. Cannot be used in WindowXP. Alternative System has been proposed by Allard 2003 Using Parallel Port, 50uS Guarantee. Can be used in Non-Realtime OS.

60 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : WINSGL Proposed by Waschbusch, 2006 Can synchronize signals from multiple Graphic cards. Can be used in WindowsXP Using Special API Library . PowerStrip Using Software Phase Lock Loop (PLL) technique. PLL is a Proportional-Integral (PI) feedback system. 61

PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : WINSGL Mechanic of WinSGL (M. Waschbsch,2006) 62 POLARIZATION OF LIGHT Circular Elliptical Linear 63 CONCEPT OF THE PROPOSED SYSTEM

CAUSE OF PROBLEM, DLP TECHNOLOGY DLP (Digital Lighting Processor) 64 PROPOSED SYSTEM : SHUTTER GLASSES CONTROL LCD SPECTRUM TRANSPARENCY The transparency in different colors are difference. Investigated By Woods ,2002 The transparencies in same spectrum on different time are difference. Showing a Non-Linear Characteristic.

65 PROPOSED SYSTEM Com : Computer MIB : Marker Insertion Box Proj : Projector Tcam :Tracker Camera ODD : Opto Detection Dongle ShtCnt : Shutter glasses Control 66 PROPOSED SYSTEM This

project consists of the development of four devices which are , Marker Insertion Box Opto Detector Dongle attached on the projected screen Shutter Glasses mobile Controller. Vision- Inertia fusioned head tracking system. 67

Recently Viewed Presentations

  • BlueCross BlueShield of Western New York

    BlueCross BlueShield of Western New York

    BlueCross BlueShield of Western New York BlueShield of Northeastern New York. ICD-10: Coding to the Highest Specificity. November 17, 2015
  • Critical Design Review

    Critical Design Review

    Critical Design Review The Fab Four Jeremy Conrad Electronics Expert Javier Matamoros Thrust Guru Greg Williams Wood Working Specialist Luis Perez Computer Technician Outline Mission Final Design Introduction Scale Drawings General Structure Materials Weight Analysis Control Systems Other Adjustments Conclusion...
  • WWW.ICAD-CISD.COM New Prevention Technologies Workshop Module 1: Basic

    WWW.ICAD-CISD.COM New Prevention Technologies Workshop Module 1: Basic

    Objectives . This workshop will: Increase the capacity of media representatives to report on NPT trials with accuracy and sensitivity. Build skills amongst community-based organizations to critically analyze media discourse about HIV prevention trials
  • Apresentação do PowerPoint - CIMAC

    Apresentação do PowerPoint - CIMAC

    A Estrutura de Apoio Técnico tem por objetivo central o apoio à implementação e desenvolvimento do Pacto para o Desenvolvimento e Coesão Territorial (PDCT) da CIMAC, nas prioridades de investimento e tipologias de operações que respeitam ao Programa Operacional Regional...
  • English Literature Yr 10 End of Year revision

    English Literature Yr 10 End of Year revision

    Explore how Shakespeare presents the relationship between Macbeth and Banquo (extract Act 3 Scene 1). Mention honour between men and how Macbeth has ignored loyalty over ambition - killing his best friend to reach goal of being king. Relationship is...
  • OMB Super Circular 101 - Grant Requirements and Compliance

    OMB Super Circular 101 - Grant Requirements and Compliance

    Other than an unmodified opinion on major programs. Known or likely questioned costs that exceed 5% of total Federal awards expended for the program. Major Program Determination-
  • Air Pollution in the united kingdom - About

    Air Pollution in the united kingdom - About

    Splish splash splish look at all the fish. The acid rain fell down now they're upside down. With there bellies up in the air . Air pollution seems to be everywhere. How do I stop it I think I know....
  • Chapter 14: Ethics and Social Responsibility

    Chapter 14: Ethics and Social Responsibility

    Utilitarian view of ethics: Greatest good to the greatest number of people. Assesses actions based on consequences. Business professionals are inclined to use profits, efficiency and other performance measures to judge what is best for most people . Individualism view...