|Acquisition Program: ||PMA-205 Aviation Training Systmes|| Objective: ||Develop innovative computer algorithms and associated technologies (as appropriate) to support automatic and continuous estimation and correction of geometric and photometric errors arising from the use of a small set of cooperating “intelligent” projectors (integrated projection and sensing) to create a single seamless wide-area (panoramic) image as part of a deployable visual training system for multiple viewers.
|| Description: ||Recent advances in projector technologies, off-line display calibration, and rendering algorithms have made possible the use of multiple overlapping projectors to create a visually seamless wide-area image on many every-day (unprepared) surfaces. Such systems and methods could be an integral part of deployable visual training systems. One key to the success of such applications is the method used to calibrate (estimate) the relative geometric and photometric parameters of the projectors and imagery to facilitate the necessary warping and blending. Researchers have had initial success through the use of embedded sensors  and off-line passive approaches . For deployable multi-projector visual training systems to be practical the projections must be robust to physical and electrical perturbations over time, adjusting automatically and continuously during use . Through an application of multiple polarized projected images, it is further possible to provide individual viewpoints for two or more users immersed in the same simulation. 
|| ||PHASE I: Demonstrate the feasibility of proposed innovative solutions to provide automatic and continuous estimation and correction of projected imagery from a small overlapping set of casually configured conventional or intelligent projectors. Identify corresponding algorithm and device possibilities and tradeoffs related to complexity of use and implementation, robustness, and reliability.
|| ||PHASE II: Develop a prototype multi-projector deployable display system using the chosen intelligent projectors (technologies). Adapt/modify an example of an existing visual training application (software) to function with the prototype, and demonstrate the automatic and continuous geometric and photometric calibration capabilities.
|| ||PHASE III: Install and test prototype multi-projector display system (with automatic and continuous calibration) within a system providing shipboard training capability.
PRIVATE SECTOR COMMERCIAL POTENTIAL/|| ||DUAL-USE APPLICATIONS: The simulation based training and entertainment industries will benefit as the need for expensive wall-mounted (or head-mounted) visual image generators will no longer be required. Projectors that could correct screen distance, screen angles, curves and dimensions, and that in addition automatically adjust to properly overlap images for immersive surround-screen imaging would enable simulations to be conducted in any room. With the addition of corrections for multiple viewpoints, several trainees could participate in a two-dimensional or three-dimensional simulation simultaneously.
|| References: ||
1. Lee, J. C., Dietz, P. H., Maynes-Aminzade, D., Raskar, R., and Hudson, S. E., “Automatic Projector Calibration With Embedded Light Sensors,” in Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA, October 24 - 27, 2004). UIST '04. ACM Press, New York, NY, 123-126.
2. Raskar, R., Brown, M., Yang, R., Chen, W., Welch, G., Towles, H., Seales, B., and Fuchs, H., “Multi-Projector Displays Using Camera-Based Registration,: in Proceedings of the Conference on Visualization 99: Celebrating Ten Years (San Francisco, CA, USA, October 24 – 29, 1999): pp. 161-168.
3. Yang, R. and Welch, G., “Automatic and Continuous Projector Display Surface Estimation Using Every-Day Imagery,” presented by Herman Towles at the 9th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (Plzen, Czech Republic, 2001).
4. Hendriks, E. A. andRedert, “A. Real-Time Synthesis Of Digital Multiple-Viewpoint Stereoscopic Images,” SPIE Proceedings Vol. 3639 pp.266-276.|
|Keywords: ||Projection; Simulation; Intelligent; Visual Display; Training; Multiple-viewpoint|