Interacting with real objects while in virtual reality poses certain challenges. Disney has come up with a system that allows users to accurately catch a real ball while in a virtual environment. Here is how it works:
we track the projectile motion of a ball as it is being tossed between users. Using Unscented Kalman Filtering, we generate predictive estimates of the ball’s motion as it approaches the catcher. The predictive assistance visualizations effectively increases the user’s senses but can also alter the user’s strategy in catching.
More information about this project is available here.