WiFi could protect you from getting lost in virtual reality

first_img You’re at home playing a virtual reality (VR) game on the Oculus Rift, dodging zombies like a pro. But then you step too far back or look behind you, and suddenly you’re frozen in space, as the system’s infrared cameras can no longer see the lights on your goggles and it loses track of you. Instant brain food. Now, researchers have come up with a way to spare you such a frustrating end by using standard Wi-Fi technology to enhance VR’s tracking abilities. In addition to improving VR, the technology could also help track robots or drones and streamline motion capture for movies.VR enables a user to move through a virtual 3D world projected through the video screens in the system’s headset. To track the user’s movement, the Rift uses one or more infrared cameras in a room, often on tripods. The headset has accelerometers to measure tilt, and it has infrared lights that the cameras use to track movement forward, back, or sideways. Another VR system, the HTC Vive, tracks movement by projecting infrared light from devices in the corners of the room that are detected by sensors on the headset. A related technology, called augmented reality (AR), maps virtual features onto the wearer’s view of the real world. So a user’s living room may be inhabited by virtual monsters. Microsoft’s HoloLens AR system uses several outward-facing cameras on the headset to track the user’s movement in relation to the environment.Such systems have their limitations, however. In order for VR games to work without glitches, users often need to stay within a few square meters, and the infrared sightlines can’t be blocked by furniture or other people or by turning away. Microsoft’s AR system doesn’t work in all lighting conditions, it can be confused by blank walls or windows, and it can’t track your hands if they move out of view. alvarez/iStockphoto Sign up for our daily newsletter Get more great content like this delivered right to you! Country Email Click to view the privacy policy. Required fields are indicated by an asterisk (*) Virtual reality could become easier to navigate, thanks to an assist from Wi-Fi. center_img By Matthew HutsonJul. 24, 2017 , 3:00 AM Country * Afghanistan Aland Islands Albania Algeria Andorra Angola Anguilla Antarctica Antigua and Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia, Plurinational State of Bonaire, Sint Eustatius and Saba Bosnia and Herzegovina Botswana Bouvet Island Brazil British Indian Ocean Territory Brunei Darussalam Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Cayman Islands Central African Republic Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo Congo, the Democratic Republic of the Cook Islands Costa Rica Cote d’Ivoire Croatia Cuba Curaçao Cyprus Czech Republic Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Ethiopia Falkland Islands (Malvinas) Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guatemala Guernsey Guinea Guinea-Bissau Guyana Haiti Heard Island and McDonald Islands Holy See (Vatican City State) Honduras Hungary Iceland India Indonesia Iran, Islamic Republic of Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Korea, Democratic People’s Republic of Korea, Republic of Kuwait Kyrgyzstan Lao People’s Democratic Republic Latvia Lebanon Lesotho Liberia Libyan Arab Jamahiriya Liechtenstein Lithuania Luxembourg Macao Macedonia, the former Yugoslav Republic of Madagascar Malawi Malaysia Maldives Mali Malta Martinique Mauritania Mauritius Mayotte Mexico Moldova, Republic of Monaco Mongolia Montenegro Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Nicaragua Niger Nigeria Niue Norfolk Island Norway Oman Pakistan Palestine Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Poland Portugal Qatar Reunion Romania Russian Federation Rwanda Saint Barthélemy Saint Helena, Ascension and Tristan da Cunha Saint Kitts and Nevis Saint Lucia Saint Martin (French part) Saint Pierre and Miquelon Saint Vincent and the Grenadines Samoa San Marino Sao Tome and Principe Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Sint Maarten (Dutch part) Slovakia Slovenia Solomon Islands Somalia South Africa South Georgia and the South Sandwich Islands South Sudan Spain Sri Lanka Sudan Suriname Svalbard and Jan Mayen Swaziland Sweden Switzerland Syrian Arab Republic Taiwan Tajikistan Tanzania, United Republic of Thailand Timor-Leste Togo Tokelau Tonga Trinidad and Tobago Tunisia Turkey Turkmenistan Turks and Caicos Islands Tuvalu Uganda Ukraine United Arab Emirates United Kingdom United States Uruguay Uzbekistan Vanuatu Venezuela, Bolivarian Republic of Vietnam Virgin Islands, British Wallis and Futuna Western Sahara Yemen Zambia Zimbabwe Wi-Fi could protect you from getting lost in virtual reality A team of researchers from Stanford University in Palo Alto, California, wanted a simpler, cheaper, more robust system. So they turned to the common radio technology Wi-Fi. Wi-Fi has been used to localize people and objects in space before, but only with an accuracy of tens of centimeters, says Manikanta Kotaru, a computer scientist at Stanford, and he and his colleagues thought they could do better.Their solution, which they call WiCapture, requires two parts: a standard Wi-Fi chip, such as the one you might find in your phone, and at least two Wi-Fi “access points,” which are transmitters such as the ones found in home routers. Communication between the chip and a transmitter comes in high-frequency radio waves. In order to track a Wi-Fi signal source with millimeter-level accuracy, one needs to measure the time it takes a signal to travel from the chip to the transmitter with picosecond-level accuracy. However, the chip and transmitter have different clocks, and no two clocks in Wi-Fi devices are perfectly synchronized.  To get around this problem the researchers took advantage of the fact that signals reach the transmitter through many paths. Some radio waves travel directly to the receiver to create the main signal, whereas others bounce off walls to create echoes. Kotaru wrote an algorithm that looks at signals from two different paths, identified by triangulating among the transmitter’s multiple antennas. Those signals will be equally affected by clock asynchrony, so the algorithm can just compare their relative change as the chip moves and ignore the drift of the clocks’ timing. Still, this method measures distance to only one transmitter; using two or more transmitters in combination allows the algorithm to use triangulation to track motion in two dimensions. (The researchers will eventually expand WiCapture to track motion in three dimensions.)To test the idea, scientists placed the Wi-Fi chip on a mechanical device that could move it with high accuracy in an office 5 meters by 6 meters with four Wi-Fi transmitters in the corners. As they moved the chip around in various patterns, WiCapture tracked its position to within a centimeter. Next, the researchers tried an office in which all the Wi-Fi transmitters were occluded by furniture or walls. As long as two were in the same room as the chip, WiCapture’s median error was still only 1.5 centimeters. Outside, the median error was again less than a centimeter, the team will report this month at the Conference on Computer Vision and Pattern Recognition in Honolulu.“It was really nice to bridge work in the wireless community with work in the virtual reality community,” says Dina Katabi, a computer scientist at the Massachusetts Institute of Technology in Cambridge who was not involved in the experiment. Yuval Boger, a physicist and the CEO of Sensics, a VR hardware and software company in Columbia, Maryland, says, “the need is real” for a robust hi-resolution position tracker. He notes that 1 centimeter is not a high enough accuracy for head tracking, but would work for hand tracking. In a fighting game, “I’m not sure I’m going to do any small delicate movements with a sword.”The authors acknowledge that WiCapture still has a slower reaction time and lower accuracy than infrared cameras, but they think they can improve both by combining it with an accelerometer to add another source of data and fill in the gaps. In any case, Kotaru says, the technology is basically ready to use.last_img