Virtual Reality with Physical Space is the next media for Rakuten


  If you’re an old-fashioned romantic, there’s no better time to express your love for that special someone than Valentine’s Day. Some Romeos go beyond the traditional chocolates and roses and offer their Juliets an engagement ring. But even if you don’t pop the question on February 14, all the work involved in planning a wedding can take away from the high of getting hitched. Researchers at Rakuten Institute Technology, though, are taking some of the pain out of the process with a platform that allows users virtual previews of possible venues for the big day.

  The Virtual Wedding System takes users on an immersive visit to a wedding venue with high-definition, 360-degree photos of what it looks like inside and outside. The user is also able to walk-through photo-realistic virtual environment, as well as watching panoramic videos of dynamic events. It can save couples the time and effort involved with visiting multiple wedding venues, which are often being used and not available for visitors. Users put on a HMD or a head-mounted display (Oculus Rift or Samsung Galaxy Gear VR) to see the images and can then “navigate” through the virtual environment with a standard game controller.

  If you’ve never tried the recent wave of virtual reality (VR) gear including Oculus Rift or Gear VR in the last 2 to 3 years, it’s like Google Street view for your eyes. You may soon forget your real surroundings as your brain accepts the wraparound imagery, and you’ll feel like you really are in the actual wedding venue, descending a grand staircase into an elegant banquet room or something.

  In one example, 134 high-resolution omnidirectional images / videos were taken using a Samsung Gear 360 in a wedding hall of Saitama Prefecture, north of Tokyo. Users can explore the facility’s courtyard and swimming pool, entrance hallway, dining room, grand staircase and table of honor by following glowing green arrows that seem to float on the 360-degree imagery. So far, photographing this venue only took a few hours, but it would have taken at least three months to recreate it as a 3D computer model in the past. However, Rakuten Institute of Technology or RIT developed software to merge the images into a seamless virtual experience without effort, a process that is purely semi-automatic. Our system is friendly to use. You don’t need to be professional at shooting 360-degree photos/videos. Just walk and take a photo/video at your pace. Then our system will create VR world from a series of 360-degree experiences.

  RIT previously used the platform to capture two famous religious sanctuaries in Nagano Prefecture: the Buddhist temple of Zenkoji and the Shinto shrine of Togakushi. Rakuten introduced the virtual travel experiences to the public in 2014, with another event the following year featuring the scenic garden of Kenroku-en in Ishikawa Prefecture. People who can’t easily travel due to age or infirmity expressed particular appreciation for the experience.

  The camera system for Google Street View would cost around 2 million yen, but even 3 years ago the Ricoh Theta or similar cameras was only about 40,000 yen. It’s a very affordable price. One of the reasons we’re having a VR boom in recent years is that the cost of components for the display and sensors in the HMD, as well as the capturing device itself, is much lower than in the past.

  The Virtual Wedding System is being provided by Rakuten Wedding, a wedding search and planning site, and will be shown off at bridal fairs. With the consumer launch of the HMD like Sony PS-VR, Galaxy Gear VR, HTC Vive, etc, the potential for VR applications is getting bigger and bigger.

  This is a new type of media for Rakuten services that could be used by merchants, hotel owners and wedding venue owners to generate their own immersive content. Instead of designing webpages using photos and text, in the future we may want to design a virtual reality system highlighting the unique features of each venue.