The 3D Future of Your Smartphone Camera

The Matterport system could revolutionize smartphone photography even further than the infamous Oscar 'selfie'.

The Matterport system could revolutionize smartphone photography even further than the infamous Oscar 'selfie'. Ellen DeGeneres/AP

A matte black robotic camera the size of a 1980s lunchbox sits atop a tripod. On its face, there are three 2D cameras and three 3D sensors. There's a handle on one end sprouting from the left side of the device.

Its handler hits a button on an iPad app, and it begins to move. Over the next 24 seconds, it will make six stops as it spins 360 degrees. The imagery data will be sent to the a room full of servers, turned from a point cloud into a textured 3D mesh, and returned to the tablet.

After a single scan, the basic features of the room are already visible on the screen. We move the camera to another spot, and hit record again. More details fill in.


Matterport iPad software (Alexis Madrigal)

After four to six more scans and twenty minutes in the cloud, the system will have created a textured, photorealistic 3D model of the room. It's dimensionally accurate, too, so you could, for example, measure the ceiling height or the distance between walls. For gestalt realism, I'd put the 3D models it creates somewhere in-between a Playstation 2 game and a Playstation 3 game.

All in, it might take half an hour or an hour to turn a physical space into a photorealistic virtual space. Doing something like this in the past would have taken orders of magnitude longer.

This is the Matterport system , and it debuts today at $4,500, or about the cost of a professional digital camera like the Canon 5D Mark III and a nice lens. The necessary access to the cloud platform runs an extra $50-$150 a month, depending on usage.

This is a tool for professionals. But so were the original lug-about laptops or those cell phones shaped like bricks. In the next few years, Matterport's CEO Bill Brown told me, every picture you take will have a three-dimensional component.

"The company started with the long-term vision that there is going to be a 3D sensor in everyone's pocket," Brown said. "We know that we're going to get there ... We think it's as big as the transition from film to digital."

Brown's been working on 3D imaging since his days at Canesta, which created the technology that eventually came to power the latest-generation of Microsoft's Kinect controller .

Along with the co-founders of Matterport, Matt Bell and Dave Gausebeck, he's obsessed with the idea that you'll have a 3D camera in your mobile device soon.

They've even had a chance to play with Google's early incarnation of that vision, the mysterious Project Tango , which purports to create simple 3D maps of a space with sensors embedded in the phone. "These sensors allow the phone to make over a quarter million 3D measurements every second, updating its position and orientation in real-time, combining that data into a single 3D model of the space around you," the project site says.

Because Matterport's system is modular, they were able to connect the Tango into their cloud system and capture a decent model of Gausebeck's garage using just the phone.

"Google has pushed the envelope on the technology faster than people thought was possible," Brown said. He pointed out that Intel, too, has been investing in 3D motion sensing , and said that he thought a company would announce a mobile device with 3D imaging built in before the end of the year .

For Brown, it's obvious that people would want 3D imaging built into their phones.

"There is no reason that anyone would take a picture that is just 2D. When you take a shot, you'll capture the 3D data. If nothing else, your 2D shots will be better," he said. "Today you walk and take a video. If you were capturing the 3D data, you're able to reconstruct anything you've walked through. You've created an environment by putting all of the 3D underneath the 2D data."

I will admit that it still feels strange to me. I'm not sure what I would do with a library of 3D models of the places I've been. But the ability to do such a thing in the next few years with a consumer device still floors me.

For now, Brown sees three groups of people who might be interested in Matterport's pro offering: The documenters, the promoters, and the visualizers.

Documenters might include people in the construction industry, architects, or insurance claims adjusters. These people need accurate measurements and records of spaces. And that's what Matterport can provide.

Promoters are an obvious market, too. We're talking realtors or people renting spaces (AirBnb hosts, say). This is already a market that's served by the kinds of professional photographers who might buy the Matterport camera.

Visualizers are the most heterogeneous group. It includes anyone who wants to play with a space for some reason, everyone from a forensic analyst to an interior designer who wants to show clients how their house might change with an accent wall.

Admittedly, these are all niche applications. But Brown believes that only by getting out into markets can they really understand the problems and opportunities for 3D scanning. The cost and size of 3D imaging technology are both shrinking and therefore opening up new opportunities, but what those opportunities might be for regular consumers remains unclear.

For companies like Google, though, the stakes are clear. 3D sensing gives devices—or robots—"a human-scale understanding of space and motion." Our world is 3D, and they want machines to be able to see it like we do.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.