Apple Maps “Look Around”, Release #7
Tokyo, Osaka, & Nagoya
August 2020
⚠️ Tap or click any image to enlarge
On August 4, 2020, Apple released “Look Around” for the Tokyo, Osaka, and Nagoya areas:
Covering 38% of Japan’s population, this latest Look Around release is Apple’s largest yet in terms of land area:
And it brings the total number of Look Around areas to fourteen:
Similar to what we’ve seen in the U.S., Apple appears to be targeting Japan’s largest cities...
...which allows Apple to cover more than 38.2% of Japan’s population while only covering 2.8% of its land area:
Look Around also now covers a much greater share of the Japanese population than the U.S. population:
However, given that Apple’s market share is even higher in Japan than in the U.S., it makes sense that Japan is the first country after the U.S. to receive Look Around:
* * *
One of the things that makes Apple’s Look Around imagery so interesting is the kind of features that can be built out of it. Google, for instance, uses Street View imagery to help power its AR navigation feature, “Live View”:
And Street View imagery is so important to Google’s AR implementation that Live View isn’t available in areas without it:
During WWDC 2020, we saw hints that Apple is taking a similar approach. Specifically, ARKit’s new “Location Anchor” feature appears to be enhanced by—and maybe even directly dependent upon—Apple Maps’s Look Around imagery for localization:
To place location anchors with precision, geo tracking requires a better understanding of the user’s geographic location than is possible with GPS alone. Based on a particular GPS coordinate, ARKit downloads batches of imagery that depict the physical environment in that area and assist the session with determining the user’s precise geographic location.
This localization imagery captures the view mostly from public streets and routes accessible by car. As a result, geo tracking doesn’t support areas within the city that are gated or accessible only to pedestrians, as ARKit lacks localization imagery there.
Because localization imagery depicts specific regions on the map, geo tracking only supports areas only from which Apple has collected localization imagery in advance.
But this isn’t the only new feature that Apple’s Look Around imagery appears to be powering. As part of iOS 14, Apple also released a new “Refine Location” feature...
...and, according to TechCrunch, this feature uses Look Around imagery to help determine user locations in areas with poor GPS signals (typically areas with lots of tall buildings).
If we look at U.S. cities with lots of tall buildings, we see an interesting pattern: all but one of Apple’s eleven Look Around areas appear on this list:1
This suggests that Apple might be prioritizing areas with lots of tall buildings as it rolls out Look Around, in order to support its “Refine Location” feature.
And it would also explain why, up until now, Apple has only released the central parts of many metropolitan areas (as it did with Los Angeles and New York):
If Apple is in fact targeting cities with large numbers of tall buildings, then it also makes it easy to see why Japan was the first country after the U.S. to receive Look Around:
* * *
On average, Apple has been releasing new Look Around areas every 61 days:
So given past patterns, Apple’s next Look Around area(s) are most likely to be released sometime in early October.
Then again, there’s reason to expect at least one new Look Around area even sooner...
During Apple’s “Explore ARKit 4” WWDC 2020 session, Apple announced that San Francisco, New York, Los Angeles, Chicago, and Miami would be the first five areas with support for ARKit’s new “Location Anchor” feature.
As we saw earlier, Location Anchors seem to be enhanced by—and maybe even directly dependent upon—Apple’s Look Around imagery.
While we don’t know when Apple’s WWDC sessions were recorded, this seems to suggest that Apple had expected Look Around imagery for Miami to have been released by the time of WWDC.
In other words, Apple might release Look Around for the Miami area in the near future.
* * *
Speaking of AR and WWDC, it’s a bit surprising that Apple didn’t announce an AR navigation feature for Apple Maps at this year’s WWDC.
Google Maps first added AR navigation for select users in February 2019 and then later released it for all iOS and Android users in August 2019.
Apple has shown strong interest in AR since first unveiling ARKit at WWDC 2017. And from a purely technical standpoint, Apple would seem to have everything it needs to add AR navigation to Apple Maps.
So it seems as if Apple is waiting for something... but what?
Similar to how Google’s AR implementation is dependent upon Street View, it’s likely that Apple’s would also only work in areas where Apple already has Look Around. As we saw earlier, Apple has released Look Around for just fourteen areas...
...so one possibility is that Apple is holding off on launching AR navigation until additional Look Around areas come online.
Another possibility is that Apple is waiting until LiDAR-capable camera systems are added to iPhones. Earlier this year, Apple added a “breakthrough LiDAR Scanner” to its iPad Pro models—and this same technology is rumored to be coming to this year’s iPhones.
AR navigation would make for an interesting demo of a “breakthrough LiDAR Scanner”, so there seems to be at least an outside chance of AR navigation being added to Apple Maps later this year. And if this were to happen, it also seems within the realm of possibly that Apple would dramatically expand its Look Around coverage.
Given that ARKit’s new Location Anchors are currently supported in Miami (but that there hasn’t yet been a Look Around release for Miami), it’s possible that Apple has a number of “finished”—but unreleased—Look Around areas that it’s deliberately withholding until a later date...
...and this date could be the launch of new iPhone hardware.
Of course, all of this is just speculation. But as long as we’re speculating, let’s try to guess Apple’s next Look Around areas...
* * *
While there aren’t many similarities amongst Apple’s eleven current U.S. Look Around cities, something they do have in common is that they’ve all been visited by Apple Maps’s pedestrian imagery collection effort:
They’re all also highly visited by travelers and tourists—with each area receiving more than half a million international visitors annually:
And with the exceptions of Las Vegas and Honolulu, they all have populations of five million or more:
And as we saw earlier, with the exception of Washington, they all have at least 50 skyscrapers (likely in support of iOS 14’s “Refine Location” feature):
So this gives us a handful of factors to examine. And when we look at all of the areas where Apple has collected pedestrian imagery—but hasn’t yet released Look Around—some interesting patterns emerge:
All of this suggests that Atlanta, Dallas, and Miami have the highest likelihood of being Apple’s next Look Around areas—followed by Detroit, Phoenix, and San Diego.
Meanwhile, Albuquerque, Austin, Buffalo, Denver, Jacksonville, Kansas City, New Orleans, Salt Lake City, and the Tampa Bay Area also seem to have higher than average chances.
And these patterns have largely repeated for the three Look Around areas that Apple has released outside of the U.S.:
All of this suggests that London has the highest chance of being Apple’s next international Look Around city—followed by Barcelona and Madrid:
Meanwhile, Dublin, Edinburgh, and Lisbon also seem to have higher than average chances, given that they’ve also been visited by Apple’s pedestrian collection effort.
__
1 The only Look Around city not listed is Washington, which doesn’t really have any skyscrapers, except for the Washington Monument.
But there’s also something else interesting about Washington: it’s the only Look Around city that doesn’t have Flyover imagery. So even though Washington doesn’t have particularly tall buildings, Apple needed to collect “3D” imagery there (since it didn’t already have any from Flyover). ↩︎
APPLE MAPS “LOOK AROUND” RELEASES
“Release #6: Seattle” Jun 2020
“Release #5: Chicago” Apr 2020
“Release #4: Boston, Philadelphia, & Washington” Feb 2020
“Release #3: Houston” Nov 2019
“Release #2: New York & Los Angeles” Sep 2019
“Release #1: San Francisco, Las Vegas, & Honolulu” Sep 2019