HACKINTOSH.ORG | Macintosh discussion forums

Developers Demo Augmented Reality Improvements Coming in iOS 11.3

The iOS 11.3 update (https://www.macrumors.com/2018/01/24/everything-new-in-ios-11-3/), seeded to developers and public beta testers last week, introduces ARKit 1.5, an upgraded version of the set of tools developers can use to create augmented reality apps for the iPhone and the iPad.





As it turns out, ARKit 1.5 can do a lot of neat things. It can map irregularly shaped surfaces for better detection of your surroundings, and it can also recognize and map vertical surfaces like walls and doors, so you can use AR to place and detect items on walls.





Over the course of the last week, developers have been testing out ARKit 1.5 and sharing short demo videos on Twitter, providing a look at just what will be possible with augmented reality apps when iOS 11.3 is available.





(http://cdn.macrumors.com/article-new/2018/01/Apple_AR_Experience_01232018-800x533.jpg)


Vertical surface detection, for example, is shown off in the video below. A realistic-looking tunnel is projected on a wall, and while this doesn't have any immediate usage implications, it's a useful demo of how ARKit sees walls in iOS 11.3.





<center><blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">So I've been playing with the new ARKit wall detection today...what do you think?#arkit (https://twitter.com/hashtag/arkit?src=hash&amp;ref_src=twsrc%5Etfw) #madewitharkit (https://twitter.com/hashtag/madewitharkit?src=hash&amp;ref_src=twsrc%5Etfw) #augmentedreality (https://twitter.com/hashtag/augmentedreality?src=hash&amp;ref_src=twsrc%5Etfw) #iOS113 (https://twitter.com/hashtag/iOS113?src=hash&amp;ref_src=twsrc%5Etfw) #arkit15 (https://twitter.com/hashtag/arkit15?src=hash&amp;ref_src=twsrc%5Etfw) #ar (https://twitter.com/hashtag/ar?src=hash&amp;ref_src=twsrc%5Etfw) #AugmentedReality (https://twitter.com/hashtag/AugmentedReality?src=hash&amp;ref_src=twsrc%5Etfw) pic.twitter.com/J9tj6sJf9S (https://t.co/J9tj6sJf9S)</p>&mdash; Ubicolor™ (@ubicolorapps) January 25, 2018 (https://twitter.com/ubicolorapps/status/956588710509842434?ref_src=twsrc%5Etfw) <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> </center>


An example of how vertical plane detection can be used in augmented reality games is demonstrated in the video below, where creatures projected into open space take advantage of the area around them.





<center><blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Made a weird #GGJ18 (https://twitter.com/hashtag/GGJ18?src=hash&amp;ref_src=twsrc%5Etfw) game Creature-z this weekend with @tristan_damron (https://twitter.com/tristan_damron?ref_src=twsrc%5Etfw), @marknerys (https://twitter.com/marknerys?ref_src=twsrc%5Etfw) and @ericklind (https://twitter.com/ericklind?ref_src=twsrc%5Etfw) using #ARkit (https://twitter.com/hashtag/ARkit?src=hash&amp;ref_src=twsrc%5Etfw) verticalPlane detection. Big up to @PIGSquad (https://twitter.com/PIGSquad?ref_src=twsrc%5Etfw) for hosting  pic.twitter.com/BKRdhVKHvq (https://t.co/BKRdhVKHvq)</p>&mdash; lauri (＾ｰ^)ノ (@lingoded) January 29, 2018 (https://twitter.com/lingoded/status/957931270947799046?ref_src=twsrc%5Etfw) <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> </center>


Another demo adds virtual artwork to a blank wall, a concept that could potentially be used in an art gallery or museum where art is invisible without a smartphone.





<center><iframe src="https://www.youtube.com/embed/X5-g10cNmrM" width="560" height="315" frameborder="0" allowfullscreen="allowfullscreen"></iframe></center>


Vertical plane detection is used in the video below to show a realistic-looking virtual cockatoo coming through a window and landing on a windowsill.





<center><blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Look what flew in through my window today... #ARKit (https://twitter.com/hashtag/ARKit?src=hash&amp;ref_src=twsrc%5Etfw) pic.twitter.com/MFYYQlBjP4 (https://t.co/MFYYQlBjP4)</p>&mdash; Abhishek Singh (@shekitup) January 31, 2018 (https://twitter.com/shekitup/status/958755397145366530?ref_src=twsrc%5Etfw) <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> </center>


In addition to mapping oddly shaped spaces and recognizing vertical surfaces, ARKit 1.5 also includes image detection features that work on everything from movie posters to barcodes, as demoed below. In the future, you might be able to scan a barcode with ARKit to get a virtual popup of nutritional information, calories, and more.





<center><blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">In ARKit 1.5 reference images can be any image. Including barcodes!!!! #ARKit (https://twitter.com/hashtag/ARKit?src=hash&amp;ref_src=twsrc%5Etfw) #AugmentedReality (https://twitter.com/hashtag/AugmentedReality?src=hash&amp;ref_src=twsrc%5Etfw) pic.twitter.com/8fwJTcSoRo (https://t.co/8fwJTcSoRo)</p>&mdash; azamsharp (@azamsharp) January 31, 2018 (https://twitter.com/azamsharp/status/958717842362335233?ref_src=twsrc%5Etfw) <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> </center>


Image detection could be useful in settings like art galleries and museums, where visitors could use it to scan paintings and exhibits to receive more information, as shown off in the video below.





<center><blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">#arkit (https://twitter.com/hashtag/arkit?src=hash&amp;ref_src=twsrc%5Etfw) image detection 1st try: success! As @Apple (https://twitter.com/Apple?ref_src=twsrc%5Etfw) said, great feature for museums. Now I need content for 2300 paintings @NationalGallery (https://twitter.com/NationalGallery?ref_src=twsrc%5Etfw) pic.twitter.com/1m3LZVVCfJ (https://t.co/1m3LZVVCfJ)</p>&mdash; Romain Derrien (@LondonRom) January 28, 2018 (https://twitter.com/LondonRom/status/957674566427594752?ref_src=twsrc%5Etfw) <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> </center>


Though not visible in the demo videos shared by developers, ARKit 1.5 also introduces a higher camera resolution, so passthrough video is 1080p rather than 720p, and there's also support for autofocus capabilities, another feature that will improve the augmented reality experience on iOS devices.





Recent data has suggested that the ARKit framework has seen only modest adoption (https://www.macrumors.com/2018/01/04/arkit-use-has-slowed-since-september/) from developers and stagnating growth since its debut in iOS 11, but improvements like ARKit 1.5 may change that in the future. Augmented reality on iOS devices is still in its infancy and it will take time for developers and users to discover the best real-world use cases for the technology.





Apps using ARKit 1.5 will be available starting this spring when iOS 11.3 is released to the public.  




<div class="linkback">Related Roundup: iOS 11 (https://www.macrumors.com/roundup/ios-11/)</div><div class="linkback">Tag: ARKit (https://www.macrumors.com/roundup/arkit/)</div>
Discuss this article (https://forums.macrumors.com/threads/ios-11-3-arkit-developer-demonstrations.2103890/) in our forums

<div class="feedflare">
<img src="http://feeds.feedburner.com/~ff/MacRumors-Front?d=yIl2AUoC8zA" border="0"></img> (http://feeds.macrumors.com/~ff/MacRumors-Front?a=uGleULe_vzc:3bQV9ncl0x0:yIl2AUoC8zA) <img src="http://feeds.feedburner.com/~ff/MacRumors-Front?d=6W8y8wAjSf4" border="0"></img> (http://feeds.macrumors.com/~ff/MacRumors-Front?a=uGleULe_vzc:3bQV9ncl0x0:6W8y8wAjSf4) <img src="http://feeds.feedburner.com/~ff/MacRumors-Front?d=qj6IDK7rITs" border="0"></img> (http://feeds.macrumors.com/~ff/MacRumors-Front?a=uGleULe_vzc:3bQV9ncl0x0:qj6IDK7rITs)
</div><img src="http://feeds.feedburner.com/~r/MacRumors-Front/~4/uGleULe_vzc" height="1" width="1" alt=""/>

Source: Developers Demo Augmented Reality Improvements Coming in iOS 11.3 (https://www.macrumors.com/2018/01/31/ios-11-3-arkit-developer-demonstrations/)