HACKINTOSH.ORG | Macintosh discussion forums

Facebook’s iOS app uses AI and VoiceOver to describe the contents of photos to blind users

<div class="feat-image">(https://9to5mac.files.wordpress.com/2016/04/facebook-voiceover.png?w=1600&h=1000#038;h=500)</div>
<p>At a time when so many <a href="http://9to5mac.com/tag/facebook/" target="_blank">Facebook[/url] posts comprise a photo and a brief comment, there’s one group of people who get rather left out of the picture: those who are blind and partially sighted. That’s a problem Facebook is fixing, starting from today. The iOS app now uses artificial intelligence to figure out the content of photos, and Apple’s <a href="http://9to5mac.com/tag/voiceover/" target="_blank">VoiceOver[/url] feature to read aloud a description of them.</p>
<p><a href="http://www.theverge.com/2016/4/5/11364914/facebook-automatic-alt-tags-blind-visually-impared" target="_blank">The Verge[/url] got a demo of the feature, which Facebook calls ‘automatic alt text.’</p>

<p class="p1"><span class="s1">Automatic alt text, which is coming to iOS today and later to Android and the web, recognizes objects in photos using machine learning [

…] While still in its early stages, the technology can reliably identify concepts in categories including transportation (“car,” “boat,” “airplane”), nature (“snow,” “ocean,” “sunset”), sports (“basketball court”), and food (“sushi”). The technology can also describe people (“baby,” “smiling,” beard”), and identify a selfie.</span></p>

<p>Facebook said that there were two approaches it could have taken to the problem, and it chose the one it believed would be most successful …</p>
<p> <a href="http://9to5mac.com/2016/04/05/facebook-blind-users-automatic-alt-text/#more-426216" class="more-link">more…[/url]</p>
Filed under: <a href='http://9to5mac.com/category/apps/'>Apps[/url] Tagged: <a href='http://9to5mac.com/tag/accessibility/'>accessibility[/url], <a href='http://9to5mac.com/tag/automatic-alt-text/'>automatic alt text[/url], <a href='http://9to5mac.com/tag/blind/'>blind[/url], <a href='http://9to5mac.com/tag/blind-people/'>Blind people[/url], <a href='http://9to5mac.com/tag/facebook/'>Facebook[/url], <a href='http://9to5mac.com/tag/voiceover/'>VoiceOver[/url] <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/9to5mac.wordpress.com/426216/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/9to5mac.wordpress.com/426216/" />[/url] <a rel="nofollow" href="http://feeds.wordpress.com/1.0/godelicious/9to5mac.wordpress.com/426216/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/delicious/9to5mac.wordpress.com/426216/" />[/url] <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gofacebook/9to5mac.wordpress.com/426216/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/facebook/9to5mac.wordpress.com/426216/" />[/url] <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gotwitter/9to5mac.wordpress.com/426216/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/twitter/9to5mac.wordpress.com/426216/" />[/url] <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gostumble/9to5mac.wordpress.com/426216/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/stumble/9to5mac.wordpress.com/426216/" />[/url] <a rel="nofollow" href="http://feeds.wordpress.com/1.0/godigg/9to5mac.wordpress.com/426216/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/digg/9to5mac.wordpress.com/426216/" />[/url] <a rel="nofollow" href="http://feeds.wordpress.com/1.0/goreddit/9to5mac.wordpress.com/426216/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/reddit/9to5mac.wordpress.com/426216/" />[/url] <img alt="" border="0" src="(http://[img]http://pixel.wp.com/b.gif)[/img]?host=9to5mac.com&blog=22754319&post=426216&subd=9to5mac&ref=&feed=1" width="1" height="1" /><img alt="" border="0" src="(http://[img]http://pixel.wp.com/b.gif)[/img]?host=9to5mac.com&blog=22754319&post=426216&subd=9to5mac&ref=&feed=1" width="1" height="1" /><div class="feedflare">
<img src="http://feeds.feedburner.com/~ff/9To5Mac-MacAllDay?i=n8kZJM9fo18:CpUDPTiIQpA:D7DqB2pKExk" border="0"></img> (http://feeds.feedburner.com/~ff/9To5Mac-MacAllDay?a=n8kZJM9fo18:CpUDPTiIQpA:D7DqB2pKExk)
</div><img src="http://feeds.feedburner.com/~r/9To5Mac-MacAllDay/~4/n8kZJM9fo18" height="1" width="1" alt=""/>

Source: Facebook’s iOS app uses AI and VoiceOver to describe the contents of photos to blind users (http://feedproxy.google.com/~r/9To5Mac-MacAllDay/~3/n8kZJM9fo18/)