We took a look at Google’s new Photos app yesterday, and it has a tonne of new features. Another new addition is the intelligence behind the app, which it uses to recognise people, places and things.
Google’s Photos service already uses some smarts to create its auto-awesome stories and compilations, but that only goes so far. The new Photos app takes this a step further. Not only will it pick out and identify faces, but it will recognise objects too — cars, food, places, structures and more.
One can only imagine that the computing power required to make these identifications and matches implies that this is a cloud-powered feature, though it is plausible that it could be performed on device in future.
The new auto-detected things are shown in the search interface, accessible via a floating action button in the main screen. As Android Police have rightly picked up, this really isn’t the most intuitive place for it — it could be better done. Regardless, the feature works pretty well – it picks out faces even if they’re hiding more in the background of a photo.
“Things” isn’t quite so fine tuned, but it does seem to work rather well depending on the subjects of your photos. Some of the groups which have been identified thus far include cars, skylines, dogs, flowers, stadiums, weddings, ships, food and more.
The accuracy (or wit) with which Photos groups things will be interesting to explore; cats can be mixed up with dogs (depending on how the dog looks I guess!), ships can be interchangeable with spaceships, and so on. Whether Google gets it right or not, you are able to manually remove images from groupings if you like, though it’s unknown whether this will feed into Google’s server side algorithms to improve future matches.
The guys over at Android Police have clearly got some unbridled access to this app to have seen what it can do, and sadly we can only report their findings — no one else has this kind of access to the app thus far.