Categories
Community

The Aspiring AR/VR Developer

Thanks to the advanced camera systems and even LiDARs nowadays in our smartphones Augmented reality is subtly blending into everyday consumer life; you can actually see how a new Ikea couch or Apple Homepod will look in your living room before you decide and buy one. Companies like Meta (formerly Facebook) are building an entirely new world using Virtual Reality termed Metaverse where you can create virtual office spaces to have real-time meetings with your colleagues, play a game of basketball and even attend concerts. 

AR augments the real-world scene by adding layers on top of your real world, whereas VR creates completely immersive virtual environments that need VR goggles or headsets to experience it. Both of these technologies started as the next chapter of the gaming industry but quickly found their way into other applications like Fashion, Interior Designing, e-commerce, Architecture and Metaverse. You no longer have to visit a physical store to experience how a new jacket or pair of glasses will look on you or a theme park in Florida to enjoy a roller-coaster ride. 

Download the Aspiring AR/VR Developer infographic here!

Categories
Platforms

Game On! AR vs VR

Here at /Data we offer certainty to those that are speculating about software developers: who they are, what they are choosing to do with at work and with their hobby time, and how they are doing it.  We consider ourselves the analysts of the developer economy and often say that we help the world to understand developers…and developers to understand their world.  ARVR

google-cardboard

“Google Cardboard 3d, 360 degree video viewer” by mr.racy is licensed under CC BY 2.0

Two of the areas that we are often asked about by big businesses with skin in the game are Augmented Reality (AR) and Virtual Reality (VR). Part of my job is to brief top tier organisations on what the developer audience is focussed upon so the companies can make the best decisions. I don’t speculate — I’m not brave enough for that.  Instead, like every analyst at the company, I use our data to find trends and outliers in this emerging sector.

How do we get the data? We ask the people at the coal face, the developers. We do this twice a year through one of the largest and broadest surveys in the developer calendar. We have a set of questions about AR/VR which we update regularly to find out how the latest frameworks and hardware are faring, and which programming languages are most popular. We can tie the data back to the types of apps that developers are creating, whether they work professionally or as hobbyists, and where they are based, among other things. We write reports after analysing the data, which you can find here. The AR/VR reports are in the “Emerging” category.

In the rest of this blog post, I’m going to share a few key facts that we gathered in a recent wave of our survey (Q2 2018). We currently have another survey running and would love to include your opinions; if you share them with us, there’s the chance to win some awesome prizes. Interested? Take the survey. 

ARVR development is immature

OK, that probably came out wrong! AR/VR development is still not a mature area in that it’s hardly established in the same way as desktop or web development. We generally use the more polite term “nascent” to describe an area where most of the developers working in it are hobbyists, though often professionals in other sectors, or students. In nascent areas, we find most developers are simply trying out ideas to find out more about the basics of the technology and work out where to go with it. 

ARVR development is increasing in popularity, with over 20% of our survey respondents saying they had worked on such a project in the past 12 months. Given our estimates of the total worldwide developer population, that gives a global population of AR/VR developers of over 5M.

We see a high number of young, inexperienced developers in this area, which is another sign of a sector that hasn’t yet settled down sufficiently for businesses to build a stable ecosystem of professional developers within it. It’s a sign of churn, where developers try the technology and move on. Most AR/VR apps are developed within the games category and, where they are not, their developers are still uncertain of their audience. Among AR/VR developers, almost 2 out of 3 are not so much bothered about making revenue from their efforts, but are simply interested in gaining experience. 

Virtual reality

Hardware moves rapidly in this sector, and we find ourselves updating our question set for each survey as acquisitions and closures affect the vendor marketplace.

When it comes to VR, developers are clearly keen on sexy dedicated hardware such as Oculus. But our data reveals that the same number of VR developers work with the cheaper, smartphone-based option Google Cardboard. The hardware created by a range of third party device manufacturers, incorporating the Windows 10 Mixed Reality platform (which can also be used for VR) is also highly popular with VR developers. 

ARVR Graph

 

Augmented Reality

AR is a very different beast to VR. It’s well-suited for a smartphone platform, most famously made popular by Pokémon Go. Huge investments by Apple and Google are paying off. They are keen to get you developing on their platforms because of the massive potential within the app stores (again, see Pokémon Go for an example).

ARCore on Android and ARKit on iOS are the platforms of choice for AR development by some margin. The most popular wearable for AR is Microsoft HoloLens, as Magic Leap had yet to be launched at the time of the survey. It will be interesting to see how things have changed now that device is out of the closet. So, if you’re working on this newest of hardware, tell us about it in the survey!

AR is the simple, more accessible end of the spectrum for developers. The spectrum crosses from more sophisticated mixed reality up to full-blown virtual reality. Developers are finding that AR is a good place to start, particularly during this period where underlying technology and hardware undergoes rapid evolution and pricing levels for consumers start to wobble. Starting with AR, developers can learn how to blend virtual elements ever more seamlessly into the real world, and take their experience later into the convergence zone as virtual reality becomes a more realistic proposition for users and developers alike. It’s the gateway for many, and we are seeing more growth in AR than VR for this reason.

https://youtu.be/r87hy0bdUh8?t=85

 

What about working cross platform?

Fragmentation is real, and being able to deploy across a range of hardware is always attractive. If you’re a game developer, and even if you are not, Unity and Unreal provide sophisticated cross platform development and tools that include ARVR. They do come with a steep learning curve so we find them mostly popular with those already initiated (e.g. game devs). Other platforms such as Lens Studio, Spark AR and Sumerian are empowering AR developers, and we want to find out how popular they are becoming in the developer community. 

To get this kind of useful information, and more, we need you in the survey this time around!  We want to know what languages you are using, the hardware, the platforms, and the apps you are creating. Has the new Oculus Quest has piqued your interest and restarted the heart of VR development? Or is AR and mixed reality where it’s at? Why not take the chance to tell us? Help us tell the teams behind these products what you are deciding, so they can do their best to support you. 

Have your say. Take the survey. 

Categories
Business Platforms

Virtual reality: Where did it all go wrong?

In this article, I’m going to talk about how I perceive the mainstream consumer audience to have rejected virtual reality, and suggest that its child, augmented reality, may be the Slope of Enlightenment that convinces us to buy in. While these are my views alone, towards the end of the piece, I’ve dug out some data from software developers around the world who are working with AR and VR. Even if you don’t care about my views, you may find what they have to say interesting. And, if you’d like to express your own thoughts, I’ve included a link to a survey that’s open right now, which will help key players in the industry to  draw their own conclusions.

Virtual reality: Tomorrow’s world, today

I worked in the smartphone industry before it came of age. Our mission was “a smartphone in every pocket” at a time when simple feature phones like the Motorola RAZR were the must-have communications device. Within a few years of our early projects, the competitor, Apple, launched the iPhone. The rest is history. The App Store opened its doors, the stars aligned, the technology dream was realised and smartphones went on to rule the world.

I grew up in a time of change. We had a BBC microcomputer before I was ten years old. As a teenager, I sashayed along to the sounds of the eighties on a tape Walkman, and later mobile CD players and minidiscs. Then Napster, now Spotify. Change. The cadence of technological evolution was a rapid heartbeat, sounded out by the Internet, mobile phones and a maturing software development industry, which I joined enthusiastically.

Maybe I just got used to an unrealistic pace of change? But whatever happened to virtual reality (VR)? Its heartbeat seems to have flatlined. Nothing much has changed in the years that have passed since the “year of VR” (pick your year, we’ve had a few of them), which turned out to be nothing much of the sort. When I look at my mobile phone of a few years ago, or my website developed in 2004, I think how clunky and quaint they look compared to the sleek form factor and execution possible today. But when I look at the VR headsets of yesteryear and today and compare what they deliver? Not so much.

Take a look at this slideshow of legacy VR hardware. Sure, we’ve come some way since the Sensorama, but the Sega VR of 1993 wasn’t significantly more dorky than today’s HTC Vive Cosmos, was it?

Does anybody really want to strap a heavy, nerdy headset on that makes you suffer motion sickness after a few minutes use, tethers you to a PC, dulls your senses to the real world outside the headset and causes you to trip over your furniture?

Sure, expensive and shiny, next generation VR devices, are coming. But much of the hardware available is unchanged from when it came to the stores two or more years ago, which means hard-core early adopter audiences aren’t shelling out again.  While availability of more cost-accessible hardware for casual users has increased, e.g. the Oculus Go, the handsets are still expensive enough to give mainstream consumers pause, and typically compromise on aspects of quality that mean the VR experience is somewhat flawed.

Convince people that you’ll change their lives

In the consumer world, expectations for VR were raised early and sadly led to disappointment as it became clear that the ambitions went far beyond what was possible given the technology available. Overpromised, VR lost the attention of mainstream audiences, as it simply could not deliver. In part, this was down to problems with the hardware, such as cumbersome headsets, inadequate processors, poor displays and weak audio. Then there’s the secondary reason: there is no “must-have” killer app that convinces sufficient people that you’ll change their lives.

The two issues go hand in hand (the ‘chicken and egg’ situation) since if technology is inadequate, the content creators see no justification for investing heavily in VR. In turn, this means insufficient buyers and revenue to justify the investment in improving the technology. (It’s worth pointing out that secondary uses for VR, such as in industry, education, healthcare, have a very different uptake/content model, and as such, I’m considering just the mainstream here).

And, as such, entertainment content is the key to unlocking adoption by persuading consumers that VR devices are a must-have item. Like 3D TV, VR has thus far failed to deliver a sufficiently convincing experience that sends people rushing to shops to buy the hardware, despite its costs and the limitations involved.

What’s more, VR content isn’t coming along as fast it used to. Hollywood used it for marketing, e.g. to promote films such as 2016’s Fantastic Beasts and Where to Find Them and TV shows including Game of Thrones. But this has dropped back as consumer uptake and gratification was found to be negligible.

Venture funding for consumer VR software companies may drop by more than half this year, to $265 million from $576 million a year ago, SuperData says. And this isn’t surprising. According to the SiliconANGLE. VR headset sales have dropped nearly 34% since Q2 2017. Even committed hardware manufacturers are showing signs of taking their foot off the gas. Samsung, which was one of the first to market with its Gear VR mobile headset, didn’t say anything about VR in its major announcements at CES this year.

Is AR the way out of the trough of despair?

Experts predict that new kids on the block, Augmented Reality (AR) on smartphones and Mixed Reality (MR) headsets, such as Microsoft’s HoloLens. will pick up the audience that VR failed to serve. In terms of the Gartner Hype Cycle, AR and MR — the children of VR — look to serve as the Slope of Enlightenment.

AR can be delivered by the hardware already in your pocket. It doesn’t need the level of resolution or processor power demanded by VR. AR is also far less cumbersome than VR and can be used on the go since it doesn’t require total immersion in the experience. The software brings in a virtual element without losing the real world.  

Certainly, analysts report adoption of augmented reality and mixed reality to be on the up, with earnings expected to come from mobile AR apps, particularly games. Google and Apple have strongly embraced this market with ARCore and ARKit, enabling developers to access AR services on more than 500 million devices in the wild today. Both Apple and Google envisage third-party apps and services that use AR as valuable additions to their app stores. Successful apps add billions to the top line (Apple was expected to make $3 billion revenue over 2 years from in-app purchases within the best known AR title to date, Pokémon Go) and high-profile AR apps also strengthen the ecosystems of both companies, boosting other revenue streams.

The smart money is now shifting to companies working on AR and MR. Apple have a rumoured research project to build a headset for delivery next year. Investment in companies working on MR is expected to jump by nearly 50 percent this year, according to SuperData, with sales of MR headsets expected to ramp up significantly and surpass earnings of VR headsets within the next two years.

The above is purely my opinion, based on observations of the tech industry over a number of years and a healthy degree of skepticism when it comes to inflated expectations. It’s uninformed by experience at the coalface of development however. So, what do software developers working with AR and VR, have to say?

Software developers working in VR and AR told us…

Here at SlashData we run regular surveys of software developers around the world to uncover valuable insights from those working in mobile, desktop, IoT, cloud, web, game, AR/VR, data science and machine learning.

In our Developer Economics 14th edition report, which is based on a large-scale online developer survey that ran over a period of eight weeks between November and December 2017, we reached over 21,700 respondents in 169 countries. We studied the data returned from developers working in AR/VR and found the following:

  • 25% of professional game developers say they are targeting AR and/or VR. This figure falls slightly to 19% across the entire corpus of developers surveyed.
  • Dedicated VR hardware, such as Oculus Rift, is attractive to games developers (61% report using it), but across all developers working on VR projects, we see a much lower uptake (33%), reflecting its early adopter status in fields other than games.
  • Across all developers working on VR projects, 32% are targeting smartphone hardware using Google’s Cardboard, and 19% are using Daydream View, built into Android Nougat and beyond, reflecting that developers, and consumers, are still experimenting with the technology on their existing hardware.
  • A similar picture emerges for AR, with Android and iOS taking the lead in most popular AR platforms across all developers targeting AR.
  • Of the dedicated AR hardware available, Microsoft HoloLens leads the pack, with Google Glass at Work and MagicLeap trailing behind when the survey ran in late 2017.

We are currently running another survey and we would value your input. If you’re a software developer working in the field of AR or VR, or considering doing so, please consider answering the questions. If you’re not a developer but are working in the AR/VR field, pass the link on to your developer friends and colleagues.

Every survey completed has a chance to win Oculus Rift +Touch Virtual Reality System to test your creations (or simply play around), Samsung S9 PLus$200 towards the software subscription of your choice, or other prizes from the prize pool worth $12,000!

Plus, if you refer other developers to take the survey, you may win up to $1,000 in cash. Just don’t forget to sign up before you take the survey, so that we know you want to be included in the prize draw!

What do you say, are you in?

Categories
Platforms Tools

Top 5 Tools for Augmented Reality in Mobile Apps

Augmented Reality (AR) is about overlaying pieces of a virtual world over the real world (in contrast to Virtual Reality (VR) that is about replacing the real world with a virtual one). On mobile devices, this simply means enhancing what you can see through the device’s camera with multimedia content (e.g. you can point your camera at a movie poster and watch its trailer, or you can point it at a star in the sky and learn its name). So, basically [tweetable]AR comes down to the following three fundamental questions: where to display what and how[/tweetable].

augmented-reality-Final

But first: which are YOUR favourite tools? Take the Developer Economics Survey and you could win new, amazing gear.

The where might involve areas like 2-D image matching and tracking, 3-D object matching and tracking, face detection and tracking, SLAM tracking, and location tracking (using GPS, accelerometer, compass, gyroscope). Sometimes the where is nothing more than some predefined point locations, often referred to as Points of Interest (POIs).

On the other hand, the what and the how might leverage 3-D model rendering, animations and gesture detection. In general, the what can be any piece of digital information (e.g. text, image, video) that the user might also have the ability to interact with (e.g. rotate or move it).

Top 5 Tools for Augmented Reality

Let us now present five of the numerous AR tools that exist at the moment and that can be used to develop apps for smart-phones, tablets or even smart-glasses. The following table contains information about the license(s), under which each one of these tools is distributed, and the platforms that it supports.

Product Company License Supported Platforms
ARPA SDKs Arpa Solutions Commercial* Android, iOS (ARPA SDKs), Google Glass (ARPA GLASS SDK), Android, iOS, Windows PC (ARPA Unity Plugin)
ARLab SDKs ARLab Commercial Android, iOS
DroidAR Free and Commercial Android
Metaio SDK Metaio Free and Commercial Android, iOS, Windows PC, Google Glass, Epson Moverio BT-200, Vuzix M-100, Unity
Vuforia SDK Qualcomm Free and Commercial Android, iOS, Unity
Wikitude SDK Wikitude GmbH Commercial* Android, iOS, Google Glass, Epson Moverio, Vuzix M-100, Optinvent ORA1, PhoneGap, Titanium, Xamarin

* There is also a free trial available.

ARPA SDKs

Image (multi-)detection and (multi-)tracking, 3-D object rendering in real time, as well as user interaction with 3-D objects (e.g. selection, rotation, scaling) are some of the features that ARPA SDK offers for building AR apps on iOS and Android. ARPA GPS SDK complements ARPA SDK with geolocation-based AR functionality: it allows you to define your own POIs that, when detected, the user can select them and get more information about them or even perform actions on them (e.g. the “take-me-there” action that displays a map with directions to the selected POI). ARPA GLASS SDK and ARPA Unity Plugin offer similar functionality with ARPA SDK for Google Glass and the Unity game engine, respectively. It is worth noting that Arpa Solutions, the company behind these SDKs, have over the years developed their own AR platform, some of the features of which (e.g. face recognition and virtual buttons) might at some point be transferred also to the SDKs.

Update Oct 7, 2015: ARPA website has gone offline – their domain name, i.e. arpa-solutions.net seems to have expired.

ARLab SDKs

With AR Browser SDK you can add and remove POIs independently from the scene in real time, interact with them (e.g. touch them or point the camera to them) and perform actions on them (e.g. send SMS or share on Facebook). Image Matching SDK allows you to create your own local matching pool with thousands of images (loaded both from local resources and remote URLs), and use it to match any image without any connection to the internet, while it also supports QR code and barcode recognition. Except for these two SDKs, ARLab will soon launch Object Tracking, Image Tracking and Virtual Button SDKs. All SDKs are available for both Android and iOS.

DroidAR

DroidAR is an open-source framework that adds location-based AR functionality to Android apps. Gesture (e.g. full turn) detection, support for static and animated 3-D objects (using the model loaders from the libGDX game development framework) that the user can interact with (e.g. click on them), and marker detection are part of the functionality that DroidAR offers and that is only shaded by the poor documentation that exists for the project. There is a section on the project README file on GitHub that gives an overview of a closed-source version of DroidAR, DroidAR 2, which seems to have some interesting enhancements compared to its open-source counterpart (e.g. SLAM tracking and a jMonkeyEngine plugin).

Metaio SDK

Metaio SDK supports among others 2-D image, 3-D object, face, SLAM and location tracking, barcode and QR code scanning, continuous visual search (both offline and online through Metaio CVS), and gesture detection. Metaio has also designed their own AR scripting language, AREL (Augmented Reality Experience Language) that allows you to develop your AR apps using common web technologies (HTML5, XML, Javascript) and deploy them everywhere. Metaio SDK can be used to develop AR apps for Android, iOS, Windows PC, Google Glass, Epson Moverio BT-200 and Vuzix M-100 or using Unity.

Vuforia

Multi-target detection, target tracking, virtual buttons, Smart TerrainTM, and Extended Tracking are some of the features of Vuforia SDK. Vuforia supports the detection of several kinds of targets (e.g. objects, images, English text). Especially for image recognition purposes Vuforia allows apps to use databases that are either local on the device or in the Cloud, The platform is available for Android, iOS and Unity. There is also a version of the SDK for smart glasses (namely Epson Moverio BT-200, Samsung GearVR, and ODG R-6 and R-7) that is currently moving to its beta phase and is open for early access applications from qualified developers.

Wikitude AR SDK

Wikitude AR SDK supports image recognition and tracking, 3-D model rendering and animations (supports only the Wikitude 3-D format), video overlays, location-based tracking and image, text, button, video and HTML augmentations. Wikitude AR SDK is available for Android, iOS, Google Glass, Epson Moverio, Vuzix M-100 and Optinvent ORA1, and as a plugin for PhoneGap, a module for Titanium and a component for Xamarin.

To sum up

There are apps that allow a museum exhibit to tell its own story, that help you decide which furniture looks better in your living room, that bring an elephant you just drew on a piece of paper into life, or that warn you about all the signs you ignored while you were driving. These are examples of already available apps that provide some sort of AR functionality. So, pick one of the AR tools we described above (or one we didn’t, e.g. AndAR, ARmedia SDK, BeyondAR, mixare) and use it to integrate AR in your own apps.

Read more about the differences between AR and VR!

What do you like or hate about these tools? Take the Developer Economics Survey and win new, amazing gear.