Creating an app or cellular recreation is one factor, however staying on high of its efficiency is one thing else fully. Builders are capable of create a clearer image of their titles by analysing key metrics and making adjustments that enhance the expertise.
With gamers demanding higher high quality video games and an abundance of titles to select from, competitors is fierce. Subsequently, realizing what to maintain an in depth eye on and the way finest to take action is more and more vital.
In a latest joint meetup between Azur Video games and Google Adverts, the event and monetising of hypercasual video games was analysed. As a part of this meetup, Azur Video games CRO Maksim Kozhnov shared some perception relating to metrics and easy methods to enhance your analytics.
______________________________________________________________________________
At present, there’s a number of speak about how video games have gotten extra complicated and the way participant calls for for high quality and amount of content material are rising. In consequence, the analytical strategy can be bettering. I need to clarify how one can enhance your analytics and transfer past easy metrics to extra complicated ones that may profit your mission.
Let’s begin by briefly discussing basic metrics that everybody is aware of and makes use of. These might be divided into three teams.
Firstly, there are product metrics similar to retention, playtime, and different. There’s nothing new to say about these.
The second group is monetisation metrics. These embrace in-app purchases, advert monetisation, and subscriptions. The primary metric right here is LTV. Different metrics we take a look at embrace impressions, day by day impressions, cumulative impressions as much as a sure day, and so forth.
The third group is person acquisition metrics, together with CPI, CTR, conversion price, set up price, ROI, and natural proportion. These metrics are additionally pretty normal.
Nevertheless, it is vital to keep in mind that your most important metric is all the time return on funding (ROI). If it is increased than 100%, your mission is worthwhile. There are numerous methods to realize this.
As an illustration, you will have a comparatively low retention price, however your natural proportion might nonetheless be very excessive, which is superb to your product. Alternatively, you will have a excessive CPI, however your LTV is even increased, which might additionally end in a superb ROI. Subsequently, it is not unusual for sure metrics to fall beneath benchmark values, but your product can nonetheless generate a considerable revenue. For instance, our Hair Tattoo and Bike Hope initiatives have R1 charges of round 30%, however they will nonetheless obtain wonderful earnings by the top of their life cycle.
Now let’s transfer on to extra complicated subjects. I am going to divide them into 4 themes: funnels, advert monetisation metrics, technical metrics, and probably the most attention-grabbing half — easy methods to work with heatmaps.
Working with funnels
Let’s begin with funnels. They seem to be a widely-used software in analytics that assist monitor person churn charges at completely different phases.
On the suitable aspect, you’ll be able to see an instance of a easy stage development funnel in considered one of our video games, however it does not present a lot data to attract conclusions from.
To achieve extra insights, we add extra metrics to our funnel, as proven within the desk on the left. Initially, we divide our funnel into the beginning and the top of the degrees. This permits us to know at which stage persons are truly leaving the sport — throughout a stage or between them — for fully completely different causes.
Moreover, we add the win price and common time spent on a stage to our funnel, so we are able to exactly decide why a person left, whether or not it was attributable to a tough stage or a stage that took too lengthy to finish.
Let’s take a more in-depth take a look at why it is vital to think about step size when working with churn price. This is an instance funnel for a city-building recreation, or an idle recreation.
At first look, step 4 might appear to be the worst with a 20% churn price, however it’s truly extra complicated than that. If we add the time elapsed since set up to this funnel, issues turn into clearer.
At step 4, the churn price is 20%, whereas it is solely 10% for different steps. Nevertheless, step 4 takes longer to finish, so it is affordable to anticipate extra individuals to depart the sport over an extended time frame.
To make clear the state of affairs, let’s plot all the info factors on a graph the place the y-axis represents the share of gamers from the time of set up, and the x-axis represents the time elapsed since set up. Now, we are able to see that step 4 truly falls on the identical line as all the opposite steps besides step three. It’s because a ten% churn price is critical for under 30 seconds of gameplay. So, try to be on the lookout for points there as an alternative of specializing in step 4.
Let’s speak about promoting networks
Now we have a number of promoting networks in our video games, however in some instances, promoting from sure networks might elicit a unfavourable response from customers. As an illustration, they may have points with software program improvement kits (SDK) or issues with closing the advert window, or the commercials may merely be too aggressive. To watch this situation, we take a look at the session closure price. An instance of this metric might be seen within the following desk.
That is actual knowledge from considered one of our video games. To calculate this metric, we divide the variety of impressions that led to session closure by the whole variety of impressions within the community. As you’ll be able to see, it is evident that some networks carry out worse than others.
Subsequently, we fully disabled Advert Community 5 and 6. This led to a ten% improve in retention and LTV. Often, it is not a good suggestion to show off complete promoting networks as a result of your eCPM might drop. Nevertheless, in some instances, rising retention by disabling some networks can compensate for the eCPM drop, leading to revenue. It is even higher to disable particular adverts inflicting points, however you want a number of knowledge for this. In our case, because it was a comparatively small mission, we did not have sufficient knowledge, so we fully disabled two promoting networks, but we nonetheless received good revenue.
When analysing adverts, it is vital to additionally study the distribution of impressions amongst customers.
It’s because there are cases when you’ve got an equal variety of impressions per person, however the LTV differs between teams. This occurs attributable to eCPM fatigue with each subsequent view for every person. For instance, in group B on this graph, many customers did not watch any adverts, whereas many others watched a number of adverts. On this case, the LTV in group B will probably be decrease than in group A.
Transferring on to technical metrics
It’s evident that your mission’s technical situation considerably impacts retention and, consequently, monetisation. Regardless of this truth, few individuals take note of it.
What can we imply by technical metrics? Firstly, we discuss with FPS, common and median values, to know how easily the sport runs. We additionally monitor the variety of FPS drops, intervals when the FPS drops beneath sure ranges. Reminiscence utilization can be tracked in an analogous method. Moreover, sending knowledge about crashes to analytics is useful to know which particular occasions within the recreation brought on the crashes. It is strongly recommended to ship this knowledge to particular crash instruments like Google’s Crashlytics.
Lastly, we utilise technical funnels to establish issues in loading sequences.
The steps on this funnel signify vital phases throughout the loading course of, similar to accepting permissions, loading recreation assets, loading SDKs, buying a profile from the server, and related actions. This will help you find issues successfully.
When you observe a excessive churn price between the set up and begin of the tutorial, it is best to examine the technical funnel. Moreover, it’s advisable to trace the time between steps on this funnel, as some steps might take longer than anticipated.
Right here is an instance of how technical metrics are utilized in a real-life state of affairs in a multiplayer shooter recreation, World Struggle Heroes.
Following the discharge of a brand new model of our recreation, we observed a rise within the variety of crashes. Our builders decided that the majority of those crashes have been associated to reminiscence utilization, and our analysts found that they primarily occurred throughout battles. To deal with the difficulty, we examined the connection between reminiscence utilization and battle numbers and located reminiscence leaks. We collected further analytics on this drawback, figuring out the maps and recreation modes the place it occurred, which helped us to seek out and repair the difficulty.
Heatmaps
A heatmap is a graphical illustration of information that makes use of color coding to signify completely different values. This is a couple of examples:
They are often very useful in stage design, permitting you to review participant motion routes, sniper positions, gathering spots for gamers, areas the place gamers get caught, or the place they exit the sport. Heatmaps may also be used to review person interface (UI) parts in UI-dependent video games and apps, similar to figuring out which parts are extra steadily used and the place customers faucet on the display.
Whereas we primarily use heatmaps on our midcore initiatives, they are often helpful in hypercasual video games as effectively, particularly if the sport has complicated maps.
Right here’s how we used heatmaps for an off-road simulator:
This recreation requires you to manoeuvre a truck by difficult terrain by utilising gear shifting and different intriguing truck driving ways. We observed a major drop-off in gamers between tutorial phases, however could not discern why as a result of map being too open-ended, leading to a number of hypotheses.
To deal with this situation, we started sending participant coordinates to analytics each few seconds. These coordinates have been then positioned onto a map screenshot, the place a coordinate grid was marked, and the variety of participant occasions in every cell was tallied. The brighter the cell, the extra occasions occurred in that individual spot. This is an instance:
The extreme purple areas on the left map point out the place gamers received caught probably the most. By figuring out these spots, we have been capable of modify the map and incorporate further tutorial tricks to help gamers in comprehending what they wanted to do.
We additionally colour-coded the tutorial into complicated segments and found that some gamers merely disregarded tutorial ideas and proceeded straight to the goal purpose, which led to being caught. This is a screenshot from the sport:
The blue line represents the tutorial path from one checkpoint to a different, whereas the purple arrow signifies the ultimate goal. Some gamers noticed the target immediately and tried to achieve it straight, leading to being caught on rocks. Because of the warmth map, we have been capable of establish and handle these points, leading to a 15% improve in retention and tutorial development.
Edited by Paige Cook dinner
