I'm working on a new website called GameDataCrunch.com, a new way to understand the game industry by looking at metrics and slicing them up in a bunch of different ways.

If you want to check it out right now just go to GameDataCrunch.com.

If you want to understand my underlying design philosophy for the site, read on.

Here's one view:

Here's another:

But, let's start at the beginning. Let's pick a game, say DOOM (2016). We'll just type DOOM into the search box and click:

That takes us to the detail page for Doom.

The top of the page has a link to similar games and a hilighted summary of some of the game's best performing metrics.

We can see that it's a in the top 0.5% of games in terms of number of followers, and furthermore that it's a top-tier Horror game. Impressively, it's the #1 game with the "Demons" tag, though we can tell from the rank totals that there's less then 10% as many of those as there are Horror games.

Clicking on any of the links will take you a view that shows those rankings in a list. But before we hop over there, let's keep scrolling down:

This is my approach to metrics. Instead of trying to take one figure and multiply it by some constant, I just gather as many independently verifiable public facts as I can and list them all together.

It's pretty clear just looking at this that Doom is a top 0.5% or top 1% game by any measure. However...

Let's not jump to conclusions!

The trick is, any single metric is biased in a particular way. "Number of reviews" only measures highly engaged users (the kind who leave reviews), and is sensitive to changes in Steam's review system (with inflection points at November 26, 2013 and October 30, 2019). "Peak concurrent users" undercounts purchased but unplayed games sitting in people's backlogs, and probably overcounts multiplayer games. "Top sellers 24-hour rank" is the closest direct measure of sales performance we have, but it can't tell you anything about a game's performance in the deep past. And so on and so forth.

You see, if I was trying to extrapolate a "true" underlying sales figure from any individual metric alone, I not only have to contend with these distortions, but also issues of sample size. For lower selling games, for instance, a few extra reviews on the margin can have an enormous swing in the number of total reviews:

And this is before you even consider the fact that the most popular estimation method used to extrapolate sales from reviews has an enormous base uncertainty range, and even then we can't be entirely sure the relationship between number of reviews and game sales holds for every game on Steam.

The whole point of having metrics is to be able to compare games to one another on an apples-to-apples basis – and you lose that firm baseline when you start multiplying figures together and sticking dollar signs in front of them.

Bottom line:
We can learn a lot more from data we've actually got than from pining after figures we don't have.

Just the Facts, Ma'am

Data isn't enough though, you also need context, and that's what these three little buttons are for:

Each of these is a different way of looking at the same information. "Ranking" is the default, but here's what "Raw value" shows:

I'm not estimating or guessing anything here. I can display these metrics with high confidence and incredibly precision because they're all public figures that I can just measure directly. But what do they mean? Well, let's see if we can tell an (honest) story.

Here's the percentiles:

And here's the rankings:

And why not throw in a column of with tasty fruit icons that presents percentiles as "tiers" to help my brain visually process the context just that much faster:

This starts to paint a picture. I don't know how many sales DOOM (2016) has sold and neither do you. But I know it's probably in the top performing 100-200 games on Steam by any reasonable measure. Heck, it's a 4 year old game and it's still managed to hit #336 on the top sellers chart in a recent day.

Break it down, Slice it up

Okay, so we can get some basic metrics. What else can we do?

Well, we can see how well any given game performs within a specific category:

This shows us how DOOM performs relative to other games it shares tags with. Not surprisingly, it's near the top of just about every category it's in, only dropping out of the top 1% when you pit it against literally every other FPS on Steam.

Now, let's look at some other games' category ranks, specifically two games at the top of their respective genres.

A Tale of Two Genre Kings

Tales of Maj'Eyal, is the #2 Traditional Roguelike on all of Steam:

And here's Dead Cells, the #1 Roguevania on Steam.

Both of these are fairly niche genres in terms of number of titles, having only about 60-70 titles on Steam each, but they're very different in terms of overall popularity.

Tales of Maj'Eyal has good stats for an indie game – more than most indies will ever achieve – but Dead Cells in on another level, cracking the coveted top 1% and even top 0.5% tiers of all games on Steam.

What can we conclude from this story?

Well, it's obvious that the Roguevania genre (and it's parent genre, the Action Roguelike) is more popular than the Traditional Roguelike genre. But what does this mean for the average indie developer? Should they avoid making a Traditional Roguelike and go for making a Roguevania or Action Roguelike instead?

That's not as clear. Although the Roguevania genre is more popular and you might read that as having a higher potential sales ceiling, you'd also be setting yourself up to compete against some of the most popular games on all of Steam. So should you make a Traditional Roguelike, hoping to compete in a smaller pond? Well, maybe.

I think that's the wrong question to ask. Let's be real – most indie devs already have a good idea of what kind of games they want to and are able to make, and picking some random genre that your heart really isn't into, simply on the basis of sabermetrics, is a recipe for failure. What I do think is important is going in with your eyes open.

So, let's say you've already decided to make a Traditional Roguelike. Do you need to unseat the genre king to achieve success? And if so, do you have what it takes to do it?

Well, when I started writing this article, Tales of Maj'Eyal was actually #1 in its category. So "who will be the next genre king" is no longer a hypothetical question.

The new King of the Traditional Roguelike Genre is the Early Access title