The bulk of this month’s column is going to talk about development choices and marketing for tabletop RPGs. There is an important part that relates to our objective of getting more fun out of the 4 hour game session, so I’ll lead with that and those of you uninterested in the business analysis won’t have to wade through it to get to the good stuff.
Before anything else happens at your table, a critical decision is made: What game to play. There are so many choices across dozens of genres and many versions and revisions. My advice is to start with a sample of options and see what your group really wants to play rather than making a choice for them and then trying to build consensus.
Send an email to your group with 3-5 options of games you’d like to run and ask if there’s any significant preferential choice. Remember to also ask if there’s a game people really don’t want to play – knowing about the “don’t wannas!” is as important as the “hell yeses!” If there doesn’t seem to be a consensus, try a different selection of games and repeat until you find something that gets your group really enthused.
If you’re playing an “open table” (so much more about this is coming in future columns but I’ll just put this comment in this column today for future reference), have a very clear description of your game available on an internet resource so that prospective players can understand what you’re offering before they arrive to play.
The overall suggestion here is to let the group lead (or self-select) to a game that they’re going to enjoy playing. It’s a simple thing, but surprisingly powerful in terms of generating more fun and more long-term interest – both of which tend to keep groups cohesive in the face of the forces that tend to break them up.
Diversity & Choice in the TRPG Market
The idea for this column started with a post on RPG Pundit’s blog (“Why do Commercial RPGs Fail”). Pundit listed 5 examples of common failures in design & marketing, but I felt that he was missing the most crucial factor: The market just doesn’t want what the publisher is selling.
A bit later, Greg Christopher responded on his blog (“What the Consumer Wants”) taking the position that designers need to ignore “market research” because using it to make design decisions produces crappy results.
I responded on his blog that he was confusing two different kinds of research – the kind where you try to divine preferences from consumer surveys and the kind where you try to determine if consumers would buy the product you are offering to sell.
The distinction is important, and fills the bulk of this column. The former (as I noted in my blog comment) does often create crappy results. The latter, on the other hand, should be a critical tool in your toolbox if you want to create and sell products to the hobby gaming market.
A caveat: If you are interested in creating art – that is, a work you create from your own passion to fulfill your own need to create, without a requirement that the work have commercial value, most of the following does not apply to you. Artists pursuing art for art’s sake are free from the constraints of having to worry if they can monetize that work. The success or failure of their labors is simply internal to themselves and requires no validation in the form of sales (or even other people using or appreciating the work). On the other hand, if you think “someone will buy and play this thing I’m making”, you’ve defined your work as something that does therefore fall into the realm of commercial endeavor and thus is subject to the judgment of the marketplace.
Why Asking People What They Want Doesn’t Work
The first kind of market research tends to fail miserably. If you conduct research that asks people a bunch of questions about their preferences for something like a game design and a genre, and then try to make a product that maps to those answers regardless of your opinion of them, you’re almost certainly doomed to fail.
The reason is that there’s a known bug in human psychology that limits most people’s ability to self-analyze their own preferences. Malcolm Gladwell wrote a book about this (which is fantastic), called [ame="[URL="http://www.amazon.com/Blink-Power-Thinking-Without/dp/0316010669"]Blink: The Power of Thinking Without Thinking: Malcolm Gladwell: 8601416581309: Amazon.com: Books[/URL]"]Blink[/ame]. In short, when you ask someone “what do you like about ‘X’”, most people give you an answer that isn’t correct. When their conscious mind attempts to make sense of their unconscious desire, there’s some kind of disconnect which produces garbage output.
It is possible to get useful data out of such studies but they have to be crafted differently than you might expect. Instead of asking straightforward questions, you have to build a study that gets at people’s underlying desires with questions that cross-reference each other, and questions that help disqualify responses that are red herrings. And you can’t take the results in an unprocessed form either. Instead you have to analyze the result looking for clusters and patterns, and then try to tease out places where the data suggests there’s a need for something that the respondents are seeking. This intersection is called a “need/gap”, and they’re very valuable especially if you can figure out how to deliver a commercial solution to that need/gap.
These kinds of studies are beyond the scope of this column. I’ll end this section by just saying that I agree with the surface conclusion that if you try to make something commercially successful based on simplistic market research, you’re more than likely to fail.
Succeeding Without A Map
Most of the successful tabletop RPGs weren’t built around any grand theory of need/gaps, or in fact any real research of any kind. They are all mostly the result of individual creators bringing their ideas to the market and finding success.
If you were to simply use that as a guideline, you’d conclude that the strategy for success in this industry is to self-publish your game getting as little input as possible from others and wait for a market to find you. And you’d be wrong.
The problem is that what you’re seeing is the output of a ruthless process of winnowing. You’re only seeing the games that “got lucky”, in the sense that the designers produced a work for which a need/gap actually did exist, at a time when the market was interested in that topic, with at least adequate design, and a good enough brand to grab enough interest among early adopters to create the seed of a social network around which a community of players could aggregate.
You don’t see the hundreds (thousands probably) of games and designers that followed the same path and ran into a brick wall.
It’s hard to visualize this for tabletop RPGs because most of them never see enough traction to get into the public record. But the collectible card game market had a remarkable opportunity to capture this phenomenon. In 2001 Krause Publications printed the Scrye Collectible Card Game Checklist and Price Guide book. This book documented 100 different CCG games that had been created from 1993 to 2000. By 2003, only 3 of those games were still being produced: Magic: The Gathering, Vampire: The Eternal Struggle, and Legend of the Five Rings. In 2011, only 2 of those games are still being produced – VTES is again in a production hiatus.
Were those other 97 games all crap? No, there were some very good games in that list. But a very large percentage were not good fits for the market. They were genres too small to attract a viable audience. They were variations on an over-done theme. They were mechanically poor. They were boring. They exploited a license but had little to offer beyond the licensed IP. The reasons those games did not become evergreen products are legion.
When you look at the tabletop RPG market and see successful games produced without the appearance of any backup data, you’re seeing the tiny handful that escaped all the traps that caught their peers. You’re not seeing a success strategy. You’re seeing lotto winners.
The Simplest Test
Even some of those lotto winners used a bit of research to help them succeed. This is the easiest thing you can do if you’re a creator and want to get a sense of the value the market might have for the game you want to create.
Pay an artist to do an illustration that depicts the unique selling proposition of your game. You’d be surprised at how reasonable these prices can be – there are many more quality artists than there are regular commissions working in the hobby game industry. The smart ones appreciate the opportunity to connect with a creator at the earliest stages of the work – they know that downstream there may be substantial benefits to being a part of that early circle.
Once you’ve got your illustration, take it to game stores and to gaming conventions, and ask people a simple question: “Would you be interested in playing this game?”. Take notes. Don’t rely on your memory (which will play tricks on you). You’re looking for a substantial supermajority of positive responses. If you’re getting that kind of overwhelmingly positive feedback, chances are you’ve got yourself a good idea worth the effort to develop to the next stage. If you’re getting mixed reactions, it’s likely you don’t. Remember that a number of people telling you they like the work are just being nice – every “yes” comes with hidden caveats.
Let’s play a little game and pretend we’re seeing a series of these presentations. Check your own responses to the following images. “Would you want to play this game?” Also try “Tell me what this game is about from this picture”.
Here’s the classic that launched the genre. Any question about what this game is about?
But what about this image? What’s this game about? Would you play it?
Alternity was created by some of the best designers in the industry and was published by the biggest company in tabletop RPGs, yet it failed to find an audience. I was a retailer (and a publisher) when Alternity was announced and I remember thinking that I didn't understand what the game was supposed to be, and what audience it was supposed to address. And I formed that opinion from little more than the artwork displayed above - a sentiment that proved nearly universal within the market when the game was printed.
Most people who are enthusiasts in the hobby have a well-trained critical eye for games and can quickly sort them into mental categories of likely to play, or not likely to play just from single images.
If you listen to what they tell you, you can save yourself a lot of heartache. Chances are you’re going to get a lot of negative feedback. Great ideas are a true rarity – great ideas that are commercially viable are an even more exotic species.
Spend a few hundred bucks on an illustration, and save yourself tens of thousands of dollars and hundreds of hours of design chasing a dead end. Do a little bit of testing to help guide your ideas towards something with a pre-existing customer interest and you’ll avoid a lot of heartache.
What Great Designers Do
In my experience, great designers always have a portfolio of ideas they’re working on. They’re constantly showing them to people, getting feedback, making changes, and evolving those ideas seeking that elusive “YES!!!!” moment when they make that critical connection.
Rather than taking just one design and obsessing over it in the face of unlimited negative feedback, great designers work in parallel with many different ideas. They know that the best way to improve their odds of hitting the lotto is to buy a lot of tickets, not to play the same numbers over and over.
Ideas are the cheapest resource of our industry. They are commodities with little intrinsic value. Until you can validate an idea as being resonant with a substantial audience, you haven’t begun to move forward towards something that can be successfully published.
Clever designers are the constrained resource in this industry. Clever designers spew ideas like geysers – being in their presence is to be deluged with ideas for games. These people don’t obsess about any one of their ideas – they’re able to separate their cleverness from the reaction of others to those ideas and keep producing new ones as they seek a good fit.
Once you’ve put yourself through this process for a couple of years you’ll start to feel the unseen rhythms of the customers and you’ll start to get an innate sense for the places that an interesting design may find fertile soil. You may get lucky on the very first day, but that would be an extremely exceptional outcome. It’s more likely that you’ll work for a long time trying and discarding many ideas before you start to get significant overwhelming positive reactions. If the world worked any other way we’d be drowning under an ocean of great and successful games. The lack of that ocean is proof positive that great ideas with commercial value are truly exceptional.
--RSD / Atlanta, June 2011
Before anything else happens at your table, a critical decision is made: What game to play. There are so many choices across dozens of genres and many versions and revisions. My advice is to start with a sample of options and see what your group really wants to play rather than making a choice for them and then trying to build consensus.
Send an email to your group with 3-5 options of games you’d like to run and ask if there’s any significant preferential choice. Remember to also ask if there’s a game people really don’t want to play – knowing about the “don’t wannas!” is as important as the “hell yeses!” If there doesn’t seem to be a consensus, try a different selection of games and repeat until you find something that gets your group really enthused.
If you’re playing an “open table” (so much more about this is coming in future columns but I’ll just put this comment in this column today for future reference), have a very clear description of your game available on an internet resource so that prospective players can understand what you’re offering before they arrive to play.
The overall suggestion here is to let the group lead (or self-select) to a game that they’re going to enjoy playing. It’s a simple thing, but surprisingly powerful in terms of generating more fun and more long-term interest – both of which tend to keep groups cohesive in the face of the forces that tend to break them up.
Diversity & Choice in the TRPG Market
The idea for this column started with a post on RPG Pundit’s blog (“Why do Commercial RPGs Fail”). Pundit listed 5 examples of common failures in design & marketing, but I felt that he was missing the most crucial factor: The market just doesn’t want what the publisher is selling.
A bit later, Greg Christopher responded on his blog (“What the Consumer Wants”) taking the position that designers need to ignore “market research” because using it to make design decisions produces crappy results.
I responded on his blog that he was confusing two different kinds of research – the kind where you try to divine preferences from consumer surveys and the kind where you try to determine if consumers would buy the product you are offering to sell.
The distinction is important, and fills the bulk of this column. The former (as I noted in my blog comment) does often create crappy results. The latter, on the other hand, should be a critical tool in your toolbox if you want to create and sell products to the hobby gaming market.
A caveat: If you are interested in creating art – that is, a work you create from your own passion to fulfill your own need to create, without a requirement that the work have commercial value, most of the following does not apply to you. Artists pursuing art for art’s sake are free from the constraints of having to worry if they can monetize that work. The success or failure of their labors is simply internal to themselves and requires no validation in the form of sales (or even other people using or appreciating the work). On the other hand, if you think “someone will buy and play this thing I’m making”, you’ve defined your work as something that does therefore fall into the realm of commercial endeavor and thus is subject to the judgment of the marketplace.
Why Asking People What They Want Doesn’t Work
The first kind of market research tends to fail miserably. If you conduct research that asks people a bunch of questions about their preferences for something like a game design and a genre, and then try to make a product that maps to those answers regardless of your opinion of them, you’re almost certainly doomed to fail.
The reason is that there’s a known bug in human psychology that limits most people’s ability to self-analyze their own preferences. Malcolm Gladwell wrote a book about this (which is fantastic), called [ame="[URL="http://www.amazon.com/Blink-Power-Thinking-Without/dp/0316010669"]Blink: The Power of Thinking Without Thinking: Malcolm Gladwell: 8601416581309: Amazon.com: Books[/URL]"]Blink[/ame]. In short, when you ask someone “what do you like about ‘X’”, most people give you an answer that isn’t correct. When their conscious mind attempts to make sense of their unconscious desire, there’s some kind of disconnect which produces garbage output.
It is possible to get useful data out of such studies but they have to be crafted differently than you might expect. Instead of asking straightforward questions, you have to build a study that gets at people’s underlying desires with questions that cross-reference each other, and questions that help disqualify responses that are red herrings. And you can’t take the results in an unprocessed form either. Instead you have to analyze the result looking for clusters and patterns, and then try to tease out places where the data suggests there’s a need for something that the respondents are seeking. This intersection is called a “need/gap”, and they’re very valuable especially if you can figure out how to deliver a commercial solution to that need/gap.
These kinds of studies are beyond the scope of this column. I’ll end this section by just saying that I agree with the surface conclusion that if you try to make something commercially successful based on simplistic market research, you’re more than likely to fail.
Succeeding Without A Map
Most of the successful tabletop RPGs weren’t built around any grand theory of need/gaps, or in fact any real research of any kind. They are all mostly the result of individual creators bringing their ideas to the market and finding success.
If you were to simply use that as a guideline, you’d conclude that the strategy for success in this industry is to self-publish your game getting as little input as possible from others and wait for a market to find you. And you’d be wrong.
The problem is that what you’re seeing is the output of a ruthless process of winnowing. You’re only seeing the games that “got lucky”, in the sense that the designers produced a work for which a need/gap actually did exist, at a time when the market was interested in that topic, with at least adequate design, and a good enough brand to grab enough interest among early adopters to create the seed of a social network around which a community of players could aggregate.
You don’t see the hundreds (thousands probably) of games and designers that followed the same path and ran into a brick wall.
It’s hard to visualize this for tabletop RPGs because most of them never see enough traction to get into the public record. But the collectible card game market had a remarkable opportunity to capture this phenomenon. In 2001 Krause Publications printed the Scrye Collectible Card Game Checklist and Price Guide book. This book documented 100 different CCG games that had been created from 1993 to 2000. By 2003, only 3 of those games were still being produced: Magic: The Gathering, Vampire: The Eternal Struggle, and Legend of the Five Rings. In 2011, only 2 of those games are still being produced – VTES is again in a production hiatus.
Were those other 97 games all crap? No, there were some very good games in that list. But a very large percentage were not good fits for the market. They were genres too small to attract a viable audience. They were variations on an over-done theme. They were mechanically poor. They were boring. They exploited a license but had little to offer beyond the licensed IP. The reasons those games did not become evergreen products are legion.
When you look at the tabletop RPG market and see successful games produced without the appearance of any backup data, you’re seeing the tiny handful that escaped all the traps that caught their peers. You’re not seeing a success strategy. You’re seeing lotto winners.
The Simplest Test
Even some of those lotto winners used a bit of research to help them succeed. This is the easiest thing you can do if you’re a creator and want to get a sense of the value the market might have for the game you want to create.
Pay an artist to do an illustration that depicts the unique selling proposition of your game. You’d be surprised at how reasonable these prices can be – there are many more quality artists than there are regular commissions working in the hobby game industry. The smart ones appreciate the opportunity to connect with a creator at the earliest stages of the work – they know that downstream there may be substantial benefits to being a part of that early circle.
Once you’ve got your illustration, take it to game stores and to gaming conventions, and ask people a simple question: “Would you be interested in playing this game?”. Take notes. Don’t rely on your memory (which will play tricks on you). You’re looking for a substantial supermajority of positive responses. If you’re getting that kind of overwhelmingly positive feedback, chances are you’ve got yourself a good idea worth the effort to develop to the next stage. If you’re getting mixed reactions, it’s likely you don’t. Remember that a number of people telling you they like the work are just being nice – every “yes” comes with hidden caveats.
Let’s play a little game and pretend we’re seeing a series of these presentations. Check your own responses to the following images. “Would you want to play this game?” Also try “Tell me what this game is about from this picture”.
Here’s the classic that launched the genre. Any question about what this game is about?
But what about this image? What’s this game about? Would you play it?
Alternity was created by some of the best designers in the industry and was published by the biggest company in tabletop RPGs, yet it failed to find an audience. I was a retailer (and a publisher) when Alternity was announced and I remember thinking that I didn't understand what the game was supposed to be, and what audience it was supposed to address. And I formed that opinion from little more than the artwork displayed above - a sentiment that proved nearly universal within the market when the game was printed.
Most people who are enthusiasts in the hobby have a well-trained critical eye for games and can quickly sort them into mental categories of likely to play, or not likely to play just from single images.
If you listen to what they tell you, you can save yourself a lot of heartache. Chances are you’re going to get a lot of negative feedback. Great ideas are a true rarity – great ideas that are commercially viable are an even more exotic species.
Spend a few hundred bucks on an illustration, and save yourself tens of thousands of dollars and hundreds of hours of design chasing a dead end. Do a little bit of testing to help guide your ideas towards something with a pre-existing customer interest and you’ll avoid a lot of heartache.
What Great Designers Do
In my experience, great designers always have a portfolio of ideas they’re working on. They’re constantly showing them to people, getting feedback, making changes, and evolving those ideas seeking that elusive “YES!!!!” moment when they make that critical connection.
Rather than taking just one design and obsessing over it in the face of unlimited negative feedback, great designers work in parallel with many different ideas. They know that the best way to improve their odds of hitting the lotto is to buy a lot of tickets, not to play the same numbers over and over.
Ideas are the cheapest resource of our industry. They are commodities with little intrinsic value. Until you can validate an idea as being resonant with a substantial audience, you haven’t begun to move forward towards something that can be successfully published.
Clever designers are the constrained resource in this industry. Clever designers spew ideas like geysers – being in their presence is to be deluged with ideas for games. These people don’t obsess about any one of their ideas – they’re able to separate their cleverness from the reaction of others to those ideas and keep producing new ones as they seek a good fit.
Once you’ve put yourself through this process for a couple of years you’ll start to feel the unseen rhythms of the customers and you’ll start to get an innate sense for the places that an interesting design may find fertile soil. You may get lucky on the very first day, but that would be an extremely exceptional outcome. It’s more likely that you’ll work for a long time trying and discarding many ideas before you start to get significant overwhelming positive reactions. If the world worked any other way we’d be drowning under an ocean of great and successful games. The lack of that ocean is proof positive that great ideas with commercial value are truly exceptional.
--RSD / Atlanta, June 2011
