This post is an exploration of why the two views above look different even though the red for 100% is the exact same for each, as in South Dakota for 2013 Q4:
I recently had the opportunity to dive into how Tableau assigns colors, as the goal for this particular worksheet is to make all the 0.0%’s have a white background so the rest of the colors have a little more breathing room. I came out of it impressed with the work that Tableau’s color designers (Maureen Stone and others) have done to create good looking color palettes in Tableau. Read on for some details on how to build your own palettes.
The view is set up using Superstore Sales with a % of Furniture measure that is counting the number of records for the Furniture Product Category as a % of all records for all categories so it returns anywhere from 0-100%, with some cells being completely empty due to no sales in those State/Quarter combinations, such as Wyoming in the above views.
When building a heatmap using the default Red sequential palette (see Default Red Sequential Palette sheet) there are lots of 0.0% cells that kind of clog up the view and make it harder to see the variation in the data:
What I’d really like to do is to have the 0.0% cells start out as white (effectively transparent) and then have the color ramp go from there. We can’t do that with default Red sequential palette because that palette starts out with pinkish-grey color (#eac0bd in hex):
Customizing the Red/White/Green Palette to White/Red
Tableau does provide some palettes with a white to red range, though, and we can use one of those. So the next idea is to use a diverging palette where we set the 0 point to be on the white. Here’s how to do that:
- Choose the Red/White/Green Palette
- Click on Reversed.
- Click on Advanced>>.
- Set the Center to 0.
And here’s the view:
This certainly gets a the 0.0% cells to be white, but doesn’t quite look as warm and saturated as the default red sequential palette, particularly at the lower end of % values such for Idaho.
The reason why is based on how Tableau assigns color palettes and how those default color palettes are built. The rest of this post describes both of those, and finally how we can get a palette that has the 0.0% values as white while getting the warmth of the Red sequential palette.
How Tableau Assigns Colors
Here’s how Tableau assigns the colors for a sequential set of colors (where there is only one range from 0):
- The bottom end of values in the data gets the bottom end of the color ramp
- The top end of values in the data gets the top end of the color ramp
- The colors for everything in-between are linearly distributed across the color ramp based on the values
What’s a color ramp? It’s the gradient of colors used for assigning the values – in short, what we see in the Color Legend. Here are the two color ramps for the default Red sequential and the customized red/white/green palette:
We can shift the start and end values using the Advanced>> options for sequential palettes, so any value at or below the custom start value would get the bottom end of the color ramp and any value at or above the custom end value would get the top end of the color ramp. With a diverging palette we get a third Advanced>> option to move the center point. So what we effectively did in the above steps with the Red/White/Green palette is:
- Choose the Red/White/Green palette. The data range goes from 0-100% so 0% gets red, 50% gets white, and 100% gets green.
- Reverse the palette. Now 0% gets green, 50% gets white, and 100% gets red.
- Click on Advanced>> to get more options.
- Set the Center to 0. Now 0% gets white and 100% gets red, with 50% being a lighter red between the white and the red. Anything below 0 would get green, but there’s nothing in the data to show that.
Now that we have an understanding of that, let’s look at the colors themselves to understand how the colors aren’t as warm in this palette as they are in default Red sequential palette.
Simplest Case: White to Red
Let’s start out with the absolute simplest color ramp: a sequential palette with two colors. I edited the …/My Tableau Repository/Preferences.tps file using the instructions at http://kb.tableau.com/articles/knowledgebase/creating-custom-color-palettes. In the Simplest White to Red Palette worksheet I’ve set up a two color palette, white to red. Here’s the XML for the palette:
<color-palette name="Simplest White to Red Sequential" type="ordered-sequential"> <color>#FFFFFF</color> <!-- bottom white --> <color>#9c0824</color> <!-- top red --> </color-palette>
And the view:
Now, one thing with this palette is that the top red is the exact same red used in Tableau’s default Red sequential palette, but by comparing the Simplest White to Red Palette to the Default Sequential Red Palette the two color ramps look completely different, and it’s not because we’re starting out with white…
Tableau-ish Red Sequential
Even if we use the same start and end colors in the ramp as the default Red palette we won’t end up with the same color ramp. The Tableau-ish Red Sequential Palette worksheet uses the following palette which duplicates the bottom greyish-pink and darker red used by Tableau’s Red sequential palette:
<color-palette name="Tableau-ish Red Sequential" type="ordered-sequential"> <color>#eac0bd</color> <!-- bottom grey-ish pink --> <color>#9c0824</color> <!-- top red --> </color-palette>
Here’s the color legend:
We can see that the color ramp is much cooler than the one for the default Red sequential palette. These simple two-color palettes are not duplicating Tableau’s built-in palette and the reason why is that Tableau’s default Red sequential palette *doesn’t use only two colors*. If you’re a designer who stares at colors all the time you probably picked up on that long ago, it took me longer!
So the Tableau-ish palette starts at the bottom grayish-pink and transforms into the darker brick red. The simplest white/red palette above starts at the bottom with white and transforms into the darker brick red. But the default Red sequential palette starts at the bottom greyish-pink, then shifts to something more salmon, then saturates that more and more and subtly changes the hue until the ramp finishes with a darker brick red, thereby creating a much more complex gradient of color that changes both hue and lightness. I really don’t know how many distinct colors are in this color ramp, all I can say is that it’s more than 4. Tableau’s color designers have created a palette with multiple “stops” of color that is warmer (and more visually interesting!) than any simple single transformation of the color.
Based on some testing here’s how Tableau assigns the color ramp to the data, given N colors in the palette:
- the bottom end of values in the data gets the bottom end of the color ramp
- the top end of values in the data gets the top end of the color ramp
- the color ramp is evenly divided into N-1 segments
- the colors for values in a given segment are linearly distributed across the start and end colors for that particular segment
So to get something closer to the default palette we can add more colors between the white and the red.
Adding One Intermediate Stop: Simple White to Red Palette
For this view I created a color palette with one stop between white and red:
<color-palette name="Simple White to Red Sequential" type="ordered-sequential"> <color>#FFFFFF</color> <!-- white --> <color>#d8392c</color> <!-- 50% red --> <color>#9c0824</color> <!-- top red --> </color-palette>
Here’s the view:
That’s looking a little better…here’s the two color legends:
It’s still a little cool between 0 and 50% where the colors are looking a little too washed out. The solution to this is add more colors.
Adding Two More Intermediate Stops: Richer White to Red Palette
Here’s a color palette that gets even closer to the original Red sequential palette:
<color-palette name="Richer White to Red Sequential" type="ordered-sequential"> <color>#FFFFFF</color> <!-- white --> <color>#f57667</color> <!-- 25% red --> <color>#d8392c</color> <!-- 50% red --> <color>#c11218</color> <!-- 75% red --> <color>#9c0824</color> <!-- top red --> </color-palette>
And the view:
Idaho at 10% is still looking lighter, but it’s very much closer. Personally I’m ok with this as meeting the goal of showing the white background for 0.0% while preserving enough of the Tableau color ramp to make useful comparisons. So I can still easily tell in the view above that New Mexico had the highest performance while the change from 2013 Q1 to 2013 Q2 stands out a lot more than in the original.
Here are the color legends:
The results here are now the same as the default red sequential palette from 25% to 100%, so only from 0-25% are they slightly cooler because of the white to red color ramp. To get an even warmer palette we’d have to add even more steps, and add them evenly to retain the color ramp, so for example we could add 4 more at 12.5/25/37.5/50/62.5/75/87.5/100%.
Resources
Here’s the heatmap color palette workbook on Tableau Public and the Preferences.tps file.
There were a couple of great presentations at TC15 on color, you can catch them in the Tableau Virtual Conference:
- Using Color Effectively: Tips from a Color Science Researcher by Maureen Stone had some great insights on Tableau’s thinking.
- 50 Shades of Data: A Zen Master’s Guide to Color by Matt Francis is a tour de force through the world of color. Be warned, though, you will never look at movie posters or advertising in the same way again!
Nice post Jonathan – I was literally wondering this today when I encountered the need for the color white!! Thanks for linking to the additional information.
Hi Jonathan, thanks for posting such a detailed experiment on how the color palette works. Even I was noticing the fading-out effect when I use my own palettes and was wondering about it and your blog post came at the right time to help me understand it better.
Pingback: Two Sequential Color Palettes on the Same Map: Coloring by a Dimension and a Measure | Drawing with Numbers
Hi Jonathan, Do you know if there is a way to include actual zeroes in the color, but keep blank/nulls white?
Sorry for the delay, I’ve been away. If the data doesn’t have negative values then I’d use a calculated field for Color that sets the Null values to -1 or some other negative number and then a diverging palette with the Advanced options where negative is white, 0 is set to the starting color and then the rest of the color ramp is used.