Tuesday, June 20, 2017

The Mathematics of Gender Bias

A couple weeks ago, at Music City Agile I attended a session on combating biases presented by Neem Serra. There was a slide presented that had data from simulations on how gender bias during promotions affects the number of women at different levels of an organization. This was something that seemed to be simple to model and hopefully prove out. Around the same time, my wife became more active in the Women In Leadership events that my company regularly organizes. I have definitely experienced a raising of consciousness about the obstacles faced by women in IT and wanted to put some numbers behind this newfound consciousness.



Most of the conversation about gender bias centers around the pay gap. This is a legitimate concern and a good deal has been written about it. In this post, the exploration is centered around a slightly different question - What is the effect of gender bias in promotions through the hierarchy in an IT organization? In order to do this, we are going to set up a very simple mathematical model. We are going to start with the assumption that we are looking at an organization that has 5 levels of hierarchy, ie, line level folks are at level 1 and C-Level execs at level 5. Let us also say that in this organization, every couple of years 10% of the workforce at every level gets promoted to the next level. We are going to start with the case that the lowest level of the hierarchy has 50,000 women and 50,000 men. For the first run of our model, we will assume there is no (0%) gender bias shown during promotions. So, our starting model has the following assumptions -
  • Organization has 5 levels of hierarchy. 
  • 50,000 Women and 50,000 Men at the entry/line(first) level.
  • 10% of employees at every level receive promotions.
  • 0% promotion decisions have Gender Bias
The resulting numbers would look like this -

Level Women Men Promotions Percentage Of Women Percentage Of Men
1 50000 50000 10000 50% 50%
2 5000 5000 1000 50% 50%
3 500 500 100 50% 50%
4 50 50 10 50% 50%
5 5 5 1 50% 50%

What we see in this case is that when there is no bias involved, the percentage of women at every level equals the percentage of men. With every round of promotions, the same number of women and men get promoted.  Let us change our model to include some degree of bias. We will start with the case that there is a 10% gender bias. This would be reflected in 10% of promotion decisions involving women and 5% overall showing the bias. In other words, 5% of the promotions that should have gone to women, are actually handed to men due to conscious or sub-conscious bias. We are going to factor the bias in for promotions at every level. This time our model has this one parameter changed, and hence the following assumptions -
  • Organization has 5 levels of hierarchy. 
  • 50,000 Women and 50,000 Men at the entry/line(first) level.
  • 10% of employees at every level receive promotions.
  • 5% promotion decisions have Gender Bias
This has the following effect on the results -
LevelWomenMenPromotionsPercentage Of WomenPercentage Of Men
150000500001000050%50%
245005500100045%55%
340559510041%60%
436641036%64%
537133%67%

The percentage of women at every subsequent level gets worse. When we finally reach the fifth level, we have only about 30% women holding office. The change is drastic compared to the base model with no bias. This should not be a surprise as in many organizations, the ratio of women in the highest echelons seems to be lower than at the entry level positions. If we change the bias to be affecting 10% of promotion decisions as opposed to 5%, we get the following results -

LevelWomenMenPromotionsPercentage Of WomenPercentage Of Men
150000500001000050%50%
240006000100040%60%
332068010032%68%
426741026%74%
528120%80%

Once we change the bias to 10%, by the time we get to the fifth level of the organization, the percentage of women drops dramatically to close to 20%. Having 5 levels of hierarchy is actually a great simplification for most organizations. Usually, there are 7 or more levels separating the C-Level executives from the line level employees. The more levels we add, the more drastic the decrease in percentage becomes.

Another simplification in our modeling is assuming equal numbers of men and women in the industry. According to CNET, the percentage of women working in the tech industry is about 30. Our models, till now, have assumed an equal (at least at the starting level) ratio of men and women. What if we change the number of level one employees to reflect this. Also, let us assume bias being a factor in 10% of the promotions. Our model setup is now the following.
  • Organization has 5 levels of hierarchy. 
  • 30,000 Women and 70,000 Men at the entry/line(first) level.
  • 10% of employees at every level receive promotions.
  • 10% promotion decisions have Gender Bias
This renders the following results -
Level Women Men Promotions Percentage Of Women Percentage Of Men
1 30000 70000 10000 30% 70%
2 2400 7600 1000 24% 76%
3 192 808 100 19% 81%
4 15 85 10 15% 85%
5 1 9 1 12% 88%

The number of women at the top level in this type of an organization drops drastically to 12%. Incidentally, the research at Paysa.com suggests that the percentage of female C-Level executives is close to 12% and the percentage of tech directors (Encapsulated by Level 3 in this case) is close to our model's 19%. 


The numbers from our model matching the industry numbers is partly coincidental. We have made numerous assumptions in our modeling. The 10% promotion rate, same bias at every level, the number of levels in an organization are all assumptions in the model. These numbers do point to the existence of gender bias in the tech industry. Based on our simplifications, it seems that about 10% of the promotion decisions are affected by this bias. You can see what a drastic effect this has on an organization's makeup. 

It would be interesting to see how individual organizations stack up. How consistent is the percentage of women as you move up the rungs of the corporate ladder? How about your organization? Does it seem that the ratio of women to men seem to get smaller the further up the organization you go? The culture of organizations is a product of the culture of the individuals that make up the organizations. As individuals it is up to us, to educate ourselves and reduce the role of bias in our own thinking. Neem Serra, whose session inspired me to play with the mathematics of bias, in her session also mentioned Harvard's Project Implicit. Project implicit helps you test for different kinds of biases. So far I have been brave enough to test myself only for gender bias and am pleased to say that the results said that I was unbiased in that regard. Take the tests for yourselves and see where you land on the bias spectrum. If there is work to be done, maybe spending some time with the folks you might hold a bias against would help.

A final note - This mode of modeling (applying bias as a percentage) and interpreting the results (tracking changes in percentages of members at every level) can be applied to any type of bias. This does not have to be restricted to gender and can be expanded to test for biases with regards to race, ethnicity, sexual orientation etc.

2 comments:

  1. Prateek! This is a brilliant post. I love that you mention the IAT. I'd love to chat with you sometime about what you think we can do to help people address and overcome their biases. It ties into a workshop I'm developing. ~Cara P.

    ReplyDelete
    Replies
    1. Absolutely Cara. Would love to! Let me know when you would like to talk. It would be a great opportunity for me to learn from you.

      Delete