Quick Overview

Welcome to EvanMiya College Basketball Analytics! The main objective of our work is to assess college basketball team and player strength. We have created an advanced statistical metric, Bayesian Performance Rating (BPR), which quantifies how effective a team or player is, using advanced box-score metrics and play-by-play data. This metric is predictive in nature, which means that each rating is fine-tuned to predict performance in future games.

Note: Some of the methodology is slightly outdated, and will be updated soon.

There are several pages of analysis (plus several more that appear when appropriate):

• Team Ratings: We assess the strength of each team by calculating offensive and defensive ratings that reflect the team's offensive and defensive efficiency, while accounting for other factors, such as game pace and opponent strength.
  
• Player Ratings: We quantify the value of each player to his team on both offense and defense. A player's ratings incorporate his efficiency statistics, along with his impact on the court for his team, which is assessed by looking at how successful his team was in every possession he played. These ratings account for the strength of all other players on the floor with that player in each of his possessions that he played.
• Team Breakdown Tool: This tool provides a more detailed look into the effect that each player had on his team performance.
• Game Analysis: This page looks at advanced efficiency statistics from every game a team played in the season.

Now for some more detail into how we get these numbers:

Collecting Data

We have box score data available for every game played in the each college basketball season, along with play-by-play data, which includes substitutions. The possession by possession data is the main component used to drive our analysis.

Discarding unhelpful possessions

One key step that we take to gain the best predictions from our data is to only look at possessions in a game that “mattered”. Analyzing possessions when the game is already well out of hand isn't as valuable to us as possessions when the winner hasn't been decided yet. We use the in-game naive win probability (which assumes that teams are equally matched) in order to assess when a game was out of hand. Once a team has a win probability of at least 99%, we start down-weighting the possessions until the win probability is greater than 99.99%, at which point we discard all possessions entirely. In the rare situation where the losing team mounts a comeback and the win probability of the winning team sinks below 99%, we start giving each possession full weight again.

From a coach's perspective, every possession matters, even when your team has seemingly won or lost with minutes to spare. However, for predictive purposes, we can't properly assess the strength of a team when both teams aren't putting their normal lineups in or aren't playing as hard as they might if the outcome of the game were still in question.

Team Ratings

The purpose behind the Bayesian Performance Rating (BPR) at a team level is to provide each team a true offensive and a true defensive rating that best explains all of the real game results that we observed from the season. These can be used, along with the BPR ratings of the opposing team, to estimate each team's expected offensive and defensive efficiency (points scored per 100 possessions) in a game. Taking the possession by possession results from each game, and adjusting for home court advantage (more on that in a moment), we run a bayesian regression to find the offensive (OPBR) and defensive (DBPR) coefficients for each team. These coefficients are designed to have 0 as the national average. Thus, very good teams will have higher positive offensive and defensive ratings. A team's overall BPR is just the sum of its OBPR and DBPR.

For example, from the 2019-20 season, 4th ranked Baylor's calculated OBPR was 30.2, and their DBPR was 35.9. On the other hand, 319th ranked Idaho had an OBPR of -23.0 and a DBPR of -13.5.

Our team ratings also incorporate team-specific home court advantages, and adjust for each team's pace of play, seen in the True Tempo metric, which is the adjusted pace of play for each team, based on if they were playing the D1 team with the average tempo.

Player Ratings

In the Bayesian Performance Rating for players, each player has an Offensive BPR and a Defensive BPR, which are added together to make the player's overall BPR. Player BPR has two components: player impact and player efficiency.

The player impact part of BPR attempts to quantify a player's value to his team by looking at how efficiently his team performed on offense and defense for every possession he played. In addition, we want to adjust for the strength of his teammates on the court with him, along with the strength of opposing players for each possession he was on the court. There are some good existing advanced metrics that attempt to do this, such as Adjusted Plus-Minus. This type of metric focuses on the idea that a player's contribution to his team's margin of victory matters most. APM does not use any individual player statistics, but instead utilizes the score outcome of each possession to determine what players are better than others at positively affecting the outcome of the game, in the form of offensive and defensive efficiency. Our player impact ratings are created in a similar fashion, but we make a few adjustments to negate some of the weaknesses of this type of model, which we will explain later on.

Similar to the BPR team ratings, we want to assign a “true” offensive and defensive rating to each player, which indicates his value to his team when he is on the court. Very good players will have higher positive offensive and defensive ratings, with the average D1 player OBPR and DBPR being set at 0.

The main draw of this type of model is that we not only assess the value of a player to his team, but also account for the strength of the other teammates he shares the court with, along with the strength of the opponent players he faces. If we were to look at a more crude measure of player impact, like plus-minus or basic team efficiency when he is on the floor, it can be helpful, but doesn't answer questions such as “did he play with good teammates or bad teammates?” and “Did he play so well because he only played in garbage time against inferior opponents?”. By using a model that adjusts for the strength of all players on the court, we can more accurately assess the value that a player brings to his team when he is on the court.

There are a few shortcomings to this model the way things currently stand. One issue is that there is a lot of “noise” in this data. Due to the randomness of basketball possessions, it can be difficult to know whether a player rating estimate reflects the truth about that player's ability or is due to random chance. The model can “overfit” the data, leading to conclusions about players that just don't make sense when compared to the eye-test. For example, a deep-bench player who happened to be on the court for a handful of minutes when his team outscored the opponent 20-0 could be given an incredibly high rating because it appears that his appearance was what made the difference for his team. To account for this, we use a bayesian approach by setting a prior distribution for each player's OBPR and DBPR centered at 0, so that players who don't play many minutes will having ratings near 0, while those who have more substantial playing time can have their ratings move away from 0 as more information about their impact is accrued throughout the season. The informativeness of the prior distribution was decided using cross-validation.

Another issue with the player impact model is that it relies heavily on the assumption that a roster of players will frequently rotate in and out of the game so that we benefit from seeing lots of different lineup combinations, allowing us to distinguish each individual's impact on his team, when compared to his teammates. These player ratings become less reliable when there are pairs of teammates who are almost always on the court together, or rarely every share possessions together. In situations where player A and B are on the court together 95% of the time, it is difficult to distinguish which teammate is having the larger impact for his team.

This technique has turned out to be incredibly beneficial at generating player ratings that more accurately represent both the value and skill of each player at the offensive and defensive end. An example of this is 2018-2019 Brandon Clarke, who had a tremendous season for Gonzaga before becoming a first round draft pick. In the player impact ratings, he is ranked 10th best in the country for 2018-2019. However, once we use his high Box BPR rating to inform his prior distribution for offensive and defensive ratings, he finishes 2nd in the country in our final BPR, behind Zion Williamson. Zach Norvell, a fellow teammate of his, sees his ranking drop from 7th to 48th once we incorporate his Box BPR for the year, which was much lower.

Using Box BPR to influence our ratings doesn't change the fact that we can still easily detect good performances from players who otherwise may not fill up the stat sheet. A prime example of an underrated “intangibles” guy is 2019-2020 Alabama forward Herbert Jones, who had the highest DBPR and third highest overall BPR that year, despite having a much lower Box BPR. The degree to which he elevated his team's performance when he was on the court was astronomic, compared to Alabama's numbers without him.

Using the Team Breakdown Tool

The Team Breakdown tool is used to gain detailed insights into the performance of a team, broken down player by player. This is especially helpful when trying to explain the offensive and defensive ratings assigned to each player.

Here is the recommended approach for using the Team Breakdown:

1. Team Overview
   • This tab provides an overview of the key ratings and stats for each player.
     • BPR is the all-encompassing rating that assesses the performance of each player and the value he brings to his team when he is on the floor. This metric accounts for the strength of all other players on the floor at the same time as that player, along with the player's individual efficiency statistics.
     • Team Eff Margin is a good starting point for explaining the BPR of a player. This is the margin between team offensive and defensive efficiency with player on the court. In other words, it tells us how many more points per 100 possessions the team scored compared to the opponent when that specific player was playing. However, this value does not account for who else was on the court with that player.
     • Plus-Minus is another simple way to look at player effectiveness, with more weight given to players who played more possessions. However, this metric also does not account for other players on the floor at the same time.
2. Teammate Chemistry
   • This tab provides a unique look at how effective pairs of players were when they shared the floor together.
     • Team Eff Margin tells us how effective the team was with that player pair on the court. By default, the rows in this page are sorted by this metric in order to tell us which player pairs were most effective for the team. Once again, this is simply looking at how well the team played compared to the opponent when those two players were on the court together.
     • Chemistry is a metric that reflects how much better than average the team performs when these two players on the court together, compared to team averages when they are on the court individually. In other words, when Player A and Player B were on the court together, was the team more efficient than what we would expect if we looked at Player A and Player B's numbers individually? A chemistry score of 0 indicates that the team performed no better or worse than expected when the two players played together.
     • Weighted Chemistry weights the Chemistry score by the number of possessions that were played by the pair of teammates to give a more accurate assessment of the teammate chemistry. The problem with the Chemistry score is that if a pair of teammates only played one possession together and outscored the opponent 2-0, they would have a ridiculously high chemistry score. The weighted chemistry gives more confidence in our assessment of chemistry to player pairs who were on the court a lot together.
   • When evaluating the effectiveness of a particular player, look at where his name appears in the Teammate Chemistry tab ranking when sorted by any of these three metrics. If his name appears in the top half of the ranking more often than the bottom half, this indicates that he was one of the more effective players on his team.
3. Individual Analysis
   • This tab takes things a step further by looking at one player at a time, seeing how the team performed when a player was paired with each of his teammates. When analyzing Player A, we can use this tab to answer two questions:
   • Which players did Player A play better or worse with when he was with them on the court?
   • Which players played better or worse when they were on the court with Player A?
     • Team Eff Margin tells us how effective the team was when Player A played with a particular player. If we sort by this metric, it will tell us which teammates Player A performed better with, and which he performed worse with.
     • Above / Below Average measures how much better the teammate played when he was on the court with the player, compared to the teammate's average play. A rating of 0 indicates that the player played just as well with Player A as he did in general. A higher rating indicates that Player A being on the court made his teammate perform better than normal, and a lower rating indicates the opposite. This is a powerful tool that can assess how a player impacted his teammates. A really good player will often make all of his teammates perform better than they otherwise would. One limitation to this is in the situation when Player A shared almost all of his minutes with another player, which would give an Above / Below Average rating of close to zero, since we can't tell as easily if his teammate's performance was helped or hurt by playing with Player A.
     • Off Poss and Def Poss can be helpful in determining which teammates the player played the most with. If he spent most of his playing time with the bench players instead of the starters, this could explain why his BPR is not as high as other teammates.

About Me

My name is Evan Miyakawa, and I have my masters degree in statistics and am currently finishing up my doctorate in statistics at Baylor University. I graduated with my Bachelor's Degree in 2017 from Taylor University. You can find out more on my LinkedIn page.

My college basketball research has been featured in articles by Sports Illustrated, CBS Sports, ESPN, the AP, and others.

Contact

Feel free to email me at evanmiyakawa@gmail.com with any questions or requests. I occasionally appear on radio shows and podcasts to talk about college basketball. I also work with college basketball coaches who want to utilize analytics for their teams.

You can also follow me on Twitter.

Blog

Access the EvanMiya blog here.

Radio and Podcast Appearances

SicEm365 Radio
Randy Kennedy Show - Sports Talk 995
Left Coast Sports
UpTempo
Country Roads Confidential - West Virginia 247Sports
Spartan Radio Network
Hoopin' With Hoops - Greg Peterson
Upper Left Sports
Locked On Zags
Our Daily Bears
Hope & Rauf Presented by Heat Check CBB
Zag Talk

Article Features

Sports Illustrated: Forde Minutes: What's Plaguing College Basketball's Powerhouses? - Pat Forde
Associated Press: NCAA teams hit by COVID pauses take hope from antibodies - David Skretta
Sports Illustrated: Five Tips for Filling Out Your NCAA Tournament Bracket - Molly Geary
Spokesman Review: Numbers are adding up for No. 1 Gonzaga, but more data is needed - Jim Meehan
The Definitive Guide to Covid Pause Effect for CBB Teams - Evan Miyakawa
Spokesman Review: Rested or rusted? Analytics have helped Washington State gauge performance following COVID-19 layoffs - Theo Lawson
Kentucky Sports Radio: Advanced statistics implies that Kentucky’s Davion Mintz needs more minutes
A Sea of Blue: How to fix Kentucky