[Locked] Matchmaking Feedback Update – January 8, 2018

snickerdoodle wrote:

Chogun Rua wrote:

ZaedynFel wrote:

I’ve already applied it to examining a few samples games. For example, one match included several smurfs who are Champs on their main accounts. Our current (older) system said that the smurfs would get destroyed because it couldn’t tell they were smurfs. The newer system correctly called the match even, and identified the abilities of the players. What this means is players will quickly find themselves matching where they should be, and opponents will get a more accurate CSR update.

Still no word on a solution to the smurfing? It's by far the worst part of matchmaking for me.

I've left the information related to smurfing.

LethalQ wrote:

Chogun Rua wrote:

ZaedynFel wrote:

Happy New Year!It’s good to be back! I have a few fun updates.
PlaylistsWe have a couple of playlist changes coming this week. First, as we announced last Friday, the HCS list will be updated to reflect the official HaloWC maps and modes. Head over to http://halo.gg for more info.

In addition, we’ll be adding a simple playlist called Quickplay at the top of our Social lists. The purpose of this list is largely so incoming players having an obvious starting point. The biggest feedback we get from new players is many if not the majority haven’t played any Halo in the past and have no idea what those playlist names mean. This should make it super clear where to start. The list will feature Slayer on Rig, Truth, and Coliseum. We’re keeping the maps to a minimum so folks aren’t overwhelmed, and using Slayer since it’s a straightforward game mode for both new and solo players. The playlist will also have a maximum party size of 2. If you’re looking for some light Slayer gameplay with the chance to mentor incoming folks, hop in!
Skill SystemAs some of you saw, I’ll be speaking about the new system we are in the process of integrating at this year’s GDC. We now have just enough of the plumbing built to see results coming back from matches. The accuracy is significantly higher than what we have today despite the fact there are a few key pieces we still haven’t hooked up. That accuracy will only grow as we finish.

To be clear, we aren’t yet using the new system, but it is able to analyze current matches. I’m able to see win predictions, kill predictions, and death predictions, and compare to them what really happened. I’ll see numbers like “Kill Prediction: 13.8, Actual: 14” often. It’s fun for a stats nerd like me to be honest. On average, in its current unfinished state, it’s able to predict how many kills each player will have per minute within less than 0.4 kills. It’s often right on the money.

I’ve already applied it to examining a few samples games. For example, one match included several smurfs who are Champs on their main accounts. Our current (older) system said that the smurfs would get destroyed because it couldn’t tell they were smurfs. The newer system correctly called the match even, and identified the abilities of the players. What this means is players will quickly find themselves matching where they should be, and opponents will get a more accurate CSR update.

On the accuracy side of things, I’m seeing increases of up to 10% in how well it predicts the winner. I’ve been in this business for a long time, and have never seen that kind of jump in predictive accuracy. Definitely not on data where we are already doing a solid job of creating close matches that should be hard to predict. When the system goes live, we could see drastic improvement in match quality.

I don’t have an ETA on when we’ll switch over to using the system, but just thought some of you would enjoy hearing how well it’s doing.
Playlist PopularityHere’s an update on playlist popularity, using the last 7 days last of playtime. Things have shifted around a little bit.

Super Fiesta
Slayer
Heroic Warzone Firefight
Warzone
Castle Wars
Big Team Battle
Infection
HCS Fall 2017
Action Sack
SWAT
Legendary Warzone Firefight
Team Arena
Doubles
Warzone Turbo
Free-For-All
Breakout
Snipers
Mythic Warzone Firefight
Warzone Assault
Grifball

Still no word on a solution to the smurfing? It's by far the worst part of matchmaking for me.

Did you not read the article? It says they are currently building a system that will address it.

snickerdoodle wrote:

Chogun Rua wrote:

snickerdoodle wrote:

Chogun Rua wrote:

ZaedynFel wrote:

I’ve already applied it to examining a few samples games. For example, one match included several smurfs who are Champs on their main accounts. Our current (older) system said that the smurfs would get destroyed because it couldn’t tell they were smurfs. The newer system correctly called the match even, and identified the abilities of the players. What this means is players will quickly find themselves matching where they should be, and opponents will get a more accurate CSR update.

Still no word on a solution to the smurfing? It's by far the worst part of matchmaking for me.

I've left the information related to smurfing.

That doesn't really look like a solution for the Smurfs he's just using them a an example for his mm system.

Yes....an example of how the MM system handles smurfs and keeps them playing the correct caliber of players.

snickerdoodle wrote:

Chogun Rua wrote:

snickerdoodle wrote:

Chogun Rua wrote:

snickerdoodle wrote:

Chogun Rua wrote:

ZaedynFel wrote:

I’ve already applied it to examining a few samples games. For example, one match included several smurfs who are Champs on their main accounts. Our current (older) system said that the smurfs would get destroyed because it couldn’t tell they were smurfs. The newer system correctly called the match even, and identified the abilities of the players. What this means is players will quickly find themselves matching where they should be, and opponents will get a more accurate CSR update.

Still no word on a solution to the smurfing? It's by far the worst part of matchmaking for me.

I've left the information related to smurfing.

That doesn't really look like a solution for the Smurfs he's just using them a an example for his mm system.

Yes....an example of how the MM system handles smurfs and keeps them playing the correct caliber of players.

So for the first 10 games they will still play against silvers and golds. Again, it doesn't fix the problem.

No. I suggest you read Josh's prior MM posts. They aren't going to play silvers and golds for 10 games then Onyx/Champs after that. The system will be able to tell much, much faster than 10 games where a player should place and will pit them against appropriate opponents.

Will it solve the problem 100%? No. No system will. There will always be people who exploit and abuse systems to be jerks online. Unfortunately that's the nature of online anonymity.

JAncient wrote:

Spoiler:

Show

[wrote crazy -Yoink-]