Registration Format Proposal: Lottery System

The podcast this week got me thinking about the registration challenges we had this year (i.e. website crashing under heavy traffic). Given the rabid interest in the league (and assuming capacity can't be increased to accommodate that demand), I wonder if it's worth considering a lottery system for Parity League spots in the future.

Basically, a few weeks before registration officially opens (mid to late September), everyone who wants to play puts their name in a draw. Then 96 names (or whatever capacity is) are drawn at random and those people have right of first refusal to a spot in the league. It would be relatively simple to administer and ensure fairness in the registration process.

With that framework in place you could get a little fancier. For example, if continuity is a priority, you could give returning players two (or more) ballots in the draw. That way people who've played Parity before have a better shot at a spot but new players can still get in.

A different but comparable model would be a two-stage draw. In the first stage, a set number of spots (say, 36) are drawn from the pool of returning players, and then the remaining spots are drawn from everyone who's left over. That way you'd ensure continuity but also get some fresh faces in.

You could also make ballots merit-based (e.g. top 20 salaries from last year get extra ballots), but that's more dangerous territory for a variety of ethical/statistical reasons. Similarly, you could auction off ballots (huge fundraising opportunity for OCUA), but that makes access to Parity economically inequitable, which is not a good precedent.

Anyway, just some food for thought. Maybe this is something that's already been considered and discarded. But I'd be interested in everyone's thoughts.

My suggestion is if you go with that kind of model (tickets) - that you provide more tickets to volunteer stat keepers and league organizers. This will encourage more people to participate.   

While I see where you're coming from, if we're using your suggestion then we're taking the "control" away from the player and putting it into the hands of luck.

I'd be fairly frustrated if I was mid-range salary-achieving volunteer-loving third-year player who was available at 10:00 pm with my waiver signed... and some random person is pulling names out of a hat and I don't get picked. 

I know there are some people who didn't get their spot this year based on waiver problems/issues with logging in. But, the onus was still on them to try to get a spot. 

Hadrian - what brings this to mind for you? Are there players who are disgruntled with the process? Are you looking to just start chatter? Do tell.

Hadrian, as always, has some genius ideas to mull over. Give this man a bonus $10 000 fantasy dollars for being smrt.

I had also tossed out the idea that women could register in winter leagues the next day as this may help with the system crashing. Since there are a designated number of spots for women it would have no effect.

I would also present for mulling over, the possibility of alternating sites/days every year or two years. You could have Parity at Superdome on Mondays for two years, then at Ben Franklin on Thursdays for two years (or just alternate). This could draw from the Barrhaven and Kanata members more fairly.

I do like the lottery system, though I would not give any favourtism to high salary earners as we have all learned from the educational Parity Podcast that stats only tell one small part of a players value. See, I am paying attention.

 

I personally love the excitement and hilarity of hammering the OCUA site. It's the closest I'll ever dare to be to something like this.... https://www.youtube.com/watch?v=ruDxe4N7vV0

I also accept that there's a chance I won't get a spot and that's a reality of life. That would free me up to chirp more though....

While this won't get rid of the problem of too few spots for too many players, I'm pretty sure Toronto just opens registration for parity on a different day than all their other leagues (before others I think). That way no system crashes anymore. If parity registration happens before other leagues and a player doesn't get a spot, they could still then play in another less fun/demanding league like IAD :-P 

Just open Parity ahead of time.

Also, allowing peope to sign waivers BEFORE registration opens would help.

Hadrian, I commend your efforts to try to solve a problem that's been affecting OCUA for many years. We could use that kind of logic on the Board (hint, elections are in April). To be clear, the problem is the demand for winter league > the supply for winter league, in particular when it comes to prime time (Monday-Thursday) and prime space. This isn't a unique problem to Ultimate, a lot of sport leagues are desparate for prime indoor space.

When online registration became possible in 2014, the Board and staff reviewed various registration options. Lotto system, grandfathering or legacy, how to balance offline vs online payments, grace periods, etc. The system we currently use (first come, first served, 48 hour grace period) was seen as the fairest for the membership.

The biggest drawback from doing a lotto system is that it isn't that easy to register 700-800 winter players, most of which is done individually. Doing a lotto system would essentially require 700-800 conversations to confirm the person wants the spot and then getting them to pay. You can imagine that some players may not want to play in the league if their friend or partner doesn't get in. For this reason, Justine, splitting male and female registration could also pose challenging.

It was unfortunate the website had some issues this year. The same process was used last year without a hitch and that is also the same process Toronto Ultimate Club uses. IT can be unpredictable sometimes.

Brent - One day, it might come to having separate registration nights for each league. Why we haven't is because it makes it easier for people to only remember 1 night of registration.

Lastly, if you really want to skip the lines. Volunteer to become a league coordinator, youth & junior convenor, or board member. These volunteer roles come with a sweet pre-registration of your choice of indoor league.

The splitting up of men and women registration occurred to me this year when, at the same moment, I got into Parity and Chris did not. We were then sitting there deciding whether to try for a different night and I would unregister. I thought if he had registered the day before me, then 24 hours later I would register for whatever he did manage to get in for and save me (and you) the unregister/re-register and it would be less people on the server. 

Yes, last year was flawless. Good ol' IT lulling us into a false sense of security! 

I'll also mention that we solved the waivers so they will no longer be required to be re-signed prior to indoor registration. If you want the long form of any of these points, feel free to email me.

There's merit to your idea, Justine, but in some cases a league will sell the female spots before the male spots sell out; rare but it happens. This process might also encourage players to only sign up for a league if their partner gets in, which would be a shame.

If that were the case for this year, Parity League would be missing two of its most famous members this winter eh??

This does not prove that the system works, or that the system addresses the concern you are bringing up.

> This process might also encourage players to only sign up for a league if their partner gets in, which would be a shame.

This is the choice of the player registering! Why is it a problem you feel a process needs to directly address?

I suspect that if you look at demand for winter registrations, Parity is at the top of the list. TUC puts parity on a seperate night to minimize load on the server because demand for it is so high. Why can't OCUA do the same? We're running on the same software with, I imagine, similar server constraints. Does TUCs solution mitigate server problems? If so, why not apply it here?

> Lastly, if you really want to skip the lines. Volunteer to become a league coordinator, youth & junior convenor, or board member.

This also doesn't solve registration issues. It just allows a select few to circumvent them. I'm sure several people volunteered and were not asked to participate as coordinators or convenors, nor elected.

Sorry CC, but Burton and Keates are correct. TUC opens parity sign-up a day before all other leagues, because demand is so high - male spots fill out within minutes. It has been this way for the past four registrations windows (2x/year), and has run seamlessly. People then have 15 min to process payment once sign-up is complete before being moved to the wait list; and lots get around the 'i can't be online at noon' by asking someone else to do their registration on their behalf (i've done it before for a male friend, then completed my own without issue). There's also been a LOT less grumbling here in the way of 'we need to change how sign-up is done' after the move to a different sign-up day.

And RE: 'only having one night of registration makes it easier for ppl to remember' - trust me, no one here will let you forget... every time i've logged into FB the morning of a parity registration, my feed has been full  of 'don't forget to register for TPL!'. If it's something that matters to you, you won't forget :) .... so personally i don't find that a valid excuse.

From TUC's Adult League Info page (http://www.tuc.org/adults/winter):
[...For Winter 2017, registration will open at 12:00pm on Tuesday, November 29 (12:00pm on Monday, November 28 for the Discraft Parity League) and close about a week before the league in question starts play, or when specific leagues reach capacity....]

Happy to provide more details via email as these forums aren't meant to hash out the details.

No need to be sorry G, I understand how TUC operates. It's a different organization entirely so please consider the technical and cultural differences between the two. For one thing, OCUA's Parity League doesn't sell out in mere minutes. It takes 15-30 minutes to sell out. If we found it was selling out within minutes, we might consider changing the registration format. Keep in mind that this exact same problem was happening with Wednesday 6x6 a few years back. All good problems to have, it means we have a very popular program!

Also, grumbling is subjective. It was the same process last year when OCUA was receiving a lot of praise for winter registration. The bottleneck that happened this year had little to do with server load and wasn't something we could have reasonably foreseen. In total, the delay was 5-10 minutes. FWIW, I was able to register and grab a spot in any league at 10:15pm. I always run my own set of tests to experience what a member is going through.

Lastly, OCUA would never implement a strategy that might discourage participation. In the case of splitting registration by gender, I believe it would discourage registration on whomever's registration is offered second (assuming women). We also tend to stay away from creating single-gender policies because that's a can of worms you generally don't want to open running a coed sports league.

> No need to be sorry G, I understand how TUC operates. It's a different organization entirely so please consider the technical and cultural differences between the two. 

Can you share what these may be? Is TUC larger?

How fast did Parity sell out for guys? For girls? How many of the 800 people registering attempted to register for Parity? 

> The bottleneck that happened this year had little to do with server load and wasn't something we could have reasonably foreseen.

Why can't it have been forseen? It has been a problem every year online registration has happened, including the year the OCUA dog waiver delayed registration for indoor events. This year's load may have been worse, but the issue was absolutely foreseen.

> Lastly, OCUA would never implement a strategy that might discourage participation. In the case of splitting registration by gender, I believe it would discourage registration on whomever's registration is offered second (assuming women). We also tend to stay away from creating single-gender policies because that's a can of worms you generally don't want to open running a coed sports league.

These are all good reasons to keep certain details for registration as they are, but I'm not sure how this precludes high-demand leagues being open for registration a day or two before the rest of the winter.

As it stands, the registration load leads to slow-downs and delays. In some cases this prevents people from being able to complete registration because of dropped connections and timeouts. This can compound to people trying to get into one high-demand league, not making it, then attempting to get into another and also not making that one.

Staggering registration can significantly reduce the load on the servers that always seem to have issues, and it lets people that miss out plan their next league of choice. TUC does this, and they are of similar size and are running on similar (if not identical) technical infrastructure.

So why do you seem unwilling to entertain the idea of this as an additional solution to a re-occuring problem?

> Happy to provide more details via email as these forums aren't meant to hash out the details.

Keates, you forgot to quote the first line.

> Happy to provide more details via email as these forums aren't meant to hash out the details.

Is a statement that is incongruent with hashing out the details across several posts in various replies to members.

Kevin Hughes's picture

Server load can easily be tested.

Number of servers shouldn't be a problem. Maybe bottlenecking at the database but since the page couldn't even load for me I suspect it was app servers. Why isn't the site deployed somewhere where we can dynamically add servers for registration and then remove them later? There are plenty of providers that make this really easy to do (literally a slider to ask for more servers).

Splitting registration is a band-aid fix and then I need to be ready 2 nights in a row to register for winter.

As I said previously, the issue wasn't server load. We use an Amazon-type service that dynamically adds servers during high peak traffic. We have performed stress tests, which lead us to adopt this solution.

From my [basic] understanding, the database was overloaded because it was getting pinged more than 500 times per second, which was the website's maximum setting. This also meant that some people were unaffected. A solution was put in place immediately and it solved the issue. I'm paraphrasing for us non-IT people, but this was the traffic equivalent to 5000 people trying to access the website at the same time, mostly due to people constantly hitting refresh.

Maybe Shopify can lend us some of their expertise?

Kevin Hughes's picture

I'll gladly lend a hand :) Refreshing the page shouldn't hit the database so there is an architecture problem that is adding uneccessary load to the database.

This thread is amazing. We turned Hadrian's suggestion into a flame war against the OCUA administration.

Stay classy.

(P.S. This is probably why the BOD and OCUA staff avoid posting on the forums)

Hadrian Mertins-Kirkwood's picture

I'm actually coming at it from the perspective of how I'd feel if I didn't get into the league this year. If it was because my Internet was slower than someone else's I'd probably be more upset than if it was a random draw where I had as good a shot as anyone else. I would also be less upset if it was a merit-based system where I felt like I didn't "earn" a spot.

Basically, any system (including the status quo) priviliges some people over others in the selection process, which means there's no perfect outcome. You kind of have to decide which people you want to help out.

Here are a few options compared in brief:

  • Current system: mostly a crapshoot but discriminates against people with bad technology (or tech savvy) and people with one-off scheduling conflicts
  • Lottery system: totally random, but no reward for volunteers/returners
  • Rigged lottery system (my proposal): random-ish, but discriminates against new players
  • Merit-based (tryouts): weaker players discriminated against and large degree of subjectivity in selections
  • Application: also subjective, but would be the best way to select for hecklers based on the mandatory essay portion

The administrative burden varies pretty significantly between options and I'm sympathetic to that being an important variable for OCUA.

Other than as a point of discussion, I don't bring this up now for any particular reason. I certainly don't have a bone to pick and I don't think this is a huge issue that's desperate for solutions. I was mostly just curious to start a conversation around how you might determine who gets to play in a league where demand is so much greater than capacity. It's not actually that obvious and, given Parity's growing popularity, I expect it will only get more challenging in future years.