Post #201 · Posted at 2021-06-28 02:33:10pm 4.4 years ago
So after doing some experimentation with the current system of calculating scores, I have found a flaw.
Finding the outliers in the current way is not effective because it does NOT take into account each voter's average assigned rating.
For example, voter A could rate simfiles according to the scale:
1- below average
2 - average
3- above average
4- very good
5- awesome
6- outstanding
7- literally amazing
8- flawless
9- unbelievable
10- the best simfile ever
But voter B could use a different scale:
1- unplayable
2- trash
3- horrible
4- very bad
5- not good
6- eh
7- okay
8- nice
9- fun!
10- spectacular
Voter A assigns an average vote of around 2.5, but Voter B assigns an average vote of around 7.5. So in this scenario, a 4 from voter 1 is above average and would actually be good for the recipients overall score, better than a 7 from voter B. But the 4 would get removed over the 7 in the current system of removing outliers.
The fix is to base the outliers on which vote has the greatest effect on that simfiles final score? This is mathematically equivalent to asking: which voter rated this simfile the worst/best compared to their average given vote?
The method of doing is what I have listed above, which is subtracting each voter's average given vote from each of their votes. This makes it so that way every voter's average is the same (in this case zero) so we CAN now compare votes for a certain simfile and remove the outliers.
Now you may understand this far, but still not see the issue with the way the Week 1 votes were calculated. Well let me just state some statistics about it.
23 of the 33 lower outliers that got removed can solely be attributed to one voter. That means that voter could have changed any on those votes by increasing them 1 point, or down my any number of points, and it would have no effect on the overall scores except their own because their voter average would change and they would get a different score for their own simfile. I hope you can see that this is an issue, because this voter's votes matter less overall.
Okay, that's all for now.
Finding the outliers in the current way is not effective because it does NOT take into account each voter's average assigned rating.
For example, voter A could rate simfiles according to the scale:
1- below average
2 - average
3- above average
4- very good
5- awesome
6- outstanding
7- literally amazing
8- flawless
9- unbelievable
10- the best simfile ever
But voter B could use a different scale:
1- unplayable
2- trash
3- horrible
4- very bad
5- not good
6- eh
7- okay
8- nice
9- fun!
10- spectacular
Voter A assigns an average vote of around 2.5, but Voter B assigns an average vote of around 7.5. So in this scenario, a 4 from voter 1 is above average and would actually be good for the recipients overall score, better than a 7 from voter B. But the 4 would get removed over the 7 in the current system of removing outliers.
The fix is to base the outliers on which vote has the greatest effect on that simfiles final score? This is mathematically equivalent to asking: which voter rated this simfile the worst/best compared to their average given vote?
The method of doing is what I have listed above, which is subtracting each voter's average given vote from each of their votes. This makes it so that way every voter's average is the same (in this case zero) so we CAN now compare votes for a certain simfile and remove the outliers.
Now you may understand this far, but still not see the issue with the way the Week 1 votes were calculated. Well let me just state some statistics about it.
23 of the 33 lower outliers that got removed can solely be attributed to one voter. That means that voter could have changed any on those votes by increasing them 1 point, or down my any number of points, and it would have no effect on the overall scores except their own because their voter average would change and they would get a different score for their own simfile. I hope you can see that this is an issue, because this voter's votes matter less overall.
Okay, that's all for now.
Post #202 · Posted at 2021-06-28 02:36:12pm 4.4 years ago
eataninja | |
|---|---|
| Member | |
| 818 帖子 | |
| |
| Reg. 2011-05-05 | |
You all are going through so many hoops to defend someone's votes instead of having that person learn from the consequences of grading everyone poorly...
Post #203 · Posted at 2021-06-28 07:23:19pm 4.4 years ago
EDIT: I understand that the current system is not going to change for the first 10 weeks, but I just ask that in the future, the method of calculating final scores should be made transparent before the votes are released. That way these issues can more readily be addressed before results are released.
Anyway, as long as people don't intentionally inflate their votes to gain an advantage, there really shouldn't be any issues. The difference is negligible for most people.
I think I'm gonna leave it for now, but I hope this can be addressed later on.
Anyway, as long as people don't intentionally inflate their votes to gain an advantage, there really shouldn't be any issues. The difference is negligible for most people.
I think I'm gonna leave it for now, but I hope this can be addressed later on.
Post #204 · Posted at 2021-06-29 02:08:03am 4.4 years ago
Braeden47 | |
|---|---|
| Member | |
| 569 帖子 | |
| |
| Reg. 2008-01-02 | |
| "X scale 20" | |

Shock
Beast
https://zenius-i-vanisher.com/v5.2/viewsimfile.php?simfileid=46364
Challenge has 44.25 beats of Freeze Arrows.
Every difficulty has shocks
Post #205 · Posted at 2021-06-29 05:02:50am 4.4 years ago
chewi | |
|---|---|
| Member+ | |
| 8,666 帖子 | |
| |
| Reg. 2008-02-24 | |
![]() | |
| "♪ A Never-Ending Midnight Sun ♪" | |
Post #206 · Posted at 2021-06-30 03:51:29am 4.4 years ago
VanEden | |
|---|---|
| Member | |
| 185 帖子 | |
| |
| Reg. 2018-05-11 | |
| "orangutan occupation" | |
Post #208 · Posted at 2021-06-30 01:49:49pm 4.4 years ago
Post #209 · Posted at 2021-06-30 02:40:32pm 4.4 years ago
Week 4 - Long Distance
Wish and hope with...
Singles:
3 ||
6 ||
11 ||
13 ||
15
"There's no way you'll stay with a boy like me;
Two front teeth and the same black jeans."
Two front teeth and the same black jeans."
Post #210 · Posted at 2021-06-30 04:21:29pm 4.4 years ago
Akira | |
|---|---|
| Member | |
| 160 帖子 | |
| |
| Reg. 2007-06-17 | |
| "The S is silent." | |
Decided to pass for this week and take it easy while recovering
Post #211 · Posted at 2021-06-30 04:44:48pm 4.4 years ago
SirDj0nt | |
|---|---|
| Member | |
| 69 帖子 | |
| |
| Reg. 2017-05-07 | |
| "It’s Karl, spelled with a K." | |
Pulling back on the difficulty with this one.
Spiritbox - Blessed Be (Nightcore)
Singles:
4
9
11
14
16
Link: https://zenius-i-vanisher.com/v5.2/viewsimfile.php?simfileid=46373
Spiritbox - Blessed Be (Nightcore)
Singles:
Link: https://zenius-i-vanisher.com/v5.2/viewsimfile.php?simfileid=46373
Post #212 · Posted at 2021-07-01 01:10:39am 4.4 years ago
Pandemonium X | |
|---|---|
| Member | |
| 10,358 帖子 | |
| |
| Reg. 2007-04-06 | |
![]() ![]() | |
Post #213 · Posted at 2021-07-01 01:40:38am 4.4 years ago
tsugaru7reveng | |
|---|---|
| Member+ | |
| 1,430 帖子 | |
| |
| Reg. 2006-06-02 | |
Post #214 · Posted at 2021-07-01 06:24:30am 4.4 years ago
Lampshade | |
|---|---|
| Member | |
| 98 帖子 | |
| |
| Reg. 2019-10-12 | |
![]() | |
| "what do i put here" | |
Post #215 · Posted at 2021-07-01 02:23:26pm 4.4 years ago
TikalFan9000 | |
|---|---|
| Member | |
| 1,860 帖子 | |
| |
| Reg. 2015-02-13 | |
![]() | |
| "c r e b" | |
Post #216 · Posted at 2021-07-01 04:56:44pm 4.4 years ago
PenTA_ | |
|---|---|
| Member | |
| 249 帖子 | |
| |
| Reg. 2016-12-23 | |
![]() | |
YEEEEES PAISLEY PARKS MUSIC
Post #217 · Posted at 2021-07-01 06:19:17pm 4.4 years ago
Silver Spirit | |
|---|---|
| Member | |
| 6,778 帖子 | |
| |
| Reg. 2008-09-14 | |
![]() | |
| "i was born at a very young age" | |
Is it too late to join? I've been busy adjusting to a new job, but I'd like to participate if I can find the time for it 
Post #219 · Posted at 2021-07-01 09:56:14pm 4.4 years ago
KexMiX | |
|---|---|
| Member | |
| 175 帖子 | |
| |
| Reg. 2019-01-25 | |
| "I do DDR things sometimes" | |
Quote: Silver Spirit
Is it too late to join? I've been busy adjusting to a new job, but I'd like to participate if I can find the time for it 
You're in! Yeah, I'm not limiting when anyone can join, just as long as it's before the VIP Room


































