Development Reliability Ratings and Bonuses

Member profiles reflect reliability factors for the last 15 projects in each track. The reliability factor is calculated as the percentage of the last 15 projects that a member registers for in which that same member presents a timely submission that passes review. The projects before the first passing submission do not count against a member's reliability history.

Separate reliability ratings are kept for each track. Some of the tracks have unrated past projects that do not count for the reliability rating in this track. Below is the cut-off dates for different tracks. The past projects before these dates do not count for the reliability.

TrackDate
Component Design 05 October 2005
Component Development 05 October 2005
Conceptualization 23 March 2009
Specification 23 March 2009
Architecture 23 March 2009
Assembly 23 March 2009
Test Suites 23 March 2009
Test Scenarios 23 March 2009
Content Creation 23 March 2009
UI Prototype 01 August 2009
RIA Build 01 June 2010

The reliability bonus for each particular project depends on the reliability rating at the moment of registration for that project. A participant with no previous projects is considered to have no reliability rating, and therefore gets no bonus.

Members are eligible to receive a bonus on top of any prize money won if their Reliability Ratings are equal to or exceed 80%. Winning members with Reliability Ratings equal to or exceeding 80% and less than 90% will receive a bonus equal to 10% of the prize. For Reliability Ratings equal to or exceeding 90% and less than 95%, winning members will receive a bonus equal to 15% of the prize. And winning members with a Reliability Rating equal to or exceeding of 95% will receive a bonus equal to 20% of the prize. The following is an example of payouts based on the member's Reliability Rating:

0% - 79%80% - 89%90% - 94%95% - 100%
$5,000 $5,500 $5,750 $6,000
$2,000 $2,200 $2,300 $2,400
$500 $550 $575 $600
$200 $220 $230 $240
$100 $110 $115 $120

Please note: reliability bonuses do not apply to Digital Run winnings.

Since reliability rating is based on the past 15 projects, it can only have 15 discrete values (assuming you have submitted at least 15 times). Here are the bonuses earned for these actual reliability levels:

DetailRatingBonus
15/15 100% 20% bonus
14/15 93% 15% bonus
13/15 87% 10% bonus
12/15 80% 10% bonus
other <80% No bonus
Have more questions? Submit a request

2 Comments

  • 2
    Avatar
    Samlkysonalist

    There should be a place where the new beginner  start little and win no matter  how little  we will be happy. 

  • 0
    Avatar
    thomaskranitsas

    It's very hard to increase the reliability rating once it's get decreased.

    For example in UI PROTOTYPE I've participated in 12 challenges.

    I submitted in the first one so my reliability rating was 100%.

    I didn't submit in the second one so my reliability got 50%.

    In total I submitted in 9/12 and my reliability is still 69%.

    This is really frustrating and I consider it almost impossible to restore my reliability rating as I don't compete exclusively in UI PROTOTYPE :(

    Edited by thomaskranitsas
Please sign in to leave a comment.