December 14, 2022

Scoring system UPDATE

After receiving feedback on our scoring system and concluding that it could be improved, we have decided to update it. We believe this new approach is more fair to the designers competing in the Relume Design League.

Up until this point, our rudimentary scoring system consisted of getting the audience on Youtube to vote on which design they thought should win. From observation we have concluded that this did not always lead to the fairest result, as the scoring was more akin to a popularity contest than a design contest.

So we put our heads together and came up with a new approach to improve the scoring system for RDL matches.

New approach

Instead of giving full voting power to the audience, the new approach adds two judges into the mix. Each judge and the audience will have equal voting power. Having three inputs on the voting means that there will always be a decision made on the winner.

The judges evaluate each design based on a set of design criteria. The criteria is used to determine the judges choice for their vote.

Judging criteria

Each criteria is scored out of 10. The combined score of each criteria is calculated to determine the final score and winner.

The following criteria includes:

Design & Accessibility
  • Is the design aesthetically pleasing?
  • Does it have strong design fundamentals?
  • Is the design accessible?
Execution of brief
  • Does the design make good use of the assets available?
  • Does the design relate to the intended audience?
  • Does the design support the copywriting well?
  • Does the designer provide a good rationale for their choices?
Creativity & Originality
  • Is the design original?
  • Is there anything in the design that you haven’t seen before and works?
  • Does the designer have creative ideas around implementation?
Completion
  • Is the design complete?

Example
Feedback

We're always look for ways to improve the Relume Design League. If you have any thoughts, suggestions or feedback on the new scoring system, please share them with us at [email protected].