Post by nwilliard on Aug 3, 2015 4:13:27 GMT
The scoring method that was originally posted has been modified. Previously, too much weight was being given to false positives relative to true positives/false negatives/miss classifications. This was bringing every submission well into the negative numbers and would have likely made the best submission, the one with the fewest entries. The scoring equation has been modified to put less of a penalty on false positives and false negatives, and even less of a penalty on miss classifications (in which a fault was predicted within the correct time, but the fault code was incorrect). True positives are highly rewarded with 10 points.
The new scoring equation is as follows
Score = #truepositives*10 - #missclassifications* 0.01 - #falsepositives*0.1 - #falsenegative*0.1
truepositives are faults identified correctly with the start and end time estimated within 1 hour + or - the actual time.
missclassifications are faults identified with correct start and end times but with the wrong fault code
falsepositives are faults identified by the submission that did not actually occur in the data
falsenegatives are faults in the real data that were not identified by the submission
please make sure that your timestamps are in the correct format
YYYY-MM-DD HH:MM:SS
There were several submissions that need to be resubmitted with correct file name timestamp formats. Please resubmit by Tuesday.
The current standings:
Scoring will be updated every Sunday night. If your submission is sent back due to formatting issues please resubmit by tuesday of the same week for your submission to count during that week's scoring.
The new scoring equation is as follows
Score = #truepositives*10 - #missclassifications* 0.01 - #falsepositives*0.1 - #falsenegative*0.1
truepositives are faults identified correctly with the start and end time estimated within 1 hour + or - the actual time.
missclassifications are faults identified with correct start and end times but with the wrong fault code
falsepositives are faults identified by the submission that did not actually occur in the data
falsenegatives are faults in the real data that were not identified by the submission
please make sure that your timestamps are in the correct format
YYYY-MM-DD HH:MM:SS
There were several submissions that need to be resubmitted with correct file name timestamp formats. Please resubmit by Tuesday.
The current standings:
Group | Submission date | Score |
embminders | 14-Jul | -1162.41 |
TNB | 22-Jul | -11.12 |
embminders | 22-Jul | 2451.33 |
NRC-TIGER | 23-Jul | -1008.9 |
Maxtropy | 23-Jul | 3062.33 |
NotOurFault | 1-Aug | 12177.96 |
Scoring will be updated every Sunday night. If your submission is sent back due to formatting issues please resubmit by tuesday of the same week for your submission to count during that week's scoring.