TLDR: Coding question is evaluated based on number of testcases that the candidate's code passes for.

Each coding question explains a scenario/ problem for which a candidate needs to write code to solve the problem. The code written as an answer to the question should be bug-free, have correct logic, follow correct syntax and print the expected output. Since each coding problem is technically a scenario, the coding question includes examples of scenarios and details on how the code should work for those scenarios.

For example, let's say a coding question asks the candidate to write code that adds two numbers. Then an example scenario would be- if 2 and 3 are passed as inputs to the candidate's code, it should print 5 as the answer.

Each Adaface coding question has expert designed test cases (the number of test cases vary from question to question but it will be ~6 on average).

A test case has two parts: a given input text and an expected output text.

For a question where candidate is expected to write code that adds two numbers, an example test case would be: input (3 and 4) and expected output text would be 7.

We design test cases that evaluate a candidate's code for various edge cases. A test case passes only if candidate's code handles the scenario being tested correctly.

A candidate can submit their code for evaluation against test cases any number of times while they are coding. Each time they submit their code, the code is pitted against all the test cases for that problem to see how many test cases pass for the submitted code. A candidate's submission will be given prorated score based on number of test cases that pass.

For example: if the coding question has 6 test cases, and total score of 40 and a candidate's submitted code passes 3 test cases, then for this submission, the candidate would get a score of 20 (since only half the 6 test cases passed).

A candidate can make any number of submissions while they are coding. If a candidate runs out of time, the candidate's last code is auto-submitted for evaluation. The submission of the candidate with the highest score is marked in the scorecard as the final score.

For example, if candidate's first submission got a score of 20, the second submission got a score of 30. Later the candidate tried to improve their code but made a submission that got a score of 10, candidate's final score would be 30 (the highest submission they made).

Deductions are made to final score for two reasons: