Rating System
Basic ratings
When a translator gets hired for a job, at the end of it, the client can evaluate his performance,
and the translator also gets to evaluate the client.
Using these evaluations, we calculate a score for translators, in order to measure their punctuality,
their accuracy, and their experience (which grows as they do more and bigger jobs).
When the client rates the translator, he/she chooses a rating from 0 to 10 regarding two concepts:
punctuality and accuracy. Also, each job is "worth" a different amount of points, depending exclusively
on its size, measured by the amount of words to be translated. These "available" points are split in half
for each concept, and then each half is weighed by the ratings given by the client.
The resulting number is the experience the translator earned.
When the translator rates the client, the system is much simpler, he/she simply chooses a 0 to 10 score,
based on his work experience with the other party.
Both parties can also enter a written feedback detailing why they gave that rating or anything they
consider the rest of the Translator's Corner community should be aware of.
Court Cases
In the case where the job does not end successfully, and a court case is started, the parties are not
allowed to rate each other, to avoid retaliatory or unfair ratings, and the administrator in charge of the
case is the one who rates both parties.
These ratings will work similarly to those made by clients and translators, with two differences:
- If one of the parties misbehaves in a way that is considered serious, they can get a negative rating,
which has the effect of not only not giving any points for the job, but it also subtracts points that may
have been earned from previous jobs.
- The administrator will explain in the rating the nature of the court case, and the outcome, together with
any information he/she considers valuable for other users of the site.
Ranking
In order to give some meaning to the experience points, we created rankings.
Rankings are simply a list of all the translators for a given language pair, ordered by their experience
(most experienced first).
There is one per language pair because it wouldn't be fair to compare the experience between an
"English to Spanish" translator, with that of a "Dutch to Russian" one. (Yes, we may have one)
When you use Auto Price Comparison to search for your translator, you
will be able to see how he/she is positioned in the corresponding language, which will give you one more
piece of information to make your decision.
Cumulative Scores
When you look at the profile of a translator, you will see three rating concepts, which result from the sum
of all the ratings they got on previous jobs. These are:
- Accuracy:
The accuracy score is an average of all his accuracy ratings, weighted by the number of words in each job.
This means that the bigger the job, the more that individual rating impacts his overall score.
- Punctuality:
The overall punctuality score is also the average of all his individual punctuality ratings,
weighted by the number of words in each job.
- Experience:
The experience rating is the sum of all the experience points they got in previous jobs, and also shows
a graphical representation of how they compare with their peers.
The stars represent how much experience the translator has compared to the leader in the ranking
of that language pair.
If the translator is the leader, he/she gets 5 stars. If they have half as many points as the leader,
they get 2.5 stars, etc.
Thus, the more stars, the more "relative" experience a translator has.
Example
Project: 1000 English to Spanish Words |
| Points Type: |
User Rating |
Points Earned |
# of Icons |
| Accuracy |
8 of 10 |
400 |
4 Bull's-eyes |
| Punctuality |
9 of 10 |
450 |
4.5 Clocks |
| Experience |
N/A |
850 |
Relative to Others |