Web content assessor is a role at Lionbridge, where one has to assess webpages for quality, relevance, and accuracy. The job is very similar to that of a Search Engine Evaluator. The search engine used by the former is Bing (by Microsoft) and for the latter, it’s Google.
When you work for Google, you’re a rater, but when you work for Microsoft, you’re a judge.
The rating task is called Human Interference Task (HIT) and is a part of the Universal Human Relevance System (UHRS). Each project available to you is called a HitApp, which depends on your country and demand. There are mainly three query intents-
The judges have to judge the Landing pages (LP) based on four parameters- Intent, Scope, Authority, and Quality.
Does the landing page satisfy the query?
Does the content match the demand of the user?
Is the landing page trustworthy?
Are the quality of the landing page and the organization at par with the user’s expectations?
The judges consider these questions and then rate the landing pages on a scale varying from ‘strongly’ to ‘poorly’ depending on how well the Landing Page satisfies the user.
Rating is a bit different here as you have to ‘judge’ the webpages based on a rating matrix. This rating matrix considers the likely user intent and how well does the LP satisfy the intent. The ratings can be-
- Perfect– Meets intent of a minimum 50% of users; mostly official pages
- Excellent– Meets intent of a minimum 25% of users; users search should end here
- Good– Meets intent of a minimum 10% of users; users would continue looking for other pages
- Fair– Weakly meets the intent of the user; only useful to some searchers
- Bad– Does not meet the intent of the user; useful to none; spam and malicious content
- You give a ‘Detrimental’ rating for pages containing adult content and a ‘No Judgement’ rating for inaccessible pages.
Depending on the tasks, you can be “Multimedia Judge”, “Side by Side Judge” etc.
You will judge queries based on different factors including (but not limited) to intent, aboutness, location, quality credibility, and landing page satisfaction.
Another factor emphasized in the guidelines is the ‘Freshness’. How updated is the data? When were the changes made? How relevant are the changes? These are some questions that raters need to consider while doing the Freshness task. The webpages are judge based on three categories-
- Fresh Not Important
- Very Likely Fresh
- Most Likely Fresh.
The last two categories, as the name suggests, determine the freshness of the content. The first category, however, suggests that no matter how fresh the page is, it is not important as the website contains facts that can’t be changed.
Some raters feel that the UHRS platform is a bit outdated.
The Job Requirements-
- Fluency in English and regional language (if a resident of a non-English speaking country)
- Must be working and living in the country (which you have applied) for a period of 5 years
- Excellent communication skills
- Thorough knowledge of guidelines and flexibility to complete tasks based on them.
- Excellent research and analytical skills
- Stable and high-speed internet connection on Windows 10 or above.
- Up-to-date antivirus/anti-spyware software
- Awareness about pop culture, current affairs, and media, sports, business news in your country
- Basic knowledge of search engines and Internet
- Bachelor’s degree or equivalent
Foremost, when you work as a web content assessor, you work as an independent contractor and not as a full-time employee. The salary/pay highly depends on your location and project. The pay range is usually between $6/hour to $16/hour. The job does not offer employee benefits like health insurance, paid leaves, retirement benefits, etc. But it offers you a decent pay comparative to other freelancing jobs.
One should not enroll through Facebook groups, etc. to avoid scam. We recommend you to fill the application form through the official website only. The ‘Career’ section at the Lionbridge website will lead you to the various job vacancies. Check the job vacancy based on your country.
Once you’ve filled the basic information about your residency and language, submit a residential proof of your country and your CV. Once they review your CV, you will receive the study material (Guidelines) to prepare for the exam.
The Study Material-
The Guidelines provided by Google differs from the one by Bing. The guidelines are not easily available on the web. We know the official document as UHRS One-DCG Pilot Judging Guidelines. It is a 70-page document that needs your thorough understanding. These guidelines will perpetually decide your future as a rater. Consider it as your Holy book to pass the qualification exam.
The Qualification Exam-
Once they have shortlisted your application, you will receive a mail providing you access to the Guidelines, the study material, and the practice data. All of this will help you in preparing for the qualification exam. The exam pattern and qualification system differ from the typical qualification exam for Search Engine Evaluator for Google.
Here, you will have to complete at least 50 tasks in the Practice data before the exam. The practice data has over 250 examples for helping the candidates understand the entire process of rating tasks.
The exam comprises different rating tasks- 30 tasks in total. For every query, ratings are to be done based on Intent, Freshness, Location, Aboutness, Quality Credibility (QC). Landing Page Satisfaction (LP-Sat) is another important factor to be considered. If you have unsatisfactory performance, they may ask you to complete 15 additional rating tasks.
Complete the practice data and the exam in one week.
This may sound intimidating, but you can always reach out for any guidance to other raters available on various official and unofficial forums.
-Flexibility in time
-Highly specialized equipment not required
-No technical knowledge required
-Zero commutation costsCons
-Not a full-time job
-Low availability of tasks
-No job benefits
-Multiple projects not allowed
-Close monitoring of performance.
If you want to know how to apply at Lionbridge or just want to get help with a Lionbridge exam, feel free to contact us and we will make sure that all your questions are answered.
Contact Us at