Generative AI Annotator

Job Description:

We are looking for detail orientated candidates for the new role of Gen AI Annotator. The ideal candidate has previous experience in effectively coping with a fast-paced, high-pressure role in a constantly changing business environment. They will be client orientated, enthusiastic, courteous, assertive, and motivated to take charge of the development and improvement of AI LLM (large language model).

The candidate must possess a strong aptitude for working with data and excellent verbal and written communication skills. They will be flexible and analytical with the ability to understand and interpret large datasets and applying predefine guidelines, ensuring the accuracy and quality of annotations.

The Gen AI Annotators will be working within and promoting the Company Values – Be Brave, Be Wise, Be Proud and Exceed.

Role and Responsibilities:

Leverage your ability with English comprehension and domain knowledge in the rapidly growing field of Generative AI LLM and join our community of Annotators who play a crucial role in improving LLM.

As an Annotator, your role will be to create, assess, and refine pairs of questions and answers to improve a large language model. You'll generate realistic questions that someone might ask the LLM in a real-life context and provide the best possible answer. This task will involve you reviewing a set of guidelines, create sample prompts and response in your area of expertise.

Annotate English data accurately and consistently, and in accordance with predefined annotation guideline
Evaluate the quality of existing data resources, as well as the output of machine learning classifiers and internal tools
Develop, implement, and maintain guidelines and procedures for consistent, high-quality classification and content creation and organization
Perform basic research as needed to annotate accurately
Provide feedback on the annotation tasks and contribute to the continuous improvement of the data annotation process
Provide insights regarding observed patterns in the annotated data
Research new entity categories and best practices for organizing them

Essential Competencies:

We're seeking individuals from diverse backgrounds, who have gained experience across domains and languages. Essential competencies needed for this role are:

High Proficiency in English – C1 Level minimum as per the CEFR.
Educational background: Degree Level 7 & above
Understanding common social norms (Social dynamics, social media, popular culture)
Ability to efficiently work to specified project delivery deadlines
Excellent Communication & interpersonal skills & Flexible and innovative
Proficiency in Microsoft office suite
Excellent attention to detail and a good team player

Candidate Experience:

Ability to reference online resources, rephrase and write cohesive, accurate, responsive, and sometimes empathetic answers to the prompts in the perspective of a LLM.
Ability to ask and/or answer specialized domain free-form prompts at university-level difficulty.
Experience of data and trend analysis, and insights.
Experience of developing & implementing a range of initiatives.
Experience working in a constantly changing environment.
Able to work independently and collaboratively; must be able to manage multiple activities simultaneously and execute decision with judgment and discretion.
They will have a strong performance ethos and personal commitment to achieving outstanding customer performance.

Benefits:

Health Insurance
25 days Annual Leaves
Extensive Training & Development
Access to Covalen’s Wellness Programs.
Tax Saver Travel Card
Covalen’s Bike to Work Scheme

Further Details:

Salary: €31,063 per Annum + Bonus
Location: Office based - Sandyford (Dublin 18)
Working hours: 37.5 hours / week Monday to Friday (including Bank Holidays)
Shift: Day (9am to 5.30pm) / Evening (6pm to 2am)
Pay Schedule: Monthly
Contract Type: Permanent Full-Time Contract