Data Analyst -Quality Freelance (Remote)

About the Company Outlier is an AI training platform owned and operated by Scale AI. Through a network of experts working on different projects, Outlier helps generate training data and evaluate AI model performance. Its platform connects contributors with projects that support the development and improvement of advanced AI systems. About the Role Outlier is seeking detail-oriented, fluent English speakers to evaluate AI-generated images, videos, and audio. As an independent contractor, you will review AI-generated content, participate in live conversations with AI voice models, compare outputs against written prompts, and provide clear written feedback on quality, accuracy, and realism. Tasks may include identifying visual inconsistencies, evaluating speech quality, labeling actions in videos, and assessing how well AI-generated content follows instructions. Work is fully remote, with no minimum weekly hours. Contributors can choose their own schedules and work on available projects based on their skills and qualifications. Key Responsibilities Hold live, scenario-based conversations in English with AI voice models and evaluate how natural, useful, and clear the responses sound. Compare pairs of AI-generated images and videos to determine which better follows the given prompt. Inspect generated content closely, including zooming in on images and replaying videos or audio, to identify visual and sound-related issues. Identify problems such as distorted anatomy, flickering, unnatural movement, text errors, and audio that does not match the video. Rate outputs across criteria such as prompt adherence, quality, and realism. Write specific, evidence-based explanations in English describing issues identified during evaluations. Evaluate AI-generated images against text prompts and, where required, compare edited images with their original versions. Assess AI-generated videos against prompts or compare edited videos with their source clips. Label first-person videos showing people or robots performing hands-on tasks by dividing clips into individual actions and writing accurate captions, using AI-generated drafts as a starting point. Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice. Record short voice explanations of evaluation decisions when required. Required Qualifications Fluent English communication skills, including clear written communication and comfortable everyday conversational speech. Strong attention to detail and patience when reviewing images, videos, and audio. Ability to communicate naturally during realistic, scenario-based conversations. Experience writing short, evidence-based explanations or reviews. Ability to make clear decisions when comparing outputs, even when both options have shortcomings. Ability to inspect content carefully and identify specific quality issues. Preferred Qualifications Currently pursuing or holding a bachelor's degree or higher is an advantage. Registration Requirements A valid identification document and mobile phone from your country of residence. An up-to-date resume highlighting your expertise. A LinkedIn profile showing your educational background and work experience. Location and Work Arrangement Fully remote freelance opportunity through the Outlier.ai platform. Applicants are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States. Contributors can set their own schedules and work without a minimum weekly hour requirement. Work availability depends on project needs. Compensation and Payment Project earnings Up to USD $15 per hour. Additional incentives are available through Missions, Outlier's version of surge pricing. Contributors earn an average additional 7.5% through Missions, while the top quartile earns an average additional 11%. Payments are processed weekly on Tuesdays for tasks completed during the previous payment period, which runs from Tuesday through Monday at midnight UTC. Available payment methods include PayPal, AirTM, and ACH transfer. Rates vary based on expertise, skills assessment, location, project requirements, and other factors. Higher rates may be available for certain qualifications, such as a PhD. Lower rates apply to some non-core work, including initial project onboarding and project overtime phases. Some projects offer additional incentive payments. Payment terms should be reviewed for each project. Incentive figures are based on payments made over the previous six months and are updated quarterly. Additional Benefits Free access to leading large language models (LLMs), valued at more than $200 per month. Opportunity to work with experts across different fields on pre-release AI models. Access to a contributor network of more than 900,000 Outlier Experts across 52 countries, with over $600 million paid to experts. Employment Type and Work Authorization This is a 1099 contract opportunity. Contributors join Outlier as freelancers or independent contractors, not employees. Internships, employment sponsorship, and visa sponsorship are not offered. Applicants must be authorized to work in their country of residence. International students may be eligible to sign up depending on their visa status. Candidates with questions about their individual tax or immigration circumstances should consult a qualified tax or immigration advisor.

Back to blog

Other Jobs To Apply

Remote Account Executive, HubSpot Partner Sales

Remote Staff Backend Product Software Engineer, Commerce Platform

Remote Senior Digital Marketing Strategist -Startups/SMB (Remote US)

amazon flex

Regional Team Leader – South 1

Warehouse Assistant - Full-time

Remote Account Executive, HubSpot Partner Sales

AVP, Regional Credit Sales Manager Sam's Club (AZ, Phoenix Metro)

Remote Staff Backend Product Software Engineer, Commerce Platform

Remote Senior Digital Marketing Strategist -Startups/SMB (Remote US)

Remote Out of Office Position / Data Entry (Hiring Immediately)

amazon flex

Branded Content Writer, Freelance, Part-Time

Warehouse Assistant - Full-time

Remote Real Tool-Use Repair Clips Creator

AVP, Regional Credit Sales Manager Sam's Club (AZ, Phoenix Metro)

Remote Russian-English Healthcare Customer Service Specialist

Remote Out of Office Position / Data Entry (Hiring Immediately)

Branded Content Writer, Freelance, Part-Time

Staff iOS Engineer, Media Foundation - Remote

Remote Real Tool-Use Repair Clips Creator

Remote Russian-English Healthcare Customer Service Specialist

Remote Care Review Clinician

Staff iOS Engineer, Media Foundation - Remote

Sr. Project Management Analyst (Health & Casualty Claims implementations, Remote)

Remote Care Review Clinician

Remote Insurance Agent, West Coast

Sr. Project Management Analyst (Health & Casualty Claims implementations, Remote)

Remote Insurance Agent, West Coast

Medical Coder - AI Trainer (Remote)

Medical Coder - AI Trainer (Remote)

Remote Work From Home Administrative Assistant Admin - Part Time Panelists Needed

Remote Work From Home Administrative Assistant Admin - Part Time Panelists Needed

Remote Data Analyst

Remote Data Analyst

Senior Product Designer - Search & Findability (Remote)

Senior Product Designer - Search & Findability (Remote)

Remote Medical Assistant – CMA (Clinical & Admin)

Remote Medical Assistant – CMA (Clinical & Admin)

Remote Help Desk Specialist I - Secret Clearance

Remote Help Desk Specialist I - Secret Clearance

Solutions Architect, Enterprise (Retail, Restaurant & CPG) (Remote)

Sr. Project Manager - BESS

Sr. Project Manager - BESS

Amazon Customer Service

Amazon Customer Service

Remote Pharmacist — Diabetes Care Programs

Remote Pharmacist — Diabetes Care Programs

Sr Sales Manager

Sr Sales Manager

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...