Back to jobs
YO IT CONSULTING logo

AI Agent Power User - Remote

YO IT CONSULTINGRemote

Posted September 18, 2026

Job Description

AI Agent Power User

Role Type: Contractor
Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand

We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows.

You’ll use your professional experience and hands-on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.

Scope of Work

  • Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.

  • Document workflows and identify where AI performance meets or falls short of real business requirements.

  • Evaluate AI-generated outputs using defined rubrics and quality criteria.

  • Provide clear, actionable feedback to AI research and product teams.

  • Identify recurring AI strengths, weaknesses, and opportunities for process improvement.

  • Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.

  • Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

Preferred Qualifications

  • 5+ years of professional experience in any business function involving technology and operational problem-solving.

  • Bachelor’s degree or higher in any discipline.

  • Daily, hands-on experience using ChatGPT and/or Claude for real professional work.

  • Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.

  • Comfortable working with AI tools and common workplace productivity platforms.

  • Excellent written English and strong documentation skills.

  • Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.