Schedule: Full-Time, 45 hours/week
Work Days: Monday to Friday
Work Hours: Staggered shifts between 8:00 AM to 8:00 PM EST
Work Setup: Fully Remote
Apply here: https://operationsarmy.com/application
About The Role
Were looking for highly detail-oriented Accounting AI Analyst to support our AI operations team. In this role, you will be responsible for labeling and reviewing AI-generated outputs, identifying inconsistencies, and helping improve overall model performance. This is a great opportunity for candidates with experience in data entry, finance operations, QA, or similar roles, who thrive in a structured, fast-paced, and fully remote environment.
Key Responsibilities
- Label and Tag AI Conversations: Accurately annotate AI agent conversations using internal tools such as LangSmith or other proprietary platforms.
- Review and QA AI Outputs: Analyze and correct AI-generated outputs related to contracts, accounts receivable transactions, reconciliations, and similar data.
- Identify and Escalate Issues: Flag logic errors, inconsistencies, or unclear agent behavior, and escalate them to leads or relevant stakeholders.
- Document and Report Edge Cases: Help document unique cases, recurring patterns, or workflow challenges to support model training and improvements.
- Contribute to Workflow Development: Support the creation of efficient tagging workflows and quality assurance best practices.
- Maintain Quality and Productivity: Meet or exceed daily output goals while ensuring consistent quality, accuracy, and attention to detail.
- 1 to 3 years of experience in data entry, finance operations, customer support, quality assurance, or tagging/labeling roles
- Strong reading comprehension and ability to follow detailed workflows and task instructions
- Good written English communication skills for internal documentation and feedback
- Familiarity with accounting or finance terms (e.g., invoices, cash applications, aging reports) is a plus
- Comfortable using tools such as Airtable, Google Sheets, and AI annotation platforms
- Highly reliable, self-motivated, and organized
- Ability to thrive in a fully remote and fast-paced team environment
- Airtable
- Google Sheets
- AI Annotation Tools (e.g., LangSmith or similar proprietary platforms)
