Experience
2025 — Now
Seattle, Washington, United States
• Up-skill org-wide workforce of project managers on LLM efficiencies by developing and facilitating training
• Pilot scaled self-serve LLM development tools for content evaluation and providing engineering feedback for tooling improvements
• Evolve workforce (e.g., vendors, contractors) strategies to enable faster LLM development by creating a replicable execution playbook
• Develop LLM evaluation criteria (e.g., rater/human agreement, model confidence scores) and processes for consistent measurement across projects within the sub-org
2023 — 2024
Seattle, Washington, United States
• Managed $14M human content labeling operations across 7 global sites and 15 languages
• Led end-to-end operations for high-volume human content labeling workflows to develop and refine machine learning classifiers for harm detection on Facebook, Instagram, and Threads.
• Translated complex policy goals into precise annotation guidelines and scalable workflows.
• Iterated on content labeling guidelines grounded in policy, product requirements, and ML model needs—balancing edge case clarity with labeling efficiency. Trained and calibrated global reviewer teams to ensure consistency and alignment with classifier objectives.
• Enabled launch of LLM as content labeler, automating 20% of labels and saving $2.1M in OpEx.
• Partnered with engineering to zero-shot and fine-tune LLM through ground truth evaluation and prompt revision
• Developed high-judgment team of expert content reviewers and established rigorous qualitative analytical processes to evaluate LLM performance and improve model precision/recall through prompt iteration
2021 — 2023
Seattle, Washington, United States
• Capacity plan and forecast of a multi-million dollar annual budget
• Vendor manage of outsourced human labeling; maintaining efficiency and quality metrics. Increased quality metrics by 2x within 6 months, leading to higher confidence in machine learning data sets.
• Mitigate risk and improve customer trust of recommended content across Facebook and Instagram platforms.
• Partner with engineering and product teams to roadmap and develop machine learning solutions that scale detection of harmful content.
• Collaborate with legal and policy managers to ensure both accurate enforcement and scalable human labeling operations.
2020 — 2021
2020 — 2021
Seattle, Washington, United States
• Manage an international team of 13 content reviewers, responsible for global content policy adherence, compliance, and risk-mitigation of design content submitted for Amazon's Print-On-Demand service
• Scaled to manage a 36% YoY increase in design volume by developing tech feature requests, optimizing processes, and refining content moderation policy
• Grew team 62% to support marketplace expansion; extending language and localization support for the US, UK, DE, FR, IT, ES, and JP
• Onboarded new-hires by facilitating virtual instructor led training, conducting regular knowledge checks, and auditing performance to identify gaps and develop proficiency.
• Utilize machine learning models to scale detection of content defects, fraudulent content, and emerging issues
• Manage keyword repository and rule taxonomy for proactive detection of infringing metadata
2019 — 2020
2019 — 2020
Greater Seattle Area
• Prime Day category captain, orchestrated a multi-channel integrated marketing plan including affiliates, search, PR, email, event sponsorship, and onsite merchandising placements to increase traffic 92.7% YoY and drive $19MM incremental sales in 2 days
• Experiential marketing experience opening AmazonBasics Pop-Up stores in 6 locations nationwide, managing all program elements including agency relations, budget, and timeline.
• Television integrated marketing experience with Lifetime’s Military Makeover partnership, managing the production team relations, brand communication, product curation and procurement, budget, and timeline.
• Head ASIN Productivity program manager, assessed P&L to identify high velocity products to support with incremental marketing initiatives to amplify conversion
• Led seasonal and event initiatives by curating merchandised selection, creating storefronts, crafting brand messaging, and developing traffic drivers in order to drive incremental e-commerce sales
• Commercialized new-to-market AmazonBasics furniture, home, kitchen, sporting goods, and electronics product launches for optimal customer experience and brand consistency
• Digital advertising lead managing campaigns for tent pole AmazonBasics products across all categories
Education
University of Washington