About Olivia Kelly
Work across AI response evaluation, content systems, retrieval readiness, workflow design, and product content operations.
Current focus: diagnosing and improving the knowledge systems that AI-supported workflows depend on — evaluating AI response quality, assessing knowledge base readiness for retrieval, and designing lightweight operating models for content teams.
Previous work includes content strategy, knowledge management, and product content operations across enterprise and product teams in technology and professional services.
This portfolio documents methods and case studies from that work — organized as a knowledge base rather than a project list.
Tools and environments
Tools and environments include Oracle APEX, Oxygen XML Editor, DITA, Markdown, Oracle Cloud Infrastructure AI services, OpenSearch-informed search workflows, Adobe Analytics, Google Search Console, Excel/CSV-based evaluation workflows, and prompt-based LLM evaluation.
Current learning and research areas include RAG evaluation methods, LLM-as-judge workflows, RAGAS-style metrics, and observability patterns for AI-enabled content systems.