Showcase keyboard and mouse image

Hello, I’m Olivia.
I design systems that make quality, experience, and AI performance measurable.

My work sits at the intersection of content, evaluation, and workflow design. I build frameworks, tools, and measurement approaches that help teams understand what’s working, what isn’t, and where to improve.

View Case Studies
Showcase keyboard and mouse image
Profile Picture

Who am I?

I design systems that help teams evaluate and improve complex content and AI-driven experiences.

My background spans technical content, analytics, process design, and internal tools. I’ve built evaluation frameworks, reporting systems, and content-quality approaches that turn messy, ambiguous problems into structured, usable systems.

Earlier in my career, I focused on DITA XML, publishing workflows, and business intelligence. That foundation now informs my work in AI evaluation, content operations, and measurement design.

About Me

Education

2004-2006
Portland State University
Master of Science, Technical Communication
2000-2003
Sonoma State University
Bachelor of Arts, English
Jan 2019 - Dec 2019
Business Intelligence Analyst
McAfee
Jan 2013 - Jan 2019
Content Manager / Publications Specialist
McAfee
July 2010 - Dec 2013
Project Manager
RH + M3

Experience

I work at the intersection of content, systems, and teams to turn ambiguous problem spaces into structured, repeatable solutions.

My experience includes designing workflows, defining standards, building internal tools, and creating measurement approaches that help teams improve quality and performance over time.

I’m especially drawn to problems where user experience, structured information, and system behavior all intersect.

LinkedIn Download My Resume

Case studies

A selection of work focused on AI evaluation, content systems, and measurement design. These projects show how I turn scattered signals and ambiguous problems into structured approaches that teams can use.

Live case study

Writer Experience: measuring usability across tools

Designed a repeatable approach for measuring Writer Experience using SUS, qualitative feedback, and cycle-based evaluation to track improvement over time.

UX measurement evaluation design cross-tool systems
Read case study
Coming next

GenAI evaluation system for response quality

Built an internal framework and application for evaluating AI-generated responses through structured scoring, test cycles, and reporting.

AI evaluation APEX app measurement systems
Case study in progress
Coming next

RAG content readiness framework

Defined practical content guidelines and evaluation thinking to improve how technical documentation is retrieved, interpreted, and reused by AI systems.

RAG content systems standards
Case study in progress

Contact

Phone Number

(503)724-1160

Email

olivia@oliviakelly.io

Address

Portland, OR