Showcase keyboard and mouse image

Hello, I’m Olivia.
I design systems that make quality, experience, and AI performance measurable.

My work sits at the intersection of content, evaluation, and workflow design. I build frameworks, tools, and measurement approaches that help teams understand what’s working, what isn’t, and where to improve.

View Case Studies
Showcase keyboard and mouse image
Profile Picture

Who am I?

I design systems that help teams evaluate and improve complex content and AI-driven experiences.

My background spans technical content, analytics, process design, and internal tools. I’ve built evaluation frameworks, reporting systems, and content-quality approaches that turn messy, ambiguous problems into structured, usable systems.

Earlier in my career, I focused on DITA XML, publishing workflows, and business intelligence. That foundation now informs my work in AI evaluation, content operations, and measurement design.

About Me

Education

2004-2006
Portland State University
Master of Science, Technical Communication
2000-2003
Sonoma State University
Bachelor of Arts, English
May 2022 - April 2026
Product Manager / Information Architect
Oracle
Jan 2022 - May 2022
Project Manager / Technical Writer
Intel
June 2020 - Jan 2022
Program Manager
ePromos Promotional Products

Experience

I work at the intersection of content, systems, and teams to turn ambiguous problem spaces into structured, repeatable solutions.

My experience includes designing workflows, defining standards, building internal tools, and creating measurement approaches that help teams improve quality and performance over time.

I’m especially drawn to problems where user experience, structured information, and system behavior all intersect.

LinkedIn Download My Resume

Case studies

A selection of work focused on AI evaluation, content systems, and measurement design. These projects show how I turn scattered signals and ambiguous problems into structured approaches that teams can use.

Live case study

Writer Experience: measuring usability across tools

Designed a repeatable approach for measuring Writer Experience using SUS, qualitative feedback, and cycle-based evaluation to track improvement over time.

UX measurement evaluation design cross-tool systems
Read case study
Live case study

GenAI evaluation system for response quality

Designed and built a structured evaluation system to assess AI-generated responses, using standardized scoring, test cycles, and reporting to turn subjective output into measurable quality signals.

AI evaluation APEX app measurement systems
Read case study
Live case study

RAG content readiness framework

Defined practical content guidelines and evaluation thinking to improve how technical documentation is retrieved, interpreted, and reused by AI systems.

RAG content systems standards
Read case study

Contact

Phone Number

(503)724-1160

Email

olivia@oliviakelly.io

Address

Portland, OR