Showcase keyboard and mouse image

Hello, I’m Olivia.
I design systems to evaluate and improve AI-generated content.

I focus on improving GenAI response quality through structured content, evaluation frameworks, and testing systems. My work connects content, data, and AI to help teams understand what’s working—and what’s not.

Contact
Showcase keyboard and mouse image
Profile Picture

Who am I?

I design systems that improve the quality of AI-generated responses.

My background spans technical content, analytics, and process design. I’ve built evaluation frameworks, reporting systems, and internal tools that help teams measure and improve how AI systems perform.

Earlier in my career, I worked in DITA XML environments and business intelligence, where I focused on structuring information and surfacing insights through data. That foundation now informs my work in AI evaluation and content systems.

About Me

Education

2004-2006
Portland State University
Master of Science, Technical Communication
2000-2003
Sonoma State University
Bacheolor of Arts, English
Jan 2019 - Dec 2019
Business Intelligence Analyst
McAfee
Jan 2013 - Jan 2019
Content Manager/Publications Specialist
McAfee
July 2010 - Dec 2013
Project Manager
RH + M3

Experience

I work at the intersection of content, systems, and teams to turn messy problem spaces into structured, repeatable solutions.

My experience includes designing workflows, defining standards, and building tools that support content creation, evaluation, and delivery. I’ve partnered across roles to align on goals, translate ambiguity into clear processes, and implement solutions that scale.

I tend to focus on problems where structure, data, and user experience intersect—especially when the path forward isn’t fully defined.

LinkedIn Download My Resume

Projects

Analysis
Content
Design
Strategy
Technical Support

Design GenAI Evaluation System for Response Quality

Designed and built a system to evaluate and improve AI-generated responses using structured scoring, test cycles, and reporting.

Case Study
Design & Create Reporting Capabilities

Design & Create Reporting Capabilities

Designed and built Power BI dashboard reports for Information Development

Case Study

Improve Usability of Reference Guide

Rewrote and reorganized DITA Elements and Outputs Reference Guide

Case Study
Improve Usability of Reference Guide
Design & Implement Process to Solve Costly Problems

Design & Implement Process to Solve Costly Problems

Designed, developed, and implemented auditing and training program to solve costly time and resource issues at time of Localization.

Case Study

Contact

Phone Number

(503)724-1160

Email

olivia@oliviakelly.io

Address

Portland, OR