Google, Inc. : 2014 – 2018

Senior Program Manager,  Engineering Education, University Relations : 2017-2018

• Evaluating University Relations programs, metrics and dashboard lead
• Co-editor of Google AI research blog and Twitter feed (1.1M+ followers)
• Lead researcher on IT Support Professional Certificate program with Coursera
• Advisor on social impact studies including Gallup and CS education initiatives
• Founded CS Impact Network for CS/STEM education evaluators

Education Outreach Evaluation Manager, People Operations: 2014-2017

Internal
● Set up teams to evaluate Google’s K-12 outreach and social impact programs
● Managed $1.5M total budget over 3 years adding 2+ headcount and 20% budget increases
● Developed 15+ contracts worth $1.03M and managed completion by 9 contractors
● Contributed to Gallup surveys and reports on CS education
● Created study of Google-influenced tv shows leading to funding and USA today article
● Lead analyst and author for Women who Choose CS study and CS4HS teacher study
● Created “Basics of Evaluation” 2 hour class and delivered 9 times to 25+ Google teams
● Co-designed evaluations using worksheet approach with 12+ Google teams
● Launched internal go/evalhelp site w/300+ viewers in 12+ states and 150+ self-study views

External
● Offered evaluation worksheet for external use (tinyul.com/evalworksheet-google)
● Taught graduate level evaluation course 2x at Pacifica Graduate Institute
● Advised NSF evaluation capacity grants (across 3 directorates), CSNYC/CSforALL, others
● Taught EduOnAir: Empowering leaders-Introducing best practices in program evaluation
● American Evaluation Association, STEM Education TIG board, blogger for aea365.org
● Workshop leader for AEA and the American Educational Research Association twice
● Founded CS Outreach Program Evaluation Network (CS OPEN) for nonprofits
● Work featured in 2016 CSEdWeek blog, 2015 and 2017 White House commitments

Lead Consultant, Evaluation and Research Professionals (self-employed) : 2013 – 2014

• Created Salesforce dashboards to secure funding for continued CRM implementation
• Developed study proposals w/data requests for national and state-level testing agencies
• Anticipated client needs with analysis of organizational mission and information audit
• Served on advisory board for corporate review of online course evaluation strategies
• Generated and studied survey measures for a private school admissions
• Completed Institutional Review Board duties overseeing innovation (I3) grant in Oakland
• Guest lecturer with Associate Professor offer from Beijing Normal University, China

Director of Research, Buck Institute for Education : 2001 – 2013

• Helped fuel BIE’s strong reputation, ability to scale, and sustained growth for 12 years
• Established user-centered design w/formative evaluation of products and services
• Enabled growth from 3 to 10+ staff w/30 consultants, and $.5M to over $20M income
• Co-authored PBL Handbook, sold 20,000+ and translated to 7 languages
• Provided instructional design expertise (e.g., PBL-Online.org, teacher workshops, etc.)
• Conducted quantitative and qualitative studies of design, use and impacts
• Ran state-level study of PBL & 21st century learning w/West Virginia Dept. of Education
• Created National Study of PBL & High School Reform with reports for 4 reform networks
• Led Problem Based Economics study with UCLA/CRESST resulting in IES-funded study
• Chaired AERA SIG on PBL and produced study of 58 researchers in 19 states, 5 countries
• Published articles and blogs (e.g., w/Grand Prairie ISD, TX on AEA365.org)
• Led development and roll out of organization-wide Salesforce CRM w/Form Assembly

 Postdoc & Visiting Scholar, UC-Berkeley & SRI International :  2000 – 2001

• Oversaw assessment seed grants and CILT conference for 50+ leading researchers
• Taught online course on technology-supported assessments 2x to 30+ students
• Included auto-essay grading, auto-score concept maps, search path analysis charts
• Added value in online course giving developers feedback and a replication model
• Co-developed handheld collaboration assessment with rubrics and real-time reporting
• Validated measures w/video cases, rater agreement, focus groups, and classroom pilots
• Ran committee on innovation readiness measures for re-use in national/regional studies

Research Specialist, UC-Irvine, Ctr for Res. on Info Tech in Orgs (CRITO) : 1998 – 2000

• Completed post-doc on NSF/DOE-funded Teaching, Learning & Computing: 1998 survey
• Analyzed weighted data from 4000+ using representative and purposive samples
• Developed measures using SPSS for factor analysis, reliability, and predictive validity
• Supported replication including using SPSS scripts and codebooks
• Helped write winning PT3 grants for UCI school of education
• Co-taught graduate-level education research methods courses

Lead Instructional Designer,  GTE Internetworking (formerly BBN) :  1997 – 1998

• Designed logistics software training for services overseen by Joint Chiefs of Staff (TC-AIMS II)

  National School Network staff,  BBN Educational Technologies : 1994 – 1997

• National School Network Testbed 2 staff
• Online Internet Institute evaluator
• Site Feedback Form for Educators developer

 Computer Teacher, Medford Public Schools :  1993 – 1994

• Taught computer lab classes in high school (3 days a week) and elementary (2 days)

Assistant to President & Consultant, Management Strategies : 1989 – 1993

• Helped sole proprietor in highly competitive information strategies consulting business
• External: Coordinated executive sales, client relations, proposals, 4GL databases
• Internal: Coordinated recruiting, payroll, files and databases in dBase-Clipper