Data Scientist, GenAI Studio

College Board – Data Science/Strategy

Remote

*This is a full-time employee role with an initial one-year term

About the Team 

The Strategy Team is responsible for developing and executing the strategic vision and direction of the College Board. We work closely with the executive leadership team, business units, and external partners to identify opportunities and challenges, evaluate options, and implement solutions that advance our mission of expanding access to higher education. Our expertise is applying analytical frameworks, data-driven insights, and innovative thinking to address complex and dynamic issues in the education sector. We are a diverse and collaborative team of strategists, analysts, and project managers who enjoy learning from each other and sharing our knowledge and skills. Our team culture is based on trust, respect, and continuous improvement. We celebrate our successes and learn from our failures. We are passionate about making a positive impact on students, educators, and society. 

The GenAI Studio is a new initiative co-led by Strategy and Data Science to create the conditions necessary to responsibly experiment with and make informed decisions about generative AI with the goal of capitalizing on innovation that advances our work with students, educators, and members.

About the Opportunity  

As a Data Scientist for our GenAI Studio initiative, you are passionate about applying new ideas and technologies to creatively solve challenging, real-world problems. You are an early-adopter who is enthusiastic about finding high-value applications for emerging tools and new technology. You are highly capable at evaluating large data sets and telling a story with data. You are versatile, adaptable, and comfortable with uncertainty and ambiguity. You are resourceful and able to forge ahead even when faced with incomplete information. While representing our Data Science functional team, you will work day-to-day within our Strategy team where you will experiment with different generative AI techniques and tools to find the best solution for the students and teachers who use our services. You will work on cross-functional projects that involve data analysis, machine learning, natural language processing, large language models, model evaluation, and more. You will also help us define and build infrastructure to support rapid prototyping and testing of AI solutions. You will have the opportunity to learn from and collaborate with other data scientists, strategists, analysts, and project managers who share your passion for innovation and impact.

In this role, you will:

Prototype new tools leveraging emerging technologies and models (50%)

• Engage directly with users and stakeholders to deeply understand needs

• Creatively solution to rapidly test hypotheses using emerging AI technologies

• Independently manage and complete all the work needed to deliver in a rapid-prototyping environment

• Build out preliminary infrastructure to communicate with various APIs

• Craft basic user interfaces to test out ideas

• Create customized or multi-staged models to address nuanced use cases

• Engage in prompt engineering as appropriate

Evaluate generative AI models and tools (30%)

• Utilize state of the art techniques to evaluate the performance of off-the-shelf, open source, and custom models leveraging and enhancing our existing governance framework

• Judiciously evaluate the effectiveness and fairness of models and articulate considerations and concerns around implementing models in the context of the business application

Learning, ideating, and sharing (20%)

• Keep abreast of rapid technological developments and relevant product offerings, especially within the Generative AI space

• Workshop new ideas with the immediate team and program stakeholders

• Share knowledge of new developments with the team via chats, recurring meetings, and presentations when appropriate

• Communicate clearly with non-technical stakeholders to enhance their understanding of what the technology is and is not capable of

About You 

You have:

• 5+ years’ experience working in business and technology including experience as a Data Scientist with a primary focus on user-facing products

• Proven experience in developing Machine Learning, Deep Learning, and Generative AI solutions to solve real-world problems

• Programming expertise in Python and/or R

• Experience in data and statistical analysis including experience working with and evaluating text data

• Experience with SQL and NoSQL databases

• Knowledge of Agile

• Knowledge in developing applications on a Serverless or Microservices cloud platform (AWS/Azure/GCP, etc.)

• Excellent communication and listening skills with comfort presenting to both technical and business audiences, including senior leadership

• Eagerness to develop deep understanding of the problems students, educators, and College Board employees face in order to best address them

• Bachelor’s degree in a quantitative discipline or computer science preferred, Master’s degree a strong plus

• Authorization to work in the U.S.

About Our Process  

• Application review will begin the first week of January 2024 and will continue until the position is filled  

• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.   

About Our Benefits and Compensation 

College Board offers a competitive benefits and compensation program that attracts top talent looking to make a difference in education. As a self-sustaining non-profit, we believe in compensating employees equitably in relation to each other, their qualifications, their impact, and the relevant market.  

The hiring range for a new employee in this position is $144,000 to $157,000.  Your salary will be carefully determined based on your location, relevant experience, the external labor market, and the pay of College Board employees in similar roles. College Board strives to provide our best offer up front based on these criteria.  

Your salary is only one part of all that College Board offers, including but not limited to:    

• A comprehensive package designed to support the well-being of employees and their families and promote education. Our robust benefits package includes health, dental, and vision insurance, generous paid time off, paid parental leave, fertility benefits, pet insurance, tuition assistance, retirement benefits, and more 

• Recognition of exceptional performance through annual bonuses, salary growth over time through market increases, and opportunities for merit raises and promotions based on increased scope of responsibility 

• A job that matters, a team that cares, and a place to learn, innovate and thrive 

You can expect to have transparent conversations about benefits and compensation with our recruiters throughout your application process. 

About Our Culture 

Our community matters, and we strive to practice and improve our culture daily. Here are some headlines: 

• We are motivated to positively impact the educational and career trajectories of millions of students a year. 

• We prioritize building a diverse and inclusive team where every employee can thrive, and every voice is heard. 

• We welcome staff to join any or all six of our affinity groups: ARISE (Alliance for Asian Retention, Inclusion, Success, and Engagement; DIASPORA (Alliance for Pan-African Success and Achievement); Pride (alliance for LGBTQ+ staff and allies); Resilience (alliance for Native staff and advocates); SALSA (Staff Alliance for Latinx Success and Achievement); and WIN (Women’s Impact Network).  

• We value learning and growth; we offer formal and informal ways to lead through your superpowers, sharpen your strengths, and meet your development goals. 

Our high-performing engineers work with the latest technologies, so you will be constantly learning and sharpening your skills.  

#LI-MS1

#LI-REMOTE