Department of Education awards $102.8M contract for NAEP cognitive item development to Educational Testing Service
Contract Overview
Contract Amount: $102,835,756 ($102.8M)
Contractor: Educational Testing Service
Awarding Agency: Department of Education
Start Date: 2013-03-07
End Date: 2019-05-31
Contract Duration: 2,276 days
Daily Burn Rate: $45.2K/day
Competition Type: FULL AND OPEN COMPETITION
Number of Offers Received: 2
Pricing Type: COST PLUS AWARD FEE
Sector: R&D
Official Description: "CRITICAL FUNCTIONS" IGF::CT::IGF THE CONTRACTOR DEVELOPS COGNITIVE ITEMS AND SCORING RUBRICS AND STUDENT, TEACHER, AND SCHOOL SURVEY QUESTIONS FOR THE OPERATIONAL ASSESSMENTS, PILOT TESTS, AND SPECIAL STUDIES REQUIRED BY THE NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS (NAEP) FOR THE 2013-2017 PROCUREMENT CYCLE. THE CONTRACTOR SHOULD PURSUE A CREATIVE, EFFICIENT, AND INNOVATIVE APPROACH TO DEVELOPING HIGH QUALITY ITEMS THAT ARE ALIGNED TO THE NAEP FRAMEWORKS, EFFICIENTLY MEASURE STUDENT PERFORMANCE, AND MEET THE UPCOMING CHALLENGE OF TECHNOLOGY-BASED AND/OR ADAPTIVE TESTING.
Place of Performance
Location: PRINCETON, MERCER County, NEW JERSEY, 08540
Plain-Language Summary
Department of Education obligated $102.8 million to EDUCATIONAL TESTING SERVICE for work described as: "CRITICAL FUNCTIONS" IGF::CT::IGF THE CONTRACTOR DEVELOPS COGNITIVE ITEMS AND SCORING RUBRICS AND STUDENT, TEACHER, AND SCHOOL SURVEY QUESTIONS FOR THE OPERATIONAL ASSESSMENTS, PILOT TESTS, AND SPECIAL STUDIES REQUIRED BY THE NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS (NAEP) FOR… Key points: 1. Contract focuses on developing cognitive items, scoring rubrics, and surveys for NAEP assessments. 2. Emphasis on creative, efficient, and innovative approaches to meet evolving testing challenges. 3. Educational Testing Service, a major player in educational assessment, is the contractor. 4. The contract spans five years, covering the 2013-2017 procurement cycle.
Value Assessment
Rating: good
The contract value of $102.8 million over five years for specialized educational assessment development appears reasonable given the scope and duration. Benchmarking against similar large-scale educational research and development contracts would provide further context.
Cost Per Unit: N/A
Competition Analysis
Competition Level: full-and-open
The contract was awarded under full and open competition, suggesting a competitive bidding process. This method is generally expected to yield fair pricing and identify the most capable contractor.
Taxpayer Impact: Taxpayer funds are being used for a critical national educational assessment program, aiming to improve educational measurement and understanding.
Public Impact
Enhances the quality and relevance of national educational assessments (NAEP). Supports the transition to modern, technology-based testing methods. Provides valuable data for understanding student performance across the nation. Contributes to educational research and policy development.
Waste & Efficiency Indicators
Waste Risk Score: 50 / 10
Warning Flags
- Potential for cost overruns in a cost-plus award fee contract.
- Ensuring innovation and quality are maintained throughout the contract duration.
Positive Signals
- Awarded through full and open competition.
- Contractor has extensive experience in educational testing.
- Focus on improving assessment quality and efficiency.
Sector Analysis
This contract falls within the Research and Development in the Social Sciences and Humanities sector. Spending in this area supports national data collection and analysis for educational policy and improvement.
Small Business Impact
The provided data does not indicate any specific provisions or impacts related to small business participation in this contract.
Oversight & Accountability
The Department of Education is responsible for overseeing this contract to ensure the development of high-quality assessment items and adherence to NAEP frameworks. Performance metrics and regular reviews are crucial for accountability.
Related Government Programs
- Research and Development in the Social Sciences and Humanities
- Department of Education Contracting
- Department of Education Programs
Risk Flags
- Contract duration is lengthy (over 5 years).
- Cost Plus Award Fee contract type can incentivize cost growth.
- Complexity of developing items for technology-based and adaptive testing.
- Reliance on a single contractor for critical assessment components.
Tags
research-and-development-in-the-social-s, department-of-education, nj, definitive-contract, 100m-plus
Frequently Asked Questions
What is this federal contract paying for?
Department of Education awarded $102.8 million to EDUCATIONAL TESTING SERVICE. "CRITICAL FUNCTIONS" IGF::CT::IGF THE CONTRACTOR DEVELOPS COGNITIVE ITEMS AND SCORING RUBRICS AND STUDENT, TEACHER, AND SCHOOL SURVEY QUESTIONS FOR THE OPERATIONAL ASSESSMENTS, PILOT TESTS, AND SPECIAL STUDIES REQUIRED BY THE NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS (NAEP) FOR THE 2013-2017 PROCUREMENT CYCLE. THE CONTRACTOR SHOULD PURSUE A CREATIVE, EFFICIENT, AND INNOVATIVE APPROACH TO DEVELOPING HIGH QUALITY ITEMS THAT ARE ALIGNED TO THE NAEP FRAMEWORKS, EFFICIENTLY MEASURE STUDENT PERFO
Who is the contractor on this award?
The obligated recipient is EDUCATIONAL TESTING SERVICE.
Which agency awarded this contract?
Awarding agency: Department of Education (Department of Education).
What is the total obligated amount?
The obligated amount is $102.8 million.
What is the period of performance?
Start: 2013-03-07. End: 2019-05-31.
How will the effectiveness of the developed cognitive items and rubrics be measured to ensure they accurately assess student performance?
The effectiveness will likely be measured through pilot testing, statistical analysis of item performance, alignment studies with NAEP frameworks, and expert reviews by educational assessment professionals. Feedback from teachers and students involved in pilot studies will also be crucial in refining the items and rubrics to ensure they are valid, reliable, and fair measures of student achievement.
What are the primary risks associated with transitioning to technology-based and adaptive testing for NAEP, and how does this contract address them?
Key risks include technical infrastructure challenges, ensuring equitable access for all students, developing robust adaptive algorithms, and maintaining data security. This contract addresses these by requiring innovative approaches to item development suitable for digital platforms and potentially adaptive testing, implying the contractor must develop items that function effectively in these new environments and align with future NAEP technological goals.
What is the long-term value proposition of investing in advanced cognitive item development for NAEP?
The long-term value lies in improving the precision and validity of national educational measurement, providing more nuanced insights into student learning, and enabling more effective educational interventions and policy decisions. By developing items aligned with modern cognitive science and adaptable to new technologies, NAEP can maintain its relevance and provide more accurate and actionable data for improving education nationwide.
Industry Classification
NAICS: Professional, Scientific, and Technical Services › Scientific Research and Development Services › Research and Development in the Social Sciences and Humanities
Product/Service Code: SPECIAL STUDIES/ANALYSIS, NOT R&D › SPECIAL STUDIES - NOT R and D
Competition & Pricing
Extent Competed: FULL AND OPEN COMPETITION
Solicitation Procedures: NEGOTIATED PROPOSAL/QUOTE
Solicitation ID: ED-IES-12-R-0021
Offers Received: 2
Pricing Type: COST PLUS AWARD FEE (R)
Evaluated Preference: NONE
Contractor Details
Address: 666 ROSEDALE RD STOP 85 D, PRINCETON, NJ, 08541
Business Categories: Category Business, Corporate Entity Tax Exempt, Nonprofit Organization, Not Designated a Small Business, Special Designations, U.S.-Owned Business
Financial Breakdown
Contract Ceiling: $103,721,138
Exercised Options: $103,721,138
Current Obligation: $102,835,756
Actual Outlays: $1,674,165
Subaward Activity
Number of Subawards: 58
Total Subaward Amount: $11,192,032
Contract Characteristics
Multi-Year Contract: Yes
Commercial Item: COMMERCIAL PRODUCTS/SERVICES PROCEDURES NOT USED
Cost or Pricing Data: NO
Timeline
Start Date: 2013-03-07
Current End Date: 2019-05-31
Potential End Date: 2020-03-30 00:00:00
Last Modified: 2026-01-16
More Contracts from Educational Testing Service
- National Assessment of Educational Progress Platform Development Contract for the National Center for Educational Statistics, Institute of Education Sciences, Within the Department of Education — $125.5M (Department of Education)
- "critical Functions" Igf::ct::igf Design National Assessment of Educational Progress (naep) Assessment Instruments and Sample Design Specifications That Meet the Highest Industry and Nces Standards for Providing Valid and Useful National, Regional, State, and School District Results AS Well AS for Significant Subgroups; Analyze Data to Produce Statistics in ALL Assessed Areas and Targeted Special Reports Using Statistically and Psychometrically Rigorous Methodologies That Help in Detecting Quality Control Problems, Assist in the Understanding of Results and Make IT Possible to Focus on Relevant and Timely Educational Issues; Report Timely Assessments Results (I.E., Within SIX Months of the END of Data Collection for Reading and Mathematics AT Fourth and Eighth Grades and Within Twelve Months for ALL Other Assessments) in a WAY That Communicates Effectively With the General Public and Other Stakeholders, Including Those More Technically Sophisticated; Provide Results in Printed and Web-Based Formats — $108.8M (Department of Education)
- National Assessment of Educational Progress Design, Analysis, and Reporting Contract for the National Center for Education Statistics, Institute of Education Sciences, Within the Department of Education — $96.9M (Department of Education)
- National Assessment of Educational Progress Item Development Contract for the National Center of Education Statistics, Institute of Education Sciences, Within the Department of Education — $79.8M (Department of Education)
- Naep DAR Component — $70.7M (Department of Education)
Other Department of Education Contracts
- Administrative Action — $2.2B (Conduent Education Solutions, LLC)
- - Tivod Supports the Origination, Disbursement, and Reporting of Title IV Federal Student AID Programs, Including - BUT NOT Limited to - Direct Loans, Pell Grants, and the Teacher Education Assistance for College and Higher Education Grants. the Title IV Solution Shall Also Provide Ongoing Support for the Discontinued Title IV Federal Student AID Programs, Including - BUT NOT Limited to - Academic Competitiveness Grants and National Science and Mathematics Access to Retain Talent Grants — $1.5B (Accenture Federal Services LLC)
- Federal Student AID Common Origination and Disbursement Services — $1.1B (Accenture LLP)
- Provide Direct Loan Services Such AS Call Center and Financial Reporting - Nelnet From 12/15/2019 Through 12/14/2020 — $983.7M (Nelnet Servicing LLC)
- Debt Management and Collections System (dmcs) Igf::ct::igf — $906.9M (Maximus Federal Services, Inc.)