Trec Assessors LLC

Trec Assessors LLC, a woman-owned, minority-owned small disadvantaged business based in Gaithersburg, Maryland, provides specialized human relevance assessment and system output evaluation services to the National Institute of Standards and Technology (NIST) as a pure prime contractor (100% of recent awards), with no subcontractor footprint across its entire 147-award portfolio. The firm competes predominantly under Total Small Business set-asides on NIST's research evaluation programs and operates as a limited liability company.

Trec Assessors delivers human relevance judgments, benchmarking metrics, and technical assessments across NIST's signature evaluation initiatives: the Text Retrieval Conference (TREC), Text Video Retrieval Evaluation (TRECVID), and Text Analysis Conference (TAC). Work encompasses information retrieval evaluation, retrieval augmented generation (RAG) assessment, entity extraction, generative AI evaluation, visual question answering, and multilingual retrieval tasks. Recent representative delivery orders include a $34,784.64 order from NIST on September 14, 2026, for TREC change detection forecasting; a $43,327.95 delivery order in August 2025 for TREC RAG task evaluation; and a $70,761.95 order in August 2025 for the Recognizing Ultra-Fine-Grained Entities, Events, and Relations (RUFEERS) task. All work is performed at the contractor's North Potomac, Maryland facility on firm fixed-price terms.

Customer concentration is extreme: NIST accounts for 129 of 147 awards (99% of award count) and $7.6 million of $8 million combined potential value (95%). The Defense Advanced Research Projects Agency and the Department of Defense National Security Agency provide marginal diversification through 13 and 4 awards respectively, totaling $326 thousand. The vendor sits on three NIST IDIQs: a $1.5 million single-award vehicle (contract 1333ND21DNB770031) originally awarded October 1, 2021, and running through September 2026, which anchors 56 task orders valued at $1.7 million; a second NIST IDIQ (DOCSB134116CQ0025) supporting 50 task orders at $992 thousand; and a third vehicle (DOCSB134111CQ0019) supporting 24 task orders at $735 thousand.

Activity has declined moderately in recent years — 14 awards in 2024 and 10 in 2025, followed by 5 awards year-to-date in 2026 — but the portfolio carries minimal recompete risk, with only one award (potential value $10 thousand) reaching ultimate completion within the next twenty-four months. The firm's entire footprint is allocated across NIST evaluation research with no exposure to defense contracting prime work, leaving it dependent on NIST's continued funding of TREC, TRECVID, and TAC programs and vulnerable to consolidation of those research initiatives or shift to alternative evaluation methodologies.

TREC Assessors LLC provides experienced evaluation support to government entities investigating advanced retrieval and natural language processing capabilities.