# D4D Evaluation Summary Report

Generated: 2025-11-21T11:37:24.054360

## Overview

Total evaluations: 17

Projects evaluated: AI_READI/docs_aireadi_org_docs-2, AI_READI/docs_google_com_document-d, AI_READI/doi, AI_READI/doi_row2, AI_READI/doi_row9, AI_READI/fairhub, AI_READI/fairhub_row10, AI_READI/fairhub_row13, CHORUS/CHoRUS for Equitable AI - github, CHORUS/aim-ahead-bridge2ai-for-clinical-care-informational-webinar, CM4AI/dataverse_10.18130_V3_B35XWX, CM4AI/dataverse_10.18130_V3_F3TD5R, CM4AI/doi, CM4AI/doi_row3, VOICE/healthnexus, VOICE/healthnexus_row13, VOICE/physionet_b2ai-voice_1.1

Methods evaluated: gpt5


## Overall Scores

### Rubric10 Scores (0-50)

| Project | Curated | GPT-5 | Claude Code |
|---------|---------|-------|-------------|
| AI_READI/docs_aireadi_org_docs-2 | N/A | 12.0 (24.0%) | N/A |
| AI_READI/docs_google_com_document-d | N/A | 2.0 (4.0%) | N/A |
| AI_READI/doi | N/A | 0.0 (0.0%) | N/A |
| AI_READI/doi_row2 | N/A | 4.0 (8.0%) | N/A |
| AI_READI/doi_row9 | N/A | 4.0 (8.0%) | N/A |
| AI_READI/fairhub | N/A | 2.0 (4.0%) | N/A |
| AI_READI/fairhub_row10 | N/A | 5.0 (10.0%) | N/A |
| AI_READI/fairhub_row13 | N/A | 4.0 (8.0%) | N/A |
| CHORUS/CHoRUS for Equitable AI - github | N/A | 6.0 (12.0%) | N/A |
| CHORUS/aim-ahead-bridge2ai-for-clinical-care-informational-webinar | N/A | 6.0 (12.0%) | N/A |
| CM4AI/dataverse_10.18130_V3_B35XWX | N/A | 13.0 (26.0%) | N/A |
| CM4AI/dataverse_10.18130_V3_F3TD5R | N/A | 11.0 (22.0%) | N/A |
| CM4AI/doi | N/A | 1.0 (2.0%) | N/A |
| CM4AI/doi_row3 | N/A | 4.0 (8.0%) | N/A |
| VOICE/healthnexus | N/A | 2.0 (4.0%) | N/A |
| VOICE/healthnexus_row13 | N/A | 7.0 (14.0%) | N/A |
| VOICE/physionet_b2ai-voice_1.1 | N/A | 37.0 (74.0%) | N/A |

### Rubric20 Scores (varies by max)

| Project | Curated | GPT-5 | Claude Code |
|---------|---------|-------|-------------|
| AI_READI/docs_aireadi_org_docs-2 | N/A | 38.0/84 (45.2%) | N/A |
| AI_READI/docs_google_com_document-d | N/A | 8.0/84 (9.5%) | N/A |
| AI_READI/doi | N/A | 0.0/84 (0.0%) | N/A |
| AI_READI/doi_row2 | N/A | 10.0/84 (11.9%) | N/A |
| AI_READI/doi_row9 | N/A | 10.0/84 (11.9%) | N/A |
| AI_READI/fairhub | N/A | 8.0/84 (9.5%) | N/A |
| AI_READI/fairhub_row10 | N/A | 14.0/84 (16.7%) | N/A |
| AI_READI/fairhub_row13 | N/A | 10.0/84 (11.9%) | N/A |
| CHORUS/CHoRUS for Equitable AI - github | N/A | 20.0/84 (23.8%) | N/A |
| CHORUS/aim-ahead-bridge2ai-for-clinical-care-informational-webinar | N/A | 20.0/84 (23.8%) | N/A |
| CM4AI/dataverse_10.18130_V3_B35XWX | N/A | 38.0/84 (45.2%) | N/A |
| CM4AI/dataverse_10.18130_V3_F3TD5R | N/A | 30.0/84 (35.7%) | N/A |
| CM4AI/doi | N/A | 4.0/84 (4.8%) | N/A |
| CM4AI/doi_row3 | N/A | 10.0/84 (11.9%) | N/A |
| VOICE/healthnexus | N/A | 8.0/84 (9.5%) | N/A |
| VOICE/healthnexus_row13 | N/A | 14.0/84 (16.7%) | N/A |
| VOICE/physionet_b2ai-voice_1.1 | N/A | 51.0/84 (60.7%) | N/A |

## Method Comparison


### GPT5
- Average Rubric10: 14.1%
- Average Rubric20: 20.5%
- Evaluations: 17