# Validated D4D Agent Processing Report

Generated: 2025-10-30 23:35:38

## Overall Summary

- **Files processed**: 15
- **Errors**: 29
- **Skipped**: 0

## Validation Summary

- **Downloads successful**: 39
- **Downloads failed**: 5
- **Content relevant to project**: 33
- **Content with limited relevance**: 6

## Results by Column

### AI_READI

**Validation Results:**
- Downloads: 5 successful, 2 failed
- Relevance: 1 relevant, 4 limited

#### Successfully Processed

- ✅ `docs_aireadi_org_docs-2_row9.txt` → `docs_aireadi_org_docs-2_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 8 (found: ai-readi, diabetes, fairhub)
- ✅ `s42255-024-01165-x_row3.pdf` → `s42255-024-01165-x_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ⚠️ Limited relevance to AI_READI
- ✅ `e097449.full_row2.pdf` → `e097449.full_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ⚠️ Limited relevance to AI_READI
- ✅ `zenodo_org_records-10642459_row10.txt` → `zenodo_org_records-10642459_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ⚠️ Limited relevance to AI_READI
- ✅ `google_doc_1rJsa5kySlBRRNhsO_WY7N3bfSKtqDi-Q_row12.pdf` → `google_doc_1rJsa5kySlBRRNhsO_WY7N3bfSKtqDi-Q_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ⚠️ Limited relevance to AI_READI

#### Errors

- ❌ `fairhub_dataset_2_tab_access_row11.txt` (stage: download_validation): Content appears to be incomplete or invalid
- ❌ `fairhub_dataset_2_row11.txt` (stage: download_validation): Content appears to be incomplete or invalid

### CHORUS

**Validation Results:**
- Downloads: 2 successful, 0 failed
- Relevance: 2 relevant, 0 limited

#### Successfully Processed

- ✅ `github_chorus_ai_row9.pdf` → `github_chorus_ai_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 4 (found: chorus)
- ✅ `aim-ahead-bridge2ai-for-clinical-care-informational-webinar_row8.pdf` → `aim-ahead-bridge2ai-for-clinical-care-informational-webinar_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 4 (found: bridge2ai)

### CM4AI

**Validation Results:**
- Downloads: 12 successful, 0 failed
- Relevance: 10 relevant, 2 limited

#### Successfully Processed

- ✅ `dataverse_10.18130_V3_B35XWX_tab_versions_row15.txt` → `dataverse_10.18130_V3_B35XWX_tab_versions_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 16 (found: cm4ai, microscopy, imaging, cellular, dataverse)
- ✅ `biorxiv_2024.05.21.589311v1_row4.pdf` → `biorxiv_2024.05.21.589311v1_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ⚠️ Limited relevance to CM4AI
- ✅ `creativecommons_org_licenses-by-nc-sa_row14.txt` → `creativecommons_org_licenses-by-nc-sa_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ⚠️ Limited relevance to CM4AI

#### Errors

- ❌ `dataverse_10.18130_V3_F3TD5R_tab_versions_row18.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 214, column 50:
     ... jects: No. De-identified Samples: Yes. FDA Regulated: No.
                                         ^
- ❌ `dataverse_10.18130_V3_B35XWX_tab_metadata_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 611, column 494:
     ... e-Relevant Cell Lines. 2024. doi: http://doi.org/10.1101/2024.05 ... 
                                         ^
- ❌ `dataverse_10.18130_V3_F3TD5R_tab_files_row18.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 188, column 65:
     ... -02-27; release publication date: 2025-07-01
                                         ^
- ❌ `dataverse_10.18130_V3_F3TD5R_tab_metadata_row18.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 190, column 147:
     ... e-Relevant Cell Lines. 2024. doi: http://doi.org/10.1101/2024.05 ... 
                                         ^
- ❌ `dataverse_10.18130_V3_B35XWX_tab_files_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 174, column 57:
     ... te: 2025-02-27; Publication date: 2025-03-03. Dataset to be augm ... 
                                         ^
- ❌ `dataverse_10.18130_V3_F3TD5R_row18.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 184, column 50:
     ... jects: No; De-identified Samples: Yes; FDA Regulated: No
                                         ^
- ❌ `dataverse_10.18130_V3_B35XWX_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 160, column 57:
     ... te: 2025-02-27; publication date: 2025-03-03. The collection wil ... 
                                         ^
- ❌ `dataverse_10.18130_V3_B35XWX_tab_terms_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 219, column 176:
     ... -Relevant Cell Lines." 2024. doi: http://doi.org/10.1101/2024.05 ... 
                                         ^
- ❌ `dataverse_10.18130_V3_F3TD5R_tab_terms_row18.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 168, column 50:
     ... jects: No; De-identified Samples: Yes; FDA Regulated: No. Data G ... 
                                         ^

### VOICE

**Validation Results:**
- Downloads: 20 successful, 3 failed
- Relevance: 20 relevant, 0 limited

#### Successfully Processed

- ✅ `healthnexus_tab_2_row15.txt` → `healthnexus_tab_2_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 21 (found: voice, b2ai-voice, bridge2ai voice, vocal, speech, health data nexus)
- ✅ `healthnexus_tab_usage-notes_row15.txt` → `healthnexus_tab_usage-notes_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 21 (found: voice, b2ai-voice, bridge2ai voice, vocal, speech, health data nexus)
- ✅ `github_eipm_bridge2ai-docs_row21.json` → `github_eipm_bridge2ai-docs_row21_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 4 (found: voice, bridge2ai voice)
- ✅ `physionet_b2ai-voice_1.1_row16.txt` → `physionet_b2ai-voice_1.1_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 28 (found: voice, b2ai-voice, bridge2ai voice, vocal, speech, physionet, health data nexus)
- ✅ `drive_google_com_B2AI_Voice_DTUA_row13.pdf` → `drive_google_com_B2AI_Voice_DTUA_d4d.yaml`
  - Download: ✅ Success
  - Relevance: ✅ Score 4 (found: voice)

#### Errors

- ❌ `healthnexus_tab_acknowledgements_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 182, column 32:
        - Required training: TCPS 2: CORE 2022
                                   ^
- ❌ `healthnexus_tab_files_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 208, column 32:
        - Required training: TCPS 2: CORE 2022.
                                   ^
- ❌ `healthnexus_tab_background_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 299, column 34:
          - Required training: TCPS 2: CORE 2022
                                     ^
- ❌ `healthnexus_tab_description_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 243, column 32:
        - Required training: TCPS 2: CORE 2022.
                                   ^
- ❌ `docs_b2ai-voice_org_row21.txt` (stage: download_validation): File too small (55 bytes)
- ❌ `healthnexus_tab_documentation_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 221, column 34:
          - Required training: TCPS 2: CORE 2022
                                     ^
- ❌ `healthnexus_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 161, column 32:
        - Required training: TCPS 2: CORE 2022.
                                   ^
- ❌ `healthnexus_tab_methods_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 185, column 32:
        - Required training: TCPS 2: CORE 2022
                                   ^
- ❌ `healthnexus_tab_release-notes_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 167, column 32:
        - Required training: TCPS 2: CORE 2022
                                   ^
- ❌ `healthnexus_tab_conflicts-of-interest_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 342, column 32:
        - Required training: TCPS 2: CORE 2022
                                   ^
- ❌ `healthnexus_tab_references_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 244, column 32:
        - Required training: TCPS 2: CORE 2022.
                                   ^
- ❌ `healthnexus_tab_metadata_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 217, column 32:
        - Required training: TCPS 2: CORE 2022.
                                   ^
- ❌ `healthnexus_tab_abstract_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 205, column 32:
        - Required training: TCPS 2: CORE 2022
                                   ^
- ❌ `healthnexus_tab_versions_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 213, column 32:
        - Required training: TCPS 2: CORE 2022.
                                   ^
- ❌ `healthnexus_tab_ethics_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 164, column 32:
        - Required training: TCPS 2: CORE 2022.
                                   ^
- ❌ `google_doc_row12.html` (stage: download_validation): Content appears to be incomplete or invalid
- ❌ `healthnexus_tab_citationModal_row15.txt` (stage: d4d_processing): Invalid YAML generated: mapping values are not allowed here
  in "<unicode string>", line 230, column 97:
     ... 64/qb6h-em84; latest version DOI: https://doi.org/10.57764/3sg0-7440
                                         ^
- ❌ `github_eipm_bridge2ai-docs_README_row21.md` (stage: download_validation): Content appears to be incomplete or invalid

