Résumés, degrees, interviews, references, and prior titles all carry useful information, but each is partial, context-sensitive, and vulnerable to bias.

Employers must predict future performance before they can observe it, so hiring will always depend on imperfect signals. Structured interviews, job-knowledge tests, and well-designed work samples improve judgment, but none is a certainty machine. The defensible goal is plural evidence: structured assessment plus scoped work evidence—not one universal score.

Contents (6 sections)

Evidence snapshot

Supported by cited sources
FindingScope or qualification
Structured interviews show estimated validity around .42; job-knowledge tests around .40; work samples around .33.Revised personnel-selection literature; estimates are moderate, not perfect.
Academic performance correlates about .21 with job performance and .34 with training performance.2024 meta-analysis; education still has broad value.
Identical résumés with White-sounding names received 50% more callbacks in a landmark audit.Specific experimental context; later large-scale work also found racialized contact penalties.
Recent-graduate underemployment was 42.5% in 2025 Q4.New York Fed occupational definition; not evidence that degrees have no value.

What the evidence does not prove

Supported by cited sources

Structured selection can be meaningfully predictive, degrees have strong average labor-market value, and work samples can impose unpaid burdens or reward prior familiarity. One artifact should never become a universal capability judgment.

Why different stakeholders can care

Proposed

Employers want fewer false positives and false negatives; applicants want relevant access; educators want demonstrated ability recognized; and civil-rights institutions want structured, job-related selection.

Question to investigate

Open question

What The Solar Guild must test

Research question

Does a work-result record from The Solar Guild improve structured employer judgment beyond a normal résumé without increasing bias, burden, or reviewer disagreement?

Core sources

Supported by cited sources
Revised predictor-validity findingsAcademic performance and employment outcomesBertrand and Mullainathan résumé auditNew York Fed — College Labor MarketEEOC — Uniform Guidelines

References and limits

This page is published by The Solar Guild. Sources are listed so readers can inspect the basis of the page. A project statement is not independent proof unless the page identifies supporting outside evidence.

  • Problem 2 in The Solar Guild — Twenty Problems Worth Testing v1.0
  • Direct source links are provided above; quantitative claims retain their stated scope and qualification
  • The Solar Guild's response is explicitly separated from evidence that the problem exists