Speech brain-computer interfaces (BCIs) convert neural activity into language to restore communication for people with paralysis and enable new human-computer interaction methods. However, the field lacks a standardized measure of progress due to inconsistent datasets, recording methods, speech types, and vocabularies across systems, making reported scores rarely comparable. Researchers highlight the need to resolve two unresolved questions underlying this measurement problem.