Brain-to-text decoding: A non-invasive approach via typing
We present Brain2Qwerty, a deep learning model that decodes full sentences from non-invasive brain recordings (EEG and MEG) as participants type memorized sentences. In a cohort of 35 volunteers, Brain2Qwerty achieved an average character error rate of 32% with MEG and 67% with EEG, reaching 19% for the best individuals and generalizing to unseen sentences. Analyses reveal contributions from both motor and higher cognitive processes. These results bring non-invasive brain decoding closer to invasive neuroprostheses, paving the way for safe communication interfaces for patients unable to speak or move.