Forget Physical Keyboards: Meta’s Surface Touch Typing Technology Turns Any Surface into a Virtual Keyboard

Mark Zuckerberg shows off his 100 WPM typing speed on a virtual keyboard in VR.

Meta claims to have developed a breakthrough text decoding technique that enables touch typing on any flat surface.

The technique uses a temporal convolutional network to translate hand motion into text characters, without any physical or capacitive keys.

The technique also incorporates a language model and a beam search algorithm to deal with finger drift and erratic hand movements.

Meta’s method outperforms contact-based techniques in terms of text decoding accuracy and achieves parity with physical keyboard typing.

Meta collected a dataset from 20 touch typists and tested their model on various benchmarks, including contact-based text decoding and traditional physical keyboard typing.

Meta’s method achieved an average speed of 73 WPM with an impressive 2.38% uncorrected error rate.

Meta’s method eliminates the need for physical keyboards or capacitive touch interfaces, resulting in a seamless and efficient typing experience.

Meta’s method showcases its dedication to advancing text entry methods for VR and AR environments.

Meta’s method represents a significant leap from its earlier technology, such as PinchType, which averaged a mere 12 WPM.