Forget Physical Keyboards: Meta’s Surface Touch Typing Technology Turns Any Surface into a Virtual Keyboard
Mark Zuckerberg shows off his 100 WPM typing speed on a virtual keyboard in VR.
Meta claims to have developed a breakthrough text decoding technique that enables touch typing on any flat surface.
The technique uses a temporal convolutional network to translate hand motion into text characters, without any physical or capacitive keys.
The technique also incorporates a language model and a beam search algorithm to deal with finger drift and erratic hand movements.
Meta’s method outperforms contact-based techniques in terms of text decoding accuracy and achieves parity with physical keyboard typing.
Meta collected a dataset from 20 touch typists and tested their model on various benchmarks, including contact-based text decoding and traditional physical keyboard typing.
Meta’s method achieved an average speed of 73 WPM with an impressive 2.38% uncorrected error rate.
Meta’s method eliminates the need for physical keyboards or capacitive touch interfaces, resulting in a seamless and efficient typing experience.
Meta’s method showcases its dedication to advancing text entry methods for VR and AR environments.
Meta’s method represents a significant leap from its earlier technology, such as PinchType, which averaged a mere 12 WPM.