The latest articles on Forem by Maxwell (@maxwellmanga). https://forem.com/maxwellmanga https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F1111688%2Feda2d885-e17e-4415-826a-df1855837347.jpeg https://forem.com/maxwellmanga en Maxwell Sat, 01 Jul 2023 21:40:32 +0000 https://forem.com/maxwellmanga/speech-calculator-interface-through-transformer-model-52kl https://forem.com/maxwellmanga/speech-calculator-interface-through-transformer-model-52kl <p>Since the rising of Transformers Models in 2017, numerous applications are observed from different domains from Natural Language Processing(NLP) to Automatic Speech Recognition (ASR). In this article, We will propose a tool based on Transformer Model to solve Mathematical Word Problems (MWP). Concretely the designed tool proposed will be for arithmetic expression evaluation, a subclass of MWP.<br> We call this tool Voice Calculator Interface (VCI). The design of VCI is given in the figure below.</p> <p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fpmjrx1vp3dihkxd5ckjh.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fpmjrx1vp3dihkxd5ckjh.png" alt="Image description" width="800" height="326"></a></p> <p>Voice Calculator Interface flowVCI processes arithmetic expressions from a speech. Similar to a physical calculator the user can order calcul by its voice. no more needed to type just speak :).</p> <p>It uses a transformer-based technology to transcribe a voice from a speech. The related transformer is Openai/Whisper this large language model permit extraction of a text from a speech, at considerable precision. Openai/Whisper was obtained from the Hugging Face model repository, you can access the model <a href="https://huggingface.co/openai/whisper-medium" rel="noopener noreferrer">here</a> <a href="https://huggingface.co/openai/whisper-medium" rel="noopener noreferrer">https://huggingface.co/openai/whisper-medium</a> Thanks for this community.<br> The transcribed text should be an arithhmetic expression. or example, as five plus three times five became (5 + 3*5), if the transcribed text doesn't have sens in terms of calcculation VCI rejects.<br> the transcribed text is then parsed to extract atoms of the calculus expression from its alphabet. The atoms are organized into categories:</p> <ol> <li>- <strong>Operators</strong>: Represent basic arithmetic expressions +, -,*, /</li> <li>- <strong>Functions</strong>: Represent a set of functions based command</li> <li>- <strong>Unit</strong>: Represent the set of natural numbers from 1 to 9</li> <li>- <strong>Tense</strong>: Union of the set of natural number multiples of 10 and the set of numbers from 10 to 19.</li> <li>- <strong>Others</strong>: Set of numbers in hundred, thousand, million</li> </ol> <p>After atoms are extracted in the expression, VCI evaluates the expression and gives the result.<br> The aim of VCI tool is to act as a Brain-Computer Interface for calculus, to solve decidable Maths Word Problems.</p> <p>The repository of the project can be found here <a href="https://github.com/MaxwellNM/voice-calculator-interface" rel="noopener noreferrer">https://github.com/MaxwellNM/voice-calculator-interface</a></p> ai deeplearning