DEMONSTRATION OF VISUAL-BASED AND AUDIO-BASED HCI SYSTEM

Priya Rathore, Anjali Khatri, Aparna Pushpad, Swekcha Jain

Abstract: This paper is an attempt to provide a bird’s eye view to the concept of Human Compute Interaction (HCI). The intention is to focus on the uni-modal architecture of HCI; especially the HCI system based on visual-based and color-based communication channels viz-a-viz color recognition and speech recognition. We have developed a Graphical User Interface (GUI) for the same using MATLAB; one push button assigned for color input (through webcam) and the other push button assigned for speech input (through microphone). In color recognition, primary colors i.e. RGB are detected in frames captured in real time or images uploaded offline. Subsequently, desired operation is executed (we have set commands to open D drive). In speech recognition, audio input through microphone is compared with a pre-stored audio file and then an operation is performed automatically (here, we have set commands to open Google web browser). The respective algorithms of these two processes have been described with flow-charts and snapshots of MATLAB results have been displayed.

Keywords: Human Computer Interaction, Uni-Modal Architecture, Color Recognition, Speech Recognition

DOI: https://doi.org/10.15623/ijret.2016.0504065