This paper proposes an efficient reconfigurable hardware design of sound source localization system using one microphone pair. We have used time delay of arrival (TDOA) algorithm using phase transform (PHAT) to achieve time difference between the microphone signals. Phased transform (PHAT) based filter can reach high SNR gains, which makes it very suitable for localizing the sound source in a microphone array system. Our design has implemented on Spartan6 Lx45 FPGA and presented the implementation results in terms of accuracy and speech quality. We compare the original angle between the microphones to the resultant angle between the microphones and observed that proposed design provides very sharp accuracy in every corresponding angle. We also compare the speech quality of proposed design signal with normal delayed signal. The evaluation infers that our proposed hardware induce feasible for hand-held devices. © Springer Nature Singapore Pte Ltd 2017.