Proceedings of the First International Conference on Advanced Scientific Innovation in Science, Engineering and Technology, ICASISET 2020, 16-17 May 2020, Chennai, India

Research Article

Automated Face Detection And Swapping In Video

Download809 downloads
  • @INPROCEEDINGS{10.4108/eai.16-5-2020.2303961,
        author={Jayant P. Patel and Amruth M. Shetty and Amar N. Vishwakarma and Vishakha  Shelke},
        title={Automated Face Detection And Swapping In Video},
        proceedings={Proceedings of the First  International Conference on Advanced Scientific Innovation in Science, Engineering and Technology, ICASISET 2020, 16-17 May 2020, Chennai, India},
        publisher={EAI},
        proceedings_a={ICASISET},
        year={2021},
        month={1},
        keywords={be student department of computer engineering universal college of engineering mumbai},
        doi={10.4108/eai.16-5-2020.2303961}
    }
    
  • Jayant P. Patel
    Amruth M. Shetty
    Amar N. Vishwakarma
    Vishakha Shelke
    Year: 2021
    Automated Face Detection And Swapping In Video
    ICASISET
    EAI
    DOI: 10.4108/eai.16-5-2020.2303961
Jayant P. Patel1,*, Amruth M. Shetty1, Amar N. Vishwakarma1, Vishakha Shelke2
  • 1: BE Student ,Department of Computer Engineering, Universal college of Engineering, Mumbai
  • 2: Assistant Professor, Department of Computer Engineering, Universal college of Engineering, Mumbai
*Contact email: jayantpatel275@gmail.com

Abstract

Face was used as one of the normal behaviors for identifying humans. It generally stays a challenge to cause a computer framework to carry on like how a human senses things. We have made our application to help and simulate the visualization of a human’s imagination of Deep Fake videos. The entire face swapping project is divided into three stages, the first stage extracts the frames from a video file. The Second stage includes face detection and landmark extraction from frames for which we have used the getfrontalface() and predictor() function of dlib library in Python which tells us whether a face is present in an image and also provides us the landmarks of the facial features. In the third stage, we use Delaunay triangulation and affine transformation to find the triangles by their index values and the coordinates of the triangles then these triangles are matched and swapped from one face to another. Finally, the application will generate frames with swapped faces, which are further combined into a video file.