Real Time Person Removal

2020: Release of the program

At the end of February, 2020 the web engineer from Google Jason Mayes published source codes of the Real Time Person Removal program which is capable to delete people with video in real time on the GitHub portal, replacing their images with background elements.

This code tries to learn structure of a background of video over time to delete from a frame of any person — Meayes on GitHub wrote. — All this occurs in real time in the browser using the system of machine learning TensorFlow.

The program erasing people with video in real time is created

TensorFlow is the program developed by Google open source used for machine learning and applications of neural network. The Mayesa program takes the personnel from the webcam, copies them, and then scans the copy regarding figures of the person. If the program notices a subject which identifies as the person, it covers his figure with the image elements with the empty room taken from the previous personnel. Then software sends the corrected video, already without people, to the user's browser.

The solution it is possible to check online on own webcam via the website Glitch.com or Codepen.io, having included JavaScript support in the browser. Software works not at once and before your figure disappears from a frame, it is necessary to resemble a little in front of the camera. Mayes reminds that his development is only experimental, so, on the image some artifacts will be all the same noticeable. Besides, the source code of the application is available to downloading and modification by everyone, it is necessary to notify on it the author only.^[1]

The solution is far from an ideal, and users can easily distinguish the pixelated circuits of the body moving on the "empty" room. However similar programs are, as a rule, incapable to work with video in real time and usually do not cope with a difficult, not monophonic background, unlike Mayes's software.^[2]

Notes