Wifi: how to detect human presence

Sobrón Polancos, Iker

EHUko Bilboko Ingeniaritza Eskolako ikertzailea

Landa Sedano, Iratxe

EHUko Bilboko Ingeniaritza Eskolako irakaslea

In the era of wireless communications, in addition to connectivity, communication systems offer other services. For example, mobile phones can position without GPS. In this sense, wifi systems also manage to detect human presence through artificial intelligence. In this article, firstly, we will explain how the wifi signal is displayed when there are people involved. Below we present an expert system of counting the number of people in a room, based on the wifi signal, and in relation to this system we will show different fields of application. For example, care for older people.
wifi-radarra-nola-hauteman-gizakiaren-presentzia
Figure . Reflection and refraction processes: the blue arrows represent the reflection of two rays and the yellow arrows that cross the person, the refraction process.

The wifi signal: besides being a communication system, it is a radar

Currently we can find the wifi connection anywhere in a city. In wifi communication, Wi-Fi devices use RF electromagnetic waves to share data. That is, when we download a video from Youtube or send an email, the invisible radio frequency waves that contain information will make different displacements between the electronic device (a computer, a mobile, etc.) and the router antenna of our environment. On this path of expansion, airborne waves can hit and cross walls, people, or other objects in the environment. The processes of entablation and crossing are called reflections and refractions. Normally, each reflection or refraction process is represented by lightning between connected devices. In this way we can call the collection of all rays as a wireless communication channel. The channel has great importance in the level and quality of the wifi signal received. Therefore, if we observe the signal that reaches the wifi receiver, we can extract a great information about the wireless communication channel and therefore about the environment [1].

In fact, when a person moves between the transmitter and the receiver of a wifi communication, you can change the level of the wifi signal. Especially because a person's presence in radio broadcasting is an obstacle, which can cause changes in the wireless communication channel. That is, each new ray can produce power changes in the received signal. Therefore, if we analyze the incidents of the signal level that is received, we can know what happens around a router. Among others, the number of people in this environment.

When a room is empty, the direct beam between emitter and receiver will be the main one. Therefore, the signal normally received will be stable over time. However, when some people move inside the room, the rays that model the wifi signal will vary direction or intensity depending on the number of obstacles found. Therefore, different signal characteristics can be investigated to know the wireless channel. For example, power level, phase and signal amplitude, Doppler frequency, etc. The analysis of how these characteristics vary over time allows us to assess what has caused them.

Figure . There are three situations in a room: an empty room, a friend and two friends. The right side shows the actual signal levels a receiver receives in each state for 15 seconds. The images show that the more people around a wifi communication, the more fluctuations appear at the level of signal received.

Precisely, in the TSR Lab research group we are investigating how we can exploit wireless channel measurements to detect human presence and quantify the number of people. To do this, we analyze the behavior of the channel using mathematical tools. For example, statistics, information theory, frequency analysis and spectral analysis are the most widely used tools. The results obtained through mathematical analysis are used to feed an expert system that counts the number of people.

Artificial intelligence to count the number of people

In recent years artificial intelligence is increasingly present in our lives. Every day we can find examples such as voice recognition systems, automatic translators or sending personalized ads to Internet users. An artificial intelligence system is only a computer based on observation and reasoning, capable of behaving in a human way. To do this, expert systems solve a problem using complex mathematical algorithms (neural networks, Bayesian networks, bioinspired algorithms) and formal logic, based on a series of parameters that measure the environment. Systems normally study observation statistics, looking for the most likely solution to solve a problem [2]. For example, a chess based expert system is introduced with numerous chess plays as observation. Thus, the system, through statistics, can find the best move and win the world chess champion.

Focusing on the detection of human presence, the expert system proposed by us is based on the ability to count people close to the coverage area of the wifi communications system. In this case, the observations of the system are electrical signals collected in the receiver antenna, generated by the radio waves that travel from the transmitter to the receiver. After mathematically learning the behavior of signals, an expert system collects the collected information and, using the acquired knowledge, determines the number of people in one place. The degree of success of the system will depend on the learning capacity of the expert system. And how can the system learn to perceive people? To do this we have to prepare the system so that it knows the appearance of the signals when there are one, two or more people in one place.

Figure . Structure of the expert system of detection of human presence by wireless signal wifi [2].

Let's take a simple example. Suppose a child who doesn't know how to tell we show him several photos in which two or more people appear and we show him the difference between those that appear two or more people. If we show another photo of two people to the trained child, surely that child will classify it well (there are two options: two or more people appear in the photo). We perform a procedure similar to the example given with the expert system, that is, we teach you what are the main characteristics of the wifi signal when in the environment studied there are between zero and four people. With this learning model, the developed expert system manages to classify 0-4 people in the middle, with average success odds of 87% and 84%, using neural networks [3] and support vector machines [2], respectively.

From the research point of view, one of the most important issues is the reliability of the system. At this time, the degree of failure is largely conditioned by the training and learning capacity of the expert system. In short, the diversity of environments that we can find in our field makes it necessary to adjust the system of perception of the human presence to different environments. To do this, it is necessary to take previous measures for each environment.

Applications of the human presence detection system

Table . Mixing matrix of the expert system based on SVM algorithms [2]. In the diagonal of the matrix appear the percentages of successes in green; outside the diagonal appear the percentages of errors with red tones. The best results would be to reach 100% diagonally and 0% off the diagonal.

As already mentioned, at this time anyone can find wifi connections in cities. Therefore, the proposed system could be used anywhere, with a wifi connection. Moreover, any wifi system is connected via the Internet. This means that anyone can access your system from anywhere in the world and therefore can know what happens in the environment of your wifi receiver.

In this sense, the main applications are related to remote monitoring. For example, the control of customers in stores [4], the detection of unauthorized entries [5] or the care of elderly people in sheltered homes [6]. However, in addition to the aforementioned applications, an expert system based on wifi signals could be developed for other types of monitoring, such as the identification of emotions (sadness, joy, anger) or the follow-up of breathing and heartbeat [7][8].

Bibliography

[1] S. D. Domenico, M. D. Sanctis, E. Cianca, F. Giuliano and G. Bianchi, “Exploring Training Options for RF Sensing Using CSI,” in IEEE Communications Magazine, vol. 56, no. 5, pp. 116-123, May 2018.
[2] I. Sobrón, J. From the Self, I. Eizmendi and M. Vélez, “Device-Free People Counting in IoT Environments: New Insights, Results and Open Challenges,” in IEEE Internet of Things Journal, Volume 64, Issue 6, December 2018, pp. 4396-4408.
[3] I. Sobrón, J. del Ser, I. Eizmendi and M. Vélez, “A Deep Learning Approach to Device-Free People Counting from WiFi Signals” in 12th International Symposium on Intelligent Distributed Computing (IDC 2018), Bilbao (Spain), October 2018.
[4] C. Wu, Z. Yang, Z. Zhou, X. Liu, Y. Liu, and J. Cao, “Non-invasive detection of moving and stationary human with WiFi,” in IEEE Journal on Selected Areas in Communications, vol. 33, no. 11, pp. 2329–2342, Nov 2015.
[5] S. D. Domenico, M. D. Sanctis, E. Cianca and M. Ruggieri, «WiFi-based through-the-wall presence detection of stationary and moving humans analyzing the doppler spectrum,» en IEEE Aerospace and Electronic Systems Magazine, vol. 33, no. 5-6, pp. 14-19, May-June 2018.
[6] S. Savazzi, S. Sigg, M. Nicholas, V. • Kianoush and U. Spagnolini, “Device-Free Radio Vision for Assisted Living: Leveraging wireless channel quality information for human sensing,” in IEEE Signal Processing Magazine, vol. 33, no. 2, pp. 45-58, March 2016.
[7] Z. Wang, B. Guo, Z. Yu and X. Zhou, “Wi-Fi CSI-Based Behavior Recognition: From Signals and Actions to Activities,” in IEEE Communications Magazine, vol. 56, no. 5, pp. 109-115, May 2018.
[8] X. Wang, C. Yang and S. Mao, “<unk> Beat: Exploiting CSI Phase Data for Vital Sign Monitoring with Commodity WiFi Devices,” in 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS), Atlanta, GA, 2017, pp. 1230-1239.
Babesleak
Eusko Jaurlaritzako Industria, Merkataritza eta Turismo Saila