A smart home vs an automated home
-
I did a blog post on my website about this topic and wanted to bring it up here to see what people thought of as far as a different realm of sensors. I'll start by talking a little about the topic title.
Some people just have automated homes, and others with more complex setups start touching on the topic of smart homes. What is the difference? Here is a scenario:
You normally wake up at 6:00 AM for work during the week, so you set up timers that do different things. At 5:55 AM you have the coffee pot turn on to automatically make you your morning coffee. At 6:00 AM, the alarm sounds and you turn some lights on in the house to be ready for when you get up. At 6:50 AM, the garage door automatically opens for you to leave for work. And at 6:55, the garage door closes and your house gets locked and the alarm sets itself.
A simple scenario that could be handled by home automation. What then makes an automated home a smart home? Data data and more data. The more data that you have your system collecting, the more informed decisions you can have it make. One of the things that I wanted to delve into with this post is occupancy sensing. To take that a step further, people sensing. I am not just talking about having motion sensors to tell you when someone walks by. I am talking full on people sensing. Your house knowing how many occupants are inside, but where each of these occupants are. This is one of the hardest parts of a true smart home. Lets look at the scenario that I mentioned above. Normally you wake up a 6:00 AM to go to work, but you decided some time ago that you would take a vacation day. Your system looks at your calendar and sees this and knows that you don't need to get up early, so it doesn't sound the alarm or turn on the coffee pot. What if the system not only knew that someone was in bed, but knew that it was you. So you slept in a little bit and wake up at 6:30 to start your day. Your automation system sees that you have gotten up, so it then starts the coffee pot. It knows that you have the day off, so it doesn't open and close the garage door, and it doesn't set the alarm.
What if your system not only knew you or other members of your family were home, but where in the house people were at any given time? What if your setup knew that you liked the temperature in a room at 70° F, but your wife liked it a bit cooler at 67° F. and could adjust the room temperature base on who was in the room. These are just some tip of the iceberg examples of things that make up a smart home. I used to be a user of a controller software called Open Source Automation (OSA). Here is a video from one of OSA's creators, Vaughn Rupp. https://youtu.be/KTLPAW9YCwM
So now on to my question, what are peoples thoughts on ways to do people sensing? It could be MySensors type ideas or others.
Vera Plus running UI7 with MySensors, Sonoffs and 1-Wire devices
Visit my website for more Bits, Bytes and Ramblings from me: http://dan.bemowski.info/ -
I did a blog post on my website about this topic and wanted to bring it up here to see what people thought of as far as a different realm of sensors. I'll start by talking a little about the topic title.
Some people just have automated homes, and others with more complex setups start touching on the topic of smart homes. What is the difference? Here is a scenario:
You normally wake up at 6:00 AM for work during the week, so you set up timers that do different things. At 5:55 AM you have the coffee pot turn on to automatically make you your morning coffee. At 6:00 AM, the alarm sounds and you turn some lights on in the house to be ready for when you get up. At 6:50 AM, the garage door automatically opens for you to leave for work. And at 6:55, the garage door closes and your house gets locked and the alarm sets itself.
A simple scenario that could be handled by home automation. What then makes an automated home a smart home? Data data and more data. The more data that you have your system collecting, the more informed decisions you can have it make. One of the things that I wanted to delve into with this post is occupancy sensing. To take that a step further, people sensing. I am not just talking about having motion sensors to tell you when someone walks by. I am talking full on people sensing. Your house knowing how many occupants are inside, but where each of these occupants are. This is one of the hardest parts of a true smart home. Lets look at the scenario that I mentioned above. Normally you wake up a 6:00 AM to go to work, but you decided some time ago that you would take a vacation day. Your system looks at your calendar and sees this and knows that you don't need to get up early, so it doesn't sound the alarm or turn on the coffee pot. What if the system not only knew that someone was in bed, but knew that it was you. So you slept in a little bit and wake up at 6:30 to start your day. Your automation system sees that you have gotten up, so it then starts the coffee pot. It knows that you have the day off, so it doesn't open and close the garage door, and it doesn't set the alarm.
What if your system not only knew you or other members of your family were home, but where in the house people were at any given time? What if your setup knew that you liked the temperature in a room at 70° F, but your wife liked it a bit cooler at 67° F. and could adjust the room temperature base on who was in the room. These are just some tip of the iceberg examples of things that make up a smart home. I used to be a user of a controller software called Open Source Automation (OSA). Here is a video from one of OSA's creators, Vaughn Rupp. https://youtu.be/KTLPAW9YCwM
So now on to my question, what are peoples thoughts on ways to do people sensing? It could be MySensors type ideas or others.
-
I did a blog post on my website about this topic and wanted to bring it up here to see what people thought of as far as a different realm of sensors. I'll start by talking a little about the topic title.
Some people just have automated homes, and others with more complex setups start touching on the topic of smart homes. What is the difference? Here is a scenario:
You normally wake up at 6:00 AM for work during the week, so you set up timers that do different things. At 5:55 AM you have the coffee pot turn on to automatically make you your morning coffee. At 6:00 AM, the alarm sounds and you turn some lights on in the house to be ready for when you get up. At 6:50 AM, the garage door automatically opens for you to leave for work. And at 6:55, the garage door closes and your house gets locked and the alarm sets itself.
A simple scenario that could be handled by home automation. What then makes an automated home a smart home? Data data and more data. The more data that you have your system collecting, the more informed decisions you can have it make. One of the things that I wanted to delve into with this post is occupancy sensing. To take that a step further, people sensing. I am not just talking about having motion sensors to tell you when someone walks by. I am talking full on people sensing. Your house knowing how many occupants are inside, but where each of these occupants are. This is one of the hardest parts of a true smart home. Lets look at the scenario that I mentioned above. Normally you wake up a 6:00 AM to go to work, but you decided some time ago that you would take a vacation day. Your system looks at your calendar and sees this and knows that you don't need to get up early, so it doesn't sound the alarm or turn on the coffee pot. What if the system not only knew that someone was in bed, but knew that it was you. So you slept in a little bit and wake up at 6:30 to start your day. Your automation system sees that you have gotten up, so it then starts the coffee pot. It knows that you have the day off, so it doesn't open and close the garage door, and it doesn't set the alarm.
What if your system not only knew you or other members of your family were home, but where in the house people were at any given time? What if your setup knew that you liked the temperature in a room at 70° F, but your wife liked it a bit cooler at 67° F. and could adjust the room temperature base on who was in the room. These are just some tip of the iceberg examples of things that make up a smart home. I used to be a user of a controller software called Open Source Automation (OSA). Here is a video from one of OSA's creators, Vaughn Rupp. https://youtu.be/KTLPAW9YCwM
So now on to my question, what are peoples thoughts on ways to do people sensing? It could be MySensors type ideas or others.
@dbemowsk there is some promising research using radar, single source, with multiple receivers in a T shape, in theory it is 3dimensional and whole house. Ill see if i can find the paper I read, i think there is similar work that uses of the shelf wifi gear.
Ive also looked into (and not found enough to do anything with) lower frequency rf,but it seems to require running wieenaround the room, and probably a grid on the floor. It also seemed similar to capacitive sensing, but i dont understand the science enough to truly claim that.
I tried to find research on what EM people absorb and emit, but didnt find much publically available. I dont like the idea of carrying a fevice around for tracking like this.
There are methods that are sensitive enough to detect respiration, used in fire detection that may be of use. Maybe extremely sensitive microphones that can detect heartbeats or footsteps. Some serious signal processing there, which maynlead to DSP devices or maybe some gpu acceleration.
Any of these could be doctorate earning projects, but I keep hoping . Things like intels movidius usb stick may make this stuff more accessible.
Sorry these arent much more than speculatiom, but it what I have found when looking for similar solutions.
Oh 2 more, multi "pixel" ir, omron makes some that are 4x4 or 1x8, several of these, or some kind of scanning to get enough resolutions, or maybe webcams and opencv type computer vision.
-
@dbemowsk there is some promising research using radar, single source, with multiple receivers in a T shape, in theory it is 3dimensional and whole house. Ill see if i can find the paper I read, i think there is similar work that uses of the shelf wifi gear.
Ive also looked into (and not found enough to do anything with) lower frequency rf,but it seems to require running wieenaround the room, and probably a grid on the floor. It also seemed similar to capacitive sensing, but i dont understand the science enough to truly claim that.
I tried to find research on what EM people absorb and emit, but didnt find much publically available. I dont like the idea of carrying a fevice around for tracking like this.
There are methods that are sensitive enough to detect respiration, used in fire detection that may be of use. Maybe extremely sensitive microphones that can detect heartbeats or footsteps. Some serious signal processing there, which maynlead to DSP devices or maybe some gpu acceleration.
Any of these could be doctorate earning projects, but I keep hoping . Things like intels movidius usb stick may make this stuff more accessible.
Sorry these arent much more than speculatiom, but it what I have found when looking for similar solutions.
Oh 2 more, multi "pixel" ir, omron makes some that are 4x4 or 1x8, several of these, or some kind of scanning to get enough resolutions, or maybe webcams and opencv type computer vision.
-
Maybe something like a lytro camera sould be adapted. If the data could be gathered live and processed quickly.....
-
Back when I was with the OSA project, one thing people were using was cell phone data. Not so easy for detecting what rooms people were in, but you could get some idea of who was home or not. I have also heard of people doing cool hacks with Microsoft Kinect cameras. Here is an example of some good motion sensing with kinect. https://www.youtube.com/watch?v=3-kZjkNIFxY
It's an interesting topic which is why I posted it. The key is gathering data. The more data you can gather, the better the chances you can figure out who is home and where they are in the house.
-
I suggest figuring out what would be the easiest way to try it out. If you like it, then maybe you're more inclined to try computer vision or something that's not so easy.
-
Hi, @dbemowsk
Interesting topic :) Not more than speculation here, just an idea - would be thermal cameras that would capture size and shape of subject. By the way kinect is also could be used for this purpose, and maybe even more easily available. Basically that would allow to easily count persons in the rooms, even in the bed - if you have decided just not to get up for some reason ;) Not sure if kineck could detect motionless person under blanket.
Another interesting add-on to the solution searching: Xandem alarm system. They claim that can detect and track more than one radio waves interfering object (subject). But they track changes in rf "net", so if someone just sleeps like a baby - not an option.
And if familiar with machine learning and video processing - I think possibilities becomes very foggy, but endless - some serious data processing and by shape, size etc. you can start recognising not that "if" someone in the room, but "who".
-
I know Amazon Echo can now recognize different voices, so it could be listening to see who's home?
@matt-shepherd Something I hadn't thought of. Nice idea. I do have an Amazon Echo in my living room. My only question on that is have they figured out a way to sparate 2 Amazon devices like an Echo in one room and a Dot in another room to know what room a sound came from? Last I checked, that was not possible.
I was looking into it a bit for other automation stuff like turning on a light in a room. For example, when I am in the living room and I say "turn the overhead light on", it turns on the living room overhead light. When I go into the office, where now I am being heard by the Dot, and I say the same phrase, it should turn the office overhead light on. From the reading that I have done, you can't use them that way, but it should be possible somehow.
-
Just read this.
https://www.theverge.com/2017/6/26/15876630/amazon-echo-alexa-room-intercom-house-calls-devices-dot-show
Sounds like Amazon actually IS looking to be able to define rooms. I could only hope that somewhere down the road that they add some of that data to the Alexa app for my Vera Plus. I could then script things by room. -
In the latest video of Andreas Spiess he is talking about presence detection with an esp32 by sniffing the wifi traffic. There are a number of commercial products that 2 or more can be installed to triangulate signals from smartphones wifi and Bluetooth (I had to install 3 of those in a Mercedes dealership, they were from Netgear if I remember well): basically there is a Master one and they talk to each other on their own separate wifi network; I think it is kind of a mesh network, because they can relay data of distant nodes to the Master device. Of course once installed they need to be calibrated by me standing in a known position with my smartphone in my hands and turning around 90° each time I was told to.
I would have liked too to have the home automation system to be aware of people in the house by the means of BT devices, but it is still in the to do list. As said before the data analysis is going to be tricky but it going to be the main subject of the following years, as more and more AI and machine learning cloud services are popping up (I did a quick peek on the IBM site and I got scared by the amount of services that are available and I will never be able to use, as my programming skills are not really the best) -
Just read this.
https://www.theverge.com/2017/6/26/15876630/amazon-echo-alexa-room-intercom-house-calls-devices-dot-show
Sounds like Amazon actually IS looking to be able to define rooms. I could only hope that somewhere down the road that they add some of that data to the Alexa app for my Vera Plus. I could then script things by room.@dbemowsk
I use mine with Openhab as they have a skill, and im waiting for the new ‘Routines’ to be released, I think Amazon are raising their game and along with the new Routines https://www.theverge.com/2017/9/27/16375050/alexa-routines-echo-amazon-2017 and now that it can recognise different voices https://www.theverge.com/circuitbreaker/2017/10/11/16460120/amazon-echo-multi-user-voice-new-feature it could help my house turn from Automated to Smart very soon. -
@dbemowsk
I use mine with Openhab as they have a skill, and im waiting for the new ‘Routines’ to be released, I think Amazon are raising their game and along with the new Routines https://www.theverge.com/2017/9/27/16375050/alexa-routines-echo-amazon-2017 and now that it can recognise different voices https://www.theverge.com/circuitbreaker/2017/10/11/16460120/amazon-echo-multi-user-voice-new-feature it could help my house turn from Automated to Smart very soon.@matt-shepherd If they can then get multi tiered location setup down, that would be awesome. By multi tiered location setup I mean being able to define say 2 houses, maybe a main home and a vacation home, and then have devices that have a defined parent, such as main home or vacation home. That would allow for say having two devices named living room light.
My only thought on that for occupancy sensing would be, what if you walked into the room and didn't say anything? None the less, it gets back to what I said about data, the more you have, the more informed your scripting decisions can be. One other thing, if you used multiple echos or dots, you would have to make sure that more than one device doesn't hear the command.
-
The question may turn out to be whether people are willing to accept less than perfect performance in exchange for occasionally more capability (when it works). I think Z-wave and x-10 were good examples (of unreliability) showing that's not what people want. People seem to prefer less capability, but have it work 100% of the time the way it's supposed to. At the very least, WAF is low on unreliable things.
-
http://people.csail.mit.edu/fadel/wivi/
Ok this is the one I was looking for
-
http://people.csail.mit.edu/fadel/wivi/
Ok this is the one I was looking for
@wallyllama interesting.
-
This sounds like a very do-able basic solution to counting the number of people in a room.
http://cocoontech.com/forums/topic/18483-room-occupancy-counters-need-help/
As the guy asks, how do you make it look nice. Would there be another way of doing the two beams? Small laser pointer modules perhaps?If you put these on every doorway in your house, you could get the logic down to where it would know a fairly exact count of how many people are in a room at any given time.
Vera Plus running UI7 with MySensors, Sonoffs and 1-Wire devices
Visit my website for more Bits, Bytes and Ramblings from me: http://dan.bemowski.info/ -
This sounds like a very do-able basic solution to counting the number of people in a room.
http://cocoontech.com/forums/topic/18483-room-occupancy-counters-need-help/
As the guy asks, how do you make it look nice. Would there be another way of doing the two beams? Small laser pointer modules perhaps?If you put these on every doorway in your house, you could get the logic down to where it would know a fairly exact count of how many people are in a room at any given time.
-
@dbemowsk search "see through walls with wifi". I suspect it could be mounted to the wall and covered with art or something transparent at 10ghz, or with loss of sensitivity in the wall itself.
@wallyllama Though I see future potential in this, I don't see it as anything that can be put into operation easily at this stage.
