Skip to content
  • MySensors
  • OpenHardware.io
  • Categories
  • Recent
  • Tags
  • Popular
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Announcements
  3. 💬 Building a Raspberry Pi Gateway

💬 Building a Raspberry Pi Gateway

Scheduled Pinned Locked Moved Announcements
1.1k Posts 173 Posters 423.1k Views 131 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • O otto001

    @MasMat : what does your mysgw.log show?

    MasMatM Offline
    MasMatM Offline
    MasMat
    wrote on last edited by
    #858

    @otto001
    Syslog:

    Mar 21 20:06:05 DietPi systemd[1]: Started MySensors Gateway daemon.
    Mar 21 20:06:05 DietPi mysgw: Starting gateway...
    Mar 21 20:06:05 DietPi mysgw: Protocol version - 2.2.0
    Mar 21 20:06:05 DietPi mysgw: MCO:BGN:INIT GW,CP=RNNGL---,VER=2.2.0
    Mar 21 20:06:05 DietPi mysgw: TSF:LRT:OK
    Mar 21 20:06:05 DietPi mysgw: TSM:INIT
    Mar 21 20:06:05 DietPi mysgw: TSF:WUR:MS=0
    Mar 21 20:06:05 DietPi mysgw: TSM:INIT:TSP OK
    Mar 21 20:06:05 DietPi mysgw: TSM:INIT:GW MODE
    Mar 21 20:06:05 DietPi mysgw: TSM:READY:ID=0,PAR=0,DIS=0
    Mar 21 20:06:05 DietPi mysgw: MCO:REG:NOT NEEDED
    Mar 21 20:06:05 DietPi mysgw: MCO:BGN:STP
    Mar 21 20:06:05 DietPi mysgw: MCO:BGN:INIT OK,TSP=1
    Mar 21 20:06:05 DietPi mysgw: GWT:RMQ:MQTT RECONNECT
    Mar 21 20:06:05 DietPi mysgw: connected to 127.0.0.1
    Mar 21 20:06:05 DietPi mysgw: GWT:RMQ:MQTT CONNECTED
    Mar 21 20:06:05 DietPi mysgw: GWT:TPS:TOPIC=mysensors-out/0/255/0/0/18,MSG SENT
    

    Where is mysgw.log?

    1 Reply Last reply
    0
    • O Offline
      O Offline
      otto001
      wrote on last edited by
      #859

      @MasMat : I just forgot, that I reconfigured rsyslogd to log mysgw to a different file. syslog is correct.

      I do not use mqtt for mysensors yet, but the syslog seems good?

      1 Reply Last reply
      0
      • Richard van der PlasR Offline
        Richard van der PlasR Offline
        Richard van der Plas
        wrote on last edited by
        #860

        Was pointed here from another post, having serious issues with high CPU utilization op the gateway, is there any workaround and the moment?

        top:

        asks: 157 total,   2 running, 155 sleeping,   0 stopped,   0 zombie
        %Cpu(s):  2.5 us, 23.0 sy,  0.0 ni, 74.3 id,  0.1 wa,  0.0 hi,  0.0 si,  0.0 st
        KiB Mem :   949580 total,   448732 free,   146912 used,   353936 buff/cache
        KiB Swap:   102396 total,   102396 free,        0 used.   737656 avail Mem 
        
          PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND                                                                                                                                         
          337 root      20   0   20492   1060    932 R 100.0  0.1  28:54.55 mysgw                                                                                                                                           
         3947 pi        20   0    8248   3324   2736 R   1.6  0.4   0:00.82 top                                                                                                                                             
          447 homeass+  20   0  340112  63684   9916 S   1.0  6.7   3:28.71 hass                                                                                                                                            
            7 root      20   0       0      0      0 S   0.3  0.0   0:04.18 rcu_sched                                                                                                                                       
          767 root      20   0  126572   8628   6544 S   0.3  0.9   0:00.95 piplight-daemon                                                                                                                                      
        
        PRETTY_NAME="Raspbian GNU/Linux 9 (stretch)"
        NAME="Raspbian GNU/Linux"
        VERSION_ID="9"
        VERSION="9 (stretch)"
        Linux raspberrypi 4.9.59-v7+ #1047 SMP Sun Oct 29 12:19:23 GMT 2017 armv7l GNU/Linux
        

        Rebooting the pi sometimes helps, sometimes freezes the pi
        seeing nothing strange in the mysensors log what so ever
        running MySensors Version 2.2.0
        and Home Assistant Version 0.64.0
        Anyone can point me in the direction where to troubleshoot this further ?
        its not a high traffic gateway (around 10 sensors connected of which 5 updating every 15 minutes)

        mfalkviddM 1 Reply Last reply
        0
        • Richard van der PlasR Richard van der Plas

          Was pointed here from another post, having serious issues with high CPU utilization op the gateway, is there any workaround and the moment?

          top:

          asks: 157 total,   2 running, 155 sleeping,   0 stopped,   0 zombie
          %Cpu(s):  2.5 us, 23.0 sy,  0.0 ni, 74.3 id,  0.1 wa,  0.0 hi,  0.0 si,  0.0 st
          KiB Mem :   949580 total,   448732 free,   146912 used,   353936 buff/cache
          KiB Swap:   102396 total,   102396 free,        0 used.   737656 avail Mem 
          
            PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND                                                                                                                                         
            337 root      20   0   20492   1060    932 R 100.0  0.1  28:54.55 mysgw                                                                                                                                           
           3947 pi        20   0    8248   3324   2736 R   1.6  0.4   0:00.82 top                                                                                                                                             
            447 homeass+  20   0  340112  63684   9916 S   1.0  6.7   3:28.71 hass                                                                                                                                            
              7 root      20   0       0      0      0 S   0.3  0.0   0:04.18 rcu_sched                                                                                                                                       
            767 root      20   0  126572   8628   6544 S   0.3  0.9   0:00.95 piplight-daemon                                                                                                                                      
          
          PRETTY_NAME="Raspbian GNU/Linux 9 (stretch)"
          NAME="Raspbian GNU/Linux"
          VERSION_ID="9"
          VERSION="9 (stretch)"
          Linux raspberrypi 4.9.59-v7+ #1047 SMP Sun Oct 29 12:19:23 GMT 2017 armv7l GNU/Linux
          

          Rebooting the pi sometimes helps, sometimes freezes the pi
          seeing nothing strange in the mysensors log what so ever
          running MySensors Version 2.2.0
          and Home Assistant Version 0.64.0
          Anyone can point me in the direction where to troubleshoot this further ?
          its not a high traffic gateway (around 10 sensors connected of which 5 updating every 15 minutes)

          mfalkviddM Offline
          mfalkviddM Offline
          mfalkvidd
          Mod
          wrote on last edited by
          #861

          @richard-van-der-plas the best workaround so far is in the post I linked to.

          1 Reply Last reply
          0
          • M mvader

            @gohan said in 💬 Building a Raspberry Pi Gateway:

            @masmat have you tried with ethernet gateway? If I have time I'll try the mqtt this weekend

            @mvader I never noticed that.... is it the mqtt GW?

            I'm not using mqtt.
            for debug purposes i use MYSController
            every 10 seconds on the dot. it shows me the version of the gateway.

            201	3/15/2018 20:47:15	RX	0 - Gateway	INTERNAL	C_INTERNAL	NO	I_VERSION	2.2.0
            202	3/15/2018 20:47:25	RX	0 - Gateway	INTERNAL	C_INTERNAL	NO	I_VERSION	2.2.0
            203	3/15/2018 20:47:35	RX	0 - Gateway	INTERNAL	C_INTERNAL	NO	I_VERSION	2.2.0
            204	3/15/2018 20:47:45	RX	0 - Gateway	INTERNAL	C_INTERNAL	NO	I_VERSION	2.2.0
            205	3/15/2018 20:47:55	RX	0 - Gateway	INTERNAL	C_INTERNAL	NO	I_VERSION	2.2.0
            206	3/15/2018 20:48:05	RX	0 - Gateway	INTERNAL	C_INTERNAL	NO	I_VERSION	2.2.0
            
            

            @marceloaqno any ideas about that?

            M Offline
            M Offline
            marceloaqno
            Code Contributor
            wrote on last edited by
            #862

            @mvader The gateway will respond with an I_VERSION every time a controller connected to port 5003 sends an I_VERSION request.

            1 Reply Last reply
            0
            • gohanG gohan

              @marceloaqno I got my gw rfm69 gateway suddenly stopped communicating with nodes. I tried everything to reinstall it but without luck. I was able to have it running on my test rpi with a complete OS reinstall. Is there anything else I need need to clean up from my install to reset every settings? (besides the mysensors folder and mysensors.dat file I already deleted)

              M Offline
              M Offline
              marceloaqno
              Code Contributor
              wrote on last edited by
              #863

              @gohan Sorry to hear that, mysgw doesn't change any system files, a simple reboot and rebuild of the gateway should be enough to resume communication in a case of more serious error.

              1 Reply Last reply
              0
              • MasMatM MasMat

                @marceloaqno What does your mosquitto.log show?
                I did a fresh install of DietPi (stretch), Mosquitto and MySensors --branch master. I left out everything and pretty much did the configure command as you did. I get the same result, but mosuiqtto log shows:

                1521584708: New connection from 127.0.0.1 on port 1883.
                1521584708: New client connected from 127.0.0.1 as mygateway1 (c1, k15, u'masi').
                1521584733: Socket error on client mygateway1, disconnecting.
                1521584778: New connection from 127.0.0.1 on port 1883.
                

                So is this normal?
                I have one sensors built that's not connecting (its log shows it just trying and trying..). I would like to user simple password and the LEDs, I will build one extra sensors just to help testing.

                M Offline
                M Offline
                marceloaqno
                Code Contributor
                wrote on last edited by
                #864

                @masmat This is my mosquitto.log

                1521680648: mosquitto version 1.4.10 (build date Fri, 22 Dec 2017 08:19:25 +0000) starting
                1521680648: Config loaded from /etc/mosquitto/mosquitto.conf.
                1521680648: Opening ipv4 listen socket on port 1883.
                1521680648: Opening ipv6 listen socket on port 1883.
                1521762617: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
                1521763549: New connection from 127.0.0.1 on port 1883.
                1521763549: New client connected from 127.0.0.1 as mygateway1 (c1, k15, u'rpi').
                

                A socket error message:

                1521764339: Socket error on client mygateway1, disconnecting.
                

                shows only if I stop/exit mysgw.

                MasMatM 1 Reply Last reply
                0
                • M marceloaqno

                  @masmat This is my mosquitto.log

                  1521680648: mosquitto version 1.4.10 (build date Fri, 22 Dec 2017 08:19:25 +0000) starting
                  1521680648: Config loaded from /etc/mosquitto/mosquitto.conf.
                  1521680648: Opening ipv4 listen socket on port 1883.
                  1521680648: Opening ipv6 listen socket on port 1883.
                  1521762617: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
                  1521763549: New connection from 127.0.0.1 on port 1883.
                  1521763549: New client connected from 127.0.0.1 as mygateway1 (c1, k15, u'rpi').
                  

                  A socket error message:

                  1521764339: Socket error on client mygateway1, disconnecting.
                  

                  shows only if I stop/exit mysgw.

                  MasMatM Offline
                  MasMatM Offline
                  MasMat
                  wrote on last edited by
                  #865

                  @marceloaqno OK, I will look into that once I have an extra sensor feeding my gw (the one I built is a little complex and could be buggy).

                  Another question: I configured mysgw without "simple password" to sort out problems.
                  Now to reconfigure mysgw I have to run the "./configure --blah --blahblah..." command and "make", but do I also have to do "make install"? And do I have to re-start & enable the service? Should I stop it first also? Anybody got a step-by-step for this?

                  1 Reply Last reply
                  0
                  • gohanG Offline
                    gohanG Offline
                    gohan
                    Mod
                    wrote on last edited by
                    #866

                    You could also make a simple node running mock mysensors sketch that can simulate a working sensor, if you need some data running through the gateway. When I recompile the gateway I usually stop the service, uninstall the mysgw service and do the make and make install. I don't really know if it is actually required but I like to keep things clean

                    M MasMatM 2 Replies Last reply
                    1
                    • gohanG gohan

                      You could also make a simple node running mock mysensors sketch that can simulate a working sensor, if you need some data running through the gateway. When I recompile the gateway I usually stop the service, uninstall the mysgw service and do the make and make install. I don't really know if it is actually required but I like to keep things clean

                      M Offline
                      M Offline
                      marceloaqno
                      Code Contributor
                      wrote on last edited by
                      #867

                      The two patches to fix ethernet stability have been merger into the development branch, and also some changes to the gateway logging. I updated the build instructions to reflect the changes.

                      1 Reply Last reply
                      1
                      • gohanG gohan

                        You could also make a simple node running mock mysensors sketch that can simulate a working sensor, if you need some data running through the gateway. When I recompile the gateway I usually stop the service, uninstall the mysgw service and do the make and make install. I don't really know if it is actually required but I like to keep things clean

                        MasMatM Offline
                        MasMatM Offline
                        MasMat
                        wrote on last edited by MasMat
                        #868

                        @gohan I made a sensor that sends DHT11 temp+hum. This is the output (some of it..) from mosquitto_sub to topic mysensors-out. So I appear to have a something working. OpenHab2 is not finding any items still...

                        pi@DietPi:~ $ mosquitto_sub  -u XXXXXX -P YYYYYY -v -t 'mysensors-out/#'
                        mysensors-out/99/1/1/0/0 14.0
                        mysensors-out/99/0/1/0/1 46.0
                        mysensors-out/99/1/1/0/0 15.0
                        mysensors-out/99/0/1/0/1 45.0
                        mysensors-out/99/1/1/0/0 15.0
                        mysensors-out/99/0/1/0/1 45.0
                        mysensors-out/99/0/1/0/1 44.0
                        mysensors-out/99/0/1/0/1 45.0
                        mysensors-out/99/0/1/0/1 44.0
                        mysensors-out/99/1/1/0/0 15.0
                        mysensors-out/99/0/1/0/1 45.0
                        mysensors-out/99/1/1/0/0 15.0
                        mysensors-out/99/0/1/0/1 44.0
                        mysensors-out/99/0/1/0/1 45.0
                        mysensors-out/99/0/1/0/1 44.0
                        mysensors-out/99/1/1/0/0 15.0
                        mysensors-out/99/0/1/0/1 44.0
                        mysensors-out/99/1/1/0/0 15.0
                        

                        Once I changed the config to include simple password, it's not showing anything anymore in mosquitto_sub
                        It would appear that something is missing from my setup or there's a bug in the configure-line. Can someone tell if there's a bug here somewhere:

                        sudo ./configure --my-transport=nrf24 --my-rf24-irq-pin=15 --my-signing=password --my-signing-password=ZZZZZZ --my-gateway=mqtt --my-controller-ip-address=127.0.0.1 --my-mqtt-user=XXXXXX --my-mqtt-password=YYYYYY --my-mqtt-publish-topic-prefix=mysensors-out --my-mqtt-subscribe-topic-prefix=mysensors-in --my-mqtt-client-id=mygateway1 --my-leds-err-pin=12 --my-leds-rx-pin=16 --my-leds-tx-pin=18
                        
                        1 Reply Last reply
                        0
                        • gohanG Offline
                          gohanG Offline
                          gohan
                          Mod
                          wrote on last edited by
                          #869

                          Look also in node log, that's the first place to look at

                          MasMatM 1 Reply Last reply
                          0
                          • gohanG gohan

                            Look also in node log, that's the first place to look at

                            MasMatM Offline
                            MasMatM Offline
                            MasMat
                            wrote on last edited by MasMat
                            #870

                            @gohan I did, I will post it (but it appears to send normally). But the only things I changed was:

                            1. Rpi configure added: --my-signing=password --my-signing-password=ZZZZZZ
                            2. In the nodes code: #define MY_SIGNING_SIMPLE_PASSWD = "ZZZZZZ"
                            AnticimexA 1 Reply Last reply
                            0
                            • gohanG Offline
                              gohanG Offline
                              gohan
                              Mod
                              wrote on last edited by
                              #871

                              I use also these parameters with the normal signing

                              --my-signing=software --my-signing-request-signatures --my-signing-weak_security --my-signing-debug
                              

                              of course the debug parameter is there only for debug reasons

                              1 Reply Last reply
                              0
                              • MasMatM MasMat

                                @gohan I did, I will post it (but it appears to send normally). But the only things I changed was:

                                1. Rpi configure added: --my-signing=password --my-signing-password=ZZZZZZ
                                2. In the nodes code: #define MY_SIGNING_SIMPLE_PASSWD = "ZZZZZZ"
                                AnticimexA Offline
                                AnticimexA Offline
                                Anticimex
                                Contest Winner
                                wrote on last edited by
                                #872

                                @masmat check that the version you are using (release or beta) match your use of the simple flags, as they differ at the moment.

                                Do you feel secure today? No? Start requiring some signatures and feel better tomorrow ;)

                                MasMatM 1 Reply Last reply
                                0
                                • AnticimexA Anticimex

                                  @masmat check that the version you are using (release or beta) match your use of the simple flags, as they differ at the moment.

                                  MasMatM Offline
                                  MasMatM Offline
                                  MasMat
                                  wrote on last edited by MasMat
                                  #873

                                  @anticimex Both Arduino IDE is 2.2 and Rpi is compiled with 2.2 stable.
                                  I'm seeing !TSF:MSG:SIGN FAIL in the serial monitor so something is not compatible... I will try making password >8 characters next (currently 6).

                                  I will also add those parameters to see if that makes a difference before reuploading arduino code

                                  AnticimexA 1 Reply Last reply
                                  0
                                  • MasMatM MasMat

                                    @anticimex Both Arduino IDE is 2.2 and Rpi is compiled with 2.2 stable.
                                    I'm seeing !TSF:MSG:SIGN FAIL in the serial monitor so something is not compatible... I will try making password >8 characters next (currently 6).

                                    I will also add those parameters to see if that makes a difference before reuploading arduino code

                                    AnticimexA Offline
                                    AnticimexA Offline
                                    Anticimex
                                    Contest Winner
                                    wrote on last edited by Anticimex
                                    #874

                                    @masmat if you add the signing debug flag and use the log parser on the homepage it should become clear what the problem is. You can also use the troubleshooting guide in the signing documentation.

                                    Do you feel secure today? No? Start requiring some signatures and feel better tomorrow ;)

                                    1 Reply Last reply
                                    0
                                    • MasMatM Offline
                                      MasMatM Offline
                                      MasMat
                                      wrote on last edited by
                                      #875

                                      @anticimex This is what's happening in the gw:

                                      TSF:MSG:READ,36-192-15,s=69,c=0,t=81,pt=1,l=21,sg=0:221
                                      !TSF:MSG:LEN,16!=28
                                      TSF:MSG:READ,75-68-77,s=48,c=1,t=110,pt=1,l=25,sg=1:249
                                      !TSF:MSG:LEN,16!=32

                                      The parser didn't really help much: more baffled than before....and I came away from the troubleshooting guide feeling really stupid :)

                                      AnticimexA 1 Reply Last reply
                                      0
                                      • MasMatM MasMat

                                        @anticimex This is what's happening in the gw:

                                        TSF:MSG:READ,36-192-15,s=69,c=0,t=81,pt=1,l=21,sg=0:221
                                        !TSF:MSG:LEN,16!=28
                                        TSF:MSG:READ,75-68-77,s=48,c=1,t=110,pt=1,l=25,sg=1:249
                                        !TSF:MSG:LEN,16!=32

                                        The parser didn't really help much: more baffled than before....and I came away from the troubleshooting guide feeling really stupid :)

                                        AnticimexA Offline
                                        AnticimexA Offline
                                        Anticimex
                                        Contest Winner
                                        wrote on last edited by
                                        #876

                                        @masmat looks to me that your gateway is not set up for signing

                                        Do you feel secure today? No? Start requiring some signatures and feel better tomorrow ;)

                                        gohanG 1 Reply Last reply
                                        0
                                        • AnticimexA Anticimex

                                          @masmat looks to me that your gateway is not set up for signing

                                          gohanG Offline
                                          gohanG Offline
                                          gohan
                                          Mod
                                          wrote on last edited by
                                          #877

                                          @anticimex I think he didn't use all the parameters for the configure, right?

                                          AnticimexA MasMatM 2 Replies Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          12

                                          Online

                                          11.7k

                                          Users

                                          11.2k

                                          Topics

                                          113.0k

                                          Posts


                                          Copyright 2019 TBD   |   Forum Guidelines   |   Privacy Policy   |   Terms of Service
                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • MySensors
                                          • OpenHardware.io
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular