Using mqttGateway2.pl for Serial to MQTT on RaspberryPI

aaron832

Re: Raspberry PI + MQTT (Mosquitto) + Serial Gateway

Was wondering if anyone else had luck with the mqttGateway2.pl script Yveaux created. I believe I have everything setup correctly. It appears to be initializing correctly. The code is getting all the way down into registration of the on_error and on_read. I know I am definitely getting activity over the serial because I can see it just tailing it. Anyone have any suggestions? Maybe a common pitfall?

```# -- Switch to choose between Ethernet gateway or serial gateway
my $useSerial = 1;

# -- Settings when using Serial gateway
my $serialPort   = "/dev/ttyMySensorsGateway";
my $serialBaud   = 115200;
my $serialBits   = 8;
my $serialParity = "none";
my $serialStop   = 1;

pi@raspi-hab:~ $ sudo tail -f /dev/ttyMySensorsGateway



105;255;3;0;15;
105;255;0;0;17;2.0.0-beta
105;255;3;0;6;0
105;255;3;0;11;Garage Sensor
105;255;3;0;12;1.0
105;0;0;0;7;
105;1;0;0;6;
105;0;1;0;1;36.0

Yveaux

@aaron832 serial support is untested in the github version. I have an updated version that runs fine with a serial gateway. I'll upload it to github and let you know.

Yveaux

@aaron832 You can now find the latest version at https://github.com/Yveaux/MySensors_MQTTGateway
I did a major rework of the script and you can now configure it from the commandline.
Run the script with --help to get usage info.

E.g. usage:

Ethernet gateway: ./mqttGateway2.pl --gwhost 192.168.1.100
Serial gateway: ./mqttGateway2.pl --serial /dev/ttyMySensorsGateway

aaron832

Awesome. Thanks Yveaux. Ill test it out today. I think your script is the best solution for a Raspberry PI acting as an OpenSensor gateway and OpenHab server at the moment, which is why I am really glad you made it. A straight serial interface to OpenHab just doesn't work.

aaron832

Thanks it works great! On my forked version I just updated the script to contain the latest protocol definitions.

Yveaux

@aaron832 good to hear!
I had some issues today after a reboot of my server. Seemed like nothing was coming in at first through the serial gateway. Restarted a few times and looked at the serial output and then it started working suddenly... Fishy...
Anyway, if you create a pull request I can merge your changes, if you like.

aaron832

Done. I am a little confused about getting subscriptions working with your script. If a node should be receiving a message from the gateway... should it perform a one time request() or should the subscription be manually added to the /var/run/mqttMySensors/.... subscription file? I guess the confusion being a node that although it might receive a message from a gateway... it may not necessarily ask for it specifically.

Yveaux

@aaron832 The idea is that a node subscribes to events automatically once it has requested a value once.
The MySensors' MQTT implementation (for the ethernet gateway) will just subscribe to all events for a sensor once the sensor presents itself to the gateway. This is probably a more convenient implementation, but I just implemented it differently originally.

aaron832

@Yveaux I see. Well I added the request() call to my sensor and the perl script is picking it up. However, it is not able to write to the serial device I guess?

20160201-12:14:57 RX: [105;4;2;0;2; ] fr=105 ci=004 c=C_REQ st=V_LIGHT noack -> Subscribe to '/mySensors/105/4/V_LIGHT'
20160201-12:14:57 [Subscribe '/mySensors/105/4/V_LIGHT']
20160201-12:14:57 TX: [105;4;1;0;2;0 ] fr=105 ci=004 c=C_SET st=V_LIGHT noack '0' -> Publish to gateway '/mySensors/105/4/V_LIGHT':'0'
EV: error in callback (ignoring): Filehandle GEN0 opened only for input at /usr/local/lib/arm-linux-gnueabihf/perl/5.20.2/AnyEvent/Handle.pm line 966.
20160201-12:14:58 [105;255;3;0;15;]

pi@raspi-hab:~ $ ls -la /dev/ttyMySensorsGateway
lrwxrwxrwx 1 root root 10 Feb 1 12:14 /dev/ttyMySensorsGateway -> /dev/pts/2
pi@raspi-hab:~ $ ls -la /dev/pts/2
crw-rw---- 1 root tty 136, 2 Feb 1 12:14 /dev/pts/2
pi@raspi-hab:~ $ ps -ealf | grep mq
4 S root 17624 7825 0 80 0 - 1650 poll_s 12:14 pts/0 00:00:00 sudo ./mqttGateway2.pl --serial /dev/ttyMySensorsGateway
4 S root 17631 17624 0 80 0 - 3815 SyS_ep 12:14 pts/0 00:00:01 /usr/bin/perl -w? ./mqttGateway2.pl --serial /dev/ttyMySensorsGateway
0 S pi 17941 13671 0 80 0 - 1065 pipe_w 12:20 pts/4 00:00:00 grep --color=auto mq

aaron832

I figure it has something to do with this line from http://cpansearch.perl.org/src/COOK/Device-SerialPort-1.04/SerialPort.pm

# a handle object for ioctls: read-only ok
$self->{HANDLE} = new_from_fd IO::Handle ($self->{FD}, "r");

hoegaarden_bier

I am having the same problem when sending the response back to the node over MQTT.
My mqttGateway2.pl crashes and gets in a infinite loop:
Anyone got a sollution for this problem?

20160216-21:38:05 TX: [10;10;1;0;24;1 ] fr=010 ci=010 c=C_SET st=V_VAR1 noack '1' -> Publish to gateway '/mySensors/10/10/V_VAR1':'1'
20160216-21:38:05 Exception: Filehandle GEN0 opened only for input at /usr/local/lib/arm-linux-gnueabihf/perl/5.20.2/AnyEvent/Handle.pm line 966.

20160216-21:38:05 Restarting...
20160216-21:38:05 .
20160216-21:38:05 .
20160216-21:38:05 trying to restore subscriptions
20160216-21:38:05 Restoring previous subscriptions:
20160216-21:38:05 Exception: Filehandle GEN0 opened only for input at /usr/local/lib/arm-linux-gnueabihf/perl/5.20.2/AnyEvent/Handle.pm line 2308.

Yveaux

@hoegaarden_bier said:

Exception: Filehandle GEN0 opened only for input at /usr/local/lib/arm-linux-gnueabihf/perl/5.20.2/AnyEvent/Handle.pm line 966.

AnyEvent seems to crash. I run the script using Perl 5.14.2 on 64-bit Ubuntu; you seem to run at an ARM platform...
Probably there's the catch.
Can you try on an Intel Linux system?

hoegaarden_bier

thanks for the response, unfortunately I am running the Openhab on my raspberry so switching to linux is not an option....

aaron832

@hoegaarden_bier I have the same setup (raspberry pi running openhab with a radio). Two of the different methods for getting Raspberry Pi Gateway sensor serial data to Openhab have failed me. One being the perl script mentioned here. Still haven't figured out why it won't work (fully) under a raspberry pi environment. The other option is having openhab read from serial rather than MQTT as mentioned here: http://forum.mysensors.org/topic/655/serial-gateway-connection-to-openhab/32 However, I have noticed that openhab will run the "Item Arduino received update" rule in parrallel when receiving serial messages in short succession. This causes the parrallel rule to overwrite the currently running rules' variable and it becomes a problem. Its also pretty messy and would require you to update your openhab rules on any mysensor updates.

Not to mention, the Serial Gateway you are likely running on your raspberry pi is for opensensor 1.4 (i think) and it going to be completely left in the dust as soon as 2.0 comes around I think.

If you dare, you can follow my project here: ~~https://github.com/aaron832/Arduino/tree/raspberry-gateway-MQTT~~ (Edit: See Newer Version Below)
Basically I took an updated Raspberry PI serial gateway and updated it to include MQTT.
Just run 'make' under libraries/MySensors and run libraries/MySensors/examples_RPi/PiGatewayMQTT

I am currently looking at getting this stuff onto the develop branch so that it will be around with 2.0

Artur Maj

Thanks aaron832 for the gateway.
While running make all from under libraries/MySensors I am getting:
examples_RPi/PiGatewayMQTT.cpp:42:23: fatal error: mosquitto.h: No such file or directory
compilation terminated.
Makefile:102: recipe for target 'examples_RPi/PiGatewayMQTT.o' failed
make: *** [examples_RPi/PiGatewayMQTT.o] Error 1
Can you help?

Artur Maj

OK, I had to install mosquitto libraries: sudo apt-get install libmosquitto-dev . All compiled fine. It is always good to ask.

aaron832

@Artur-Maj You also have the option of going towards a prototype 2.0 branch that is being worked on. Doing this, you will be able to get support and updates in the future.

My branch is here: https://github.com/aaron832/Arduino/tree/feature/MQTTSupport
Perform "make mqtt" under Arduino/libraries/MySensors
You can change any mqtt settings by uncommenting lines in Arduino/libraries/MySensors/examples_RPi/PiGateway.cpp
The format MQTT messages are as follows:
From MySensors to Openhab: mygateway1-out/node/sensor/command/ack/dataType
From OpenHab to MySensors: mygateway1-in/node/sensor/command/ack/dataType

There is still more work to be done, but it works at least as well as the previous version.

Artur Maj

@aaron832 Thanks I will do that. In fact I am connecting MySensors to eventghost not OpenHab but the ide MQTT is the same.

Artur Maj

@aaron832 While running make all from libraries/MySensors I am getting errors like that:

examples_RPi/PiGateway.o: In function transportSendWrite(unsigned char, MyMessage&)': /home/artur/Arduino-feature-MQTTSupport/libraries/MySensors/./core/MyTransportNRF24.cpp:102: undefined reference to RF24::powerUp()'
/home/artur/Arduino-feature-MQTTSupport/libraries/MySensors/./core/MyTransportNRF24.cpp:103: undefined reference to RF24::stopListening()' /home/artur/Arduino-feature-MQTTSupport/libraries/MySensors/./core/MyTransportNRF24.cpp:104: undefined reference to RF24::openWritingPipe
and continues....
I have installed : https://github.com/TMRh20/RF24.
What I am doing wrong?

aaron832

Try typing

"uname -m"

into your console (that hosts the gateway). If it does not say
"armv6l" or "armv7l" (edit: correction)
then the Makefile will not include -lrf24-bcm in the LDFLAGS (libraries include). If this is the problem then what hardware are you making the gateway on?

Using mqttGateway2.pl for Serial to MQTT on RaspberryPI

14

11.7k

11.2k

113.1k