MQTT Client gateway

[tomkxy]

I don't know, you have to try it. What I can say that with signing support enabled it doesn't fit into the memory of a ProMini. I run it in a Mega.

[gregl]

@ruslan said:

to tomkhy: your gateway sketch compiles, but Arduino runs out of memory (I use Nano with W5100 ethernet module, SOFTSPI enabled). It does fit with MY_SIGNING_FEATURE and DEBUG disabled, but I need debug - somehow it is not registering with MQTT server. Please tell me how to reduce memory footprint.

Looks like you have it working now, but just incase, Previously when I have had memory issues , I have upgraded my bootloader to use Optiboot which gives you a little bit more.

HTH

[mlava]

@ahhk
Hello all, first post here and a bit new to the mysensors field.
I also want to know the answer as to whether this will run on the ESP8266 as hope to run a wifi gateway.
Thanks in advance! :)

[chris021]

Also keen to run this on an ESP8266 would be a great for bridging.

[John Connolly]

OK. I've got the gateway to compile and get the following:

Started!
0;0;3;0;9;read: 110-110-0 s=1,c=1,t=0,pt=7,l=5:13.2
0;0;3;0;9;read: 105-105-0 s=0,c=1,t=1,pt=7,l=5:70.0
0;0;3;0;9;read: 110-110-0 s=0,c=1,t=1,pt=7,l=5:58.3
0;0;3;0;9;read: 105-105-0 s=0,c=1,t=1,pt=7,l=5:69.9
0;0;3;0;9;read: 110-110-0 s=0,c=1,t=1,pt=7,l=5:58.2
0;0;3;0;9;read: 105-105-0 s=0,c=1,t=1,pt=7,l=5:70.0
0;0;3;0;9;read: 110-110-0 s=0,c=1,t=1,pt=7,l=5:58.3
0;0;3;0;9;read: 105-105-0 s=0,c=1,t=1,pt=7,l=5:69.9
0;0;3;0;9;read: 110-110-0 s=0,c=1,t=1,pt=7,l=5:58.2
0;0;3;0;9;read: 110-110-0 s=0,c=1,t=1,pt=7,l=5:58.3
0;0;3;0;9;read: 105-105-0 s=0,c=1,t=1,pt=7,l=5:69.8
0;0;3;0;9;read: 110-110-0 s=1,c=1,t=0,pt=7,l=5:13.3
0;0;3;0;9;read: 110-110-0 s=0,c=1,t=1,pt=7,l=5:58.5

I can ping the MQTTClinetGateway from another machine and I've confirmed Mosquitto is running OK with a series of pub/subs from other machines/devices and that side of things is working perfectly fine.

I'm not seeing any of the above gateway readings publish to my broker. Thoughts?

Cheers.

[tomkxy]

Following points to verify and check:

• is the gateway connected to the broker. As far as I remember you can check that by subscribiing to Mosquitto status messages

mosquitto_sub -v -t \$SYS/#

If not check what the authentication method is mosquitto is. If it allows anonymous access make sure that "MQTT_AUTH_REQUIRED" is not defined in the MQTTClientGateway sketch. If username and password are set correctly.

It seems that you are not using signing. So ensure that your MQTTClientGateway is compiled with the signing feature disabled. That are the two points I can imagine now provided that you are sure that you have of course a working ethernet connection.

[John Connolly]

I downloaded and installed the development branch and got the MQTTClientGateway running on an UNO with a W5100 shield (that I'm suspicious of, in terms of its reliability). The sketch runs great for a while publishing data to Mosquitto on my Mac Mini, but then stops responding after a while. I'm pretty sure the cause of the problem is the ethernet shield as it bombs out when running other sketches - the webserver one for example.

I have a few of these ENC28J60 boards and I'd like to use one of those instead, but have had some problems.

http://www.aliexpress.com/item/ENC28J60-LAN-Ethernet-Network-Board-Module-for-arduino-25MHZ-Crystal-AVR-51-LPC-STM32-3-3V/1956963721.html

I notice in the MQTTClientGateway sketch that I should just need to comment out the one W5100 Ethernet.h library and substitute with the UIPEthernet.h one, but I tried that and had no joy. Does anyone have a working sketch based on the ENC28J60 that they could post, along with the wiring diagram to connect that board in along with any additional tweaks necessary to get it running on an Uno? Thanks in advance. Cheers.

[siod]

Hi Guys,

I get this:

Started!
0;0;3;0;9;read: 0-0-0 s=0,c=0,t=0,pt=0,l=0:
0;0;3;0;9;version mismatch
0;0;3;0;9;read: 0-0-0 s=0,c=0,t=0,pt=0,l=0:
0;0;3;0;9;version mismatch

Also the Gateway does not answer to pings. Any suggestions?

edit: after a rebbot I get valid readings in the Serial monitor of the Arduino IDE now:

0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:1
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:0
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:1
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:0
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:1
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:0
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:1
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:0
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:1
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:0
0;0;3;0;9;read: 20-20-0 s=3,c=1,t=16,pt=2,l=2:1

But still, can´t ping the gw. Double checked IP and Port, seems to be fine.

[John Connolly]

I've ordered a new W5100 module - this time the red mini W5100 board missing the SD Card slot to see if I have better luck. Still keen to see code for an ENC based MQTTClientGateway though, as this will take a while to arrive... ;)

[ruslan]

To developers of the MQTT client:
I just tried the GatewayW5100MQTTClient in the latest development branch - it gives me "0;0;3;0;9;Radio init fail" error, while GatewayW5100 sketch works fine. What could be the reason? I noticed that the declarations parts in these sketches are rather different.
My setup: ARduino nano clone + W5100 module + NRF24L01 radio. All wired as in the MySensors ethernet gateway guide ([http://www.mysensors.org/build/ethernet_gateway])

[hek]

For the W5100 SOFTSPI has to be enabled. I see that this is missing from the sketch..

Try adding (coming from the normal W5100 sketch)

// W5100 Ethernet module SPI enable (optional if using a shield/module that manages SPI_EN signal)
//#define MY_W5100_SPI_EN 4  

// Enable Soft SPI for NRF radio (note different radio wiring is required)
// The W5100 ethernet module seems to have a hard time co-operate with 
// radio on the same spi bus.
#if !defined(MY_W5100_SPI_EN)
  #define MY_SOFTSPI
  #define MY_SOFT_SPI_SCK_PIN 14
  #define MY_SOFT_SPI_MISO_PIN 16
  #define MY_SOFT_SPI_MOSI_PIN 15
#endif  

I'll update the repository.

[ruslan]

Hi, Hek!
You are correct. except I also had to add these 2 lines and then radio worked:

#define MY_RF24_CE_PIN 5
#define MY_RF24_CS_PIN 6

Pls fix the repo. Looking forward to seeing mqtt client in the master branch.

[hek]

Pushed to build server. Soon merged.
https://github.com/mysensors/Arduino/pull/241

[ruslan]

What is the MQTT message to switch MQTT client gateway into inclusion mode?

[hek]

Something like this should work...

Topic: mygateway/0/255/3/0/6
Payload: 1

http://www.mysensors.org/download/serial_api_15

[dakky]

Is this MQTTClientGateway in the dev branch only? I didn't see something like this in the 1.5 release/master.
I would prefer to use my gateway as client, but I am not skilled enough to use the dev branch and work around resulting problems :sa:

greetings
Dakky

edit:
@tomkxy said:

@tomkxy said:

here https://github.com/tomkxy/Arduino.git in the branch MQTTClient.

Did you have a look at my repository above? Functional wise it is the same adapted for version 1.5. I have it in use for quite a while now.

hmm is this repo still functional? with the signing_feature enabled i'm getting compile errors:

mqttClientGateway:175: error: 'signer' was not declared in this scope
             , signer
               ^

[Samuel235]

@dakky It is currently only in the Dev branch, yes.

[maxtox]

I Think HERE is the answer of our problem!!!!

http://electronics.stackexchange.com/questions/67212/how-to-avoid-sd-card-and-w1500-spi-mixup-on-the-ethernet-shield

[cowen71]

Good afternoon gents!

So I have been playing with openHab and an arduino as a mqtt gateway and this has been successful. The only thing I don't like is that the arduino does not seem to like multiple connections to the MQTT broker.

My next step then is to use an MQTT broker (mosquitto) on the pi and then subscribe to this from the arduino. If I understand correctly, this is exactly what this thread is discussing.

So - I have downloaded the codes and without changing anything, tried to compile. This fails with numerous errors. I have te latest libraries installed and to be honest, I am a little lost as to what is wrong. Before I post lots of error messages, are there any known 'tricks' to get the latest version working?

Hopefully someone can help - Thanks guys :-)

[Samuel235]

@cowen71 - Could you please give us a little more information to help troubleshoot your issues.

What ethernet module are you using? W5100? If so you need to makesure that you have enabled soft SPI for NRF radio as it doesn't like it being on the same bus. We also have to move the CE/CSN pins for the radio too. All this is explained inside of the sketch itself.