💬 Building a MQTT Gateway

[Samuel235]

@gohan - I have not touched the MySensors.h or MyConfig.h but the sketch is below:

/**
 * The MySensors Arduino library handles the wireless radio link and protocol
 * between your home built sensors/actuators and HA controller of choice.
 * The sensors forms a self healing radio network with optional repeaters. Each
 * repeater and gateway builds a routing tables in EEPROM which keeps track of the
 * network topology allowing messages to be routed to nodes.
 *
 * Created by Henrik Ekblad <henrik.ekblad@mysensors.org>
 * Copyright (C) 2013-2015 Sensnology AB
 * Full contributor list: https://github.com/mysensors/Arduino/graphs/contributors
 *
 * Documentation: http://www.mysensors.org
 * Support Forum: http://forum.mysensors.org
 *
 * This program is free software; you can redistribute it and/or
 * modify it under the terms of the GNU General Public License
 * version 2 as published by the Free Software Foundation.
 *
 *******************************
 *
 * REVISION HISTORY
 * Version 1.0 - Henrik Ekblad
 *
 * DESCRIPTION
 * The W5100 MQTT gateway sends radio network (or locally attached sensors) data to your MQTT broker.
 * The node also listens to MY_MQTT_TOPIC_PREFIX and sends out those messages to the radio network
 *
 * LED purposes:
 * - To use the feature, uncomment WITH_LEDS_BLINKING in MyConfig.h
 * - RX (green) - blink fast on radio message recieved. In inclusion mode will blink fast only on presentation recieved
 * - TX (yellow) - blink fast on radio message transmitted. In inclusion mode will blink slowly
 * - ERR (red) - fast blink on error during transmission error or recieve crc error
 *
 * See http://www.mysensors.org/build/esp8266_gateway for wiring instructions.
 * nRF24L01+  ESP8266
 * VCC        VCC
 * CE         GPIO4
 * CSN/CS     GPIO15
 * SCK        GPIO14
 * MISO       GPIO12
 * MOSI       GPIO13
 *
 * Not all ESP8266 modules have all pins available on their external interface.
 * This code has been tested on an ESP-12 module.
 * The ESP8266 requires a certain pin configuration to download code, and another one to run code:
 * - Connect REST (reset) via 10K pullup resistor to VCC, and via switch to GND ('reset switch')
 * - Connect GPIO15 via 10K pulldown resistor to GND
 * - Connect CH_PD via 10K resistor to VCC
 * - Connect GPIO2 via 10K resistor to VCC
 * - Connect GPIO0 via 10K resistor to VCC, and via switch to GND ('bootload switch')
 *
  * Inclusion mode button:
 * - Connect GPIO5 via switch to GND ('inclusion switch')
 *
 * Hardware SHA204 signing is currently not supported!
 *
 * Make sure to fill in your ssid and WiFi password below for ssid & pass.
 */


// Enable debug prints to serial monitor
#define MY_DEBUG

// Enables and select radio type (if attached)
#define MY_RADIO_NRF24
//#define MY_RADIO_RFM69

#define MY_GATEWAY_MQTT_CLIENT

// Set this node's subscribe and publish topic prefix
#define MY_MQTT_PUBLISH_TOPIC_PREFIX "Gateway1-out"
#define MY_MQTT_SUBSCRIBE_TOPIC_PREFIX "Gateway1-in"

// Set MQTT client id
#define MY_MQTT_CLIENT_ID "mysensors-1"

// W5100 Ethernet module SPI enable (optional if using a shield/module that manages SPI_EN signal)
//#define MY_W5100_SPI_EN 4

// Enable Soft SPI for NRF radio (note different radio wiring is required)
// The W5100 ethernet module seems to have a hard time co-operate with
// radio on the same spi bus.
#if !defined(MY_W5100_SPI_EN) && !defined(ARDUINO_ARCH_SAMD)
#define MY_SOFTSPI
#define MY_SOFT_SPI_SCK_PIN 14
#define MY_SOFT_SPI_MISO_PIN 16
#define MY_SOFT_SPI_MOSI_PIN 15
#endif

// When W5100 is connected we have to move CE/CSN pins for NRF radio
#ifndef MY_RF24_CE_PIN
#define MY_RF24_CE_PIN 5
#endif
#ifndef MY_RF24_CS_PIN
#define MY_RF24_CS_PIN 6
#endif

// Enable these if your MQTT broker requires usenrame/password
//#define MY_MQTT_USER "username"
//#define MY_MQTT_PASSWORD "password"

// Enable MY_IP_ADDRESS here if you want a static ip address (no DHCP)
#define MY_IP_ADDRESS 192,168,0,22

// If using static ip you need to define Gateway and Subnet address as well
#define MY_IP_GATEWAY_ADDRESS 192,168,0,1
#define MY_IP_SUBNET_ADDRESS 255,255,255,0

// MQTT broker ip address or url. Define one or the other.
//#define MY_CONTROLLER_URL_ADDRESS "m20.cloudmqtt.com"
#define MY_CONTROLLER_IP_ADDRESS 192, 168, 0, 21

// The MQTT broker port to to open
#define MY_PORT 1883

/*
// Enable inclusion mode
#define MY_INCLUSION_MODE_FEATURE
// Enable Inclusion mode button on gateway
//#define MY_INCLUSION_BUTTON_FEATURE
// Set inclusion mode duration (in seconds)
#define MY_INCLUSION_MODE_DURATION 60
// Digital pin used for inclusion mode button
//#define MY_INCLUSION_MODE_BUTTON_PIN  3

// Set blinking period
#define MY_DEFAULT_LED_BLINK_PERIOD 300

// Flash leds on rx/tx/err
// Uncomment to override default HW configurations
//
//
//
*/

#define MY_DEFAULT_ERR_LED_PIN 11  // Error led pin
#define MY_DEFAULT_RX_LED_PIN  12  // Receive led pin
#define MY_DEFAULT_TX_LED_PIN  13  // the PCB, on board LED

#include <Ethernet.h>
#include <MySensors.h>

void setup()
{
}

void presentation()
{
	// Present locally attached sensors here
}


void loop()
{
	// Send locally attached sensors data here
}

EDIT: My issue was resting on the MQTT Server, had OpenHAB and MySensors gateway using same ClientID.

[mlava]

@Gabor-Bognar I also need to be able to do this.
Is there a solution to have a port 1883 for MQTT and port 5003 for telnet?

[Gefkuz]

Hi,

There is a missing parameter in your sketch :
// The MAC address can be anything you want but should be unique on your network.
// Newer boards have a MAC address printed on the underside of the PCB, which you can (optionally) use.
// Note that most of the Ardunio examples use "DEAD BEEF FEED" for the MAC address.
#define MY_MAC_ADDRESS 0x90, 0xA2, 0xDA, 0x10, 0xEB, 0x1D

In normal way, this line is note really important.
But if you want to use two separate MQTT on the same network, you should add this line and modify the mac adress on the two MQTT...

Bye

[scottdube]

Is it possible to have a single device acting as a ethernet gateway and an mqtt gateway?

[gohan]

No, but if you really really need the 2 connections you could use node-red to read data from the ethernet gateway and mirror them to mqtt

[scottdube]

I am wondering why you cannot built the ethernet gateway and combine the mqtt client sketch into it? I am trying to shift towards mqtt (experiment) while still having sensors available in Vera. I have the MQTT plugin on vera but have not yet figured out how to use the child device to control devices via MQTT. It seems like a waste to control the MQTT device only through Vera and I would never be able to shift away from vera that way. I'm new to this so I am still trying to understand the entire picture.

Thanks!

[mfalkvidd]

@scottdube my guess is that nobody with sufficient knowledge has had enough motivation and time to see if it can be done - especially since other solutions (nodered, myscontroller) already exist.

[scottdube]

@mfalkvidd I am missing something, the reason I want it to do both is that I want the flexibility to use Node Red and my Vera controller. I was thinking that as I built new sensors they would run through node red but be available to vera as well. I'm sure I just don't yet understand how people are designing their hybrid systems yet. My solution was to have the mysensors gateway also put the sensors values out to the mqtt broker and vice versa but there must be another way I am not seeing yet...

Thanks!

[gohan]

maybe it is time to switch away from Vera to something else that still uses zwave?

[scottdube]

@gohan Maybe that is the answer, I'll research that a bit... That was what I was hoping to do over time with my strategy...

[mfalkvidd]

@scottdube you can let Vera connect to Nodered.

See these threads for some ideas on what other people have done
https://forum.mysensors.org/topic/3891/2-controllers-and-1-gateway-expected-behavior/5
https://forum.mysensors.org/topic/4792/node-red/2
https://forum.mysensors.org/topic/9106/new-node-red-contrib-mysensors-out/2

[joaoabs]

I'd like to have a very simple (intra-home) web page in my raspberry PI that would be updated with all of my nodes information and that could also turn on/off nodes with actuators (basically I don't want to have a fancy controller).
If I understood correctly, with this MQTT Ethernet Gateway I could implement this by running Mosquito that would subscribe information from each node, through this MQTT gateway.
Does this mean I can avoid having a controller?
Cheers,

[gohan]

Technically speaking yes but I don't see the point in reinventing the wheel

[รอเรือ]

I rebuilt my serial gateway to a MQTT gateway. FWIW I had to connect 5V to my WizNET (W5100) Ethernet module (3.3V did not work) I couldn't make DHCP work so I used a fixed IP. Finally I had to replace the capacitor over the radio power feed from 4.7 uF capacitor to a 100 uF capacitor (That made a big difference!). Works great now.

[Guillermo Schimmel]

It should have:

void presentation() {
sendSketchInfo("Gateway node", "1.0");
}

In order to show the right topology in some tools, i.e. mycontroller.org

Thanks

[sionut]

Hi, is there any case for this gateway ? I wouldn't want all those wires to lay around in plain view..

[mfalkvidd]

@sionut "this gateway" is a bit ambiguous. The mqtt gateway can be based on different Arduinos and use different expansion boards, which will make a big difference for casing. Which variant are you planning to build?

[sionut]

That's a good question. :) I didn't realize that the arduino board is not specified (neither in this tutorial nor in the ethernet one).
However, I see that the ethernet gateway project (https://www.mysensors.org/build/ethernet_gateway) mentions that any arduino board would be fine. Since I'm only a beginner, I don't know what board would suffice for this kind of project. Could you recommend me the cheapest Arduino board that can do the job ?

[mfalkvidd]

@sionut if you have wifi, I would suggest esp8266 (wemos d1 mini if you want a specific board recommendation). It has built-in wifi so you don’t need an expansion board. Guide: https://www.mysensors.org/build/esp8266_gateway It can be run in mqtt mode if you prefer mqtt over plain tcp.

If you prefer ethernet, the Arduino Uno seems to be the one that matches the W5100 shield.

[sionut]

Great. I have wifi, so I will use the esp8266. I think I will continue with this board here as it's something I can find in a local store nearby.

I just need one more clarification though: in the ESP8266 gateway page I see the following paragraph:

Just connect the radio, install gateway software and you're good to go.

Now, considering that the board already has WIFI, why do I need the radio ?