Thingsboard-gateway

Minor release, contains bug-fixes and improvements.

What's Changed
* Change thingsboard-gateway.service to use tb_gateway.json instead yaml by LukaszDuss in https://github.com/thingsboard/thingsboard-gateway/pull/1194
* Fixed MQTT RPC by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1201
* Fixed Modbus installation and converter by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1202
* Added Modbus version compatibility for converter by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1203
* Fixed config modification bug for Modbus Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1207
* Fixed Modbus Slaves stopping by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1208
* Fixed OPC-UA remote logging by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1209

New Contributors
* LukaszDuss made their first contribution in https://github.com/thingsboard/thingsboard-gateway/pull/1194

**Full Changelog**: https://github.com/thingsboard/thingsboard-gateway/compare/3.4.1...3.4.2

What's Changed

Added minor fixes for modbus connector.
Fixed error with logLevel key in connector configuration.

Added backing up for connectors configuration files on update and tb_gateway.json on remote configurator start.

* Fixed send_current_configuration method by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1183
* Fixed modbus slave init by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1192


**Full Changelog**: https://github.com/thingsboard/thingsboard-gateway/compare/3.4...3.4.1

What's Changed

**Service:**
- New remote configuration dashboard - Can be used with ThingsBoard version 3.6 or above. Contains new, more convenient dashboards and improved functionality, in comparison to the old one.
- New Configuration Wizard - Now, you can run **tb-gateway-configurator**, configure general parameters, like host, port, credentials and connect your gateway to your ThingsBoard account easily. Then, you can use Remote Configuration dashboard to configure other parameters from UI.
- Added RPC through Connector - Added ability to send "service" RPCs (get/set) to connectors and receive or write a data, without actual device.
- Changed GRPC library to 1.58.0.
- General Improvements

**Modbus Connector:**

- Fixed RPC processing
- Fixed uplink converter
- General Improvements

**Rest Connector:**

- General Improvements

**SQLite Storage:**

- Fix for bug with stale data by mursisoy

**Warning**: Old yaml file configuration is deprecated, it is recommended to make a backup of your configuration before updating.

New Contributors
* mursisoy made their first contribution in https://github.com/thingsboard/thingsboard-gateway/pull/1173

**Full Changelog**: https://github.com/thingsboard/thingsboard-gateway/compare/3.3...3.4

Minor release of ThingsBoard IoT gateway. Contains usability improvements and bug fixes.

What's changed:

**Gateway service:**

- Added data duplicate detector
- Added statistics files examples for different OS
- Added `minEventsProcess` parameter
- Added Gateway Shell
- Added device filtering
- Fixed reconnecting
- Added device provisioning
- Added converter remote configuration update
- General Improvements
​

**Docker Image:**
​
- General Improvements
​

**MQTT Connector:**
​
- Added `sendDataOnlyOnChange` parameter
- Added shared subscriptions support
- General Improvements
​

**Modbus Connector:**
- Added TLS connection support
- General Improvements
​

**BLE Connector:**
- Added advertising mode support
- General Improvements
​

**OPC-UA AsyncIO Connector:**
- General Improvements
​

**REST Connector:**
- General Improvements
​

**FTP Connector:**
- General Improvements
​

**SNMP Connetor:**
- General Improvements
​

**Request Connector:**
- General Improvements
​

**OCPP Connector:**
- General Improvements


List of pull requests:
* Fixed getting converter type by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/970
* Fixed Dockerfile by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/971
* Fixed getting custom converter by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/972
* Added converter config error for MQTT Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/974
* Updated GRPC Connectors by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/976
* Fixed grpcio version in requirements.txt by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/979
* Added sendDataOnlyOnChange parameter for MQTT Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/991
* Fixed data-sending delay by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/994
* Fixed data misplaced for OPC-UA AsyncIO Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/996
* Added shared subscriptions support for MQTT Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/997
* Added statistics file examples for different OS by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1001
* Change ERROR to WARNING in statistics service log by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1002
* Updated SNMP Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1003
* Fixed RPC for Request Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1004
* Added parameter minEventsProcess by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1005
* Updated commands in linux statistics file by ahmed-0011 in https://github.com/thingsboard/thingsboard-gateway/pull/1008
* fix statistics service thread is blocking on rasperberry pi by xunyuw in https://github.com/thingsboard/thingsboard-gateway/pull/1009
* [Core] Data duplicate detector feature. by devaskim in https://github.com/thingsboard/thingsboard-gateway/pull/1000
* Deleted requirements.txt from docker folder by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1011
* Revert code for fix rasperberry PI, block Statistics function work by xunyuw in https://github.com/thingsboard/thingsboard-gateway/pull/1026
* [Core] Support of TTL in duplicate filtering. by devaskim in https://github.com/thingsboard/thingsboard-gateway/pull/1019
* Duplicate Detector: Configuration parameter mistype by devaskim in https://github.com/thingsboard/thingsboard-gateway/pull/1027
* Added responseValueExpression RPC param for Request Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1031
* Fixed on_attributes_update for OPC-UA AsyncIO Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1034
* Fixed writing multiple registers for Modbus Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1035
* Fixed reading boolean for Modbus Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1036
* Updated modbus.json file by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1038
* Added device filtering by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1039
* Fixed version resolving by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1040
* [WIP] Added Gateway Shell by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1017
* Added entrypoint for Gateway Shell by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1047
* Added BLE Advertising mode support by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1049
* Fixed modbus_serial.json config file by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1053
* Fixed imports in OCPP Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1057
* Fixed starting Gateway with incorrectly closed manager by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1058
* Fixed modbus reconnecting by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1062
* Fixed Shell connection for Windows by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1067
* Added additional error log for Modbus Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1069
* Request connector bug by Kevin-ox in https://github.com/thingsboard/thingsboard-gateway/pull/1072
* Fixed TB Gateway Service reconnect by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1076
* Updated submodule by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1078
* Updated requires by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1081
* Updated submodule by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1082
* Added TLS support for Modbus TCP Connection by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1083
* Added Gateway Provisioning by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1084
* Updated submodule by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1085
* Added converter update from shared attr for Connectors by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1087
* Updated generate_certificate method by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1088
* Added on demand caching of custom MQTT converters. by devaskim in https://github.com/thingsboard/thingsboard-gateway/pull/1090
* Load .pyc modules by CoderPuppy in https://github.com/thingsboard/thingsboard-gateway/pull/1086
* Changed queries using for REST Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1095
* Fixed process_remote_converter_configuration_update method by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1101
* Get rid of warning while setting connector name. by devaskim in https://github.com/thingsboard/thingsboard-gateway/pull/1100
* [FEATURE] Add sharing id instead of global converter cache for MQTT connector. by devaskim in https://github.com/thingsboard/thingsboard-gateway/pull/1099
* Updated converter update request for MQTT Connector by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1104
* Fixed FTP Converter by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1107
* Fixed statistics sending period by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1109
* Fixed KeyError for some edge cases. by devaskim in https://github.com/thingsboard/thingsboard-gateway/pull/1111
* Changed the default converters to use local instead of class variables by mircopz in https://github.com/thingsboard/thingsboard-gateway/pull/1110
* Added synchronizing method for converters config by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1112
* Fix a race condition in the Sqlite storage which caused all data to stop by CoderPuppy in https://github.com/thingsboard/thingsboard-gateway/pull/1114
* Remove sleep per data point pushed by CoderPuppy in https://github.com/thingsboard/thingsboard-gateway/pull/1113
* bug tb_gateway_service.py -> __form_statistics by Kevin-ox in https://github.com/thingsboard/thingsboard-gateway/pull/1122
* Updated tests by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1132
* Fixed modbus tests by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1133
* Updated submodule by samson0v in https://github.com/thingsboard/thingsboard-gateway/pull/1134

New Contributors
* ahmed-0011 made their first contribution in https://github.com/thingsboard/thingsboard-gateway/pull/1008
* xunyuw made their first contribution in https://github.com/thingsboard/thingsboard-gateway/pull/1009
* Kevin-ox made their first contribution in https://github.com/thingsboard/thingsboard-gateway/pull/1072
* CoderPuppy made their first contribution in https://github.com/thingsboard/thingsboard-gateway/pull/1086

**Full Changelog**: https://github.com/thingsboard/thingsboard-gateway/compare/v3.2...3.3

**Gateway:**
​
- Added configurable statistics collecting
- Added ⚡️ HotReloader for dev mode
- Fixed and optimized data packing algorithm
- Added certificates end date checking and generation new one
- SDK as a dependency for Gateway
- Added ability to connect to ThingsBoard via the username and password
- General Improvements
​

**MQTT Connector:**
​
- Added default bytes data converter
- Added MQTT 5 support
- Added `get/set` RPC methods
- General Improvements
​

**Modbus Connector:**

- Updated version of the used Modbus library to version >=3.0.0.
(Installation required, after installation gateway restart required)
- Added `get/set` RPC methods
- General Improvements
​

**Socket Connector:**
​
- Added `set` RPC method
​

**OPC-UA AsyncIO Connector:**

- Bug fixes
- General Improvements
​

**REST Connector:**
​
- Added `get/set` RPC methods
​

**OPC-UA Connector:**
​
- General Improvements
​

**SNMP Connector:**
​
- General Improvements
​

**ODBC Connector:**
​
- General Improvements
​

**GRPC Service:**
​
- General Improvements
​

**Docker Image:**
​
- Gateway configuration via the env variables
- Fix for logs location folder
- Fixed and optimized
​

**[NEW] XMPP Connector**
​

**[NEW] OCPP Connector**
​

**[NEW] GRPC MQTT Connector**
​

**[NEW] GRPC Modbus Connector**
​

**[NEW] GRPC OPCUA Connector**
​

**Contributors:**
​
- devascim
- JavierNR
- KevinPoole
- zhufeng88
- anirudh-mehta
- micropz
- nagarjunredla
- wilterdinkrobert
- bcl-dev
- Maksym2022

**Gateway:**

- Added functionality for checking devices activity
- General Improvements
- Added new statistic service, it may configured like regular connector by configuration file

**Remote Configurator:**

- General Improvements

**All Type of Connectors:**

- From now users can add the `useGRPC` flag for on/off the default GRPC connector realization (using GRPC allows you to get real multiprocessing for the gateway and gives more hardware resources to the gateway)

**MQTT Connector:**

- General Improvements
- From now connector won't pass the None value from the converter

**BLE Connector:**

- Improved stability
- General Improvements

**Modbus Connector:**

- General Improvements
- Improved Modbus Compatibility Adapter
- Added tests

**OPC-UA Connector:**

- From now connector will use node name if key not found in config file
- Perfomance Improvements
- General Improvements

**REST Connector:**

- Added `Remote Response` and `Custom Response`
- Added opportunity to process query params
- Added opportunity to receive different data types
- Added `Attribute Request`
- General Improvements

**Request Connector:**

- General Improvements

**GRPC:**

- Perfomance Improvements
- General Improvements

**Docker Image:**

- Added support for ARM v.7

**[New] Socket Connector**

- Added `Attribute Request`

**[New] GRPC Socket Connector**

**[New] OPC-UA AsyncIO connector**
Designed to have better performance and stay updated with actual

**Contributors:**
[ysimonx](https://github.com/thingsboard/thingsboard-gateway/commits?author=ysimonx),
[jeffreylauck](https://github.com/thingsboard/thingsboard-gateway/commits?author=jeffreylauck),
[wilterdinkrobert](https://github.com/thingsboard/thingsboard-gateway/commits?author=wilterdinkrobert),
[VeryBitter](https://github.com/thingsboard/thingsboard-gateway/commits?author=VeryBitter),
[ferguscan](https://github.com/thingsboard/thingsboard-gateway/commits?author=ferguscan),
[Liangzx](https://github.com/thingsboard/thingsboard-gateway/commits?author=Liangzx),
[Kretiss](https://github.com/thingsboard/thingsboard-gateway/commits?author=Kretiss),
[DavideBorsatti](https://github.com/thingsboard/thingsboard-gateway/commits?author=DavideBorsatti).

**Full Changelog**: https://github.com/thingsboard/thingsboard-gateway/compare/3.0.1...3.1