Posts made by JeeLet

myC_2.x and influxDB1.8
OdroidC2 and Armbian 23.02.2 Focal with Linux 6.1.11-meson64

info    helper/helper.go:29     welcome to MyController server :)
info    helper/helper.go:33     version information     {"versionInfo": "{version:2.0.0-devel, buildDate:2023-03-24T15:27:53+00:00, gitCommit:7e4cd9f569fbf1b0894465bcdc023fe98704aad6, goVersion:go1.20.2, compiler:gc, platform:linux, arch:arm64, h>
info    backup/restore.go:170   executing import job    {"sourceDir": "mc_home/data/storage/memory_db/yaml", "fileType": "yaml"}
info    helper/server_defaults.go:30    error on fetching system settings, assuming it is fresh install and populating default details. if not, report this issue       {"error": "no documents in result"}

error   api.settings_api        settings/update_geo_location.go:69      error on getting geo location, updating location details with default values and disabling auto update  {"error": "Get \"https://ipinfo.io/json\": dial tcp: lookup ipinfo.io >

info    api.settings_api        settings/update_geo_location.go:85      location data to be updated     {"location": {"autoUpdate":false,"locationName":"Namakkal","latitude":11.2222469,"longitude":78.1650174}}
info    helper/server_defaults.go:104   there is no user available in the storage database. creating default user 'admin'
info    helper/server.go:401    checking for upgrade    {"lastUpgradePatch": "2.0.0-1"}
info    route_handler   http_router/handler.go:111      secure share directory included {"directory": "mc_home/secure_share", "handlerPath": "/secure_share"}
info    route_handler   http_router/handler.go:116      insecure share directory included       {"directory": "mc_home/insecure_share", "handlerPath": "/insecure_share"}
info    gateway_service gateway/listener.go:22  gateway service filter config   {"filter": {"Disabled":false,"MatchAll":false,"Types":[],"IDs":[],"Labels":{"location":"server"}}}
info    handler_service handler/service_listener.go:86  handler service filter config   {"filter": {"Disabled":false,"MatchAll":false,"Types":[],"IDs":[],"Labels":{"location":"server"}}}
info    system_jobs_service     system_jobs/job_telemetry.go:41 telemetry data reporter job scheduled   {"cron": "0 48 3 * * *"}
info    system_jobs_service     system_jobs/job_telemetry.go:45

bybye

update your organization, when you configure indluxdb 2 ... yes it is well understood, that's what I did .

I just redid a new install, armbian/MyC/InfluxDB2 with the right configuration, and still the same "metric" problem

I even tested on the Gateway sketch with the line
"metric = getControllerConfig().isMetric;" ..... it's a firework of errors

yes from the vacations
and I forget about influxDB2 ( for the moment)

Error ... a new problem.

Request failed with status code 500
URL: /api/metric
Message: "invalid: failed to decode request body: organization name "myc_org" not found"

secret:  *********  #  THIS SECRET !!!

# disable telemetry service, if you do not wish to share non-PII data
# non-PII - non Personally Identifiable Information
telemetry:
  enabled: true

web:
  web_directory: web_console
  enable_profiling: false
  read_timeout: 60s
  http:
    enabled: true
    bind_address: "0.0.0.0"
    port: 8080
  https_ssl:
    enabled: true
    bind_address: "0.0.0.0"
    port: 8443
    cert_dir: mc_home/certs/https_ssl
  https_acme:
    enabled: false
    bind_address: "0.0.0.0"
    port: 9443
    cache_dir: mc_home/certs/https_acme
    acme_directory:
    email: hello@example.com
    domains: ["mycontroller.example.com"]

logger:
  mode: record_all
  encoding: console
  enable_stacktrace: false
  level:
    core: info
    web_handler: info
    storage: info
    metric: warn

directories:
  data: mc_home/data
  logs: mc_home/logs
  tmp: mc_home/tmp
  secure_share: mc_home/secure_share
  insecure_share: mc_home/insecure_share

bus:
  type: embedded
  topic_prefix: mc_server
  server_url: nats://127.0.0.1:4222
  insecure: false
  connection_timeout: 10s

gateway:
  disabled: false
  types: []
  ids: []
  labels:
    location: server

handler:
  disabled: false
  types: []
  ids: []
  labels:
    location: server

database:
  storage:
    type: memory
    dump_enabled: true
    dump_interval: 10m
    dump_dir: "memory_db"
    dump_format: ["yaml","json"]
    load_format: "yaml"

  metric:
    disabled: true
    type: influxdb
    uri: http://127.0.0.1:8086
    token: IZw********RN****Lw==
    username:
    password:
    organization_name: myc_org
    bucket_name: myc
    batch_size:
    flush_interval: 5s

Yes also the deletion of fields/nodes/gateway are not possible with the interface, it remains in memory, I am obliged to go in the yaml file and delete them

I'm going to take a little vacation.
I'm starting to lose track of why and how

@jkandasa I found it

when MyC has not yet created data, a blank system (no connection and activation of the gateway)

the connection for the web page is not possible if
"metric: disabled : true"

MyController does not like to be alone

Thank you for the additional information.

yes, influxDB2 is working well with MyC

but I have to put the parameter to true

database: > metric: > disabled: true

so that the web page opens, otherwise it's a black screen.

with as result the message :
"WARNING: Metrics database disabled

weird

it doesn't matter.
now I look at influxdb2 how to use it with myC

excuse me @jkandasa I gave up, a moment of tiredness.

I started all over again.
I started again with influxdb 1.xx .
For influxdb2.xx I start again in the week with another OdroidC2 .

it's not very good to want to test new versions at the same time, MyC2++ and influxDB2

but now I can install influxDB2 without any problem

I found the problem

in the config file: mycontroller.yaml

database: > metric: > disabled: true

it must be "true".
and it's ok, the MyC page is displayed

but I find myself with the error

"WARNING: Metrics database disabled"

a future with influxdb2 ....
Yes, I will have to open a new thread on the marriage between MyC and influxDB

influxdb2
install with the new version of MyController
(this is a lot, influxdb2 and MyC v2.00
development/mycontroller-server-2.0.0-devel-linux-arm64.tar.gz)

install :https://portal.influxdata.com/downloads/

$ wget -q https://repos.influxdata.com/influxdata-archive_compat.key

echo '393e8779c89ac8d958f81f942f9ad7fb82a25e133faddaf92e15b16e6ac9ce4c influxdata-archive_compat.key' | sha256sum -c && cat influxdata-archive_compat.key | gpg --dearmor | sudo tee /etc/apt/trusted.gpg.d/influxdata-archive_compat.gpg > /dev/null

----influxdata-archive_compat.key: OK---

$ echo 'deb [signed-by=/etc/apt/trusted.gpg.d/influxdata-archive_compat.gpg] https://repos.influxdata.com/debian stable main' | sudo tee /etc/apt/sources.list.d/influxdata.list

$ sudo apt update

----Atteint :1 http://ports.ubuntu.com focal InRelease----
----Réception de :7 https://repos.influxdata.com/debian stable/main----

$ sudo apt install influxdb2 

$ systemctl start influxdb.service

$ sudo systemctl enable influxdb.service

$ sudo /opt/apps/mycontroller/mcctl.sh start

------ start command issued to the MyController server -----

but a mistake, Log MyController

hostId:}", "loggerConfig": {"Mode":"record_all","Encoding":"console","Level":{"Core":"info","WebHandler":"info","Storage":"info","Metric":"warn"},"EnableStacktrace":false}}
2023-03-25T18:43:25.873+0100	error	metric_influxdb	extra_v1/admin.go:42	error on calling api	{"error": "failed with status code. [status: 401 Unauthorized, statusCode: 401, body: {\"code\":\"unauthorized\",\"message\":\"unauthorized access\"}]"}
2023-03-25T18:43:25.873+0100	error	helper/server.go:112	error on getting metric database	{"error": "failed with status code. [status: 401 Unauthorized, statusCode: 401, body: {\"code\":\"unauthorized\",\"message\":\"unauthorized access\"}]"}
2023-03-25T18:43:25.873+0100	fatal	cmd/root.go:38	error on starting server	{"error": "failed with status code. [status: 401 Unauthorized, statusCode: 401, body: {\"code\":\"unauthorized\",\"message\":\"unauthorized access\"}]"}
2023-03-25T18:45:33.062+0100	info	helper/helper.go:29	welcome to MyController server :)
2023-03-25T18:45:33.065+0100	info	helper/helper.go:33	version information	{"versionInfo": "{version:2.0.0-devel, buildDate:2023-03-24T15:27:53+00:00, gitCommit:7e4cd9f569fbf1b0894465bcdc023fe98704aad6, goVersion:go1.20.2, compiler:gc, platform:linux, arch:arm64, 

no connection to the web page
xxx.x.x.x refused to connect.

influxDB is functional

in Yaml format it's easier to understand your problem.

welcome with MyController, the minimalist of the minimalists

Here is an example of a temperature sensor on one of my Dasboards

8565-f5945591f8bc
title: Sallon  -  Sensor Temp   -  12hours
showTitle: true
scrollbarDisabled: false
static: false
type: widget_utilization_panel
layout:
  w: 37
  h: 53
  x: 35
  'y': 0
config:
  chart:
    color: '#ffa940'
    fillOpacity: 15
    height: 70
    interpolation: basis
    strokeWidth: 1.5
    thickness: 20
    yAxisMaxValue: ''
    yAxisMinValue: ''
  metric:
    duration: '-12h'
    interval: 3m
    metricFunction: percentile_99
    refreshInterval: '300000'
  resource:
    displayName: true
    filter: {}
    filterType: quick_id
    isMixedResources: false
    nameKey: name
    quickId: GwRs485.33.9.V_TEMP
    resources: []
    roundDecimal: 0
    timestampKey: current.timestamp
    type: field
    unit: deg
    valueKey: current.value
  table: {}
  type: spark_area

MyController can be installed anywhere, it is pure carbon, the hardest material

I realize that the questions I ask, many are explained in the Documentation

Hello jkandasa
yes influx 2.x soon on a new install.
a new hardware base, maybe an Odroid-N2 !?

https://songrgg.github.io/operation/influxdb-command-cheatsheet/
the management of metrics in terminal mode with CLI commands for ver1.8 is not simple
a good thing with a graphical interface.

version 2.0 already has an integrated tool https://docs.influxdata.com/influxdb/v2.6/visualize-data/visualization-types/table/

Let's talk about MyC again.

on image of the architecture https://v2.mycontroller.org/doc-images/architecture.png

how the dialogue between the mys gateway and influxDB works

I don't understand the difference between StorageDB and MetricDB

you say "You can also use influx 2.x. MyC supports influx 2.x"?

on a next new installation I switch to the influxDB-2 version I don't have anything to modify in mycontroller ?? .... I may try ??

For the last test with grafana, the "mc_gauge_float_data" values work but not the "mc_binary_data" numbers
(maybe I'm wrong in the config)

I try to read the future, yes the future is tomorrow (yes I have a crystal ball)

the elements that come out : TIG
Telegraf + InfluxDB + Grafana

and telegraf is an obligatory passage, evolution of influxDB v2

the infos put aside
https://www.sqlpac.com/fr/documents/influxdb-migration-v1-v2-procedure.html

major changes in influxDB
The TSI index is the default storage engine, the In-Memory index is removed.
Chronograf (visualization tool) is integrated in InfluxDB.
Flux becomes the default language and InfluxQL is unfortunately removed.
Continuous queries are replaced by Tasks.
The native support of OpenTSDB, Graphite, CollectD... protocols is also unfortunately removed in InfluxDB v2, Telegraf agents must be implemented.

then the next step is : ??? apt install telegraf ???

a question:

Can MyC manage the database of influxDB ?

a bit like on HAss : https://forum.hacf.fr/t/installer-influxdb-dans-home-assistant-et-booster-votre-base-de-donnee/360

cella will allow me to make cleaning of the old Node that I removed.

it was to make a test, how to use the 2mqtt that you created.

arduino -- usb ---> Mosquitto --> myC
in arduino a temperature (IA*) or a command (DI*)

• IA=analog input / DI= digital input

a good year 2023 for you @jkandasa and your family.

myController --> influxDB --> Grafana
yes functional, and it's quite simple (the principle)
the discovery of influxDB and Grafana is rich.

I will surely have questions about the marriage between myC and influxDB (v1.8) ..... how the databases are created and deleted in time.

an image of the configuration

bonjour @jkandasa

.... a test of the Mqtt protocol with myController
(Odroid and Arduino Uno)

I'm looking for an architecture with :

• myController and Mosquito (functional part)
• Gateway-Usb with sensors and Oled display
  (for a bidirectional dialogue)

is it possible ???
...I've been looking for sketches as examples for GWusb but nothing seen.

https://github.com/mycontroller-org/2mqtt
https://forum.mysensors.org/topic/11721/serial-ethernet-to-mqtt/5
https://forum.mycontroller.org/topic/368/serial-mqtt-adapter

Re-Edit : subject abandoned

.... happy holidays to you Jkandasa

I'm rethinking my vision / use of the Mys protocol

as I have chosen a Usb gateway and mostly a communication bus in rs485 (RF is for specific cases)

MyC <---usb---> Gateway Mega2560/Gui-Oled <----RS485---> Nodes1 2 3 <---- RF ---> NodeX

• the controller in a closet
• the gateway on the desk (usb 3 meters)
• the nodes everywhere in the house (in the technical parts)

and as the "real" Node to Node doesn't work (yes a gateway is mandatory for routing)

I'll see how I'm going to do a state management.
I'm testing a feedback on the OLED display of the gateway.

an example of the sketch on the gateway of a remote node

//------ node 36 Link distant ------ 
    const byte LINKY_NODE_ID  = 36 ;  // node linky
    const byte CHILD_ID_PAPP  = 1 ;   // ID papp
    uint16_t valPAPP ;  //  variable valeur PAPP 
    
    //-------- linky papp ------------------
 if (message.sender == LINKY_NODE_ID && message.sensor==CHILD_ID_PAPP  && message.type == V_VA  ) {    // val PAPP
    valPAPP = message.getInt();
    Serial.print("val PAPP. : ");
    Serial.println(valPAPP);                     
    }
      
    //------------ OLED valeur PAPP --------------------------
 void valPaPP()
  {
  oled.set2X();           
  oled.setCursor(37,2);
  oled.print(valPAPP);
  oled.print("va  ");
  }

I get it, it's a push mode enter, or "pull flow".

"Node down status maintained by MyC" ... yes that's a very good thing.

ideas out loud about the structure of the system:
MyC <--- Gw <--- node1 <---- node2 <--- ...etc
. the nodes give us the values of the sensors
. MyC displays or sends commands and other things

• Gw and stick to the controller, it does not do much, it relays, it is an intermediary.
  Couldn't we use the Gateway-Usb to monitor the nodes ?
  of their values ? of their states ?