Martino FerrariandClaude Opus 4.6 5562877c99 fix(udps): publish the producer's HRT frequency so timestamps survive the hop
DATA packets timestamp with the raw value of the producer's high-resolution
counter, and the wire never said how fast that counter runs. The hub divided by
its own timer's frequency instead, which is only the same number while producer
and hub share a machine — on x86 it is the TSC frequency and differs from model
to model. Off-box, every accumulated batch was therefore laid out over the wrong
span of time: the samples in it drift away from where they belong and start
colliding with the next packet's, which is the "same" symptom as a stale time
base even though nothing is out of order.

CONFIG now carries the rate as a trailing uint64, alongside the publish-mode
byte and read the same tolerant way: absent or zero means the producer did not
say, and the hub falls back to its own timer as before. Anything below 1 kHz is
not a high-resolution timer and is refused, so a mis-parsed payload cannot
stretch a millisecond batch across seconds.

The Accumulate DATA payload is unchanged, so this costs nothing per packet and
the period *within* a batch is still estimated from the gap between packets.

The Go, C and browser parsers already ignore trailer bytes they do not know,
so they read the new CONFIG unchanged; none of them uses the HRT timestamp.

Also corrects the Accumulate DATA layout in all three protocol documents: they
described it as one snapshot per array signal, where it has always been one per
accumulated cycle.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-09-02 02:49:50 +02:00
2026-05-29 13:29:59 +02:00
2026-08-21 23:24:48 +02:00
2026-05-29 13:29:59 +02:00
2026-06-12 15:25:13 +02:00
2026-05-29 13:29:59 +02:00

MARTe2 Integrated Components

A unified MARTe2 library providing real-time signal streaming and on-the-fly debugging for control applications built with MARTe2.


Overview

This repository integrates two complementary capabilities:

Capability Component Purpose
Signal streaming UDPStreamer DataSource Continuously stream selected signals to a browser-based oscilloscope over UDP
Signal debugging DebugService Interface On-demand signal tracing, value forcing, and conditional breakpoints — zero application code changes required
Sine generation SineArrayGAM Generate continuous sine-wave arrays for testing and simulation
Time stamping TimeArrayGAM Provide time-reference arrays aligned to an RT cycle
Log forwarding TCPLogger Interface Forward REPORT_ERROR log events to TCP clients in real time
Integrated client Common/Client/go Go packages for UDPS protocol and WebSocket hub
Debug web client Client/debugger Browser-based debug UI communicating with DebugService

Repository Structure

MARTe_Integrated_components/
├── Common/
│   ├── UDP/                        UDPS binary protocol header (shared by all components)
│   └── Client/go/                  Go packages: udpsprotocol, wshub
├── Source/Components/
│   ├── DataSources/UDPStreamer/     Real-time UDP signal streaming DataSource
│   ├── GAMs/SineArrayGAM/          Sine-wave array generator GAM
│   ├── GAMs/TimeArrayGAM/          Time-reference array GAM
│   ├── Interfaces/DebugService/    Signal tracing/forcing/breakpoint Interface
│   └── Interfaces/TCPLogger/       TCP log-forwarding LoggerConsumerI
├── Test/
│   ├── GTest/                      GTest harness for UDPStreamer unit tests
│   ├── Integration/                Integration tests for DebugService
│   ├── Components/DataSources/UDPStreamer/  UDPStreamer unit tests
│   └── Configurations/             MARTe2 config files for tests and demos
├── Client/debugger/                Go web client for DebugService
└── Docs/                           Documentation

Components

UDPStreamer DataSource

Streams MARTe2 signals over UDP using the UDPS binary protocol. Clients register by sending a CONNECT packet; the server then sends CONFIG (signal metadata) and continuous DATA packets. Features:

  • Optional 16-bit quantization (configurable per signal: QuantizedType)
  • Packed high-frequency bursts (NumberOfElements > 1 with SamplingRate)
  • Automatic packet fragmentation for payloads exceeding MaxPayloadSize

See Docs/UDPStreamer.md and Docs/Protocol.md.

SineArrayGAM

Generates a continuous float32 sine-wave array every RT cycle. Used as a signal source for testing and demo applications. Configurable: Frequency, Amplitude, Phase, SamplingRate, NumberOfElements.

See Docs/SineArrayGAM.md.

TimeArrayGAM

Generates a time-reference uint64 array. Each element holds the timestamp of the corresponding sample in a packed burst, computed from the RT cycle timestamp and the configured SamplingRate.

Anchor selects how the burst is placed in time:

Anchor out[k]
FirstSample input + k · period
LastSample input (N1k) · period
Continuous input(first cycle) + (n + k) · period

FirstSample/LastSample re-read the timer each cycle, so a lost RT cycle (LinuxTimer re-phases with counter += nCycles) punches a whole-period hole into the time base even though only one array of samples was produced. Use Continuous when the data signal is itself contiguous (SineArrayGAM never skips phase): it latches the timer once and then advances an internal sample counter by N per cycle, like an acquisition card running off its own clock.

DebugService Interface

Instruments a running MARTe2 application without modifying its source code. On Initialise() it patches the ClassRegistryDatabase to wrap all standard MemoryMap*Broker types. When RealTimeApplication::ConfigureApplication() runs afterward the application transparently uses the wrapped brokers.

Capabilities accessible over TCP (port 8080 by default):

  • DISCOVER — enumerate all signals with type and alias metadata
  • TRACE — enable/disable high-speed UDP telemetry per signal (with decimation)
  • FORCE / UNFORCE — inject persistent values into signals on the RT path
  • BREAK — set conditional breakpoints (>, <, ==, etc.)
  • PAUSE / RESUME / STEP — execution stepping
  • TREE / INFO / LS — live ORD navigation
  • VALUE — read current signal value on demand
  • MSG — send MARTe2 Message to any ORD object

High-speed signal telemetry is streamed as UDP binary datagrams (port 8081). Logs are forwarded via TcpLogger (port 8082).

See Docs/DebugService.md.

TCPLogger Interface

A LoggerConsumerI that forwards every MARTe2 REPORT_ERROR call to up to 8 TCP clients on a configurable port. Works as a sidecar to DebugService.

StreamHub Application

Headless C++ hub (Source/Applications/StreamHub/) that aggregates multiple UDPStreamer sources and serves them to oscilloscope clients over WebSocket (port 8090): ring buffers with wall-clock time calibration, LTTB decimation, hub-side trigger engine, per-window zoom. Clients: browser SPA (Client/webui + Client/udpstreamer/static) and native ImGui desktop client (Client/streamhub). Demo: ./run_streamhub.sh -w -g; E2E test: Test/E2E/suite/run_e2e.sh.

See Docs/StreamHub-UserGuide.md, Docs/StreamHub-API.md and Docs/StreamHub-Developer.md.

UDPS Protocol

The Common/UDP/UDPSProtocol.h header defines the shared binary wire format used by both UDPStreamer and DebugService. It is intentionally free of MARTe2-specific dependencies so it can also be used by Go clients (via Common/Client/go/udpsprotocol).

See Docs/Protocol.md.


Build

Prerequisites

  • MARTe2 built and installed (set MARTe2_DIR)
  • MARTe2-components built and installed (set MARTe2_Components_DIR)
  • GCC toolchain, make
  • Go 1.21+ (for clients)

Setup

# Edit env.sh to set MARTe2_DIR and MARTe2_Components_DIR, then:
source env.sh

Build all C++ components

make -f Makefile.gcc core

Build and run tests

make -f Makefile.gcc test
source env.sh
./Build/x86-linux/Test/Integration/IntegrationTests

Build Go clients

# Integrated UDPS web client
cd Common/Client/go && go build ./...

# Debug web client
cd Client/debugger && go build ./...

Clean

make -f Makefile.gcc clean

Quick Start

1. Stream signals with UDPStreamer

Add to your MARTe2 config:

+Streamer = {
    Class          = UDPStreamer
    Port           = 44500
    MaxPayloadSize = 1400
    Signals = {
        Voltage = { Type = float32; Unit = "V" }
    }
}

Launch the web client:

cd Common/Client/go
./udpstreamer-webui --streamer 127.0.0.1:44500 --listen :8080

Open http://localhost:8080 and drag signals onto plots.

2. Debug a running application with DebugService

Add to your MARTe2 config (as a sibling of +App):

+DebugService = {
    Class       = DebugService
    ControlPort = 8080
    UdpPort     = 8081
    LogPort     = 8082
}
+Logger = { Class = TcpLogger; Port = 8082 }

Launch the debug client:

cd Client/debugger
./debugger --listen :9090

Open http://localhost:9090, explore the object tree, trace signals, force values.


Documentation

Document Contents
Docs/Protocol.md UDPS binary wire protocol specification
Docs/UDPStreamer.md UDPStreamer DataSource configuration reference
Docs/UDPS-C-Client.md Standalone C/C++ UDPS receiver library (Common/Client/c)
Docs/SineArrayGAM.md SineArrayGAM configuration reference
Docs/DebugService.md DebugService TCP API and architecture
Docs/Tutorial.md Step-by-step tutorial covering both components
Docs/WebUI.md Web client user guide
Docs/StreamHub-UserGuide.md StreamHub oscilloscope user guide (web + ImGui clients)
Docs/StreamHub-API.md StreamHub WebSocket protocol (commands, events, binary frames)
Docs/StreamHub-Developer.md StreamHub internals, threading, time base, build & E2E tests
ARCHITECTURE.md System architecture overview

License

Licensed under the EUPL v1.1 (see individual source files for copyright notices).

S
Description
No description provided
Readme
43 MiB
Languages
C++ 35.5%
Makefile 23.3%
JavaScript 11.3%
Go 10.2%
C 7.6%
Other 12.1%