Subscribe
THE DAILY DIGEST

The daily edition.

Essential reading from Rocket Enterprise. Straight to the source.

Archived edition
DAILY EDITION1 story· 4 min read

Observability via Consolidated Tracing Facility (CTF) & OpenTelemetry

In complex rehosted environments where multi-step batch jobs (JCL) and online transaction processors (CICS/IMS) execute concurrently across multi-process Service Execution Processes (SEPs), isolating performance anomalies, race conditions, or intermittent database timeouts requires granular diagnostic visibility without attaching invasive debuggers or recompiling application code.

IN FOCUS

Observability via Consolidated Tracing Facility (CTF) & OpenTelemetry

In complex rehosted environments where multi-step batch jobs (JCL) and online transaction processors (CICS/IMS) execute concurrently across multi-process Service Execution Processes (SEPs), isolating performance anomalies, race conditions, or intermittent database timeouts requires granular diagnostic visibility without attaching invasive debuggers or recompiling application code. [1]

Read the full briefing

1. Capability Overview

In complex rehosted environments where multi-step batch jobs (JCL) and online transaction processors (CICS/IMS) execute concurrently across multi-process Service Execution Processes (SEPs), isolating performance anomalies, race conditions, or intermittent database timeouts requires granular diagnostic visibility without attaching invasive debuggers or recompiling application code.

Rocket Enterprise Server 12.0 delivers a two-tiered observability framework:

  1. Consolidated Tracing Facility (CTF): An embedded diagnostic tracing infrastructure designed for low-overhead, component-level capture of runtime internals (COBOL Run-Time System, XA switch modules, JCL initiators, CICS/IMS engines, and communication listeners) (Consolidated Tracing Facility - Rocket Software Documentation).
  2. OpenTelemetry Integration (12.0): Native support for modern distributed tracing and metric collection, enabling teams to pipe runtime telemetry directly into enterprise Application Performance Monitoring (APM) platforms such as Jaeger, Prometheus, Dynatrace, Datadog, or Grafana via standard OpenTelemetry Protocol (OTLP) pipelines (Using OpenTelemetry - Rocket Software Documentation).

2. Architecture & How It Works

  • Declarative Configuration & CTF Emitters: CTF behavior is governed by a declarative configuration file (typically ctf.cfg) specified via the MFTRACE_CONFIG environment variable (To Enable CTF Tracing - Rocket Software Documentation).
    • Pluggable Emitters: Trace records are processed by modular emitters, primarily binfile (high-performance binary output), textfile (human-readable text), or javalogger (Emitter List - Rocket Software Documentation). The binfile emitter records events in an indexed, compact binary format that imposes minimal latency on active transaction threads and can be formatted offline.
    • Process-Isolated Logging: Because Enterprise Server operates across independent SEPs, Rocket documentation strongly recommends parameterizing trace file destinations with $(PID) (e.g., location = /var/log/ctf-$(PID).log) to prevent concurrent process file locks and write collisions (mfotl.exporter.#).
  • Surgical Component-Level Filtering: Rather than logging all events indiscriminately, CTF permits granular filtering by subsystem. For example:
  • Modern Distributed Tracing with OpenTelemetry: Enterprise Server 12.0 adds the mfotl.* configuration family to propagate trace context across network boundaries (Configuring OpenTelemetry - Rocket Software Documentation). It supports otlp_http exporters with configurable retry policies, exponential backoff, and gzip compression to ship spans and server performance metrics out to standard collectors without custom application hooks (mfotl.exporter.#).

3. Practical Configuration & Operational Tidbits

  1. Enabling CTF in Region Properties: In ESCWA (Enterprise Server Common Web Administration), go to [Region] > General > Properties > Environment Variables and define (To Enable CTF Tracing - Rocket Software Documentation): All child processes and SEPs instantiated by that region automatically inherit the tracing configuration upon startup.
MFTRACE_CONFIG=/etc/microfocus/ctf.cfg
MFTRACE_LOGS=/var/logs/es_traces
  1. Troubleshooting XA Resource Failures: When an XA database connection or two-phase commit fails intermittently, create a minimal ctf.cfg targeting the mf.esxa component. The resulting log files (cassi.textfile.<pid>.log) capture the underlying vendor client error codes without requiring database re-configuration (RM Switch Module Diagnostics - Rocket Software Documentation).
  2. Production Tracing Guardrails: Avoid enabling global textfile emitters or verbose debug levels across all components in production environments. Instead, use the binfile emitter paired with circular file size limits, or reserve fine-grained tracing for specific target components to prevent log directory exhaustion and preserve transaction throughput (Diagnostics in Enterprise Server - Rocket Software Documentation).

4. Reference Citations (Rocket Enterprise Server 12.0 Manuals)

Enterprise Server · 12.0 · Linux/UNIX
Documentation references
REFERENCE 1Consolidated Tracing Facility - Rocket Software DocumentationEnterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/voj1742951555131.htmlREFERENCE 2Using OpenTelemetry - Rocket Software DocumentationEnterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/cxk1769595532388.htmlREFERENCE 3To Enable CTF Tracing - Rocket Software DocumentationEnterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/cri1742952143503_1.htmlREFERENCE 4Emitter List - Rocket Software DocumentationEnterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/ewl1742952155274_1.htmlREFERENCE 5mfotl.exporter.#Enterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/qvo1742952397616.htmlREFERENCE 6RM Switch Module Diagnostics - Rocket Software DocumentationEnterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/sbb1742951387124.htmlREFERENCE 7Configuring OpenTelemetry - Rocket Software DocumentationEnterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/kmq1761037992518.htmlREFERENCE 8Diagnostics in Enterprise Server - Rocket Software DocumentationEnterprise Server · Rocket Docs 12.0 · Linux/UNIXhttps://docs.rocketsoftware.com/bundle/enterpriseserverux_ug_120/page/cjg1742952166148.html
That’s the briefing.You’ve reached the end of this edition.
More editions

From the archive

View all
Sep 25

IMS Support (IMS TM & IMS DB Emulation)

Sep 24

CICS Intersystem Communication (ISC) & Distributed Processing

Sep 23

Database File Handler (DBFH) & Relational VSAM Datastores