Skip to main content

ArcNet

ArcNet is the encrypted tunnel layer of the EmberNet fabric: the point-to-point IP tunnels between the central platform and every remote site, giving nodes plain Layer 3 reachability to each other for agent check-ins and storage replication.

Where Flux is an identity-based application overlay, ArcNet is a straightforward encrypted IP tunnel.

Flux is the primary path, and ArcNet is the one that needs the network's permission. ArcNet is UDP and wants a reachable port, which is the first thing an industrial network filters; Flux rides outbound TCP/443, which is the egress those sites allow. An endpoint that reports ArcNet as its active path has lost Flux and is degraded, not optimised.

At sites where Flux is the only thing that gets out, ArcNet does not stop working — it is carried over Flux, so the site still gets its Layer 3 tunnel without needing UDP to traverse the plant firewall. That is the normal configuration, not a fallback.

Where it sits

The fabric uses different layers for different jobs:

LayerCarried byWhat rides on it
Layer 3 (IP routing)ArcNetNode-to-node IP reachability and storage replication between nodes
Layer 4+ (application overlay)FluxThe cluster API, cross-site app interfaces, device proxying, remote access
Layer 2 (Ethernet bridging)WeldLegacy protocols that need a broadcast domain, such as EtherNet/IP and PROFINET discovery

Most deployments only use the first two. Weld is operator-toggled and exists for equipment that cannot work any other way.

The cluster API is on Flux, not ArcNet. Nodes reach their own cluster API through a Flux service address rather than a node IP, which is what lets a site keep a working control plane when its ArcNet tunnel is down or was never permitted. Do not design around the assumption that losing ArcNet costs you the control plane; it does not.

Addressing

ArcNet is a hub-and-spoke topology built on RFC 6598 carrier-grade NAT space, 100.64.0.0/10, with the hub at 100.64.0.1.

PropertyValue
TransportUDP
Address space100.64.0.0/10 (RFC 6598)
TopologyHub-and-spoke
Available addresses4,194,304
Host interfacewg0, at the OS level rather than in a container

RFC 6598 rather than RFC 1918 is a deliberate choice. Factory networks are full of 10.x and 192.168.x addressing, and a management tunnel that collides with plant addressing is a management tunnel you cannot use during an incident. The 100.64.0.0/10 block is non-routable on the public internet, distinct from RFC 1918 space, and large enough that no deployment will exhaust it.

Viewing tunnel status

Admin and Engineer users see a VPN Status card scoped to their own tenant. It shows:

  • Connection count, for example "2 of 3 peers connected"
  • Per-peer rows with peer name, status, and time since last handshake
  • Aggregate transfer, total up and down across your tenant's peers

Status indicators follow the handshake, not a ping:

IndicatorMeaning
Pulsing greenConnected. A handshake completed within the last two minutes
Static grayInactive. No recent handshake; the remote host may be offline
Static redDisabled. The peer has been suspended by platform staff

A handshake older than two minutes does not always mean the tunnel is broken. ArcNet is quiet when there is nothing to send, so a peer that is genuinely idle can drift into gray and recover the moment traffic resumes.

Managing peers

Peer lifecycle is a Global Command function. Platform staff can create, rename, enable, disable, and delete peers, assign each one to a tenant, and retrieve its configuration or enrollment QR code.

Tenant users cannot manage peers. Assigning a peer to a tenant is what makes it visible on that tenant's VPN Status card, so a peer with no tenant tag is visible only to platform staff.

RoleWhat they see
Global CommandThe full mesh, all peers, all tenants, with full management
AdminRead-only VPN status for their own tenant
EngineerRead-only VPN status for their own tenant
OperatorNo VPN visibility

Relationship to the rest of the platform

  • Flux is the primary path and carries application traffic and the cluster API; ArcNet gives nodes Layer 3 IP reachability to each other. They are complementary, not alternatives — and on most sites ArcNet is carried over Flux rather than running beside it.
  • Network Devices reaches managed network equipment over ArcNet tunnels.
  • Ops deploys to clusters that are reachable over ArcNet.
  • Cinder replicates storage between nodes across it.

Next steps