Integration Test Results by Device

These devices are fully tested in each software release:

Device Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
arubacx 130 42 7
bird 69 44
cat8000v 186 28 2
csr 168 21 2
dellos10 131 44 3
dnsmasq 5 14
eos 211 23 2
frr 202 21
iol 177 24 1
ioll2 183 29 2
iosv 156 21 1
iosvl2 158 22 1
linux 19 70
srlinux 105 56 3
srsim 119 75
vjunos-router 111 48 1
vjunos-switch 131 59 1
vptx 113 55 1
vyos 267 100 6

Notes:

We try to do our best to support these devices, but we can't do miracles. However, we do run tests whenever we make a change in device configuration template or device definitions.

Device Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
cisco8000v 104 32
crpd 74 90 1
cumulus 144 35 3
cumulus_nvue 99 47
iosxr 89 32
nxos 95 56
openbsd 41 57
routeros7 57 45 2 3 2
sonic 11 15 1
sros 115 67

We don't test these devices. It might not be worth it, or they are too slow to boot, or it's impossible to get a decent device image, or the vendor concocted some crazy evaluation/licensing restrictions.

Feature Coverage

Feature Passed Caveat Validation
failed
Configuration
failed
Crashed
Initial configuration 180 5
OSPFv2 235 2
OSPFv3 240 13
BGP 385 5
BGP sessions 188
BGP policies 59
EBGP multihop 33
IS-IS 136
EIGRP 14
RIPv2/RIPng 69 6
Routing Policies 129 1
Routing Filters 56
Static Routes 102 2
VLANs 334 2 3
VRFs 368 1
VXLAN 72 1
EVPN 173 4
MPLS (LDP, VPN) 164 1
SR-MPLS 64
DHCPv4/v6 73 1
First-hop gateway 35 3
Link aggregation (LAG) 40 2
Spanning Tree (STP) 42
SRv6 8

Platform Features Integration Test Results

Feature Passed Not
supported
Crashed Config
failed
Validation
failed
clab 4
components 1
config 4 1
graph 5
libvirt 4
multiprovider 3
tc 2
unmanaged 3