Integration Test Results by Device

These devices are fully tested in most software releases:

Device Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
arubacx 134 50 8
bird 118 64
cat8000v 201 32 2
crpd 104 71 1
csr 182 42 3
dellos10 137 52 4
dnsmasq 7 16
eos 229 29 3
frr 219 26
iol 190 30 1
ioll2 197 34 2
iosxr 132 51
linux 20 75
srlinux 130 62 2
srsim 127 79
vjunos-router 152 51 1
vjunos-switch 154 55 1
vptx 142 61 2
vyos 278 116 6

Notes:

We try to do our best to support these devices, but we can't do miracles. However, we do run tests whenever we make a change in device configuration template or device definitions.

Device Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
cisco8000v 144 47 2
cumulus 145 35 3
cumulus_nvue 98 49
exos 28 30
iosv 160 27 2
iosvl2 165 27 2
nxos 103 78 3
openbsd 68 67 2
routeros7 87 75
sonic 100 42 1 2
sros 115 67
vpp 41 21

We don't test these devices. It might not be worth it, or they are too slow to boot, or it's impossible to get a decent device image, or the vendor concocted some crazy evaluation/licensing restrictions.

Feature Coverage

Feature Passed Caveat Validation
failed
Configuration
failed
Crashed
Initial configuration 221 4 1
OSPFv2 298 2
OSPFv3 328 12 1
BGP 414 4
BGP sessions 237 4
BGP policies 69
EBGP multihop 40
IS-IS 153
EIGRP 14
RIPv2/RIPng 69 6
Routing Policies 155 1
Routing Filters 66
Static Routes 133 2
VLANs 382
VRFs 390 1
VXLAN 96 1
EVPN/VXLAN 117 5
EVPN/MPLS 14 1
EVPN Designs 88
EVPN multihoming 4
MPLS (LDP, VPN) 182
SR-MPLS 64
DHCPv4/v6 73 1
First-hop gateway 38 3
Link aggregation (LAG) 40 2
Spanning Tree (STP) 43
SRv6 10
Tunnel interfaces 24
Network services 16

Platform Features Integration Test Results

Feature Passed Not
supported
Crashed Config
failed
Validation
failed
clab 4
cli 3 2
components 1
config 5
graph 5
large 3
libvirt 4
multiprovider 3
tc 2
templates 3
unmanaged 3
validate 5