summaryrefslogtreecommitdiff
path: root/doc/rfc/rfc2285.txt
diff options
context:
space:
mode:
authorThomas Voss <mail@thomasvoss.com> 2024-11-27 20:54:24 +0100
committerThomas Voss <mail@thomasvoss.com> 2024-11-27 20:54:24 +0100
commit4bfd864f10b68b71482b35c818559068ef8d5797 (patch)
treee3989f47a7994642eb325063d46e8f08ffa681dc /doc/rfc/rfc2285.txt
parentea76e11061bda059ae9f9ad130a9895cc85607db (diff)
doc: Add RFC documents
Diffstat (limited to 'doc/rfc/rfc2285.txt')
-rw-r--r--doc/rfc/rfc2285.txt1403
1 files changed, 1403 insertions, 0 deletions
diff --git a/doc/rfc/rfc2285.txt b/doc/rfc/rfc2285.txt
new file mode 100644
index 0000000..da2c0f8
--- /dev/null
+++ b/doc/rfc/rfc2285.txt
@@ -0,0 +1,1403 @@
+
+
+
+
+
+
+Network Working Group R. Mandeville
+Request for Comments: 2285 European Network Laboratories
+Category: Informational February 1998
+
+
+ Benchmarking Terminology for LAN Switching Devices
+
+Status of this Memo
+
+ This memo provides information for the Internet community. It does
+ not specify an Internet standard of any kind. Distribution of this
+ memo is unlimited.
+
+Copyright Notice
+
+ Copyright (C) The Internet Society (1998). All Rights Reserved.
+
+Table of Contents
+
+ 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . 2
+ 2. Existing definitions . . . . . . . . . . . . . . . . . . . . . . 2
+ 3. Term definitions . . . . . . . . . . . . . . . . . . . . . . . . 3
+ 3.1 Devices. . . . . . . . . . . . . . . . . . . . . . . . . . . 3
+ 3.1.1 Device under test (DUT) . . . . . . . . . . . . . . . . 3
+ 3.1.2 System under test (SUT) . . . . . . . . . . . . . . . . 3
+ 3.2 Traffic orientation. . . . . . . . . . . . . . . . . . . . . 4
+ 3.2.1 Unidirectional traffic. . . . . . . . . . . . . . . . . 4
+ 3.2.2 Bidirectional traffic . . . . . . . . . . . . . . . . . 5
+ 3.3 Traffic distribution . . . . . . . . . . . . . . . . . . . . 6
+ 3.3.1 Non-meshed traffic. . . . . . . . . . . . . . . . . . . 6
+ 3.3.2 Partially meshed traffic. . . . . . . . . . . . . . . . 7
+ 3.3.3 Fully meshed traffic. . . . . . . . . . . . . . . . . . 8
+ 3.4 Bursts . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
+ 3.4.1 Burst . . . . . . . . . . . . . . . . . . . . . . . . . 9
+ 3.4.2 Burst size . . . . . . . . . . . . . . . . . . . . . . 10
+ 3.4.3 Inter-burst gap (IBG). . . . . . . . . . . . . . . . . 10
+ 3.5 Loads . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
+ 3.5.1 Intended load (Iload) . . . . . . . . . . . . . . . . 11
+ 3.5.2 Offered load (Oload) . . . . . . . . . . . . . . . . . 12
+ 3.5.3 Maximum offered load (MOL) . . . . . . . . . . . . . . 13
+ 3.5.4 Overloading . . . . . . . . . . . . . . . . . . . . . 14
+ 3.6 Forwarding rates . . . . . . . . . . . . . . . . . . . . . 15
+ 3.6.1 Forwarding rate (FR) . . . . . . . . . . . . . . . . . 15
+ 3.6.2 Forwarding rate at maximum offered load (FRMOL). . . . 16
+ 3.6.3 Maximum forwarding rate (MFR). . . . . . . . . . . . . 16
+ 3.7 Congestion control . . . . . . . . . . . . . . . . . . . . 17
+ 3.7.1 Backpressure . . . . . . . . . . . . . . . . . . . . . 17
+ 3.7.2 Forward pressure . . . . . . . . . . . . . . . . . . . 18
+
+
+
+Mandeville Informational [Page 1]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ 3.7.3 Head of line blocking . . . . . . . . . . . . . . . . 19
+ 3.8 Address handling . . . . . . . . . . . . . . . . . . . . . 20
+ 3.8.1 Address caching capacity . . . . . . . . . . . . . . . 20
+ 3.8.2 Address learning rate . . . . . . . . . . . . . . . . 20
+ 3.8.3 Flood count . . . . . . . . . . . . . . . . . . . . . 21
+ 3.9 Errored frame filtering . . . . . . . . . . . . . . . . . . 21
+ 3.9.1 Errored frames . . . . . . . . . . . . . . . . . . . . 22
+ 3.10 Broadcasts . . . . . . . . . . . . . . . . . . . . . . . . 22
+ 3.10.1 Broadcast forwarding rate at maximum load . . . . . . 22
+ 3.10.2 Broadcast latency . . . . . . . . . . . . . . . . . . 23
+ 4. Security Considerations . . . . . . . . . . . . . . . . . . . . 24
+ 5. References. . . . . . . . . . . . . . . . . . . . . . . . . . . 24
+ 6. Acknowledgements. . . . . . . . . . . . . . . . . . . . . . . . 24
+ 7. Author's Address. . . . . . . . . . . . . . . . . . . . . . . . 24
+ 8. Full Copyright Statement. . . . . . . . . . . . . . . . . . . . 25
+
+1. Introduction
+
+ This document is intended to provide terminology for the benchmarking
+ of local area network (LAN) switching devices. It extends the
+ terminology already defined for benchmarking network interconnect
+ devices in RFCs 1242 and 1944 to switching devices.
+
+ Although it might be found useful to apply some of the terms defined
+ here to a broader range of network interconnect devices, this RFC
+ primarily deals with devices which switch frames at the Medium Access
+ Control (MAC) layer. It defines terms in relation to the traffic put
+ to use when benchmarking switching devices, forwarding performance,
+ congestion control, latency, address handling and filtering.
+
+2. Existing definitions
+
+ RFC 1242 "Benchmarking Terminology for Network Interconnect Devices"
+ should be consulted before attempting to make use of this document.
+ RFC 1944 "Benchmarking Methodology for Network Interconnect Devices"
+ contains discussions of a number of terms relevant to the
+ benchmarking of switching devices and should also be consulted.
+
+ For the sake of clarity and continuity this RFC adopts the template
+ for definitions set out in Section 2 of RFC 1242. Definitions are
+ indexed and grouped together in sections for ease of reference.
+
+ The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
+ "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
+ document are to be interpreted as described in RFC 2119.
+
+
+
+
+
+
+Mandeville Informational [Page 2]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+3. Term definitions
+
+3.1 Devices
+
+ This group of definitions applies to all types of networking devices.
+
+3.1.1 Device under test (DUT)
+
+ Definition:
+
+ The network forwarding device to which stimulus is offered and
+ response measured.
+
+ Discussion:
+
+ A single stand-alone or modular unit which receives frames on one
+ or more of its interfaces and then forwards them to one or more
+ interfaces according to the addressing information contained in
+ the frame.
+
+ Measurement units:
+
+ n/a
+
+ Issues:
+
+ See Also:
+
+ system under test (SUT) (3.1.2)
+
+3.1.2 System Under Test (SUT)
+
+ Definition:
+
+ The collective set of network devices to which stimulus is offered
+ as a single entity and response measured.
+
+ Discussion:
+
+ A system under test may be comprised of a variety of networking
+ devices. Some devices may be active in the forwarding decision-
+ making process, such as routers or switches; other devices may be
+ passive such as a CSU/DSU. Regardless of constituent components,
+ the system is treated as a singular entity to which stimulus is
+ offered and response measured.
+
+
+
+
+
+
+Mandeville Informational [Page 3]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ Measurement units:
+
+ n/a
+
+ Issues:
+
+ See Also:
+
+ device under test (DUT) (3.1.1)
+
+3.2 Traffic orientation
+
+ This group of definitions applies to the traffic presented to the
+ interfaces of a DUT/SUT and indicates whether the interfaces are
+ receiving only, transmitting only, or both receiving and
+ transmitting.
+
+3.2.1 Unidirectional traffic
+
+ Definition:
+
+ When all frames presented to the input interfaces of a DUT/SUT are
+ addressed to output interfaces which do not themselves receive any
+ frames.
+
+ Discussion:
+
+ This definition conforms to the discussion in section 16 of RFC
+ 1944 which describes how unidirectional traffic can be offered to
+ a DUT/SUT to measure throughput. Unidirectional traffic is also
+ appropriate for:
+
+ -the measurement of the minimum inter-frame gap -the creation of
+ many-to-one or one-to-many interface overload -the detection of
+ head of line blocking -the measurement of forwarding rates and
+ throughput when congestion control mechanisms are active.
+
+ When a tester offers unidirectional traffic to a DUT/SUT reception
+ and transmission are handled by different interfaces or sets of
+ interfaces of the DUT/SUT. All frames received from the tester by
+ the DUT/SUT are transmitted back to the tester from interfaces
+ which do not themselves receive any frames.
+
+ It is useful to distinguish traffic orientation and traffic
+ distribution when considering traffic patterns used in device
+ testing. Unidirectional traffic, for example, is traffic
+ orientated in a single direction between mutually exclusive sets
+ of source and destination interfaces of a DUT/SUT. Such traffic,
+
+
+
+Mandeville Informational [Page 4]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ however, can be distributed between interfaces in different ways.
+ When traffic is sent to two or more interfaces from an external
+ source and then forwarded by the DUT/SUT to a single output
+ interface the traffic orientation is unidirectional and the
+ traffic distribution between interfaces is many-to-one. Traffic
+ can also be sent to a single input interface and forwarded by the
+ DUT/SUT to two or more output interfaces to achieve a one-to-many
+ distribution of traffic.
+
+ Such traffic distributions can also be combined to test for head
+ of line blocking or to measure forwarding rates and throughput
+ when congestion control mechanisms are active.
+
+ When a DUT/SUT is equipped with interfaces running at different
+ media rates the number of input interfaces required to load or
+ overload an output interface or interfaces will vary.
+
+ It should be noted that measurement of the minimum inter-frame gap
+ serves to detect violations of the IEEE 802.3 standard.
+
+ Issues:
+
+ half duplex / full duplex
+
+ Measurement units:
+
+ n/a
+
+ See Also:
+
+ bidirectional traffic (3.2.2)
+ non-meshed traffic (3.3.1)
+ partially meshed traffic (3.3.2)
+ fully meshed traffic (3.3.3)
+ congestion control (3.7)
+ head of line blocking (3.7.3)
+
+3.2.2 Bidirectional traffic
+
+ Definition:
+
+ Frames presented to a DUT/SUT such that every receiving interface
+ also transmits.
+
+ Discussion:
+
+ This definition conforms to the discussion in section 14 of RFC
+ 1944.
+
+
+
+Mandeville Informational [Page 5]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ When a tester offers bidirectional traffic to a DUT/SUT all the
+ interfaces which receive frames from the tester also transmit
+ frames back to the tester.
+
+ Bidirectional traffic MUST be offered when measuring the
+ throughput or forwarding rate of full duplex interfaces of a
+ switching device.
+
+ Issues:
+
+ truncated binary exponential back-off algorithm
+
+ Measurement units:
+
+ n/a
+
+ See Also:
+
+ unidirectional traffic (3.2.1)
+ non-meshed traffic (3.3.1)
+ partially meshed traffic (3.3.2)
+ fully meshed traffic (3.3.3)
+
+3.3 Traffic distribution
+
+ This group of definitions applies to the distribution of frames
+ forwarded by a DUT/SUT.
+
+3.3.1 Non-meshed traffic
+
+ Definition:
+
+ Frames offered to a single input interface and addressed to a
+ single output interface of a DUT/SUT where input and output
+ interfaces are grouped in mutually exclusive pairs.
+
+ Discussion:
+
+ In the simplest instance of non-meshed traffic all frames are
+ offered to a single input interface and addressed to a single
+ output interface. The one-to-one mapping of input to output
+ interfaces required by non-meshed traffic can be extended to
+ multiple mutually exclusive pairs of input and output interfaces.
+
+ Measurement units:
+
+ n/a
+
+
+
+
+Mandeville Informational [Page 6]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ Issues:
+
+ half duplex / full duplex
+
+ See Also:
+
+ unidirectional traffic (3.2.1)
+ bidirectional traffic (3.2.2)
+ partially meshed traffic (3.3.2.)
+ fully meshed traffic (3.3.3)
+ burst (3.4.1)
+
+3.3.2 Partially meshed traffic
+
+ Definition:
+
+ Frames offered to one or more input interfaces of a DUT/SUT and
+ addressed to one or more output interfaces where input and output
+ interfaces are mutually exclusive and mapped one-to-many, many-
+ to-one or many-to-many.
+
+ Discussion:
+
+ This definition follows from the discussion in section 16 of RFC
+ 1944 on multi-port testing. Partially meshed traffic allows for
+ one-to-many, many-to-one or many-to-many mappings of input to
+ output interfaces and readily extends to configurations with
+ multiple switching devices linked together over backbone
+ connections.
+
+ It should be noted that partially meshed traffic can load backbone
+ connections linking together two switching devices or systems more
+ than fully meshed traffic. When offered partially meshed traffic
+ devices or systems can be set up to forward all of the frames they
+ receive to the opposite side of the backbone connection whereas
+ fully meshed traffic requires at least some of the offered frames
+ to be forwarded locally, that is to the interfaces of the DUT/SUT
+ receiving them. Such frames will not traverse the backbone
+ connection.
+
+ Measurement units:
+
+ n/a
+
+ Issues:
+
+ half duplex / full duplex
+
+
+
+
+Mandeville Informational [Page 7]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ See Also:
+
+ unidirectional traffic (3.2.1)
+ bidirectional traffic (3.2.2)
+ non-meshed traffic (3.3.1)
+ fully meshed traffic (3.3.3)
+ burst (3.4.1)
+
+3.3.3 Fully meshed traffic
+
+ Definition:
+
+ Frames offered to a designated number of interfaces of a DUT/SUT
+ such that each one of the interfaces under test receives frames
+ addressed to all of the other interfaces under test.
+
+ Discussion:
+
+ As with bidirectional partially meshed traffic, fully meshed
+ traffic requires each one the interfaces of a DUT/SUT to both
+ receive and transmit frames. But since the interfaces are not
+ divided into groups as with partially meshed traffic every
+ interface forwards frames to and receives frames from every other
+ interface. The total number of individual input/output interface
+ pairs when traffic is fully meshed over n switched interfaces
+ equals n x (n - 1). This compares with n x (n / 2) such interface
+ pairs when traffic is partially meshed.
+
+ Fully meshed traffic on half duplex interfaces is inherently
+ bursty since interfaces must interrupt transmission whenever they
+ receive frames. This kind of bursty meshed traffic is
+ characteristic of real network traffic and can be advantageously
+ used to diagnose a DUT/SUT by exercising many of its component
+ parts simultaneously. Additional inspection may be warranted to
+ correlate the frame forwarding capacity of a DUT/SUT when offered
+ meshed traffic and the behavior of individual elements such as
+ input or output buffers, buffer allocation mechanisms, aggregate
+ switching capacity, processing speed or medium access control.
+
+ The analysis of forwarding rate measurements presents a challenge
+ when offering bidirectional or fully meshed traffic since the rate
+ at which the tester can be observed to transmit frames to the
+ DUT/SUT may be smaller than the rate at which it intends to
+ transmit due to collisions on half duplex media or the action of
+ congestion control mechanisms. This makes it important to take
+ account of both the intended and offered loads defined in sections
+ 3.5.1.and 3.5.2 below when reporting the results of such
+ forwarding rate measurements.
+
+
+
+Mandeville Informational [Page 8]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ When offering bursty meshed traffic to a DUT/SUT a number of
+ variables have to be considered. These include frame size, the
+ number of frames within bursts, the interval between bursts as
+ well as the distribution of load between incoming and outgoing
+ traffic. Terms related to bursts are defined in section 3.4
+ below.
+
+ Measurement units:
+
+ n/a
+
+ Issues:
+
+ half duplex / full duplex
+
+ See Also:
+
+ unidirectional traffic (3.2.1)
+ bidirectional traffic (3.2.2)
+ non-meshed traffic (3.3.1)
+ partially meshed traffic (3.3.2)
+ burst (3.4.1)
+ intended load (3.5.1)
+ offered load (3.5.2)
+
+3.4 Bursts
+
+ This group of definitions applies to the intervals between frames or
+ groups of frames offered to the DUT/SUT.
+
+3.4.1 Burst
+
+ Definition:
+
+ A sequence of frames transmitted with the minimum legal inter-
+ frame gap.
+
+ Discussion:
+
+ This definition follows from discussions in section 3.16 of RFC
+ 1242 and section 21 of RFC 1944 which describes cases where it is
+ useful to consider isolated frames as single frame bursts.
+
+ Measurement units:
+
+ n/a
+
+ Issues:
+
+
+
+Mandeville Informational [Page 9]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ See Also:
+
+ burst size (3.4.2)
+ inter-burst gap (IBG) (3.4.3)
+
+3.4.2 Burst size
+
+ Definition:
+
+ The number of frames in a burst.
+
+ Discussion:
+
+ Burst size can range from one to infinity. In unidirectional
+ traffic as well as in bidirectional or meshed traffic on full
+ duplex interfaces there is no theoretical limit to burst length.
+ When traffic is bidirectional or meshed bursts on half duplex
+ media are finite since interfaces interrupt transmission
+ intermittently to receive frames.
+
+ On real networks burst size will normally increase with window
+ size. This makes it desirable to test devices with small as well
+ as large burst sizes.
+
+ Measurement units:
+
+ number of N-octet frames
+
+ Issues:
+
+ See Also:
+
+ burst (3.4.1)
+ inter-burst gap (IBG) (3.4.3)
+
+3.4.3 Inter-burst gap (IBG)
+
+ Definition:
+
+ The interval between two bursts.
+
+ Discussion:
+
+ This definition conforms to the discussion in section 20 of RFC
+ 1944 on bursty traffic.
+
+
+
+
+
+
+Mandeville Informational [Page 10]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ Bidirectional and meshed traffic are inherently bursty since
+ interfaces share their time between receiving and transmitting
+ frames. External sources offering bursty traffic for a given
+ frame size and burst size must adjust the inter-burst gap to
+ achieve a specified average rate of frame transmission.
+
+ Measurement units:
+
+ nanoseconds
+ microseconds
+ milliseconds
+ seconds
+
+ Issues:
+
+ See Also:
+
+ burst (3.4.1)
+ burst size (3.4.2)
+
+3.5 Loads
+
+ This group of definitions applies to the rates at which traffic is
+ offered to any DUT/SUT.
+
+3.5.1 Intended load (Iload)
+
+ Definition:
+
+ The number of frames per second that an external source attempts
+ to transmit to a DUT/SUT for forwarding to a specified output
+ interface or interfaces.
+
+ Discussion:
+
+ Collisions on CSMA/CD links or the action of congestion control
+ mechanisms can effect the rate at which an external source of
+ traffic transmits frames to a DUT/SUT. This makes it useful to
+ distinguish the load that an external source attempts to apply to
+ a DUT/SUT and the load it is observed or measured to apply.
+
+ In the case of Ethernet an external source of traffic MUST
+ implement the truncated binary exponential back-off algorithm to
+ ensure that it is accessing the medium legally
+
+
+
+
+
+
+
+Mandeville Informational [Page 11]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ Measurement units:
+
+ bits per second
+ N-octets per second
+ (N-octets per second / media_maximum-octets per second) x 100
+
+ Issues:
+
+ See Also:
+
+ burst (3.4.1)
+ inter-burst gap (3.4.3)
+ offered load (3.5.2)
+
+3.5.2 Offered load (Oload)
+
+ Definition:
+
+ The number of frames per second that an external source can be
+ observed or measured to transmit to a DUT/SUT for forwarding to a
+ specified output interface or interfaces.
+
+ Discussion:
+
+ The load which an external device can be observed to apply to a
+ DUT/SUT may be less than the intended load due to collisions on
+ half duplex media or the action of congestion control mechanisms.
+ This makes it important to distinguish intended and offered load
+ when analyzing the results of forwarding rate measurements using
+ bidirectional or fully meshed traffic.
+
+ Frames which are not successfully transmitted by an external
+ source of traffic to a DUT/SUT MUST NOT be counted as transmitted
+ frames when measuring forwarding rates.
+
+ The frame count on an interface of a DUT/SUT may exceed the rate
+ at which an external device offers frames due to the presence of
+ spanning tree BPDUs (Bridge Protocol Data Units) on 802.1D-
+ compliant switches or SNMP frames. Such frames should be treated
+ as modifiers as described in section 11 of RFC 1944.
+
+ Offered load MUST be indicated when reporting the results of
+ forwarding rate measurements.
+
+
+
+
+
+
+
+
+Mandeville Informational [Page 12]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ Measurement units:
+
+ bits per second
+ N-octets per second
+ (N-octets per second / media_maximum-octets per second) x 100
+
+ Issues:
+
+ token ring
+
+ See Also:
+
+ bidirectional traffic (3.2.2)
+ fully meshed traffic (3.3.3)
+ intended load (3.5.1)
+ forwarding rate (3.6.1)
+
+3.5.3 Maximum offered load (MOL)
+
+ Definition:
+
+ The highest number of frames per second that an external source
+ can transmit to a DUT/SUT for forwarding to a specified output
+ interface or interfaces.
+
+ Discussion:
+
+ The maximum load that an external device can apply to a DUT/SUT
+ may not equal the maximum load allowed by the medium. This
+ will be the case when an external source lacks the resources
+ to transmit frames at the minimum legal inter-frame gap or when
+ it has sufficient resources to transmit frames below the
+ minimum legal inter-frame gap. Moreover, maximum load may vary
+ with respect to parameters other than a medium's maximum
+ theoretical utilization. For example, on those media employing
+ tokens, maximum load may vary as a function of Token Rotation
+ Time, Token Holding Time, or the ability to chain multiple
+ frames to a single token. The maximum load that an external
+ device applies to a DUT/SUT MUST be specified when measuring
+ forwarding rates.
+
+ Measurement units:
+
+ bits per second
+ N-octets per second
+ (N-octets per second / media_maximum-octets per second) x 100
+
+ Issues:
+
+
+
+Mandeville Informational [Page 13]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ See Also:
+
+ offered load (3.5.2)
+
+3.5.4 Overloading
+
+ Definition:
+
+ Attempting to load a DUT/SUT in excess of the maximum rate of
+ transmission allowed by the medium.
+
+ Discussion:
+
+ Overloading can serve to exercise buffers and buffer allocation
+ algorithms as well as congestion control mechanisms. The number
+ of input interfaces required to overload one or more output
+ interfaces of a DUT/SUT will vary according to the media rates of
+ the interfaces involved.
+
+ An external source can also overload an interface by transmitting
+ frames below the minimum inter-frame gap. A DUT/SUT MUST forward
+ such frames at intervals equal to or above the minimum gap
+ specified in standards.
+
+ A DUT/SUT using congestion control techniques such as backpressure
+ or forward pressure may exhibit no frame loss when a tester
+ attempts to overload one or more of its interfaces. This should
+ not be exploited to suggest that the DUT/SUT supports rates of
+ transmission in excess of the maximum rate allowed by the medium
+ since both techniques reduce the rate at which the tester offers
+ frames to prevent overloading. Backpressure achieves this purpose
+ by jamming the transmission interfaces of the tester and forward
+ pressure by hindering the tester from gaining fair access to the
+ medium. Analysis of both cases should take the distinction
+ between intended load (3.5.1) and offered load (3.5.2) into
+ account.
+
+ Measurement units:
+
+ bits per second
+ N-octets per second
+ (N-octets per second / media_maximum-octets per second) x 100
+
+ Issues:
+
+
+
+
+
+
+
+Mandeville Informational [Page 14]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ See Also:
+
+ unidirectional traffic (3.2.1)
+ intended load (3.5.1)
+ offered load (3.5.2)
+ forwarding rate (3.6.1)
+ backpressure (3.7.1)
+ forward pressure (3.7.2)
+
+3.6 Forwarding rates
+
+ This group of definitions applies to the rates at which traffic is
+ forwarded by any DUT/SUT in response to a stimulus.
+
+3.6.1 Forwarding rate (FR)
+
+ Definition:
+
+ The number of frames per second that a device can be observed to
+ successfully transmit to the correct destination interface in
+ response to a specified offered load.
+
+ Discussion:
+
+ Unlike throughput defined in section 3.17 of RFC 1242, forwarding
+ rate makes no explicit reference to frame loss. Forwarding rate
+ refers to the number of frames per second observed on the output
+ side of the interface under test and MUST be reported in relation
+ to the offered load. Forwarding rate can be measured with
+ different traffic orientations and distributions.
+
+ It should be noted that the forwarding rate of a DUT/SUT may be
+ sensitive to the action of congestion control mechanisms.
+
+ Measurement units:
+
+ N-octet frames per second
+
+ Issues:
+
+ See Also:
+
+ offered load (3.5.2)
+ forwarding rate at maximum offered load (3.6.2)
+ maximum forwarding rate (3.6.3)
+
+
+
+
+
+
+Mandeville Informational [Page 15]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+3.6.2 Forwarding rate at maximum offered load (FRMOL)
+
+ Definition:
+
+ The number of frames per second that a device can be observed to
+ successfully transmit to the correct destination interface in
+ response to the maximum offered load.
+
+ Discussion:
+
+ Forwarding rate at maximum offered load may be less than the
+ maximum rate at which a device can be observed to successfully
+ forward traffic. This will be the case when the ability of a
+ device to forward frames degenerates when offered traffic at
+ maximum load.
+
+ Maximum offered load MUST be cited when reporting forwarding rate
+ at maximum offered load.
+
+ Measurement units:
+
+ N-octet frames per second
+
+ Issues:
+
+ See Also:
+
+ maximum offered load (3.5.3)
+ forwarding rate (3.6.1)
+ maximum forwarding rate (3.6.3)
+
+3.6.3 Maximum forwarding rate (MFR)
+
+ Definition:
+
+ The highest forwarding rate of a DUT/SUT taken from an iterative
+ set of forwarding rate measurements.
+
+ Discussion:
+
+ The forwarding rate of a device may degenerate before maximum load
+ is reached. The load applied to a device must be cited when
+ reporting maximum forwarding rate.
+
+
+
+
+
+
+
+
+Mandeville Informational [Page 16]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ The following example illustrates how the terms relative to
+ loading and forwarding rates are meant to be used. In particular
+ it shows how the distinction between forwarding rate at maximum
+ offered load (FRMOL) and maximum forwarding rate (MFR) can be used
+ to characterize a DUT/SUT.
+
+ (A) (B)
+ Test Device DUT/SUT
+ Offered Load Forwarding Rate
+ ------------ ---------------
+ (1) 14,880 fps - MOL 7,400 fps - FRMOL
+ (2) 13,880 fps 8,472 fps
+ (3) 12,880 fps 12,880 fps - MFR
+
+ Measurement units:
+
+ N-octet frames per second
+
+ Issues:
+
+ See Also:
+
+ offered load (3.5.2)
+ forwarding rates (3.6.1)
+ forwarding rate at maximum load (3.6.2)
+
+3.7 Congestion control
+
+ This group of definitions applies to the behavior of a DUT/SUT when
+ congestion or contention is present.
+
+3.7.1 Backpressure
+
+ Definition:
+
+ Any technique used by a DUT/SUT to attempt to avoid frame loss by
+ impeding external sources of traffic from transmitting frames to
+ congested interfaces.
+
+ Discussion:
+
+ Some switches send jam signals, for example preamble bits, back to
+ traffic sources when their transmit and/or receive buffers start
+ to overfill. Switches implementing full duplex Ethernet links may
+ use IEEE 802.3x Flow Control for the same purpose. Such devices
+ may incur no frame loss when external sources attempt to offer
+ traffic to congested or overloaded interfaces.
+
+
+
+
+Mandeville Informational [Page 17]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ It should be noted that jamming and other flow control methods may
+ slow all traffic transmitted to congested input interfaces
+ including traffic intended for uncongested output interfaces.
+
+ A DUT/SUT applying backpressure may exhibit no frame loss when a
+ tester attempts to overload one or more of its interfaces. This
+ should not be interpreted to suggest that the interfaces of the
+ DUT/SUT support forwarding rates above the maximum rate allowed by
+ the medium. In these cases overloading is only apparent since
+ through the application of backpressure the DUT/SUT avoids
+ overloading by reducing the rate at which the tester can offer
+ frames.
+
+ Measurement units:
+
+ frame loss on congested interface or interfaces N-octet frames per
+ second between the interface applying backpressure and an
+ uncongested destination interface
+
+ Issues:
+
+ jamming not explicitly described in standards
+
+ See Also:
+
+ intended load (3.5.1)
+ offered load (3.5.2)
+ overloading (3.5.4)
+ forwarding rate (3.6.1)
+ forward pressure (3.7.2)
+
+3.7.2 Forward pressure
+
+ Definition:
+
+ Methods which depart from or otherwise violate a defined
+ standardized protocol in an attempt to increase the forwarding
+ performance of a DUT/SUT.
+
+ Discussion:
+
+ A DUT/SUT may be found to inhibit or abort back-off algorithms in
+ order to force access to the medium when contention occurs. It
+ should be noted that the back-off algorithm should be fair whether
+ the DUT/SUT is in a congested or an uncongested state.
+ Transmission below the minimum inter-frame gap or the disregard of
+ flow control primitives fall into this category.
+
+
+
+
+Mandeville Informational [Page 18]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ A DUT/SUT applying forward pressure may eliminate all or most
+ frame loss when a tester attempts to overload one or more of its
+ interfaces. This should not be interpreted to suggest that the
+ interfaces of the DUT/SUT can sustain forwarding rates above the
+ maximum rate allowed by the medium. Overloading in such cases is
+ only apparent since the application of forward pressure by the
+ DUT/SUT enables interfaces to relieve saturated output queues by
+ forcing access to the medium and concomitantly inhibiting the
+ tester from transmitting frames.
+
+ Measurement units:
+
+ intervals between frames in microseconds
+ intervals in microseconds between transmission retries during
+ 16 successive collisions.
+
+ Issues:
+
+ truncated binary exponential back-off algorithm
+
+ See Also:
+
+ intended load (3.5.1)
+ offered load (3.5.2)
+ overloading (3.5.4)
+ forwarding rate (3.6.1)
+ backpressure (3.7.1)
+
+3.7.3 Head of line blocking
+
+ Definition:
+
+ Frame loss or added delay observed on an uncongested output
+ interface whenever frames are received from an input interface
+ which is also attempting to forward frames to a congested output
+ interface.
+
+ Discussion:
+
+ It is important to verify that a switch does not slow transmission
+ or drop frames on interfaces which are not congested whenever
+ overloading on one of its other interfaces occurs.
+
+ Measurement units:
+
+ forwarding rate and frame loss recorded on an uncongested
+ interface when receiving frames from an interface which is also
+ forwarding frames to a congested interface.
+
+
+
+Mandeville Informational [Page 19]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ Issues:
+
+ input buffers
+
+ See Also:
+
+ unidirectional traffic (3.2.1)
+
+3.8 Address handling
+
+ This group of definitions applies to the address resolution process
+ enabling a DUT/SUT to forward frames to their correct destinations.
+
+3.8.1 Address caching capacity
+
+ Definition:
+
+ The number of MAC addresses per n interfaces, per module or per
+ device that a DUT/SUT can cache and successfully forward frames to
+ without flooding or dropping frames.
+
+ Discussion:
+
+ Users building networks will want to know how many nodes they can
+ connect to a switch. This makes it necessary to verify the number
+ of MAC addresses that can be assigned per n interfaces, per module
+ and per chassis before a DUT/SUT begins flooding frames.
+
+ Measurement units:
+
+ number of MAC addresses per n interfaces, modules, or chassis
+
+ Issues:
+
+ See Also:
+
+ address learning rate (3.8.2)
+
+3.8.2 Address learning rate
+
+ Definition:
+
+ The maximum rate at which a switch can learn new MAC addresses
+ without flooding or dropping frames.
+
+
+
+
+
+
+
+Mandeville Informational [Page 20]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ Discussion:
+
+ Users may want to know how long it takes a switch to build its
+ address tables. This information is useful to have when
+ considering how long it takes a network to come up when many users
+ log on in the morning or after a network crash.
+
+ Measurement units:
+
+ frames with different source addresses per second
+
+ Issues:
+
+ See Also:
+
+ address caching capacity (3.8.1)
+
+3.8.3 Flood count
+
+ Definition:
+
+ Frames forwarded to interfaces which do not correspond to the
+ destination MAC address information when traffic is offered to a
+ DUT/SUT for forwarding.
+
+ Discussion:
+
+ When recording throughput statistics it is important to check that
+ frames have been forwarded to their proper destinations. Flooded
+ frames MUST NOT be counted as received frames. Both known and
+ unknown unicast frames can be flooded.
+
+ Measurement units:
+
+ N-octet valid frames
+
+ Issues:
+
+ spanning tree BPDUs.
+
+ See Also:
+
+ address caching capacity (3.8.1)
+
+3.9 Errored frame filtering
+
+ This group of definitions applies to frames with errors which a
+ DUT/SUT may filter.
+
+
+
+Mandeville Informational [Page 21]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+3.9.1 Errored frames
+
+ Definition:
+
+ Frames which are over-sized, under-sized, misaligned or with an
+ errored Frame Check Sequence.
+
+ Discussion:
+
+ Switches, unlike IEEE 802.1d compliant bridges, do not necessarily
+ filter all types of illegal frames. Some switches, for example,
+ which do not store frames before forwarding them to their
+ destination interfaces may not filter over-sized frames (jabbers)
+ or verify the validity of the Frame Check Sequence field. Other
+ illegal frames are under-sized frames (runts) and misaligned
+ frames.
+
+ Measurement units:
+
+ n/a
+
+ Issues:
+
+ See Also:
+
+3.10 Broadcasts
+
+ This group of definitions applies to MAC layer and network layer
+ broadcast frames.
+
+3.10.1 Broadcast forwarding rate
+
+ Definition:
+
+ The number of broadcast frames per second that a DUT/SUT can be
+ observed to deliver to all interfaces located within a broadcast
+ domain in response to a specified offered load of frames directed
+ to the broadcast MAC address.
+
+ Discussion:
+
+ There is no standard forwarding mechanism used by switches to
+ forward broadcast frames. It is useful to determine the broadcast
+ forwarding rate for frames switched between interfaces on the same
+ card, interfaces on different cards in the same chassis and
+
+
+
+
+
+
+Mandeville Informational [Page 22]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+ interfaces on different chassis linked together over backbone
+ connections. The terms maximum broadcast forwarding rate and
+ broadcast forwarding rate at maximum load follow directly from the
+ terms already defined for forwarding rate measurements in section
+ 3.6 above.
+
+ Measurement units:
+
+ N-octet frames per second
+
+ Issues:
+
+ See Also:
+
+ forwarding rate at maximum load (3.6.2)
+ maximum forwarding rate (3.6.3)
+ broadcast latency (3.10.2)
+
+3.10.2 Broadcast latency
+
+ Definition:
+
+ The time required by a DUT/SUT to forward a broadcast frame to
+ each interface located within a broadcast domain.
+
+ Discussion:
+
+ Since there is no standard way for switches to process
+ broadcast frames, broadcast latency may not be the same on all
+ receiving interfaces of a switching device. The latency
+ measurements SHOULD be bit oriented as described in section 3.8
+ of RFC 1242. It is useful to determine broadcast latency for
+ frames forwarded between interfaces on the same card, on
+ different cards in the same chassis and on different chassis
+ linked over backbone connections.
+
+ Measurement units:
+
+ nanoseconds
+ microseconds
+ milliseconds
+ seconds
+
+ Issues:
+
+ See Also:
+
+ broadcast forwarding rate (3.10.1)
+
+
+
+Mandeville Informational [Page 23]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+4. Security Considerations
+
+ Documents of this type do not directly effect the security of the
+ Internet or of corporate networks as long as benchmarking is not
+ performed on devices or systems connected to operating networks.
+
+ The document points out that switching devices may violate the IEEE
+ 802.3 standard by transmitting frames below the minimum interframe
+ gap or unfairly accessing the medium by inhibiting the backoff
+ algorithm. Although such violations do not directly engender
+ breaches in security, they may perturb the normal functioning of
+ other interworking devices by obstructing their access to the medium.
+ Their use on the Internet or on corporate networks should be
+ discouraged.
+
+5. References
+
+ [1] Bradner, S., "Benchmarking Terminology for Network
+ Interconnection Devices", RFC 1242, July 1991.
+
+ [2] Bradner, S., and J. McQuaid, "Benchmarking Methodology for
+ Network Interconnect Devices", RFC 1944, May 1996.
+
+6. Acknowledgments
+
+ The Benchmarking Methodology Working Group of the IETF and
+ particularly Kevin Dubray (Bay Networks) are to be thanked for the
+ many suggestions they collectively made to help complete this
+ document. Ajay Shah (WG), Jean-Christophe Bestaux (ENL), Henry Hamon
+ (Netcom Systems), Stan Kopek (Digital) and Doug Ruby (Prominet) all
+ provided valuable input at various stages of this project.
+
+ Special thanks go to Scott Bradner for his seminal work in the field
+ of benchmarking and his many encouraging remarks.
+
+7. Author's Address
+
+ Robert Mandeville
+ European Network Laboratories (ENL)
+ 2, rue Helene Boucher
+ 78286 Guyancourt Cedex
+ France
+
+ Phone: + 33 1 39 44 12 05
+ Mobile Phone + 33 6 07 47 67 10
+ Fax: + 33 1 39 44 12 06
+ EMail: bob.mandeville@eunet.fr
+
+
+
+
+Mandeville Informational [Page 24]
+
+RFC 2285 Benchmarking Terminology February 1998
+
+
+8. Full Copyright Statement
+
+ Copyright (C) The Internet Society (1998). All Rights Reserved.
+
+ This document and translations of it may be copied and furnished to
+ others, and derivative works that comment on or otherwise explain it
+ or assist in its implementation may be prepared, copied, published
+ and distributed, in whole or in part, without restriction of any
+ kind, provided that the above copyright notice and this paragraph are
+ included on all such copies and derivative works. However, this
+ document itself may not be modified in any way, such as by removing
+ the copyright notice or references to the Internet Society or other
+ Internet organizations, except as needed for the purpose of
+ developing Internet standards in which case the procedures for
+ copyrights defined in the Internet Standards process must be
+ followed, or as required to translate it into languages other than
+ English.
+
+ The limited permissions granted above are perpetual and will not be
+ revoked by the Internet Society or its successors or assigns.
+
+ This document and the information contained herein is provided on an
+ "AS IS" basis and THE INTERNET SOCIETY AND THE INTERNET ENGINEERING
+ TASK FORCE DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING
+ BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION
+ HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF
+ MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Mandeville Informational [Page 25]
+