One document matched: draft-ietf-rtgwg-ordered-fib-05.xml


<?xml version="1.0" encoding="US-ASCII"?>
<!DOCTYPE rfc SYSTEM "rfc2629.dtd">
<?rfc toc="yes"?>
<?rfc compact="yes"?>
<?rfc symrefs="no"?>
<rfc category="exp" docName="draft-ietf-rtgwg-ordered-fib-05"
     ipr="trust200902">
  <front>
    <title>Loop-free convergence using oFIB</title>

    <author fullname="Pierre Francois" surname="Pierre Francois">
      <organization>Universite catholique de Louvain</organization>

      <address>
        <postal>
          <street>Place Ste Barbe, 2</street>

          <city>Louvain-la-Neuve</city>

          <code>1348</code>

          <country>BE</country>
        </postal>

        <uri>http://inl.info.ucl.ac.be/</uri>
      </address>
    </author>

    <author fullname="Olivier Bonaventure" surname="Olivier Bonaventure">
      <organization>Universite catholique de Louvain</organization>

      <address>
        <postal>
          <street>Place Ste Barbe, 2</street>

          <city>Louvain-la-Neuve</city>

          <code>1348</code>

          <country>BE</country>
        </postal>

        <uri>http://inl.info.ucl.ac.be/</uri>
      </address>
    </author>

    <author fullname="Mike Shand" surname="Mike Shand">
      <organization>Cisco Systems</organization>

      <address>
        <postal>
          <street>Green Park, 250, Longwater Avenue,</street>

          <city>Reading</city>

          <code>RG2 6GB</code>

          <country>UK</country>
        </postal>

        <email>mshand@cisco.com</email>
      </address>
    </author>

    <author fullname="Stewart Bryant" surname="Stewart Bryant">
      <organization>Cisco Systems</organization>

      <address>
        <postal>
          <street>Green Park, 250, Longwater Avenue,</street>

          <city>Reading</city>

          <code>RG2 6GB</code>

          <country>UK</country>
        </postal>

        <email>stbryant@cisco.com</email>
      </address>
    </author>

    <author fullname="Stefano Previdi" surname="Stefano Previdi">
      <organization>Cisco Systems</organization>

      <address>
        <postal>
          <street>Via Del Serafico 200</street>

          <city>00142 Roma</city>

          <country>Italy</country>
        </postal>

        <email>sprevidi@cisco.com</email>
      </address>
    </author>

    <author fullname="Clarence Filsfils" surname="Clarence Filsfils">
      <organization>Cisco Systems</organization>

      <address>
        <postal>
          <street></street>

          <city>Brussels</city>

          <region></region>

          <code></code>

          <country>Belgium</country>
        </postal>

        <email>cfilsfil@cisco.com</email>
      </address>
    </author>

    <date year="2011" />

    <area>General</area>

    <keyword>I-D</keyword>

    <keyword>Internet-Draft</keyword>

    <abstract>
      <t>This document describes a mechanism for use in conjunction with link
      state routing protocols which prevents the transient loops which would
      otherwise occur during topology changes. It does this by correctly
      sequencing the FIB updates on the routers.</t>

      <t>This mechanism can be used in the case of non-urgent link or node
      shutdowns and restarts or link metric changes. It can also be used in
      conjunction with a fast re-route mechanism which converts a sudden link
      or node failure into a non-urgent topology change. This is possible
      where a complete repair path is provided for all affected
      destinations.</t>

      <t>After a non-urgent topology change, each router computes a rank that
      defines the time at which it can safely update its FIB. A method for
      accelerating this loop-free convergence process by the use of completion
      messages is also described.</t>

      <t>The technology described in this document has been subject to
      extensive simulation using real network topologies and costs, and
      pathological convergence behaviour. A variant of the technology
      described here has been experimentally deployed in a production
      network.</t>
    </abstract>
  </front>

  <middle>
    <section title="Conventions used in the document">
      <t>The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
      "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
      document are to be interpreted as described in RFC2119 <xref
      target="RFC2119"></xref>.</t>
    </section>

    <section title="Introduction">
      <t>With link-state protocols, such as IS-IS <xref
      target="ISO10589"></xref> and OSPF <xref target="RFC2328"></xref>, each
      time the network topology changes, some routers need to modify their
      Forwarding Information Base (FIB) to take into account the new topology.
      Each topology change causes a convergence phase. During this phase,
      routers may transiently have inconsistent FIBs, which may lead to packet
      loops and losses, even if the reachability of the destinations is not
      compromised after the topology change. Packet losses and transient loops
      can also occur in the case of a link down event implied by a maintenance
      operation, even if this operation is predictable and not urgent. When
      the link state change is a metric update and when a new link is brought
      up in the network, there is no direct loss of connectivity, but
      transient packet loops and loss can still occur.</t>

      <t>For example, in <xref target="fig.example"></xref>, if the link
      between X and Y is shut down by an operator, packets destined to X can
      loop between R and Y when Y has updated its FIB while R has not yet
      updated its FIB, and packets destined to Y can loop between X and S if X
      updates its FIB before S. According to the current behaviour of ISIS and
      OSPF, this scenario will happen most of the time because X and Y are the
      first routers to be aware of the failure, so that they will update their
      FIBs first.</t>

      <figure anchor="fig.example" title="A simple topology">
        <preamble></preamble>

        <artwork><![CDATA[
                                  1               				  
                    X-------------/-------------Y   
                    |                           |   
                    |                           |   
                    |                           |   
                    |                           |   
                  1 |                           | 1 
                    |                           |   
                    |                           |   
                    |                           |   
                    |                           |   
                    S---------------------------R   
                                  2
]]></artwork>
      </figure>

      <t>It should be noted that the loops can occur remotely from the
      failure, not just adjacent to it.</t>

      <t>The goal of this document is to define a mechanism which sequences
      the router FIB updates to maintain consistency throughout the network.
      By correctly setting the FIB change order no looping or packet loss can
      occur. This mechanism may be applied to the case of managed link-state
      changes, i.e. link metric change, manual link down/up, manual router
      down/up, and managed state changes of a set of links attached to one
      router. It may also be applied to the case where one or more network
      elements are protected by a fast re-route mechanism <xref
      target="RFC5714"></xref> <xref target="RFC4090"></xref>. The mechanisms
      that are used in the failure case are exactly the same as those used for
      managed changes. For simplicity this document makes no further
      distinction between managed and unplanned changes.</t>

      <t>The technology described in this document has been subject to
      extensive simulation using real network topologies and costs and
      pathological convergence behaviour. A variant of the technology
      described here has been experimentally deployed in a production
      network.</t>
    </section>

    <section anchor="sec.ordering" title="The required FIB update order">
      <t>This section provides an overview of the required ordering of the FIB
      updates. A more detailed analysis of the rerouting dynamics and
      correctness proofs of the mechanism can be found in <xref
      target="refs.PFOB07"></xref>.</t>

      <section anchor="sec.ordering.single" title="Single Link Events">
        <t>For simplicity the correct ordering for single link changes are
        described first. The document then builds on this to demonstrate that
        the same principles can be applied to more complex scenarios such as
        line card or node changes.</t>

        <section anchor="sec.ordering.single.down"
                 title="Link Down / Metric Increase">
          <t>First consider the non-urgent failure of a link or the increase
          of a link metric. In this case, a router R MUST NOT update its FIB
          until all other routers that send traffic via R and the affected
          link have first updated their FIBs.</t>

          <t>The following argument shows that this rule ensures the correct
          order of FIB change when the link X->Y is shut down or its metric
          is increased.</t>

          <t>An "outdated" FIB entry for a destination is defined as being a
          FIB entry that still reflects the shortest path(s) in use before the
          topology change. Once a packet reaches a router R that has an
          outdated FIB entry for the packet destination, then, provided the
          oFIB ordering is respected, the packet will continue to X only
          traversing routers that also have an outdated FIB entry for the
          destination. The packet thus reaches X without looping and will be
          forwarded to Y via X->Y (or in the case of FRR, the X->Y
          repair path) and hence reach its destination.</t>

          <t>Since it can be assumed that the original topology was loop-free,
          Y will never use the link Y->X to reach the destination and hence
          the path(s) between Y and the destination are guaranteed to be
          unaffected by the topology change. It therefore follows that the
          packet arriving at Y will reach its destination without looping.</t>

          <t>Since it can also be assumed that the new topology is loop-free,
          by definition a packet cannot loop while being forwarded exclusively
          by routers with an updated FIB entry.</t>

          <t>In other words, when the oFIB ordering is respected, if a packet
          reaches an outdated router, it can never subsequently reach an
          updated router, and cannot loop because from this point on it will
          only be forwarded on the consistent path that was used before the
          event. If it does not reach an outdated router, it will only be
          forwarded on the loop free path that will be used after the
          convergence.</t>

          <t>According to the proposed ordering, X will be the last router to
          update its FIB. Once it has updated its FIB, the link X->Y can
          actually be shut down (or the repair removed).</t>

          <t>If the link X-Y is bidirectional a similar process must be run to
          order the FIB update for destinations using the link in the
          direction Y->X. As has already been shown, no packet ever
          traverses the X-Y link in both directions, and hence the operation
          of the two ordering processes is orthogonal.</t>
        </section>

        <section anchor="sec.ordering.single.up"
                 title="Link Up / Metric Decrease">
          <t>In the case of link up events or metric decreases, a router R
          MUST update its FIB BEFORE all other routers that WILL use R to
          reach the affected link.</t>

          <t>The following argument shows that this rule ensures the correct
          order of FIB change when the link X->Y is brought into service or
          its metric is decreased.</t>

          <t>Firstly, when a packet reaches a router R that has already
          updated its FIB, all the routers on the path from R to X will also
          have updated their FIB, so that the packet will reach X and be
          forwarded along X->Y, ultimately reaching its destination.</t>

          <t>Secondly, a packet cannot loop between routers that have not yet
          updated their FIB. This proves that no packet can loop.</t>
        </section>
      </section>

      <section anchor="sec.ordering.multilink" title="Multi-link events">
        <t>The following sections describe the required ordering for single
        events which may be manifest as multiple link events. For example, the
        failure of a router may be notified to the rest of the network as the
        individual failure of all its attached links. The means of identifying
        the event type from the collection of received link events is
        described in <xref target="sec.deducing"></xref>.</t>

        <section anchor="sec.ordering.linecard.router.down"
                 title="Router Down events">
          <t>In the case of the non-urgent shut-down of a router, a router R
          MUST NOT update its FIB until all other routers that send traffic
          via R and the affected router have first updated their FIBs.</t>

          <t>Using a proof similar to that for link failure, it can be shown
          that no loops will occur if this ordering is respected <xref
          target="refs.PFOB07"></xref>.</t>
        </section>

        <section anchor="sec.ordering.linecard.router.up"
                 title="Router Up events">
          <t>In the case of a router being brought into service, a router R
          MUST update its FIB BEFORE all other routers that WILL use R to
          reach the affected router.</t>

          <t>A proof similar to that for link up, shows that no loops will
          occur if this ordering is respected <xref
          target="refs.PFOB07"></xref>.</t>
        </section>

        <section anchor="sec.ordering.multilink.linecards"
                 title="Linecard Failure/Restoration Events">
          <t>The failure of a line card involves the failure of a set of links
          all of which have a single node in common, i.e. the parent router.
          The ordering to be applied is the same as if it were the failure of
          the parent router.</t>

          <t>In a similar way, the restoration of an entire linecard to
          service as a single event can be treated as if the parent router
          were returning to service.</t>
        </section>
      </section>
    </section>

    <section anchor="sec.applying" title="Applying ordered FIB updates">
      <section anchor="sec.deducing" title="Deducing the topology change">
        <t>As has been described, a single event such as the failure or
        restoration of a single link, single router or a linecard may be
        notified to the rest of the network as a set of individual link change
        events. It is necessary to deduce from this collection of link state
        notifications the type of event that has occurred in the network and
        hence the required ordering.</t>

        <t>When a link change event is received which impacts the receiving
        router's FIB, the routers at the near and far end of the link are
        noted.</t>

        <t>If all events received within some hold-down period have a single
        router (R) in common, then it is assumed that the change reflects an
        event (line-card or router change) concerning the common router
        (R).</t>

        <t>In the case of a link change event, the router at the far end of
        the link is deemed to be the common router (R).</t>

        <t>All ordering computations are based on treating the common router R
        as the root for both link and node events.</t>
      </section>

      <section anchor="sec.deciding"
               title="Deciding if ordered FIB updates applies">
        <t>There are some events (for example a subsequent failure with
        conflicting repair requirements occurring before the ordered FIB
        process has completed) that cannot be correctly processed by this
        mechanism. In these cases it is necessary to ensure that convergence
        falls back to the conventional mode of operation (see <xref
        target="sec.fallback"></xref>).</t>

        <t>In all cases it is necessary to wait some hold-down period after
        receiving the first notification to ensure that all routers have
        received the complete set of link state notifications associated with
        the single event.</t>

        <t>At any time, if a link change notification is received which would
        have no effect on the receiving router's FIB, then it may be
        ignored.</t>

        <t>If no other event is received during the hold-down time, the event
        is treated as a link event. Note that the reverse connectivity check
        means that only the first failure event, or second up event have an
        effect on the FIB.</t>

        <t>If an event is received within the hold down period which does NOT
        reference the common router (R) then in this version of the
        specification normal convergence is invoked immediately (see <xref
        target="sec.fallback"></xref>).</t>

        <t>The sudden failure of a link or a set of links that are not
        protected using a FRR mechanism must be processed using the
        conventional mode of operation.</t>

        <t>In summary an ordered FIB process is applicable if the set of link
        state notifications received between the first event and the hold down
        period reference a common router R, and one of the following
        assertions is verified : <list style="empty">
            <t>. The set of notifications refer to link down events concerning
            protected links and metric increase events</t>

            <t>. The set of notifications refer to link up events and metric
            decrease events.</t>
          </list></t>
      </section>
    </section>

    <section anchor="sec.calculation" title="Computation of the ordering">
      <t>This section describes how the required ordering is computed.</t>

      <section anchor="sec.implementation.down"
               title="Link or Router Down or Metric Increase">
        <t>To respect the proposed ordering, routers compute a rank that will
        be used to determine the time at which they are permitted to perform
        their FIB update. In the case of a failure event rooted at router Y or
        an increase of the metric of link X->Y, router R computes the
        reverse Shortest Path Tree (rSPT) in the topology before the failure
        (rSPT_OLD) rooted at Y. This rSPT gives the shortest paths to reach Y
        before the failure. The branch of the reverse SPT that is below R
        corresponds to the set of shortest paths to R that are used by the
        routers that reach Y via R.</t>

        <t>The rank of router R is defined as the depth (in number of hops) of
        this branch. In the case of ECMP, the maximum depth of the ECMP path
        set is used.</t>

        <t>Router R is required to update its FIB at time</t>

        <t>T0 + H + rank * MAX_FIB</t>

        <t>where T0 is the arrival time of the link-state packet containing
        the topology change, H is the hold-down time and MAX_FIB is a
        network-wide constant that reflects the maximum time required to
        update a FIB irrespective of the change required. The value of MAX_FIB
        is network specific and its determination is out of the scope of this
        document. This value must be agreed by all the routers in the network.
        This agreement can be performed by using a capability TLV as defined
        in <xref target="I-D.atlas-bryant-shand-lf-timers"></xref>.</t>

        <t>All the routers that use R to reach Y will compute a lower rank
        than R, and hence the correct order will be respected. It should be
        noted that only the routers that used Y before the event need to
        compute their rank.</t>
      </section>

      <section anchor="sec.implementation.up"
               title="Link or Router Up or Metric Decrease">
        <t>In the case of a link or router up event rooted at Y or a link
        metric decrease affecting link Y->W, a router R must have a rank
        that is higher than the rank of the routers that it will use to reach
        Y, according to the rule described in <xref
        target="sec.ordering"></xref>. The rank of R is thus the number of
        hops between R and Y in its renewed Shortest Path Tree. When R has
        multiple equal cost paths to Y, the rank is the length in hops of the
        longest ECMP path to Y.</t>

        <t>Router R is required to update its FIB at time</t>

        <t>T0 + H + rank * MAX_FIB</t>

        <t>It should be noted that only the routers that use Y after the event
        have to compute a rank, i.e. only the routers that have Y in their SPT
        after the link-state change.</t>
      </section>
    </section>

    <section anchor="sec.completion"
             title="Acceleration of Ordered Convergence">
      <t>The mechanism described above is conservative, and hence may be
      relatively slow. The purpose of this section is to describe a method of
      accelerating the controlled convergence in such a way that ordered
      loop-free convergence is still guaranteed.</t>

      <t>In many cases a router will complete its required FIB changes in a
      time much shorter than MAX_FIB and in many other cases, a router will
      not have to perform any FIB change at all.</t>

      <t>This section describes the use of completion messages to speed up the
      convergence by providing a means for a router to inform those routers
      waiting for it, that it has completed any required FIB changes. When a
      router has been advised of completion by all the routers for which it is
      waiting, it can safely update its own FIB without further delay. In most
      cases this can result in a sub-second re-convergence time comparable
      with that of normal convergence.</t>

      <t>Routers maintain a waiting list of the neighbours from which a
      completion message must be received. Upon reception of a completion
      message from a neighbour, a router removes this neighbour from its
      waiting list. Once its waiting list becomes empty, the router is allowed
      to update its FIB immediately even if its ranking timer has not yet
      expired. Once this is done, the router sends a completion message to the
      neighbours that are waiting for it to complete. Those routers are listed
      in a list called the Notification List. Completion messages contain an
      identification of the event to which they refer.</t>

      <t>Note that, since this is only an optimization, any loss of completion
      messages will result in the routers waiting their defined ranking time
      and hence the loop-free properties will be preserved.</t>

      <section anchor="sec.completion.construction"
               title="Construction of the waiting list and notification list">
        <section anchor="sec.completion.construction.down" title="Down events">
          <t>Consider a link or node down event rooted at router Y or the cost
          increase of the link X->Y. A router R will compute rSPT_OLD(Y) to
          determine its rank. When doing this, R also computes the set of
          neighbors that R uses to reach the failing node or link, and the set
          of neighbors that are using R to reach the failing node or link. The
          Notification list of R is equal to the former set and the Waiting
          list of R is equal to the latter.</t>

          <t>Note that R could include all its neighbors except those in the
          Waiting list in the Notification list, this has no impact on the
          correctness of the protocol, but would be unnecessarily
          inefficient.</t>
        </section>

        <section anchor="sec.completion.construction.up" title="Up Events">
          <t>Consider a link or node up event rooted at router Y or the cost
          decrease of the link Y->X. A router R will compute its new SPT
          (SPT_new(R)). The Waiting list is the set of next hop routers that R
          uses to reach Y in SPT_new(R).</t>

          <t>In a simple implementation the notification list of R is all the
          neighbours of R excluding those in the Waiting list. This may be
          further optimized by computing rSPT_new(Y) to determine those
          routers that are waiting for R to complete.</t>
        </section>
      </section>

      <section anchor="sec.completion.format"
               title="Format of Completion Messages">
        <t>The format of completion messages and means of their delivery is
        routing protocol dependent and is outside the scope of this document.
        An encoding of completion message for IS-IS is proposed in <xref
        target="I-D.bonaventure-isis-ordered"></xref>.</t>

        <t>The following information is required:</t>

        <t><list style="empty">
            <t>. Identity of the sender.</t>

            <t>. A list of routing notifications being considered in the
            associated FIB change. Each notification is defined as :</t>

            <list style="empty">
              <t>. Node ID of the near end of the link</t>

              <t>. Node ID of the far end of the link</t>

              <t>. Old Metric</t>

              <t>. New Metric</t>
            </list>
          </list></t>
      </section>
    </section>

    <section anchor="sec.fallback"
             title="Fall back to Conventional Convergence">
      <t>In circumstances where a router detects that it is dealing with
      incomplete or inconsistent link state information, or when a further
      topology event is received before completion of the current ordered FIB
      update process, it may be expedient to abandon the controlled
      convergence process. A number of possible fall back mechanisms are
      described in <xref target="AAHapp"></xref>. The state machine defined in
      the body of this document does not make any assumption about which fall
      back mechanism will be used.</t>
    </section>

    <section title="oFIB state machine">
      <t>An oFIB capable router maintains an oFIB state value which can be one
      of : OFIB_STABLE, OFIB_HOLDING_DOWN, OFIB_HOLDING_UP, OFIB_ABANDONED,
      OFIB_ONGOING.</t>

      <t>An oFIB capable router maintains a timer, Hold_down_timer. An oFIB
      capable router is configured with a value referred to as
      HOLD_DOWN_DURATION. This configuration can be performed manually or
      using <xref target="I-D.atlas-bryant-shand-lf-timers"></xref>.</t>

      <t>An oFIB capable router maintains a timer, rank_timer.</t>

      <section title="OFIB_STABLE">
        <t>OFIB_STABLE is the state of a router which is not currently
        involved in any convergence process. This router is ready to process
        an event by applying oFIB.</t>

        <t>EVENT : Reception of a link-state packet describing an event of the
        type link X--Y down or metric increase to be processed using oFIB.</t>

        <t>ACTION : Set state to OFIB_HOLDING_DOWN. Start Hold_down_timer.
        ofib_current_common_set = {X,Y}. Compute rank with respect to the
        event, as defined in <xref target="sec.calculation"></xref>. Store
        Waiting List and Notification List for X--Y obtained from the rank
        computation.</t>

        <t>EVENT : Reception of a link-state packet describing an event of the
        type link X--Y up or metric decrease which to be processed using
        oFIB.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
             

            <t>Set state to OFIB_HOLDING_UP.</t>

             

            <t>Start Hold_down_timer.</t>

             

            <t>ofib_current_common_set = {X,Y}</t>

             . 

            <t>Compute rank with respect to the event, as defined in section
            <xref target="sec.calculation" /> .</t>

             

            <t>Store Waiting List and Notification List for X--Y obtained from
            the rank computation.</t>

             
          </list></t>
      </section>

      <section title="OFIB_HOLDING_DOWN">
        <t>OFIB_HOLDING_DOWN is the state of a router that is collecting a set
        of link down or metric increase link-state packets to be processed
        together using controlled convergence.</t>

        <t>EVENT : Reception of a link-state packet describing an event of the
        type link up or metric decrease which in itself can be processed using
        oFIB.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>Set state to OFIB_ABANDONED.</t>

            <t>Reset Hold_down_timer.</t>

            <t>Trigger AAH mechanism</t>
          </list></t>

        <t>EVENT : Reception of a link-state packet describing an event of the
        type link A--B down or metric increase which in itself can be
        processed using oFIB.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>ofib_current_common_set =
            intersection(ofib_current_common_set,{A,B}).</t>

            <t>If ofib_current_common_set is empty, then there is no longer a
            node in common in all the pending link-state changes.</t>

            <list hangIndent="5" style="empty">
              <t>Set state to OFIB_ABANDONED</t>

              <t>Reset Hold_down_timer</t>

              <t>Trigger AAH mechanism.</t>
            </list>

            <t>If ofib_current_common set is not empty, update waiting list
            and notification list as defined in <xref
            target="sec.calculation" />. Note that in the case of a single
            link event, the link-state packet received when the router is in
            this state describes the state change of the other direction of
            the link, hence no changes will be made to the waiting and
            notification lists.</t>
          </list></t>

        <t>EVENT : Hold_down_timer expires.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>Set state to OFIB_ONGOING.</t>

            <t>Start rank_timer with computed rank.</t>
          </list></t>

        <t>EVENT : Reception of a completion message</t>

        <t>ACTION : Remove the sender from waiting list associated with the
        event identified in the completion message.</t>
      </section>

      <section title="OFIB_HOLDING_UP">
        <t>OFIB_HOLDING_UP is the state of a router that is collecting a set
        of link up or metric decrease link-state packets to be processed
        together using controlled convergence.</t>

        <t>EVENT : Reception of a link-state packet describing an event of the
        type link down or metric increase to be processed using oFIB.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>Set state to OFIB_ABANDONED.</t>

            <t>Reset Hold_down_timer.</t>

            <t>Trigger AAH mechanism.</t>
          </list></t>

        <t>EVENT : Reception of a link-state packet describing an event of the
        type link A--B up or metric decrease to be processed using oFIB.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>ofib_current_common_set =
            intersection(ofib_current_common_set,{A,B}).</t>

            <t>If ofib_current_common_set is empty, then there is no longer a
            common node in the set of pending link-state changes.</t>

            <list hangIndent="5" style="empty">
              <t>Set state to OFIB_ABANDONED.</t>

              <t>Reset Hold_down_timer.</t>

              <t>Trigger AAH mechanism.</t>
            </list>

            <t>If ofib_current_common set is not empty, update waiting list
            and notification list as defined in <xref
            target="sec.calculation" />. Note that in the case of a single
            link event, the link-state packet received when the router is in
            this state describes the state change of the other direction of
            the link, hence no changes will be made to the waiting and
            notification lists.</t>
          </list></t>

        <t>EVENT : Reception of a completion message</t>

        <t>ACTION : Remove the sender from the waiting list associated with
        the event identified in the completion message.</t>

        <t>EVENT : Hold_down_timer expires.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>Set state to OFIB_ONGOING.</t>

            <t>Start rank_timer with computed rank.</t>
          </list></t>
      </section>

      <section title="OFIB_ONGOING">
        <t>OFIB_ONGOING is the state of a router that is applying the ordering
        mechanism w.r.t. the set of LSP collected when in OFIB_HOLDING_DOWN or
        OFIB_HOLDING_UP state.</t>

        <t>EVENT : rank_timer expires or waiting list becomes empty.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>Perform FIB updates according to the change.</t>

            <t>Send completion message to each member of the notification
            list.</t>

            <t>Set State to OFIB_STABLE.</t>
          </list></t>

        <t>EVENT : Reception of a completion message</t>

        <t>ACTION : Remove the sender from the waiting list.</t>

        <t>EVENT : Reception of a link-state packet describing a link state
        change event.</t>

        <t>ACTION :</t>

        <t><list hangIndent="5" style="empty">
            <t>Set state to OFIB_ABANDONED.</t>

            <t>Trigger AAH.</t>

            <t>Start Hold_down_timer.</t>
          </list></t>
      </section>

      <section title="OFIB_ABANDONED">
        <t>OFIB_ABANDONED is the state of a router that has fallen back to
        fast convergence due to the reception of link-state packets that
        cannot be dealt together using oFIB.</t>

        <t>EVENT : Reception of a link-state packet describing a link-state
        change event.</t>

        <t>ACTION : Trigger AAH, reset Hold_down_timer.</t>

        <t>EVENT : Hold_down_timer expires.</t>

        <t>ACTION : Set state to OFIB_STABLE</t>
      </section>
    </section>

    <section title="IANA considerations">
      <t>There are no IANA considerations which arise from this document. Any
      such considerations will be called out in protocol specific documents
      such as <xref target="I-D.atlas-bryant-shand-lf-timers"></xref><xref
      target="I-D.bonaventure-isis-ordered">and</xref></t>
    </section>

    <section title="Security considerations">
      <t>This document requires only minor modifications to existing routing
      protocols and therefore does not add significant additional security
      risks. However a full security analysis would need to be provided within
      the protocol specific specifications proposed for deployment.</t>
    </section>

    <section anchor="sec.ack" title="Acknowledgments">
      <t>We would like to thank Jean-Philippe Vasseur and Les Ginsberg for
      their useful suggestions and comments.</t>
    </section>
  </middle>

  <back>
    <references title="Informative References">
      <reference anchor="ISO10589">
        <front>
          <title>Intermediate system to Intermediate system intra-domain
          routeing information exchange protocol for use in conjunction with
          the protocol for providing the connectionless-mode Network Service
          (ISO 8473)</title>

          <author>
            <organization abbrev="ISO">International Organization for
            Standardization</organization>
          </author>

          <date month="Nov" year="2002" />
        </front>

        <seriesInfo name="ISO/IEC" value="10589:2002, Second Edition" />
      </reference>

      <?rfc include='reference.I-D.bonaventure-isis-ordered'?>

      <reference anchor="refs.PFOB07">
        <front>
          <title>Avoiding transient loops during IGP convergence in IP
          Networks</title>

          <author fullname="Pierre Francois" initials="" surname="P. Francois"></author>

          <author fullname="Olivier Bonaventure" initials="O."
                  surname="Bonaventure"></author>

          <date month="December" year="2007" />
        </front>

        <seriesInfo name="in"
                    value="IEEE/ACM Transactions on Networking, http://inl.info.ucl.ac.be/publications" />
      </reference>

      <?rfc include='reference.RFC.2119'?>

      <?rfc include='reference.RFC.2328'?>

      <?rfc include='reference.RFC.4090'?>

      <?rfc include='reference.RFC.5714'?>

      <?rfc include='reference.RFC.5715'?>

      <?rfc include='reference.I-D.atlas-bryant-shand-lf-timers'?>
    </references>

    <section anchor="AAHapp"
             title="Mechanisms for Safely Abandoning Loop-Free Convergence (AAH)  ">
      <t>IPFRR<xref target="RFC5714"></xref> and loop-free convergence
      techniques <xref target="RFC5715"></xref> can deal with single topology
      change events, multiple correlated change events, and in some cases even
      certain uncorrelated events. However, in all cases there are events
      which cannot be dealt with and the mechanism needs to quickly revert to
      normal convergence. This is known as "Abandoning All Hope" (AAH).</t>

      <t>This appendix describes the outcome of a design study into the AAH
      problem, and is included here to trigger discussion on the trade-offs
      between complexity and robustness in the AAH solution-space.</t>

      <section title="Possible Solutions   ">
        <t>Two approaches to this problem have been proposed:</t>

        <t>1. Hold-down timer only. </t>

        <t>2. Synchronization of AAH state using AAH messages.</t>

        <t>These are described below. </t>

        <t></t>
      </section>

      <section title="Hold-down timer only  ">
        <t>This method uses a hold-down to acquire a set of LSPs which should
        be processed together. On expiry of the local hold-down timer, the
        router begins processing the batch of LSPs according to the loop free
        prevention algorithm.</t>

        <t>There are a number of problems with this simple approach. In some
        cases the timer value will be too short to ensure that all the related
        events have arrived at all routers (perhaps because there was some
        unexpected propagation delay, or one or more of the events are slow in
        being detected). In other cases, a completely unrelated event may
        occur after the timer has expired, but before the processing is
        complete. In addition, since the timer is started at each router on
        reception of the first LSP announcing a topology change, the actual
        starting time is dependant upon the propagation time of the first LSP.
        So, for a subsequent event occurring around the time of the timer
        expiry, because of variations in propagation delay it may reach some
        routers before the timer expires and others after it has expired. In
        the former case this LSP will be included in the set of changes to be
        considered, while in the latter it will be excluded leasing to serious
        routing inconsistency. In such cases continuing to operate the
        loop-free convergence protocol may exacerbate the situation.</t>

        <t>The simple approach to this would be to revert to normal
        convergence (AAH) whenever an LSP is received after the timer has
        expired. However this also has problems for the reasons above and
        therefore AAH must be a synchronous operation, i.e. it is necessary to
        arrange that an AAH invoked anywhere in the network causes ALL routers
        to AAH.</t>

        <t>It is also necessary to consider the means of exiting the AAH
        state. Again the simplest method is to use a timer. However while in
        AAH state any topology changes previously received, or which are
        subsequently received, should be processed immediately using the
        traditional convergence algorithms i.e. without invoking controlled
        convergence. If the exit from the AAH state is not correctly
        synchronized, a new event may be processed by some routers immediately
        (as AAH), while those which have already left AAH state will treat it
        as the first of a new batch of changes and attempt controlled
        convergence. Thus both entry and exit from the AAH state needs to be
        synchronised. A method of achieving this is described in <xref
        target="AAHmsg"></xref>.</t>
      </section>

      <section anchor="AAHmsg" title="AAH messages">
        <t>Like the simple timer AAH method, this method uses a hold-down to
        acquire a set of LSPs which should be processed together. On expiry of
        the local hold-down timer, the router begins processing the batch of
        LSPs according to the loop free prevention algorithm. This is the same
        behaviour as the hold-down timer only method. However, if any router,
        having started the loop-free convergence process receives an LSP which
        would trigger a topology change, it locally abandons the controlled
        convergence process, and sends an AAH message to all its neighbors.
        This eventually triggers all routers to abandon the controlled
        convergence. The routers remain in AAH state (i.e. processing topology
        changes using normal "fast" convergence), until a period of quiescence
        has elapsed. The exit from AAH state is synchronized by using a two
        step process. To achieve the required synchronization, two additional
        messages are required, AAH and AAH ACK. The AAH message is reliably
        exchanged between neighbours using the AAH ACK message. These could be
        implemented as a new message within the routing protocol or carried in
        existing routing hello messages. Two types of state machines are
        needed. A per-router AAH state machine and a per neighbour AAH state
        machine(PNSM). These are described below.</t>

        <section title="Per Router State Machine  ">
          <t>Per Router State Table</t>

          <figure>
            <artwork><![CDATA[+-------------+-----------+---------+--------+------------+----------+
| EVENT       |     Q     |   Hold  |   CC   |     AAH    | AAH-hold |
+=============+===========+=========+========+============+==========+
| RX LSP      |   Start   |    -    | TX-AAH |  Re-start  |  TX-AAH  |
| triggering  | hold-down |         | Start  | AAH timer. |   Start  |
| change      |   timer   |         |  AAH   |    [AAH]   |    AAH   |
|             |   [Hold]  |         | timer. |            |   timer. |
|             |           |         | [AAH]  |            |   [AAH]  |
+-------------+-----------+---------+--------+------------+----------+
| RX AAH      |   TX-AAH  |  TX-AAH | TX-AAH |    [AAH]   |  TX-AAH  |
| (Neighbor's | Start AAH |  Start  | Start  |            |   Start  |
|  PNSM       |   timer.  |   AAH   |  AAH   |            |    AAH   |
|  processes  |   [AAH]   |  timer  | timer. |            |   timer. |
|  RX AAH.)   |           |  [AAH]  | [AAH]  |            |   [AAH]  |
+-------------+-----------+---------+--------+------------+----------+
| Timer       |     -     | Trigger |    -   |    Start   |    [Q]   |
| expiry      |           |   CC.   |        |  AAH-hold  |          |
|             |           |  [CC]   |        |   timer.   |          |
|             |           |         |        | [AAH-hold] |          |
+-------------+-----------+---------+--------+------------+----------+
| Controlled  |     -     |    -    |   [Q]  |      -     |     -    |
| convergence |           |         |        |            |          |
| completed   |           |         |        |            |          |
+-------------+-----------+---------+--------+------------+----------+
 TX-AAH = Send "goto TX-AAH" to all other PNSMs.

]]></artwork>
          </figure>

          <t></t>

          <t>Operation of the per-router state machine is as follows:</t>

          <t>Operation of this state machine under normal topology change
          involves only states: Quiescent (Q), Hold-down (Hold) and Controlled
          Convergence (CC). The remaining states are associated with an AAH
          event.</t>

          <t>The resting state is Quiescent. When the router in the Quiescent
          state receives an LSP indicating a topology change, which would
          normally trigger an SPF, it starts the Hold-down timer and changes
          state to Hold-down. It normally remains in this state, collecting
          additional LSPs until the Hold-down timer expires. Note that all
          routers MUST use a common value for the Hold-down timer. When the
          Hold-down timer expires the router then enters Controlled
          Convergence (CC) state and executes the CC mechanism to re-converge
          the topology. When the CC process has completed on the router, the
          router re-enters the Quiescent state.</t>

          <t>If this router receives a topology changing LSP whilst it is in
          the CC state, it enters AAH state, and sends a "goto TX-AAH" command
          to all per neighbour state machines which causes each per-neighbour
          state machine to signal this state change to its neighbour.
          Alternatively, if this router receives an AAH message from any of
          its neighbors whilst in any state except AAH, it starts the AAH
          timer and enters the AAH state. The per neighbor state machine
          corresponding to the neighbor from which the AAH was received
          executes the RX AAH action (which causes it to send an AAH ACK),
          while the remainder are sent the "goto TX-AAH" command. The result
          is that the AAH is acknowledged to the neighbor from which it was
          received and propagated to all other neighbors. On entering AAH
          state, all CC timers are expired and normal convergence takes
          place.</t>

          <t>Whilst in the AAH state, LSPs are processed in the traditional
          manner. Each time an LSP is received, the AAH timer is restarted. In
          an unstable network ALL routers will remain in this state for some
          time and the network will behave in the traditional uncontrolled
          convergence manner.</t>

          <t>When the AAH timer expires, the router enters AAH-hold state and
          starts the AAH hold timer. The purpose of the AAH-hold state is to
          synchronize the transition of the network from AAH to Quiescent. The
          additional state ensures that the network cannot contain a mixture
          of routers in both AAH and Quiescent states. If, whilst in AAH-Hold
          state the router receives a topology changing LSP, it re-enters AAH
          state and commands all per neighbour state machines to "goto
          TX-AAH". If, whilst in AAH-Hold state the router receives an AAH
          message from one of its neighbours, it re-enters the AAH state and
          commands all other per neighbour state machines to "goto TX-AAH".
          Note that the per-neighbor state machine receiving the AAH message
          will autonomously acknowledge receipt of the AAH message. Commanding
          the per-neighbour state machine to "goto TX-AAH" is necessary,
          because routers may be in a mixture of Quiescent, Hold-down and
          AAH-hold state, and it is necessary to rendezvous the entire network
          back to AAH state.</t>

          <t>When the AAH Hold timer expires the router changes to state
          Quiescent and is ready for loop free convergence.</t>
        </section>

        <section title="Per Neighbor State Machine   ">
          <t>Per Neighbor State Table</t>

          <figure>
            <artwork><![CDATA[+----------------------------+--------------+------------------------+
| EVENT                      | Idle         | TX-AAH                 |
+============================+==============+========================+
| RX AAH                     | Send ACK.    | Send ACK.              |
|                            |              | Cancel timer.          |
|                            | [IDLE]       | [IDLE]                 |
+----------------------------+--------------+------------------------+
| RX ACK                     | ignore       | Cancel timer.          |
|                            |              | [IDLE]                 |
+----------------------------+--------------+------------------------+
| RX "goto TX-AAH" from      | Send AAH     | ignore                 |
| Router State Machine       | [TX-AAH]     |                        |
+----------------------------+--------------+------------------------+
| Timer expires              | impossible   | Send AAH               |
|                            |              | Restart timer.         |
|                            |              | [TX-AAH]               |
+----------------------------+--------------+------------------------+
]]></artwork>
          </figure>

          <t></t>

          <t>There is one instance of the per-neighbour (PN) state machine for
          each neighbour within the convergence control domain.</t>

          <t>The normal state is IDLE.</t>

          <t>On command ("goto TX-AAH") from the router state machine, the
          state machine enters TX-AAH state, transmits an AAH message to its
          neighbour and starts a timer.</t>

          <t>On receipt of an AAH ACK in state TX-AAH the state machine
          cancels the timer and enters IDLE state.</t>

          <t>In states IDLE, any AAH ACK message received is ignored.</t>

          <t>On expiry of the timer in state TX-AAH the state machine
          transmits an AAH message to the neighbour and restarts the timer.
          (The timer cannot expire in any other state.)</t>

          <t>In any state, receipt of an AAH causes the state machine to
          transmit an AAH ACK and enter the IDLE state.</t>

          <t>Note that for correct operation the state machine MUST remain in
          state TX-AAH, until an AAH ACK or an AAH is received, or the state
          machine is deleted. Deletion of the per neighbor state machine
          occurs when routing determines that the neighbour has gone away, or
          when the interface goes away.</t>

          <t>When routing detects a new neighbour it creates a new instance of
          the per-neighbour state machine in state Idle. The consequent
          generation of the router's own LSP will then cause the router state
          machine to execute the LSP receipt actions, which will if necessary
          result in the new per-neighbour state machine receiving a "goto
          TX-AAH" command and transitioning to TX-AAH state.</t>
        </section>
      </section>
    </section>
  </back>
</rfc>

PAFTECH AB 2003-20262026-04-23 12:02:44