Phase 2 of the network migration involved moving all the floor switches, which are currently connected to the 6509s, onto our 5548 distribution layer switches. One of our buildings is populated with 3750s and each IDF closet has two 1Gb uplinks up to the core. Our other building is populated with 2950s also with 1Gb uplinks to the core. Currently no floor switches are using etherchannels. Which means that 1 port from each IDF is in an STP blocking state. Obviously this is not ideal. For this phase we will also be migrating all the 3750s to use 10Gb uplinks as well as utilizing port channels between 3750 stacks. The 2950s unfortunately will have to stay on 1Gb uplinks however they will also utilize portchannels.
Before I go on I just wanted to let everyone know that this phase was completed yesterday night. We ran into some problems with the configuration on the Nexus 5ks. One in particular was a vlan was missing from the vlan database. The strange part about this was that the vlan showed in the vlan allowed list on the trunk links. You would think that some sort of error would have showed on the log. Another issue that we had was that some vlans were missing on the peer-link vlan allowed list on the 5ks. Besides those two issues the night went rather smoothly.
To be honest though, the most difficult part about this whole night was making sure that the fiber cables were properly flipped. As you know fiber has a Tx and Rx so the run between the access switch and the 5k has to match up. This can get confusing though when you through fiber patch panels into the mix. We had one person at the 5ks and one person going to each floor switch to swap cables and verify configuration.
All in all it was a successful night. As of right now we will not be moving anything else for about 2 weeks. At that point we want to completely remove the 6509s from our network as well as moving the rest of the blade centers to the Nexus.