Phase Two of our New Data Center Project has Begun

As I've mentioned in a few recent blogs, we're building a data center right now with the networking based on the Cisco Nexus-series line. This last week saw us enter the second major phase of this project: Installation. If I categorize this new data center we are building into three phases it would be like this:

  1. Phase 1 - Design
  2. Phase 2 - Installation
  3. Phase 3 - Application Migration

Phase 1 began back in August 2008 when we decided to use a chunk of a new product development data center for IT. This part of the data center, which holds over 2,100 racks total, has about 300 for IT. Phase 1 was the design part of the project. We worked on everything from network design, services design (load balancing), new WAN circuits, QoS, management networks, SAN, cabling, data center layout. Some of the work included research on new technologies (Nexus), network design work, and testing in the Cisco CPOC lab. All of work in the "Design" phase culminated in final design documents we provided to our implementation/operations teams a couple weeks ago. This finished the "Design" phase. This last week we moved into the "Installation" phase which began with a week-long class on the Nexus series from Skyline ATS. While a few of us on the team knew the Nexus line, many did not. So, this training was to get everyone up to speed on the new technology and train on data center design and ACE. After training each day, the operations team worked on specific device configurations based on the design configuration templates we had provided and the training. During this training, our Data Center Operations team was racking and stacking equipment, powering devices, and doing patching. Tomorrow begins the configuration of all devices. We have broken down the areas of the data center into 12 sections and assigned people to be responsible for each section. The operations team does the configurations while the engineering team (my team) provides help and guidance

  1. Data Center Management Network (Hung, Igor, Mark)
    1. VLAN renumbering on existing MGMT network
    2. FW installation in B1, connect to IT Core
    3. Bring up B1-B4 connections
    4. Config FWs
    5. Config MGMT core network switch
    6. Config Cyclades
    7. Verify patching
    8. Micro Zones switches/Cyclade configs
    9. Clean-up B1 MGMT Network
  2. Data Center Aggregation Switches (Gilbert, Kamal)
    1. Load Configs
    2. Create DMZ VDC
    3. Verify connectivity
    4. Checklist config
  3. Service POD (Ricardo, Kamal)
    1. Load Configs
    2. Verify connectivity
    3. Checklist config
  4. SAN (Nabil)
    1. Load Configs
    2. Verify connectivity
    3. Checklist config
  5. IDF and WAPs (Ricardo, Nabil)
    1. Rack & cable IDF (Verify)
    2. Hang WAPs
    3. Config switches & WAPs
    4. Bring up B1/B2 to B4 connections
  6. MicroZones (POD) (Gilbert, Hung, Nabil)
    1. Load Configs
    2. Verify connectivity
    3. Checklist config
  7. Internet Switch Extension (Hung, Nabil)
    1. Verify SMF to Security Micro Zone
    2. Finish Elevations
    3. Rack & stack B4 Internet switches
    4. Cable
    5. Config Internet Switches in B4
    6. Submit change control
    7. Make config changes in B1 Internet Module
    8. Bring up links B1-B4
    9. Verify connectivity
  8. Core upgrades & WAN (Hung, Igor)
    1. Install 10GbE cards in CR01/CR02
    2. Rack & stack ASRs
    3. Load IOS 2.3.0 on ASRs
    4. Config ASRs and CRs
    5. Bring up links to WS's
    6. Config OSPF
    7. BGP changes on CRs & VR/WR
    8. BGP filter changes on DR network
  9. Extranet (Mark, Gavin)
    1. Elevations to Terry
    2. Rack & stack of Extranet
    3. Connect to MGMT network
    4. Load proper IOS
    5. Configure
    6. Verify SMF connections back to B1 CRs
    7. BGP filter updates for 10.x.x.x/15
  10. Net Tools (Gilbert, Ricardo)
    1. Verify connectivity
    2. Config SPAN sessions
    3. Management network connectivity
    4. NetFlow Tracker installation
    5. Clearsite installation
    6. Netscout installation
    7. Gigamon installation
  11. Testing
    1. ISSU
    2. VPC peer failures
    3. VPC microzone failure
    4. Sup switchover
    5. OIR
    6. Power Supply
    7. Reboot
    8. Pull fabric card
    9. (Too many more tests to list)
  12. Final bringup of Core Router to Aggregation Router links

All of this work is being done in the next two weeks. After all that is done we still have to update all of our architecture documents and websites. It's going to be a very busy April. Once the "Installation" phase is completed the next and final phase is "Application Migration". After the initial hosting and storage equipment is installed applications from our other data centers will begin to migrate to this new data center. That could take months and will be a methodical process to ensure no interruptions of service. There will be plenty to blog about in that phase. Heading back to the data center now.....

More >From the Field blog entries:

Cisco Advanced Services Education and the Awesome Technical Knowledge Library

My Interview with Cisco about the CCDE

The Cisco QuantumFlow Processor - The Engine in the ASR 1000 Series

NPA Awards for Professionalism - Nominations Have Begun

NX-OS Training Videos on YouTube

Good Luck to All CCDE Testers Tomorrow

  Go to Cisco Subnet for more Cisco news, blogs, discussion forums, security alerts, book giveaways, and more.

Join the Network World communities on Facebook and LinkedIn to comment on topics that are top of mind.
Related:

Copyright © 2009 IDG Communications, Inc.