DPC Sibirtelecom

The Data Processing Center (DPC) of JSC Sibirtelecom company in the city of Novosibirsk, in Kalininsky district is designed and put into operation in 2009 taking into account high requirements to reliability and security. The purpose of creation of this data processing center — providing reliable infrastructure for ensuring continuous work of telecommunication equipment, own IT resources (servers, storage systems) and the equipment of the customer placed on this platform.^[1]

Architectural concepts in data center

The data center is placed in separate, six the floor building of ATC-65/71. The building is under the round-the-clock observation and protection and is located in the place not subject to the elements and disasters. The Sibirtelecom is the owner of the building so this DPC is not threatened by "change of a registration". All main and auxiliary premises of data center are on the 5th floor. The panel built building with a steel concrete framework where the data processing center is located, was designed Novosibgrazhdanproyekt in 1982 and built in 1984. Load-carrying structures of the building – steel concrete. Height on the 5th floor from the floor basis to a ceiling is 4.6 meters.

The total area of all main and auxiliary premises of data center — 854 square meters, the area of two server premises is 316 square meters of them. The area of the server premises at number N1 is 151 sq.m and the second server — 155 sq.m. It is data center, rather large by the standards of Russia.

Before creation of data center in 2008 it was carried out complex visual and instrumental inspections of the bearing and enclosing structures of the building of automatic telephone exchange. During inspection the physical status of a roof, steel concrete columns, crossbars, overlappings was defined, calculations of constructions are executed, payload on overlapping of plates, crossbars and the base is determined, heattechnical assessment of external walls is executed. Were the positive decision about a possibility of installation of condenser blocks on a roof and retrofitting of the 5th floor under data center taking into account the planned weight load up to 1000 kilograms of one square meter is received.

On the 5th floor reconstruction was made: doors metal fire-prevention are set, replacement of windows in aluminum covers on windows with a double double-glazed window is made, heating devices were replaced.

In a data processing center removable raised floors which are used as air ducts for giving of a cold air to server racks are set and are used as the place for placement of cable channels. The raised floor has height of 500 mm, regulated reference elements from fireproof materials.

Removable tiles of a raised floor have an antistatic covering and are expected a distributed load up to 1000 kg per square meter.

System of distribution of power supply

External power supply is executed from two independent sources of external power supply with reservation of power supply by means of the diesel generator set (DGS) installed in the certain building located opposite to the automatic telephone exchange building.

Power on each independent input of 1250 kVA. On the 1st floor of the building of ATC-65/71 under the input distributor (ID) the certain premises with a total area of 27.5 sq.m are selected. In VRU power feeder cables from transformer substations and DGU are brought, in VRU automatic input of a reserve, electric counters and time cut-outs with the electric drive is mounted. Total power of the equipment of a data processing center is expected 790 kVA. From VRU on the 5th floor two Impact buslines of BBI company to electrotechnical premises are laid (the N1 UPS, the N2 UPS).

In premises of the N1 UPS and N2 UPS input and output distribution frames of the reserve and guaranteed power supply, distribution frames of a power supply of external and internal blocks of precision conditioners, a board of emergency lighting and a board of powering of computer sockets are mounted.

In server premises the group boards providing distribution of power supply by telecommunication cabinets are mounted. About two group power supply lines from two group guards are brought to each server rack. In group guards the time cut-outs Schneider Electric are installed. Each time cut-out installed in a group guard is supplied with the interlock contact of management and control of a status of the time cut-out. All power distribution and the VVGNG-LS group cables on the 5th floor are laid in trays under a raised floor.

System of Regular Power Supply (SRPS)

No break power supply system provides with uninterrupted power supply the equipment installed in server premises the system of abnormal power supply and powers a part of sockets to which telecommunication equipment and office computers is connected. Regular power supply is performed according to scheme 2 (N+1), i.e. the system of regular power supply has two independent and completely identical subsystems of the guaranteed power supply where in each subsystem one more reserve element is set. So even at failure of one of subsystems of SBE it will be provided regular power supply from other subsystem. Each of subsystems of SBE consists from 4-ekh three-phase modules EMERSON UPSes of double conversion of NXA of 160 kVA/128 kW (3 main and 1 reserve) working in parallel in a uniform complex. Two blocks of the Exide Electronics storage batteries of P12V1575 type installed on racks are connected to each module UPS. Each battery pack has the capacity of 66 Ach.

N1 UPS room space with an installed system of uninterrupted power supply and rechargeable batteries is 65.1 sq.m. Premises N2 with the UPS and batteries are placed on the area of 80.9 sq.m.

Cables and buslines in electrotechnical premises between the UPS and distribution frames, the UPS and rechargeable batteries are laid on trays.

Estimated time of independent operation and providing with uninterrupted power supply and parallel operation 4-ekh modules makes 18 minutes, during the work 3-ekh modules estimated time of smooth operation at the loading stated above — 12 minutes. This time is enough for start of DGU.

System of Back Power Supply (SBPS)

In case of failures in power supply from the transformer substations (TS) or quality degradation of power supply on inputs from TP start of DGU will be provided. SRE is expected maintenance of work of all engineering systems during 4-ekh hours. There is an opportunity to execute a fuel dozaprvka in a work progress of DGU.

Conditioning system and ventilation of data center

The conditioning system and ventilation is constructed using precision EMERSON conditioners with the portable external condenser blocks installed on a building roof on supporting structures. External condenser blocks are supplied with the low-temperature winter set ensuring functioning in winter time taking into account severe Siberian frosts. Internal blocks of precision conditioners are installed on perimeter of server premises the friend opposite to the friend and mounted in premises with the UPS. Precision conditioners are supplied with microprocessor iCOM blocks with displays, G4 filters, the sensor of pollution of the filter and the sensor of leak of water. As coolant R22 freon is used. The isolated copper freon routes are laid under a raised floor and in a technology corridor, and then brought to a roof of the building and brought to external condenser blocks.

Also on two precision conditioners it is set to premises of the N1 UPS and N2 UPS for ensuring required parameters for work of sources of uninterrupted power supply and rechargeable batteries.

Draining of condensate from evaporation units conditioners is performed through a drainage system. The water supply for operation of steam humidifiers of precision conditioners is performed via filters of rough and thin cleaning. All routes of a drainage system and powering of conditioners are laid by water under a raised floor. Precision conditioners maintain the necessary temperature and a relative humidity. Refrigerating power of a conditioning system is calculated with a stock of +10% and executed according to scheme N+1.

The plenum and exhaust ventilation

In server premises by means of the plenum ventilation with mechanical motivation inflow and a pressure of air is provided. Also in server premises two exhaust systems which join and used only for removal of gas fire extinguishing substance (GOTV) and smoke after operation of a system of gas fire extinguishing are mounted. In the UPS single air exchange with mechanical inflow and an extract from an upper zone is provided, indoors with automatic installation of gas fire extinguishing (AUGPT) double air exchange is provided.

All air ducts of the plenum and exhaust ventilation are equipped with fire-retardant valves with the mechanical drive and executed of zinc galvanized steel 0.5 mm and 0.7 mm thick (air ducts over 5000 mm2). At operation of a signal "fire" the plenum and exhaust ventilation is switched-off.

Structured Cabling System (SCS)

In a data processing center the classical structured cabling system with the centralized architecture is constructed. Main cross-connect (MC), is placed in separate the premises, in Cross with a total area of 5.5 sq.m.

As horizontal cable lines copper cables the twisted pair cable of category 6 are selected. In two cabinets horizontal crosses (HC) are set. Between high-speed ports of switches, and cabinets the optical fiber cables AMP NetConnect with a cover of LSZH (are laid to the cross when burning, not selecting halogens) with 12 single-mode fibers (SM) that allows to transfer in network of data center traffic with an unlimited speed.

As server racks telecommunication cabinets of NetShelter SX of APC company are selected 42U. In two server premises it is possible to place up to 72 telecommunication cabinets. The block of distribution of power supply (PDU) Rack PDU Metered on 32A APC company with protection against an overload which is set from the back is included in the package of a cabinet and does not take the place in a rack.

In each cabinet the patch panel on 24 RJ45 ports is mounted. The fiber optics is connected to LC-LC adapters.

Integrated Security System (ISS)

The integrated security system in date cent is intended for protection of premises and the equipment. ISB allows to manage access for employees and visitors, performs record and information output about a status of an object and events. ISB consists of three systems: control and management systems for access (ACS), alarm system (AS), system of security television (SST).

Network infrastructure of a data processing center

In data center classical network 2-level infrastructure which Lego is transformed in 3-ekh-level is used if in it there is a need. For example, it is possible to install the network switch in a server rack and to provide the access level. For access to multiservice network Sibirtelecom at the kernel level Cisco switch 7606-S with two processor modules is used. In server premises N1 about two modular Cisco switches Catalyst 6509 with providing the scheme of reservation according to scheme N+1 are installed. It is possible to connect servers to these switches directly or to connect Ethernet switches.

The local computer network in the data processing center is built using two Cisco switches 2960, set in the certain cross premises where main cross-connect (MC) is placed. Cisco switches 2960 are connected by means of a category 6 cable to switches of 6509 c by use of Gigabit Ethernet technology. Switches 6509 are connected to a node of network of the Novosibirsk branch of JSC "Sibirtelecom", located on the 3rd floor of the building, using two optical fiber cables and 10 Gigabit Ethernet.

Automated system of scheduling and management (ASDU)

ASDU in a data processing center collects data on work of all engineering systems. Information from all sensors is displayed monitors and on the big wall visual screen where the status of sensors, an output of alarms is visually displayed.

ASDU performs continuous monitoring with registration of key parameters and events.

Systems control is exercised for:

• leakage of liquids
• temperature and humidity
• behind quality of the electric power
• provision and status of time cut-outs
• system operation of the guaranteed power supply
• opening and closing of telecommunication cabinets

In dispatching office the post of observation of a status of information and engineering systems of a data processing center is located. The area of dispatching office is 13.3 sq.m. In data center the round-the-clock watch and observation is organized.

Fire extinguishing system

In the certain premises which area is 34 sq.m the system of automatic gas fire fighting is installed.

As fire extinguishing substance Freon-125 gas is selected.

Cylinders with gas are indoors set, the station of fire extinguishing and spare cylinders, are available bathroom scales for weighing of cylinders with gas that allows to control a status of the filled cylinder.

In DPC the fire detection system using fire annunciators is mounted. At emergence of the fire shutdown of air conditioning blocks is executed and blocking of a ventilation system and a skid of air is performed.

Provision of services by data center Sibirtelecom

The data center of JSC Sibirtelecom is designed both for placement of own IT resources, and for placement of servers, storage systems and telecommunication equipment of third-party customers. The Sibirtelecom provides full range of services for the clients:

• telematic services on data transmission
• provision of services of a hosting
• delivery of virtual and dedicated servers in lease

Notes