Rack planning
Posted by Miksu22@reddit | sysadmin | View on Reddit | 15 comments
Hello!
We recently moved into a bigger warehouse/office complex, and I need to build the first rack setup. I have very little knowledge of racks, so any tips or tricks on how to make the most of it are welcome. I am thinking 800x1000 42U. It's going to be mostly a communications rack, but we're also going to add a few servers and UPSs later on. I'm on a tight budget, so keep that in mind. I have been looking at the APC EasyRack and Rittal VX 5309166 lately. Rittal has a storefront right next to us. I'm not sure if they sell racks there, though. However, it could save us on shipping costs if we could pick it up there. I have already asked our electrician to install a 16A, three-phase outlet and two 10A, type F sockets, as well as a dedicated 16mm² ground above the rack location. I plan to purchase one vertical PDU to handle the power from 3-phase and the 10A sockets in case we need to add something that doesn't belong in a rack but still needs to be stored there. For now, we need to rely on a 5G ISP link, but we will get fiber in the near future.
I would like to hear your recommendations on rack manufacturers and models, as well as any good practices for setting everything up in the rack. For example, are there any must-have accessories that you recommend? I also need to extend the existing CAT6 cables from their current location to the rack and plug them into patch panels. I've dreamed of getting a P-touch to label them correctly, but I probably need to use a regular Dymo instead. Currently, they're not labeled at all (thanks to who ever did this...). I also need to use more fiber than necessary since the warehouse lacks support for network cables, and because of that the cables need to run parallel next to high-voltage cables.
I plan to install the devices in the following order, starting from the top:
1U
Getaway and firewall
1U
Patch panel
Switch
Patch panel
3U (leaving room for future expansion switches)
NVR
1U
RPS
and then UPS's at the very bottom with servers above those.
And since there is so much empty space in the rack for now, I am planning to get some drawers for miscellaneous items somewhere in the middle.
Some good advice on cable routing and labeling would be helpful. I have pretty strong OCD, so these things are not gonna be overlooked never the less.
Adam_Kearn@reddit
Get a PDU and mount t it to the back
Buy a load of “IEC C13 to C14” cables in red/blue colours
You might need a few different IEC cables depending on what equipment you are mounting
Miksu22@reddit (OP)
Do you have any advice on how to implement surge protection for POE connections? Should the surge protection be placed as soon as the cable enters the building, or can it be placed just before the cable enters any switches? I need to start with a 5G ISP link, which is placed high up on a roof mast, so there is a chance it will be struck by lightning. Should I install the surge protection as soon as the cable enters the attic or before it connects to the rack, about 50 meters after entering the building? It would be much easier to install the surge protection before the rack, since I have proper ground contact there. If I want to install surge protection in the attic, I would have to use the electrical wiring ground. I'm wondering if that could cause a fire hazard if the shock traveled the length of the cable inside the building before hitting the surge protector.
Adam_Kearn@reddit
Don’t really have any experience with surge protection but I would assume you could just put earth wires on all your devices.
Most switches have a dedicated earth connection screw you could connect this to
crzyKHAN@reddit
If you can afford it move to ~220V-240 / 30A setup
Miksu22@reddit (OP)
I asked if a 32A would be possible, but it would require very long cable runs from the main electrical room, so for now, I have to go with a 16A.
I plan to use WiFi APs only in the office area of the building and connect to the network via CAT6a and fiber elsewhere. Since we don't need WiFi outside the offices right now. But which APs do you consider suitable for heights of around 30 ft in case we end up adding Wi-Fi to the production facilities someday?
I am planning to get a smart PDU of some kind. By that, I mean that it could measure groups, but not individual outlets etc. And which sensors would you recommend, if any?
pdp10@reddit
This NETIO is the most interesting PDU I've seen in years. I'd get one in to test, but we just recently bought equipment to go a slightly different way, so I don't think I'll be getting one any time soon.
graph_worlok@reddit
UPS down the bottom is the #1 rule and you have that covered!
Miksu22@reddit (OP)
Yeah that was the first advice from another subreddit too. And leave 1U gaps between the devices, I guess it makes the installing easier and affect the cooling of the devices as well?
graph_worlok@reddit
If you can, yeah. Technically it’s worse for cooling, but the places that need to worry about that don’t worry about replacing devices
Miksu22@reddit (OP)
By the way, are there any guidelines for choosing cable colors? Currently, all of our existing CAT cables come in three different colors, but I need to extend them all. So I thought I would make the extensions represent the colors we are going to use for CAT cables from this point on. And same with the fibers as well. I was thinking the ISP should be a different color than the others, but is there any standard to follow?
pdp10@reddit
No; the jacket color is purely arbitrary with UTP. Be warned that an effort to create meaning or consistency is going to severely complicate logistics, and could be largely wasted by any exceptions.
With fiber, jacket colors specify the fiber type and connector-coding.
sryan2k1@reddit
The gaps make cooling worse.
hkeycurrentuser@reddit
I try to specify 800Wx1200Dx max height the facility lifts will allow.
Yes they are big bustards, but if you can swing it, your future self will thank you.
Also get the front vertical rails moved as far forward as you can and still allow for cable management bars.
I have two facilities where I can't close the rear doors and my server hangs out the back because my server guy didn't check dimensions of a model.
ebloke002@reddit
I recently did a buildout of 40 racks and used the Panduit FlexFusion XG cabinets 45U, 700x1200. That extra depth I found more useful than the extra width. Everything went together without any hitches. The cabinets came with the finger management and PDU brackets. With the 700x1200, I was able to put in 4 vertical PDUs and still had room to cable everything to satisfy my own OCD, lol.
Miksu22@reddit (OP)
I need to take a look at that. The white color would complement the rack placement much better than a black one would. Since it's not in a typical server room. Although my supervisor would like it to be black, but the office ladies would definitely prefer white. Even though it won't be directly in the office. And the 1000 depth is the maximum we can do because of the placement location.