File Server Plans




Once again I feel the need... The need for more storage space. And with more storage space comes newer, better, more exciting hardware! So my current file server build is pretty basic, something just hobbled together from spare parts.

  • Intel Pentium Dual Core e5200

  • mATX Gigabyte LGA775 board

  • 2GB DDR2

  • 1x1TB+1x2TB in spanned volume (I know, I’m bad)

  • Couple of 2.5” drives for OS and download caching

  • 350w Sparkle power supply

I’m honestly surprised the thing has lasted this long without a drive failure. My luck while typing this, a drive would fail. So, we’re going to address the weak points in my current server build with the new one.

Power consumption

The current server consumes a fair bit of power. The processor really isn’t horrible power wise, but it is a 65w TDP, and it’s running on an older, more power hungry chipset. This is going to be remedied by a much more powerful, more efficient processor, the Intel Core i3 2120T. This is a dual core processor running at 2.6GHz, however, it’s a newer more energy efficient process, with a TDP of 35w, and by benchmarks, is about twice as powerful. The poweful part could easily be due to the included hyperthreading, but a lot of it just comes down to a better overall build process and more efficient transistors. The i3 2120T will find itself at home in my new file server build.

Expandability

The current file server is running on an mATX board which only has 2 DIMM slots, which would be alright, if they took DDR3 memory. The cost of DDR2 is practically outrageous compared to DDR3, and even compared to ECC DDR3. Sure I could populate it with 8GB of DDR2, but that’s as far as it would go. Not only that, but without ECC, one is looking at the possibility of running into errors while processing, which can lead to corrupted files. Another major limitation with the board is the minimal number of expansion slots. One can only do so much with a single PCI-e x16 slot. The board also has fairly limited I/O options, including the serviceable, however, not ideal, Realtek NIC. The final major limitation on the board is the limited number of SATA ports. The board only has 4 making an expansion card practically a necessity. Although an expansion card will be put to use in the new server, it’s not a necessity off the bat, so I can hold out on purchase until required.
For the new motherboard, I chose a SuperMicro X9SCL+-F. This board is extremely flexbile, with some great features to boot. It’s an mATX format with 3 PCI-e x8 lanes, 6 on board SATA ports, IPMI for KVM over LAN, dual Intel Gigabit NICs, an onboard USB port for OS installs, and 4 DIMM slots that accept only ECC DDR3. The board should be rock solid in this regard, serving up lots of usability niceties. Hell, with IPMI, I will only ever have to have ethernet and power hooked up. I may still go with a Tyan S5512WGM2NR, due to the onboard LSI 2008 RAID controller, which, when flashed with IT firmware, would provide 14 usable SATA ports to the server. It also includes triple Intel based LAN, providing even more interfaces for higher bandwidth applications. This however, is probably more trouble than it’s worth in my case, so I will more than likely stick by the SuperMicro board.
For drives, the server will be running pairs of 3TB drives in RAID 1. It will start with 1 pair, allowing for 3TB of usable storage space, and when adding another pair, I will stripe with the existing pair, allowing for a RAID10. This should increase performance while still maintaining a much higher level of redundancy than my current spanned volume. Once I get to the point where I run out of on board SATA ports, I will add a port expander, possibly a SuperMicro AOC-SAS2LP-MV8, which would allow a further 8 drives to be connected. Ideally at some point I would be adding an SLC SSD for a ZIL cache, along with more RAM as well for a larger ARC cache.

That about covers how I’m going to make up for the downsides of the current server, as for the rest of the parts, I believe I have decided on them. For a case, I figure a Fractal Design Define R4 will be more than adequate for what I want to do for storage, however, a Fractal Design Define XL may also be considered due to the extra 5.25” bays, along with the 2 extra 3.5” bays. The fractal cases look absolutely beautiful, and are designed for silence and good cooling. The 3.5” bays all have rubber gromets attached too, to limit hard drive vibrations, and all vents either have the option of being blocked, or include a dust filter to keep things clean.
As for a power supply, I haven’t quite decided on what model, however I am leaning toward an Antec Earthwatts power supply. I have never had any trouble with Antec supplies, and it should be enough to provide the power required for the server. Ideally, it will be a platinum model, to further cut down on power usage.
For hard drives, I’m leaning toward Seagate 7200RPM drives for the cost to performance ratio, as the 3TB models normally go for around $130. I haven’t had any trouble with the Seagate drives that I have purchased in the past, so I have no reason to believe it will be any different this time around.

The final build should look like this:

  • Intel Core i3 2120T

  • SuperMicro X9SCL+-F

  • 16GB ECC DDR3

  • 8x3TB drives in RAID 10 for 12TB usable or 10x3TB drives in RAID 10 for 15TB usable

  • 20GB Intel SLC SSD for ZIL cache

  • 650w Antec Earthwatts modular

  • Fractal Design Define R4 or Fractal Design Define XL

  • OpenIndiana installed to 16GB USB thumb drive on internal USB header.

Over the process of the build, the server will basically bump up by 3TB intervals. The bump for 6TB will also bump the RAM to 8GB, and the bump to 9TB will then bump the RAM to 16GB. I’ll add the other drives as needed then.

That about covers the file server. I’ll be sure to add any hardware updates and whatnot as more parts roll in. I’m hoping to have everything going by Christmas, and ideally at least a functional testbed without drives by the end of October. In future posts I’ll also be logging a virtual server build, and a possible desktop upgrade. And guess what? There’s some more reviews around the corner!

Stay tuned.

Finished! ...Well, sort of.

Alright! Longer time than expected to actually make another post, but hey, that's alright! I ended up finishing Water FTW 1.0 the night of the 16th when I returned home. I really didn't run into any trouble at all, other than the Switech micro reservoir being a bit hard to mount, especially with properly routing the tubing... I ended up getting it done, but the tubing wasn't quite as clean as I had liked. Oh well, it was done. Anyway, here's the first phase, along with all the parts that had been received.



Above is the weekend haul. You can see here, I brought home not only a fair number of shiny fittings and water blocks, but I also have... WHAT'S THAT? 16GB OF DDR3? Oh my. Yeah, I upgraded to 16GB of DDR3, Mushkin Blacklines. All of the fittings were ordered from Dazmode/NCIX, and arrived by Friday! Service from NCIX is normally amazing, but they went above and beyond with these 3 orders to them. The only thing that didn't arrive was the package from Elwoodz, which I was initially disappointed about, but got over it awful quick. Also pictured are the 72 K Cups from Singlecup.ca, my new spot for my coffee fix.  2 boxes of dark roast, a box of medium roast, and a box of jet fuel.










Above are the pictures that I took that actually turned out okay from Water FTW 1.0. As you can see from the first one, it's a bit of a tight fit for the reservoir with the tubing. I only had one leak during the build, and it was actually the fill port of all things. The EK blocks are simply great. Amazing machining, even if the GPU blocks seem a bit rough. I guess seeing finishes like Zalman, or the base of the Supreme HF kinda spoiled me... I was happy with this, but I wanted it to look even better... So off to Dazmode. The results are posted below...





As you can see above, with the dazmode order I decided to add a lovely tube reservoir. This particular tube is the EK Multioption 150 x2 Advanced. It comes with like, 3 holes on the top, 5 on the bottom, 3 tubes for inside the reservoir to reduce cyclone formation, along with an anti cyclone attachment. I decided to go with the tubes.  This really reduced the number of sharp turns, and actually shortened my tubing runs, which was my main goal. My second goal was a usable drain port. Because, holy crap, holding a full HAF 932 over a tub is NOT a fun experience. My drain port is right after the pump, and consists of a t block with a quick disconnect attached to it. The female end is attached to a length of tube, and I keep it for draining. This really does simplify things... A lot.



Picture of the drain port above. The Koolance quick disconnects are simply amazing. really nice build quality to them. You can also see here my pump mounting choice. I decided to zip tie it to the drive cage, with some neoprene from a cheap laptop case acting as a vibration dampener. I can't hear it, and I couldn't really even hear it when I was leak testing. Maybe it's just me, but the MCP355 isn't loud with proper mounting. Definitely not audible over the fans, which are pretty darn quiet as it is.



Upsettingly, I didn't quite have room for the above. This doesn't mean I won't try to fit it in at a later date, but I had to leave this wonderful single radiator out for now. I am, however, very happy with the temperatures I'm getting from this triple radiator. Sadly, the highest I can manage to push the processor with hyperthreading on, while still maintaining good temperatures, is 3.8GHz. I'm partially blaming this on the 16GB of DDR3. At 1.25v in the bios, 1.25v on the VTT, I can manage 3.8GHz, with a maximum temperature of 63 degrees in LinX. That's a 25 pass run with all memory. 4GHz required over .1v more, and shot temperatures up another 10 degrees, if not more. My happy medium is 3.8GHz, as the extra "performance" isn't really worth the heat. I'm very happy with a processor that idles around 22-24 degrees, and has an average load temperature of around 28-30. Even gaming doesn't push it all that far. The maximum temperature I have seen during gaming wasn't even close to the 63 max in LinX on the processor, and the GPU doesn't even hit 50... Oh, and by the way, the GPU idles around 28 degrees. Not complaining there. On the heatsink, it would easily hit 35-40 degrees idle, and I don't think I had ever seen it go under 70 degrees with a gaming load on it.



Oh, as for that 16GB of RAM... This is what I've been doing. ESXi 4.1 running in Workstation 7, virtualizing 3 different operating systems! I plan on doing a lot more tests with it, but I'm a little limited by the single Western Digital Black... I think, however, I can use this as an excuse to set up a raid array!

Well, that's enough for tonight... I'll definitely be back to post again. And, I'll leave this post with one more picture.



-Jon

Since I won't be getting any sleep tonight...

May as well update the blog with more of an "overview" of what's going on with the water cooling project. So, let's start out with a total parts list.
1x Feser X-Changer 360 Radiator
1x Feser X-Changer 120 Radiator
1x Swiftech MCP355 w/ EK X-Top
1x Swiftech Micro Res Revision 2
1x EK Supreme HF Revision 2 CPU water block Nickel/Plexi
1x EK FC470 GTX 470 full cover GPU water block Nickel/Plexi
12x Bitspower 1/2" ID 3/4" OD silver compression fittings
11x Feser 1/2" ID 3/4" OD Nickel compression fittings
6x Feser 1/2" ID 3/4" OD Silver 45 degree rotary compression fittings
5x Feser Nickel 45 degree rotary adapters
1x Bitspower silver 90 degree rotary adapter
1x Bitspower Nickel 90 degree 1/2" rotary barb
10x Bitspower silver 1/2" barbs
7x Feser nickel 1/2" barbs
1x Enzotech nickel T adapter
1x Enzotech silver 10.5mm G1/4 threaded spacer
2x Swiftech fill/drain ports
2x Poly tees
16~ Feet of PrimoChill Primoflex LRT clear 1/2" ID 3/4" OD tubing

So, as we can see, there are a TON of fittings here. I shouldn't have any trouble getting things to fit properly with everything listed here. I'm still thinking I might grab that second Feser 360, and use it for a near-future project... Water cooled media PC/Server anyone? I really can't think of anything else to do with another radiator... Other than find a way to fit it into my main loop. But what I'm going to have is already overkill as is. Well, I'll know for sure if I'm going to take that radiator some time in the afternoon. Should have all of my cash by then.

In other news, Nick's board should be shipped out tomorrow via expedited or express parcel! Since it's coming from New Glasgow, it shouldn't take all that long. The weekend will be building Nick's machine, followed by stability testing it. He'll game, I'll see the girlfriend and my friends. Sunday, I'll gather up the plethora of components and my 72 kcups, and hit the road back to Truro.

I'll be sure to update throughout the week. Perhaps we'll even see a nice review of my Keurig B44.

Bed time now...

-Jon

Oh look, more money spent

Well hot damn, I'm just on a roll now.

So, I really couldn't pass it up, someone else from the Hardware Canucks Forums, his handle being Elwoodz, was selling some lovely water gear. So, I got away with some lovely components, that'll be listed below. I also made another order from Dazmode, and got a couple more fittings from NCIX as well. So, my parts that have been obtained over the past few days are as follows...
TFC X-Changer 120
2x Bitspower 1/2" silver compression fittings
11x Feser 1/2" Nickel compression fittings
6x Feser 1/2" 45 degree rotary compression fittings
1x Enzotech nickel T adapter
7x Feser Nickel 1/2" Barbs
3x Feser 45 degree rotary adapters

There's also a pretty good chance of grabbing a second X-changer 360, for 60 dollars shipped. I could pretty easily use this in a later build, and it'll be just nice to have around in case I get a larger case. Water cooled HTPC or what?

Here's hoping everything comes in by Friday.

-Jon