Working with Real Data
Happy with our raw-disk throughput and capacity, we were ready to restore our 2TB customer database.We used 64 drives for the two central databases that comprised the 2TB customer data warehouse, which came from one SQL Server 2000 instance. We used Windows 2003 to mirror pairs of drives.This made our useable database disk space just over 12TB. Given the cost and the throughput of this server, and having the fault tolerance of mirrored drives, we were confident we had a high-performing, reliable server with a lot of disk capacity. We were still very content that we had 12TB of useable storage for our prototype server.

We restored the two customer databases. The source and target databases each contained 16 SQL Server data files, and each data file was on a separate mirrored volume. We overlapped eight files from each database on the same set of eight mirrored disks so that we had eight free mirrored disks for TempDB and the SQL Server log file.

Once we restored our databases, we set out to run several stored procedures, queries, and index builds on our prototype server. By doing so, we were able to compare exact times for our prototype to the SAN-based customer server, a 16-CPU server with more than 64GB of main memory connected to a high-end SAN that has six fiber-channel controllers that deliver about 170MB per second of sequential data throughput. Table 2 shows a comparison of some notable results from both servers.

Although we don't have room in this article to include more results, you can see from some of the test results in Table 2 that our prototype server holds its own against a much larger and more expensive server. In addition, for operations such as SELECT INTO and index builds, we saw significantly better performance compared to the customer server. Only the range query was slightly faster on the customer server. We plan many more tests on concurrent query workloads and OLTP-type workloads, instead of the sequential I/O-based workloads we've tested so far. It's important to realize that up to this point in our testing, we've used only SATA drives, which offer data throughput comparable to SCSI or SAS drives for workloads that are sequential in nature. However, SATA drives are significantly slower than SCSI or SAS drives for random I/O operations. A typical SATA drive at 7200 RPM delivers about 100 I/Os per second, whereas SCSI or SAS drives can deliver more than 150 I/Os per second. Because our server used SAS HBAs and expanders, our next round of tests will use SAS disk drives that we simply plug into our Chenbro drive chassis after removing the SATA drives. We also anticipate some exciting results for OLTP-type workloads.

The combination of hardware,Windows Server 2003 x64, and SQL Server 2005 x64 in our prototype delivers a formidable combination of database-processing power, disk capacity, and pure throughput. I hope the results I've presented here will spur customers to evaluate the opportunities for using SQL Server 2005 x64 for development and QA servers in addition to production server applications.

Author's Note: Special thanks to Jim Gray of Microsoft Research for his vision and research,which inspired our prototype and this article.

End of Article

Prev. page     1 [2]     next page -->



You must log on before posting a comment.

If you don't have a username & password, please register now.

Reader Comments

Article text and Figure 1 don't match. Article mentions 6 LSI SAS HBAs, and the figure shows only 3 (1 dual, 2 single). It would make sense to reduce the cards to 4 or fewer so that each could run on the host computer's 133Mhz PCI-X slots.

Also, the article mentions 32GB of RAM, while the figure shows 64GB. Why the difference? Which setup was used to post the results?

trimai

Article Rating 5 out of 5

Hi - The author has this response to the discrepancy on the figues:

From Rich Johnson: The graphic I saw was a picture of memory cards that said 16 x 4 GB which would be 64 GB of memory. It should be 8 x 4 GB cards. Is that what the reader saw? Its kind of small but if you really look at the diagram and the fact we refer to 32 GB of main memory than that’s a discrepancy. Regards, ---------------------------------------------- Rich Johnson Architect Business Intelligence Solutions for the Retail & Hospitality Industry

djmay

Article Rating 5 out of 5

In Table 1, the typical market cost of 64 Seagate 400GB drives is $11,340. This comes out to $178 per drive. Where can I obtain these drives at that cost? The best I can do is $230.

THEFox

Article Rating 5 out of 5

To trimai, to fully utilize PCI-X bus, you need to know deep knowledge of the hardware platform. (e.g. how many buses there in the chipset, which and which slot share the same bus). Bus always wide than HBA, so it makes great sense to use two HBA on one bus. No one will stop you to only use 4 cards, but with two more, you get more throughput.

To THEFox, $230 is not far away from $178, isn't it? Buying in a bunch always get cheaper, I reckon.

Jim Gray's paper is in more details. Something lack from this article is the RAID configuration and DB filegroup setting up. And what about OLTP? How good will this system respond to Random access?

SAN maker's easy money day should over ASAP.

xied75

Article Rating 5 out of 5

I'm also curious what (if any) RAID configuration was used as well as the location of the database drives. If you didn't use any RAID would you consider redoing the test with in applied so we could see how much of an impact this would have on performance? Enterprise customers would likely be willing to compromise on some amount of performance if we retain the reliability we get in a SAN. Thanks for considering & for the article itself.

toennitm

Article Rating 5 out of 5

I am also curious about the RAID configuration in this scenario? I heard that there is interoperability issues between LSI SAS HBA and Vitesse SAS expander but not sure they are the ones used in this setup.

jingtau

Article Rating 4 out of 5

Excellent Article, Thank you.

hughesg4

Article Rating 5 out of 5

I hope the author can update his article as somethings have changed. Vitesse no longer makes SAS Expanders. And it looks like Supermicro SC933 is a better fit for a 16-bay chassis since the LSI Expander card is included, however I think the backplane is only SAS drives, not SATA.

I did manage to find a chenbro expander card, but they sell two models, and if you want the one described in the article, it would take forever to ORDER one. I heard the lead time is about 6-weeks....

He said that they would come out with the results by plugging in SAS drives but no results or updates were forthcoming. I guess Chenbro wanted their chassis back.

Has anyone built this model yet with today's available resellers? And preferably on both SATA and SAS in your chassis so you can put your OLTP on SAS and your storage needs on SATA?

andrewn2008

Article Rating 5 out of 5

Hi andrewn2008, Thanks so much for your feedback. You ask a lot of great questions, which could end up being topics for future storage articles. We will definitely keep your comments in mind when we are acquiring and scheduling storage articles for SQL Server Magazine. Thanks again!

Megan Bearly Associate Editor, SQL Server Magazine mbearly@sqlmag.com

meganbearly

Article Rating 5 out of 5

 
 

ADS BY GOOGLE