smartOS HPC config suggestion

Posted by Andrew B. on Server Fault See other posts from Server Fault or by Andrew B.
Published on 2012-11-06T22:42:43Z Indexed on 2012/11/06 23:03 UTC
Read the original article Hit count: 249

Filed under:

zfs

|

smartos

I'm configuring a brand new HPC server and am interested in using SmartOS because of it's virtualization control and zfs features. Does this configuration make sense for a SmartOS HPC, or would you recommend an alternative?

System Specs: 2x 8-core xeon 384 GB RAM 30 TB HDs with 2x512GB SSDs

Uses: - zfs for serving data to different vms, and over the network; 1 SSD for L2ARC and 1 for ZIL - typically 1-2 ubuntu instances running R and custom C/C++ code

My biggest concerns as a newbie to SmartOS and ZFS are:

(1) will I get near-metal performance from ubuntu running on SmartOS if it is the only active vm? (2) how do I serve data from the global zfs pool to the containers and other network devices?

© Server Fault or respective owner

Related posts about zfs

ZFS replication between 2 ZFS file systems

as seen on Server Fault - Search for 'Server Fault'
I initially replicated tank/storage1 -- usb1/storage1-slave (depicted below), and then (deliberately) destroyed the snapshot I replicated from. By doing this, did I lose the ability to incrementally (zfs send -i) replicate between these 2 file systems? What's the best way to approach SYNC'ing these… >>> More
Troubleshoot broken ZFS

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I have one zpool called tank in RaidZ1 with 5x1TB SATA HDDs. I'm using Ubuntu Server 11.10 Oneric, kernel 3.0.0-15-server. Installed ZFS from ppa also I'm using zfs-auto-snapshot. The ZFS file system when zfs module loaded to the kernel hangs my computer. Before it I created few new file systems: zfs… >>> More
Oracle Solaris 11 ZFS Lab for Openworld 2012

as seen on Oracle Blogs - Search for 'Oracle Blogs'
Preface This is the content from the Oracle Openworld 2012 ZFS lab. It was well attended - the feedback was that it was a little short - thats probably because in writing it I bacame very time-concious after the ASM/ACFS on Solaris extravaganza I ran last year which was almost too long for mortal… >>> More
zfs setup question

as seen on Super User - Search for 'Super User'
Currently I have a linux storage box and server with 4x750gb harddrives in raid-5 with ext3. I have ordered 3x1.5tb disks to upgrade this. Here is my planned upgrade: Backup: Format the 1.5 tb disks Copy all data from the raid-5 disks to the 1.5tb disks Destroy the raid-5 array. New setup: Create… >>> More
I need advice about iscsi + zfs(or ntfs) + windows 2008 clustering

as seen on Server Fault - Search for 'Server Fault'
I want to setup a storage farm with iSCSI. I have 2 cluster node machine, 1 iscsi target machine that has 8TB installed as RAID 10. The capacity is now 8TB, but I'll upgrade the capacity in future. Let's say, I installed clusters as file server, and I connected these servers to iscsi target, then… >>> More

Related posts about smartos

smartOS HPC config suggestion

as seen on Server Fault - Search for 'Server Fault'
I'm configuring a brand new HPC server and am interested in using SmartOS because of it's virtualization control and zfs features. Does this configuration make sense for a SmartOS HPC, or would you recommend an alternative? System Specs: 2x 8-core xeon 384 GB RAM 30 TB HDs with 2x512GB SSDs Uses: -… >>> More
SmartOS Virtualization with one public IP address

as seen on Server Fault - Search for 'Server Fault'
Is it possible? (title of this question) Googling Virtualization with one public IP address yields nothing useful What I have: SmartOS on a dedicated server. Dedicated server has one public IP address. What I want to do: Host multiple guest OS from that server Problem: Access to the guest… >>> More
Supermicro SmartOS setup issue with HDDs

as seen on Server Fault - Search for 'Server Fault'
I'm trying to setup SmartOS on my new Supermicro server (SYS-6027R-N3RF4+). I have 8 HDDs + 2 SSDs installed in the hot-swappable drive bays. I have not configured the Intel RAID controller on the machine (it shows no RAID configured, and lists all 8 HDDs). When I boot SmartOS from my USB key for… >>> More
SmartOS reboots spontaneously

as seen on Server Fault - Search for 'Server Fault'
I run a SmartOS system on a Hetzner EX4S (Intel Core i7-2600, 32G RAM, 2x3Tb SATA HDD). There are six virtual machines on the host: [root@10-bf-48-7f-e7-03 ~]# vmadm list UUID TYPE RAM STATE ALIAS d2223467-bbe5-4b81-a9d1-439e9a66d43f KVM 512 … >>> More
Getting USB boot to work in SmartOS on HP ProLiant N40L

as seen on Server Fault - Search for 'Server Fault'
I recently downloaded SmartOS and tried running it on my HP ProLiant N40L, but it always fails on boot. After dd'ing the image to the USB stick, I plug it into the internal USB header and turn the machine on. After selecting from GRUB, it displays the following: , bss=0x0 It sits there for… >>> More