How NVIDIA Geforce RTX powered laptops empower you to make your home a place of work, play, or something in-between.
The Power to Work, The Desire to Play - with NVIDIA
The Wii original gets the Nintendo Switch remaster treatment and the results confirm just why this series is one of the best.
Xenoblade Chronicles: Definitive Edition is Role-Playing Gold
With the recent release of Fallout 76: Wastelanders, we sat down with Bethesda Game Studios to discuss its development, the original launch, and the road ahead.
Fallout 76 - The Big Interview
An entry level take on a well-worn genre that after a few hours will have you heading for the exit.
Minecraft Dungeons Review - Between a Block and a Hard Place
Is my NAS big enough?
Red
Sydney, New South Wales
937 posts
It's days like these I enjoy working in Enterprise storage.

http://i.imgur.com/Q1Ros.png

http://i.imgur.com/VOR29.png
08:47am 17/02/12 Permalink
system
Internet
--
08:47am 17/02/12 Permalink
tspec
Melbourne, Victoria
3370 posts
haha that's awesome, still not as much as the NBN has though :) What sort of set up do you have to deliver that much storage?

/edit: should have looked at the domain. emc.

last edited by tspec at 08:59:39 17/Feb/12
08:51am 17/02/12 Permalink
orbitor
Brisbane, Queensland
8802 posts
yikes take a lot of linux isos to fill that
08:52am 17/02/12 Permalink
scuzzy
Brisbane, Queensland
15167 posts
Fancy!
08:57am 17/02/12 Permalink
HeardY
Gaelic newb
Sydney, New South Wales
20518 posts
Epeen
09:07am 17/02/12 Permalink
d0mino
Melbourne, Victoria
5230 posts
WTF IS A PB?!!

09:33am 17/02/12 Permalink
Raven
Melbourne, Victoria
6511 posts
I nearly cried when I saw this. 12TB is already 50% more than the pre-RAID size of my own NAS - I get about 5.6TB :(

So that's what, about 1,200 disks?
09:36am 17/02/12 Permalink
scuzzy
Brisbane, Queensland
15168 posts
WTF IS A PB?!!
It's where you store your teen pix

http://en.wikipedia.org/wiki/Petabyte
09:38am 17/02/12 Permalink
Red
Sydney, New South Wales
938 posts
This is a 20-node cluster made up of 15x108TB 'bulk storage' type nodes and 5x36TB 'high throughput' type nodes. There's 600 spindles all up.
09:41am 17/02/12 Permalink
Raven
Melbourne, Victoria
6512 posts
Hah, So I was close, I just had the disk size wrong :P~

if by 'close' you mean 'off by 100%'. But I'll take that.
09:42am 17/02/12 Permalink
kappa
Brisbane, Queensland
1805 posts
Wow.

Interesting note from that wiki link ...
Games: World of Warcraft uses 1.3 petabytes of storage to maintain its game.[16] Steam, a digital gaming service developed by Valve, delivers over 30 petabytes of content monthly.[17]


and this
Physics: The experiments in the Large Hadron Collider produce about 15 petabytes of data per year, which will be distributed over the LHC Computing Grid.[10]
09:58am 17/02/12 Permalink
DecayingCorpse
Brisbane, Queensland
1948 posts
thats a really great figure that... but its still not big enough, in 5-10 years you'd be able to fill that with pron and tv shows :)
11:35am 17/02/12 Permalink
Hogfather
Cairns, Queensland
11928 posts
thats a really great figure that... but its still not big enough, in 5-10 years you'd be able to fill that with pron and tv shows :)

Don't think so - storage and bandwidth have been growing faster than media sizes for pretty much ever.
11:41am 17/02/12 Permalink
Red
Sydney, New South Wales
940 posts
Funny you should say that, they're expecting to add another ~90 108tb nodes over the next three years.
12:10pm 17/02/12 Permalink
Pinky
Melbourne, Victoria
12652 posts
Very impressive

Would love to see your elec bill
12:23pm 17/02/12 Permalink
Red
Sydney, New South Wales
941 posts
It'd be big. Each of the 6 racks we're using has dual 32-amp three phase PDUs...
12:59pm 17/02/12 Permalink
Raven
Melbourne, Victoria
6514 posts
6 racks? Weak!
We have a computer downstairs that has that many racks just filled with processor cards :P

Edit:
And I so want to see its timedemo results.
03:37pm 17/02/12 Permalink
Pinky
Melbourne, Victoria
12662 posts
Pics of your rack or lying
03:41pm 17/02/12 Permalink
Nathan
Brisbane, Queensland
3959 posts
Rate my rack
04:28pm 17/02/12 Permalink
Crusher
Sydney, New South Wales
1058 posts
05:49pm 17/02/12 Permalink
konstie
Melbourne, Victoria
1936 posts
so how much is something like that?
05:57pm 17/02/12 Permalink
copuis
Brisbane, Queensland
2268 posts
the answer is always, not big enough,

also, RED, sometimes, I think I want to be you.......so damn jelly, that would be so lovely to have as storage,

oh well, few more years and no doubt it will be in consumer reach
06:24pm 17/02/12 Permalink
hardware
Brisbane, Queensland
10052 posts
when does it stop becoming a NAS and start becoming a SAN?
08:31pm 17/02/12 Permalink
HerbalLizard
Brisbane, Queensland
5380 posts
So I am gunna go with either infiniband or some 10G links

Want to post some detailed spec
08:35pm 17/02/12 Permalink
stinky
USA
3688 posts
when does it stop becoming a NAS and start becoming a SAN?


when you move from file based storage to block based storage.

NAS = storage shows as a network drive ( CIFS / NFS )
SAN = storage shows as a local drive ( Fiber Channel / iSCSI )

most modern NAS can also act as SAN, and most modern SAN can also act as NAS so the line can blur.
10:25pm 17/02/12 Permalink
trillion
Brisbane, Queensland
2608 posts
Quade, start the reactor...
10:48pm 17/02/12 Permalink
Dazhel
Gold Coast, Queensland
4444 posts
whoa, 1.58 PB and growing at >3PB a year is a LOT of porn.

Hats off to you Red. I thought this database consolidation appliance was impressive enough!
192 CPUs with 2TB of RAM and 24TB of disk space

so how much is something like that?

& don't tell us in dollar terms, tell is in Ferrari 458 Italia terms.
11:19pm 17/02/12 Permalink
tspec
Melbourne, Victoria
3371 posts
most modern NAS can also act as SAN, and most modern SAN can also act as NAS so the line can blur.

We're in that boat with our Netapp, mainly using it for iSCSI atm but will most likely run up some NFS goodness to ditch the windows file server sitting within vSphere hosted our netapp, when we get around to it.
11:46pm 17/02/12 Permalink
trillion
Brisbane, Queensland
2609 posts
Step right up punters, this booky is now taking speculations on the data Red's uber racks carry...

Place your bets under the following scategories or add your own after ...

Blizz's World of Warcraft Australian transit uhm... lair. a dark cave of mmo'er guildies accounts and cloud/online/offsite/1mb db shardings

Telstra and MS's Office 365 online totally live.com.au hotmail killer. Webapp? meh.

shake and bake your own Opensource Linux flavour image hosting

Realplayer's buffering backhaul garbage collection. The crowd seems to have since moved to Youtube.

evidence of the intelligence of The borg hivemind's last known record of the coordinates for the backup plans for the Powercube. The one they all seem to be at various stages of battle/war over... :)

Porn. spindle after spindle of /.hidden/.secret/#encrypted/*.thefilth

An active sync clone of Internet Archive. Full feed.

Every usenet binary ever to have passed checkpoint.

SETI. all known unknowns and unknown unknowns. the meta is out there.




12:02am 18/02/12 Permalink
Skitza
Brisbane, Queensland
9718 posts
Don't be f***** stupid trillion.... It's filled with porn ffs.
12:06am 18/02/12 Permalink
trillion
Brisbane, Queensland
2610 posts
there's only one way to find out huh :/

Red what's your dc's edge address? ;D
12:34am 18/02/12 Permalink
stinky
USA
3689 posts

We're in that boat with our Netapp, mainly using it for iSCSI atm but will most likely run up some NFS goodness to ditch the windows file server sitting within vSphere hosted our netapp, when we get around to it.


NetApp is mostly NAS with some half assed SAN ... so would be a great idea to create a nfs/cifs volume on the netapp and share directly from there.

Better yet ewaste the whole thing like you would any other piece of tech that still runs with 90's tech and get yerself something more modern like Isilon or Dell's new Exanet based system for NAS or 3par / compellent for SAN.

11:50am 18/02/12 Permalink
Red
Sydney, New South Wales
942 posts
stinky, you forgot about CAS!

konstie/Dazhel, I don't know for sure but I'd say this cluster is worth about two 458 Italias.

So it's an Isilon cluster (as if 'ifs' didn't give that away ;)) This cluster currently has 20 nodes. 15x 108NL and 5x X200. The 108NL are 108TB (36x3TB) and the X200 are 36TB (12x3TB). The difference is the X200s have more CPU and RAM and are design for sequential IO. Also Herbal, you're quite right about the connectivity. Backend is via dual 4x QDR infiniband (so 2x 32Gbps) and each node has 2x1Gbps and 2x10Gbps ethernet front end. Each node is an 'access node' if you like so the throughput you can get through these things is pretty spesh. They have tested a 144 node cluster to 1.6million CIFS IOps and 85gigabytes/sec transfer rate.

And trillion, one of those options is getting close :D
08:26am 20/02/12 Permalink
HerbalLizard
Brisbane, Queensland
5381 posts
photos needs photos

I am going either image hosting or binaries

last edited by HerbalLizard at 18:31:53 20/Feb/12
06:30pm 20/02/12 Permalink
mooby
Brisbane, Queensland
6110 posts
photobox back in 2006 was buying half petabyte servers... they were up to 150+ when i left.
09:52pm 21/02/12 Permalink
Red
Sydney, New South Wales
944 posts
half petabyte servers with 750gb drives? that's hooooooge.
10:25pm 21/02/12 Permalink
stinky
USA
3691 posts
was briefly courted by an Isilon rep ... very impressive gear for clustered NAS . They seem to be very prevelent in the media business. Most movie houses I've seen use them, including some with direct fiber connectivity to workstations.

A bunch of dudes from isilon formed clusterix which is a clustered mysql clone which is supposed to do some very interesting things.

I remember the rep told us that we could buy a ferrari with the savings against netapp. I told him if he charged me full price and gave me a ferrari we'd talk. needless to say I never got that ferrari :)
10:26pm 21/02/12 Permalink
Romper
Melbourne, Victoria
9 posts
Thats some serious Space you have there......
01:46pm 29/02/12 Permalink
system
Internet
--
01:46pm 29/02/12 Permalink
AusGamers Forums
Show: per page
1
This thread is archived and cannot be replied to.