Tagged with raid - Personal View Talks

Need help: fast HHDs in Raid 0 - low throughput!

Psyco — Fri, 04 Sep 2020 08:01:59 +0000

After working on this problem for two weeks and getting nowhere... maybe someone here has a clue.

1) Setup:

Fast PC (Threadripper, 64GB RAM, system on M.2 SSD, Windows 10 64bit,...)
2x HGST He10 HDDs (10 TB, 7200rpm, 200+ MB/s sustained read/write speed!, SATA 6Gb/s)
Testfile: 50 GB folder with a CDNG image sequence from BMPCCK4k (each image is about 8 MB)

2) Pre-Test:

I tested both HDDs individually => sustained sequential read/write speeds close to 250 MB/s (empty disk) for the 50 GB folder

3) The goal:

I want to Raid 0 those two 10 TB drives to get higher sustained transfere speeds especially when the disks approche 50% capacity (I need arround 300 MB/s).

Videofiles (stored on another HDD) will be copied to the Raid for the time I work on them in Davinci Resolve, only to deliver the data to Resolve. Rendering results will be stored on a SSD (so there is no risk of loosing data even when the raid is totally destroyed). I need at least 10 TB of fast storage, as the RAW CDNG image sequences in 4k are quite large - and I don't have the money to do the same with SSDs.

4) The Problem:

When I convert the two drives in Windows 10 to one "striped-volume" I get a nice 20 TB software Raid 0, but when I test the transfere speed by simply copying the 50 GB folder I get 200 MB/s MAXIMUM transfere speed (thats even below a single drive!). The throughput starts at 400+ MB/s for the first 2-3 seconds filling up the disk caches and some system memory and then plummets to arround 100-200 MB/s, where it stays for the rest of the time.

5) I tried:

different stripe-sizes, an (old) hardware raid controller (even worse results, 150 MB/s max), checking for new system drivers (the Windows HDD disk drivers seem to be from 2006 and are only 32 bit!), checking HGST website for information and of course searching the internet for many many hours (either its a different problem or there is never a solution posted to the problem).

I can't try/use the onboard raid controller of the motherboard (because of Windows bullshit and I can't do a fresh system installation at the moment).

Why isn't it working?! (Setting up a Raid 0 is nothing extraordinary...so I thought.)

UPDATE: After some fiddling with Windows and a system reboot, read performance is high as it should be - only write performance is still bad.

My current workflow, lightly optimised to reduce RAID disk space

andyharris — Tue, 23 Sep 2014 02:40:13 +0000

Here's my current workflow, I believe its real weakness is knowing what files can be removed when a project ages out, or when more space is needed.

The other key issue is not copying the original footage to disk, since my SSDs are re-used on a regular basis. This makes grading a one shot process (well until the SSDs are needed again). Obviously money could improve this workflow, but then there would be no profit!

Thoughts welcomed:

The Raid 2: Berandal (BTS)

Manu4Vendetta — Tue, 22 Apr 2014 00:03:56 +0000

The first part (The Raid: Redemption) was a success acclaimed by critics and the public. A good thriller movie along with its low budget and as remembered; recorded with the Panasonic AG-AF100 and GH2 (presumably) as B-cam.

The second part was recorded with Red Epic, Red Scarlet and GoPro HD Hero 3. But interesting all the work that's involved in the actual realization.

Disk Warrior

andyharris — Sun, 22 Sep 2013 13:47:58 +0000

Yesterday morning I noticed that my Mac had mounted by 12TB Raid drive twice. At the time I merely thought 'That's odd' Yesterday evening my Mac didn't mount mount the 12TB Raid (its some 8GB) full.

Disk Utility would see the drive and the partition (greyed out). It couldn't verify or repair the partition. fsck was having none of it either. It took all night for the Raid device to verify itself, and it claimed all the bytes were in the correct place and there were no disk errors.

My strategy of having a Raid6 device with 6 drives (double stripe and parity) for security was looking rather weak.

After a bit of googling, foruming and $112 dollars I downloaded Disk Warrior. 10 minutes later and all is good.

Improving speed in Premiere Pro CS5

Brian_Siano — Tue, 29 Jan 2013 16:28:34 +0000

My system's a quad-core 3.2mhz machine, with an Nvidia Geforce 670 card (lots of CUDA) and more than enough memory. Sadly, though, the playback of my AVHCD files is frustrating; sometimes, even playing at quarter-resolution turns choppy. (That may be because the files are very long, and the compression algorithm requires a lot of back and forth.)

Anyway, I'm looking to get better performance without having up upgrade the system, and it appears that there may be 2 strategies. The first is to set up a RAID disk system for video editing. The second is to convert my video files to a less-compressed, more intraframe-like format, so playback may be faster, and edit that. So I have a few questions.

Let's say I want to take my hi-def AVHCD files, and render copies in another format that PP can play back faster. Is there a video format that'd work for this purpose?
How much can a decent RAID system speed up playback in Premiere Pro?
Which is preferred; SATA drives hooked to the motherboard, or USB 3.0 drives?

HDD multiple disk enclosures, USB 3.0 and RAID capable

Vitaliy_Kiselev — Fri, 08 Feb 2013 13:23:45 +0000

Vantec NST Quad

Available at:

Mediasonic Pro Box enclosures

4 disks, USB 2.0 - Mediasonic HF2-SU2S2

Available at:

$99 - http://www.amazon.com/Mediasonic-HF2-SU2S2-ProBox-Enclosure-Drives/dp/B002UUPWP6/ref=sr_1_5

4 disks, USB 3.0 - Mediasonic HF2-SU3S2

It has simple and RAID versions.

Available at:

8 disks, USB 3.0 -Mediasonic H82-SU3S2 ProBox

Available at:

$269 - http://www.amazon.com/Mediasonic-H82-SU3S2-ProBox-External-Enclosure/dp/B005GYDMYG

The Raid: Redemption ...Awesome Action Flick!!...AF100 A-Cam, GH2-B-cam!!

CRFilms — Sun, 29 Apr 2012 22:38:54 +0000

Haven't seen much on this, if you haven't seen it....WATCH IT. It's in limited release right now, but if it's playing within an hour of you, watch it asap. Since this was shot on the AF100 this gives you a good idea of what our GH1/2 can do with a million bucks and a bunch of trained Siliat fighters. :P

This BTS shows the AF100 in action with Fig Rig and I believe Nano flash recorder(read that somewhere, they don't say in BTS). Also note how they light. In some ways the lack of light hurt in a few sequences, noticeably the staircase ambush scene. Way dark and lots of noise. Other than that, I didn't see any jello or rolling shutter and that camera was whipping back and forth. I'm not a fan of "shaky cam", but this was used perfectly and the quick editing wasn't used to hide the fight choreography but to enhance the overall feel of the scenes.

Here's one of the scenes that the above BTS showed. Download the full 1080p to get the best view. Even if you watch every video on this channel, it won't spoil much. This movie is about an hour, 50 min and about 15min of that is talking and plot, lol, the rest is action. Great movie and the sequel is in the works.

EDIT: Forgot to put the trailer, lol: I actually prefer this to the redband trailer, but the redband is on the Vimeo page if you want to see it.