Tagged with data - Personal View Talks http://personal-view.com/talks/discussions/tagged/data/feed.rss Sat, 02 Nov 24 17:27:41 +0000 Tagged with data - Personal View Talks en-CA Graphical representation of data - asking for advice http://personal-view.com/talks/discussion/22324/graphical-representation-of-data-asking-for-advice Thu, 25 Jul 2019 13:23:10 +0000 RoadsidePicnic 22324@/talks/discussions I'm making a video with the objective to present some regional and macro-economic data info. I'm collecting references of video graphical representation of data, charts, etc. Looking for some input from you people here about what can be a good way or some place were you have seen it done good in any way.

P.S. I'm really focusing on the graphical representation thing alone, apart from the narrative or the facts illustration in broadcast news thing, but discussion of it would also be welcome.

Thanks!!

]]>
Audition Raw data import - randomly saturating chunks of audio? http://personal-view.com/talks/discussion/17944/audition-raw-data-import-randomly-saturating-chunks-of-audio Mon, 09 Oct 2017 16:25:04 +0000 juanpablo_ayala 17944@/talks/discussions Hello, guys. So, the dreadful 0 bytes file thing happened to me. My Tascam lost power during the recording. I left the SD card untouched and made an image copy of the drive so I could import it in Audition (and Audacity) as raw data in order to find the corrupted take.

My input settings were 48khz, 24 bit PCM, Stereo (just as recorded) and Little Endian. I have tried values 0, 1 and 2 (even 3) in the "start byte offset" space.

What I get is an almost 4-hour long audio file with 85% ultra-saturated sound at 0db (or almost) and the other 15% are chunks of good audio with normal levels. Where levels are just a little below 0db I can tell those are takes that I recorded just fine--Apart from this one take I'm trying to recover, I can play all other takes on my computer as wav files and they all have normal levels.

When I change the value to 0, 1 or 2 the chunks that sound good are all different, but still, together they comprise about 15% of the entire file. When I changed the value to 3 I got a split second file.

Anyone know a solution? Thanks in advance.

PS: I have also tried the chkdsk solution to recover the 0 bytes file, but the .chk files are not showing up on my drive event though the "show hidden files" option is checked.

]]>
Movie Barcode - an interesting big data view http://personal-view.com/talks/discussion/16461/movie-barcode-an-interesting-big-data-view Fri, 17 Feb 2017 06:58:47 +0000 andyharris 16461@/talks/discussions Here's a site that reduces a movie to a 2D coloured Barcode:

http://moviebarcode.tumblr.com/

Here's a short video that shows some interesting views of this data:

]]>
GH3 Data rate and colour management compression http://personal-view.com/talks/discussion/9174/gh3-data-rate-and-colour-management-compression Mon, 23 Dec 2013 06:05:35 +0000 Wotsisname 9174@/talks/discussions Hi all,

I am confused about the 50mbps / 72mbps date rate that the GH3 supposedly records at.

My footage, recorded as H264 MOV files in either of these high bit rates, is listed in FCP as between 5.8mbps and 8.5mbps. Analysing the footage with cinema tools reveals the same data rate - not the 50 / 72 it should be.

If I convert the files to ProRes I get the higher data rates - around 30 - 60mbps. Although this is closer, and sometimes in excess of the data rate I want, am I not merely up-resing the footage? The new date rate might be higher, but if it is not what the camera recorded, the information isn't t there.

I am also confused about the colour management. My h264 footage has a colour profile of 1-1-1. Is that the best I can get? I read somewhere that the GH3 will record 2-4-1. How do I set that?

Again up-resing to prores 422 or 444 will not introduce colours that are not recorded in the first place!

I look forward to hearing people's thoughts.

Jules

]]>
Retrieving Data from SD Card with bad sectors http://personal-view.com/talks/discussion/8838/retrieving-data-from-sd-card-with-bad-sectors Wed, 20 Nov 2013 19:47:29 +0000 JuMo 8838@/talks/discussions Hey everyone, today I had a monumental technical hiccup. I searched the forums here for similar stories, but mine seems to be a bit unique, so I thought I'd share it.

I spent about 4 hours this morning doing some foley and voice over work on location, I tested the audio after each take and it all played back just fine and sounded great (trusty H4n). When I got back to the editing suite and popped the card in, it took about 30 seconds for the card to pop up, which was my first red flag. Then I opened it up and it looked empty at first, then I literally watched the H4n file structure slowly appear before my eyes one folder at a time, second red flag. I attempted to copy the data over to my worktable drive and it started the visual indicators of a transfer process but never began the actual transfer. A left the work station alone for about 45 minutes and came back to a spinning wheel of death and discovered that finder had crashed without transferring a single bit or byte of the data. I tried to relaunch the crashed finder but it didn't reopen, I was left staring at my desktop backgrounds and nothing more and had to manually reboot the machine. This is where it got really fun. Now the machine would not boot up with the SD card inserted, it would just hang on the boot screen. I tried a few times, then powered down and removed the SD card and the machine started up fine. Then I put the SD card back in and the drive pops up, but as soon as I go to open it, finder crashes again. I can't even get far enough to see inside the folder anymore. Ok, so it's clearly a corrupt SD card and I'm ready to introduce it to it's new home: the garbage can, but first I need to attempt to retrieve any data I can to save me from asking my client to take another 4 hours to re-record all the audio (which, as you all probably know, is never as good the second time around). Not the end of the world if it comes to that, but I'd really rather not have to go that route, if it is at all possible to avoid. I tried the same card in a different card reader on a different work station and got basically the same results - unable to access the drive or data. So I started some research into data recovery software options and decided to give Stellar Pheonix Mac Data Recovery a try. Even the software couldn't see the drive in it's more common data backup and retrieval services, but I discovered could see a 'Generic 16GB SD' drive under the 'Image Creation' option, which it states is for exceptionally problematic corruptions. Basically it aims to create a mountable .DMG image containing every sector on the drive (including ones not in use). So I went for it. The software begins the sector processing on block 0, where it sits for about an hour. I was just about to give up and shut it down when all of a sudden it progresses, identifying block 0 as being fine, but block 1 as a bad block and continuing on, the next 30 blocks (700000 sectors) go by like a breeze, all fine, but then it gets stuck again around block 30. I'm going to leave it over night and sleep with my fingers crossed, but if anyone else has any insight or experience with a similar issue, please share your experience. I will update this thread tomorrow with results of the attempted data recovery, good or bad.

]]>
How to upload my camera shoots successfully without formatting? http://personal-view.com/talks/discussion/8186/how-to-upload-my-camera-shoots-successfully-without-formatting- Sat, 21 Sep 2013 21:30:17 +0000 Cory46463 8186@/talks/discussions Hi guys, Recently, I did some shoots with my Canon camera. However, as I attempted to upload all these shoots to my computer, I was always warned and asked to format it at first. I have used this camera many times and never encountered these similar problems before. Do you know what is going on there? Do you know how to upload my shoots successfully? Should I have to format this camera at first? Help me, please!

]]>
What is a Career in Big Data? http://personal-view.com/talks/discussion/7841/what-is-a-career-in-big-data Tue, 20 Aug 2013 20:23:38 +0000 stoney 7841@/talks/discussions Big Data is growing fast like weeds. So what it would take to become a data scientist?

  • math
  • engineering
  • writing
  • skepticism
  • curiosity

]]>
Where does the 'extra' data come from when transcoding? http://personal-view.com/talks/discussion/7827/where-does-the-extra-data-come-from-when-transcoding Mon, 19 Aug 2013 14:06:56 +0000 zm15 7827@/talks/discussions I wasn't sure what category this fit in exactly....

This is something I've never quite understood, but have always wondered. Forgive my basic knowledge here, but I've tried to research this without a specific answer as to what is going on.

When I convert from an .MTS file to ProRes422 HQ, the file get's huge. Why is that? Where is that extra data coming from if it's not there to begin with? i.e. higher bitrate. I understand the codec has a standard bitrate it will always maintain, but why do it if the original file bitrate is so much lower?

For example, a stock GH2 mts for me streams at about 22 Mbits/s, I convert it to ProRes422 HQ, that same file is now playing at 216 Mbits/s. - With no discernible image quality difference.

What is going on in the codec that makes the file so huge? Other than workflow issues, why would you want to transcode from MTS? Does converting it to ProRes (or another codec) 'Unpack' the data in a more efficient way?

Why not use something like ProRes422 LT if you're starting from a much lower data rate like a native MTS file provides?

]]>
Is there any 'EXIF' style data available in GH2 videos? http://personal-view.com/talks/discussion/814/is-there-any-exif-style-data-available-in-gh2-videos Tue, 30 Aug 2011 13:59:22 +0000 jimtreats 814@/talks/discussions
Cheers

Jim]]>
Hack Terms FAQ added to the Faqs section http://personal-view.com/talks/discussion/5893/hack-terms-faq-added-to-the-faqs-section Thu, 24 Jan 2013 13:28:15 +0000 Brian_Siano 5893@/talks/discussions Some of us have written an FAQ to explain, in general terms, what Vitaly's Hack actually does for the GH2. It's a basic summary of how the GH2 compresses its data, and why and how this impacts image quality.

This is the FAQ to read if you're trying to read the forums, and finding a lot of technical stuff and acronyms that are going right over your head. It won't make you design hacks as good as Driftwood's or Sanity or Cake, and it won't tell you which hack is the best one to use. But if you read it, you will understand what I-frames and P-frames are, what GOP is, what intraframing and interframing are, and a few other details that'll help you follow some of the discussions here.

http://www.personal-view.com/faqs/gh2-hack/hack-terms-faq

]]>
Recover files from card with error http://personal-view.com/talks/discussion/3537/recover-files-from-card-with-error Sun, 10 Jun 2012 22:15:49 +0000 charlie_orozco 3537@/talks/discussions Hi. I come to you to ask for help, because I feel very frustrated. I have two Sandisk Extreme 32GB 45MBps SDHC cards, and today I was trying to copy the video files of a shoot I had yesterday, and the card started disconnecting quite often (it was plugged into an external card reader). With various retryings I was able to copy only 6 out of 25 (11GB in total) before the card threw me an error message saying that the card needed formatting. I then got tired and decided to copy the files using the camera, but when I turned it on it told me that the camera needed formatting as well. This never happened to me. I became a little desperate and downloaded the program that the card comes from (it's a one year license code that allows you to download and use RescuePRO Deluxe). I used the program and it recoverd 15,000 M2TS video files, all of them a single frame for only the first two videos (or so it seemed) that weighed almost 30GB. I then formatted the card using the camera and tried again. I formatted many times (it's been 4 or 5 hours now) and the best I could get were the full first two videos, almost by chance, and the ones that matter are the 3 last ones... Now the program shows an error saying that it couldn't recover any files because maybe the formatting added 0 (zeros) instead of the old data, and so it may be lost. But when I try again it recovers more files. Although now they can't be read. Is it getting worse eveytime? Is there no way to recover the files? Can you recommend another program that could work for me? I need this data by the end of the week when the job is due, and I feel desperate. It's kind of a documentary, so I can't shoot this footage for a second time... If you can help me I'll be truly thankful. Best regards.

]]>