Yesterday was a normalish day, oceans of data swilling around the digipres network, some servers working, some busted, some scripts working, some silently failing, some loudly failing. It’s ok, we have smart and caring human stewards to take care of this.
-
-
Prikaži ovu nit
-
Anyway, we use
#RAWCooked to convert our#DPX to#FFV1#Matroska, and we use@FFmpeg to do the same for videotape digitisation, V210 MOVs to FFV1_MKVs..Prikaži ovu nit -
Yesterday we ingested 189 MKVs at 3.9 TB from DPX. That would have been 7.8 TB of DPX in TAR. And we ingested 110 MKV / 2.4 TB from videotape source. That would’ve been 4.8 TB of MOV. So in total 6.3 TB of Matroska ingested yesterday, would’ve been 12.6 TB... Here’s a dataviz...
Prikaži ovu nit -
-
So 6.3 TB data size reduction. But of course we store two instances, in two data tape libraries, so it’s really 12.6 TB storage cost saving. LTO6 yields 2.8 TB usable capacity, so in one day, using
#FOSS, we saved 4 LTO data tapes. If we repeat each day, one month = 120 tapes.
Prikaži ovu nit -
And this all runs through a pipeline connecting infrastructure components from
@axiellalm@Imagen_io@spectralogic - with LTO DPX help from@OvationDataPrikaži ovu nit -
All with REST APIs to push and pull data and send jobs from
#Python scripts all day#NoSystemWithoutAPIPleasePrikaži ovu nit
Kraj razgovora
Novi razgovor -
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.