Handle data while filming with rPI












1














We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.



I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).



When I insert the SSD, the hole SSD should be copied to a 4TB HDD.



So I have 4 questions:




  1. Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source


  2. What's the average file transfer speed of the rPi from USB to USB?


  3. Is there a software which allready can do this (Preferable with a data validation)


  4. Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.











share|improve this question






















  • You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
    – goldilocks
    yesterday










  • The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
    – szulat
    8 hours ago










  • @szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
    – Timothy Lukas H.
    8 hours ago
















1














We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.



I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).



When I insert the SSD, the hole SSD should be copied to a 4TB HDD.



So I have 4 questions:




  1. Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source


  2. What's the average file transfer speed of the rPi from USB to USB?


  3. Is there a software which allready can do this (Preferable with a data validation)


  4. Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.











share|improve this question






















  • You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
    – goldilocks
    yesterday










  • The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
    – szulat
    8 hours ago










  • @szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
    – Timothy Lukas H.
    8 hours ago














1












1








1







We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.



I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).



When I insert the SSD, the hole SSD should be copied to a 4TB HDD.



So I have 4 questions:




  1. Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source


  2. What's the average file transfer speed of the rPi from USB to USB?


  3. Is there a software which allready can do this (Preferable with a data validation)


  4. Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.











share|improve this question













We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.



I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).



When I insert the SSD, the hole SSD should be copied to a 4TB HDD.



So I have 4 questions:




  1. Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source


  2. What's the average file transfer speed of the rPi from USB to USB?


  3. Is there a software which allready can do this (Preferable with a data validation)


  4. Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.








pi-3b+ data-transfer






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked yesterday









Timothy Lukas H.Timothy Lukas H.

114




114












  • You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
    – goldilocks
    yesterday










  • The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
    – szulat
    8 hours ago










  • @szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
    – Timothy Lukas H.
    8 hours ago


















  • You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
    – goldilocks
    yesterday










  • The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
    – szulat
    8 hours ago










  • @szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
    – Timothy Lukas H.
    8 hours ago
















You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks
yesterday




You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks
yesterday












The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
8 hours ago




The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
8 hours ago












@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
8 hours ago




@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
8 hours ago










1 Answer
1






active

oldest

votes


















3














The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).



I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).





(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.



(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)






share|improve this answer























  • Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
    – Timothy Lukas H.
    yesterday











Your Answer






StackExchange.ifUsing("editor", function () {
return StackExchange.using("schematics", function () {
StackExchange.schematics.init();
});
}, "cicuitlab");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "447"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fraspberrypi.stackexchange.com%2fquestions%2f92721%2fhandle-data-while-filming-with-rpi%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









3














The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).



I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).





(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.



(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)






share|improve this answer























  • Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
    – Timothy Lukas H.
    yesterday
















3














The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).



I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).





(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.



(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)






share|improve this answer























  • Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
    – Timothy Lukas H.
    yesterday














3












3








3






The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).



I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).





(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.



(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)






share|improve this answer














The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).



I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).





(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.



(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)







share|improve this answer














share|improve this answer



share|improve this answer








edited yesterday

























answered yesterday









GhanimaGhanima

12.1k93978




12.1k93978












  • Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
    – Timothy Lukas H.
    yesterday


















  • Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
    – Timothy Lukas H.
    yesterday
















Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
yesterday




Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
yesterday


















draft saved

draft discarded




















































Thanks for contributing an answer to Raspberry Pi Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fraspberrypi.stackexchange.com%2fquestions%2f92721%2fhandle-data-while-filming-with-rpi%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

1300-talet

1300-talet

Display a custom attribute below product name in the front-end Magento 1.9.3.8