java 分块上传视频文件

Question

提问by kentcdodds

Yes, it's a long question with a lot of detail...So, my question is: How can I stream an upload to Vimeo in segments?

是的，这是一个很长的问题，有很多细节......所以，我的问题是：如何将上传的内容分段流式传输到 Vimeo？

For anyone wanting to copy and debug on their own machine:Here are the things you need:

对于想要在自己的机器上复制和调试的任何人：以下是您需要的东西：

My code here.
Include the Scribe library found here
Have a valid video file (mp4) which is at least greater than 10 MB and put it in the directory C:\test.mp4or change that code to point wherever yours is.
That's it! Thanks for helping me out!

我的代码在这里。
包括此处找到的 Scribe 库
拥有一个至少大于 10 MB 的有效视频文件 (mp4) 并将其放在目录中C:\test.mp4或更改该代码以指向您所在的任何位置。
而已！谢谢你的协助！

Big update:I've left a working API Key and Secret for Vimeo in the code here. So as long as you have a Vimeo account, all the code should work just fine for you once you've allowed the application and entered your token. Just copy the code from that link into a project on your favorite IDE and see if you can fix this with me. I'll give the bounty to whoever gives me the working code. Thanks! Oh, and don't expect to use this Key and Secret for long. Once this problem's resolved I'll delete it. :)

重大更新：我在此处的代码中为 Vimeo 留下了有效的 API 密钥和秘密。因此，只要您拥有 Vimeo 帐户，一旦您允许应用程序并输入您的令牌，所有代码都应该适合您。只需将该链接中的代码复制到您最喜欢的 IDE 上的项目中，看看您是否可以与我一起解决此问题。任何给我工作代码的人，我都会悬赏。谢谢！哦，不要指望长时间使用这个 Key 和 Secret。一旦这个问题解决了，我会删除它。:)

Overview of the problem:The problem is when I send the last chunk of bytes to Vimeo and then verify the upload, the response returns that the length of all the content is the length of only the last chunk, not all the chunks combined as it should be.

问题概述：问题是当我将最后一个字节块发送到Vimeo然后验证上传时，响应返回所有内容的长度仅为最后一个块的长度，而不是所有块的组合作为它应该。

SSCCE Note:I have my entire SSCCE here. I put it somewhere else so it can be Compilable. It is NOT very Short (about 300 lines), but hopefully you find it to be Self-contained, and it's certainly an Example!). I am, however, posting the relevant portions of my code in this post.

SSCCE 注意：我的整个 SSCCE在这里。我把它放在别的地方，因此它可以是Çompilable。是不是很š园艺（约300线），但希望你发现它是小号精灵包含的，它肯定是一个êxample！）。然而，我在这篇文章中发布了我的代码的相关部分。

This is how it works:When you upload a video to Vimeo via the streaming method (see Upload API documentation herefor setup to get to this point), you have to give a few headers: endpoint, content-length, and content-type. The documentation says it ignores any other headers. You also give it a payload of the byte information for the file you're uploading. And then sign and send it (I have a method which will do this using scribe).

这是它的工作原理：当您通过流式传输方法将视频上传到 Vimeo 时（请参阅此处的上传 API 文档以进行设置），您必须提供一些标头：端点、内容长度和内容类型. 文档说它忽略任何其他标题。您还可以为您上传的文件提供字节信息的有效负载。然后签名并发送它（我有一个方法可以使用scribe来做到这一点）。

My problem:Everything works great when I just send the video in one request. My problem is in cases when I'm uploading several bigger files, the computer I'm using doesn't have enough memory to load all of that byte information and put it in the HTTP PUT request, so I have to split it up into 1 MB segments. This is where things get tricky. The documentation mentions that it's possible to "resume" uploads, so I'm trying to do that with my code, but it's not working quite right. Below, you'll see the code for sending the video. Remembermy SSCCE is here.

我的问题：当我只在一个请求中发送视频时，一切都很好。我的问题是，当我上传几个更大的文件时，我使用的计算机没有足够的内存来加载所有这些字节信息并将其放入 HTTP PUT 请求中，因此我必须将其拆分为1 MB 段。这就是事情变得棘手的地方。文档提到可以“恢复”上传，所以我试图用我的代码来做到这一点，但它工作得不太正确。下面，您将看到发送视频的代码。记住我的 SSCCE 在这里。

Things I've tried:I'm thinking it has something to do with the Content-Range header... So here are the things I've tried in changing what the Content-Range header says...

我尝试过的事情：我认为它与 Content-Range 标头有关......所以这里是我尝试改变 Content-Range 标头所说的内容......

Not adding content range header to the first chunk
Adding a prefix to the content range header (each with a combination of the previous header):
- "bytes"
- "bytes " (throws connection error, see the very bottom for the error) --> It appears in the documentationthat this is what they're looking for, but I'm pretty sure there are typos in the documentation because they have the content-range header on their "resume" example as: 1001-339108/339108when it should be 1001-339107/339108. So... Yeah...
- "bytes%20"
- "bytes:"
- "bytes: "
- "bytes="
- "bytes= "
Not adding anything as a prefix to the content range header

不将内容范围标头添加到第一个块
向内容范围标头添加前缀（每个都包含前一个标头的组合）：
- “字节”
- “bytes”（抛出连接错误，请参阅错误的最底部）--> 在文档中似乎这是他们正在寻找的内容，但我很确定文档中有错别字，因为他们有其“简历”示例中的内容范围标题为：1001-339108/339108何时应该是1001-339107/339108. 嗯是的...
- “字节%20”
- “字节：”
- “字节：”
- “字节=”
- “字节=”
不添加任何内容作为内容范围标题的前缀

Here's the code:

这是代码：

/**
* Send the video data
*
* @return whether the video successfully sent
*/
private static boolean sendVideo(String endpoint, File file) throws FileNotFoundException, IOException {
  // Setup File
  long contentLength = file.length();
  String contentLengthString = Long.toString(contentLength);
  FileInputStream is = new FileInputStream(file);
  int bufferSize = 10485760; // 10 MB = 10485760 bytes
  byte[] bytesPortion = new byte[bufferSize];
  int byteNumber = 0;
  int maxAttempts = 1;
  while (is.read(bytesPortion, 0, bufferSize) != -1) {
    String contentRange = Integer.toString(byteNumber);
    long bytesLeft = contentLength - byteNumber;
    System.out.println(newline + newline + "Bytes Left: " + bytesLeft);
    if (bytesLeft < bufferSize) {
      //copy the bytesPortion array into a smaller array containing only the remaining bytes
      bytesPortion = Arrays.copyOf(bytesPortion, (int) bytesLeft);
      //This just makes it so it doesn't throw an IndexOutOfBounds exception on the next while iteration. It shouldn't get past another iteration
      bufferSize = (int) bytesLeft;
    }
    byteNumber += bytesPortion.length;
    contentRange += "-" + (byteNumber - 1) + "/" + contentLengthString;
    int attempts = 0;
    boolean success = false;
    while (attempts < maxAttempts && !success) {
      int bytesOnServer = sendVideoBytes("Test video", endpoint, contentLengthString, "video/mp4", contentRange, bytesPortion, first);
      if (bytesOnServer == byteNumber) {
        success = true;
      } else {
        System.out.println(bytesOnServer + " != " + byteNumber);
        System.out.println("Success is not true!");
      }
      attempts++;
    }
    first = true;
    if (!success) {
      return false;
    }
  }
  return true;
}

/**
* Sends the given bytes to the given endpoint
*
* @return the last byte on the server (from verifyUpload(endpoint))
*/
private static int sendVideoBytes(String videoTitle, String endpoint, String contentLength, String fileType, String contentRange, byte[] fileBytes, boolean addContentRange) throws FileNotFoundException, IOException {
  OAuthRequest request = new OAuthRequest(Verb.PUT, endpoint);
  request.addHeader("Content-Length", contentLength);
  request.addHeader("Content-Type", fileType);
  if (addContentRange) {
    request.addHeader("Content-Range", contentRangeHeaderPrefix + contentRange);
  }
  request.addPayload(fileBytes);
  Response response = signAndSendToVimeo(request, "sendVideo on " + videoTitle, false);
  if (response.getCode() != 200 && !response.isSuccessful()) {
    return -1;
  }
  return verifyUpload(endpoint);
}

/**
* Verifies the upload and returns whether it's successful
*
* @param endpoint to verify upload to
* @return the last byte on the server
*/
public static int verifyUpload(String endpoint) {
  // Verify the upload
  OAuthRequest request = new OAuthRequest(Verb.PUT, endpoint);
  request.addHeader("Content-Length", "0");
  request.addHeader("Content-Range", "bytes */*");
  Response response = signAndSendToVimeo(request, "verifyUpload to " + endpoint, true);
  if (response.getCode() != 308 || !response.isSuccessful()) {
    return -1;
  }
  String range = response.getHeader("Range");
  //range = "bytes=0-10485759"
  return Integer.parseInt(range.substring(range.lastIndexOf("-") + 1)) + 1;
  //The + 1 at the end is because Vimeo gives you 0-whatever byte where 0 = the first byte
}

Here's the signAndSendToVimeo method:

这是 signAndSendToVimeo 方法：

/**
* Signs the request and sends it. Returns the response.
*
* @param service
* @param accessToken
* @param request
* @return response
*/
public static Response signAndSendToVimeo(OAuthRequest request, String description, boolean printBody) throws org.scribe.exceptions.OAuthException {
  System.out.println(newline + newline
          + "Signing " + description + " request:"
          + ((printBody && !request.getBodyContents().isEmpty()) ? newline + "\tBody Contents:" + request.getBodyContents() : "")
          + ((!request.getHeaders().isEmpty()) ? newline + "\tHeaders: " + request.getHeaders() : ""));
  service.signRequest(accessToken, request);
  printRequest(request, description);
  Response response = request.send();
  printResponse(response, description, printBody);
  return response;
}

And here's some(an example... All of the output can be found here) of the output from the printRequest and printResponse methods: NOTEThis output changes depending on what the contentRangeHeaderPrefixis set to and the firstboolean is set to (which specifies whether or not to include the Content-Range header on the first chunk).

这里有一些（一个例子......所有的输出都可以在这里找到）来自 printRequest 和 printResponse 方法的输出：注意此输出根据contentRangeHeaderPrefix设置的内容和first布尔值的设置而变化（指定是否或不要在第一个块上包含 Content-Range 标头）。

We're sending the video for upload!


Bytes Left: 15125120


Signing sendVideo on Test video request:
    Headers: {Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes%200-10485759/15125120}

sendVideo on Test video >>> Request
Headers: {Authorization=OAuth oauth_signature="zUdkaaoJyvz%2Bt6zoMvAFvX0DRkc%3D", oauth_version="1.0", oauth_nonce="340477132", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336004", Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes: 0-10485759/15125120}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

sendVideo on Test video >>> Response
Code: 200
Headers: {null=HTTP/1.1 200 OK, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}


Signing verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d request:
    Headers: {Content-Length=0, Content-Range=bytes */*}

verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Request
Headers: {Authorization=OAuth oauth_signature="FQg8HJe84nrUTdyvMJGM37dpNpI%3D", oauth_version="1.0", oauth_nonce="298157825", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336015", Content-Length=0, Content-Range=bytes */*}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Response
Code: 308
Headers: {null=HTTP/1.1 308 Resume Incomplete, Range=bytes=0-10485759, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}
Body: 


Bytes Left: 4639360


Signing sendVideo on Test video request:
    Headers: {Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes: 10485760-15125119/15125120}

sendVideo on Test video >>> Request
Headers: {Authorization=OAuth oauth_signature="qspQBu42HVhQ7sDpzKGeu3%2Bn8tM%3D", oauth_version="1.0", oauth_nonce="183131870", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336015", Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes%2010485760-15125119/15125120}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

sendVideo on Test video >>> Response
Code: 200
Headers: {null=HTTP/1.1 200 OK, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}


Signing verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d request:
    Headers: {Content-Length=0, Content-Range=bytes */*}

verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Request
Headers: {Authorization=OAuth oauth_signature="IdhhhBryzCa5eYqSPKAQfnVFpIg%3D", oauth_version="1.0", oauth_nonce="442087608", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336020", Content-Length=0, Content-Range=bytes */*}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

4639359 != 15125120
verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Response
Success is not true!
Code: 308
Headers: {null=HTTP/1.1 308 Resume Incomplete, Range=bytes=0-4639359, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}
Body:

Then the code goes on to complete the upload and set video information (you can see that in my full code).

然后代码继续完成上传和设置视频信息（你可以在我的完整代码中看到）。

Edit 2:Tried removing the "%20" from the content-range and received this error making connection. I must use either "bytes%20" or not add "bytes" at all...

编辑 2：尝试从内容范围中删除“%20”并收到此连接错误。我必须使用“bytes%20”或根本不添加“bytes”...

Exception in thread "main" org.scribe.exceptions.OAuthException: Problems while creating connection.
    at org.scribe.model.Request.send(Request.java:70)
    at org.scribe.model.OAuthRequest.send(OAuthRequest.java:12)
    at autouploadermodel.VimeoTest.signAndSendToVimeo(VimeoTest.java:282)
    at autouploadermodel.VimeoTest.sendVideoBytes(VimeoTest.java:130)
    at autouploadermodel.VimeoTest.sendVideo(VimeoTest.java:105)
    at autouploadermodel.VimeoTest.main(VimeoTest.java:62)
Caused by: java.io.IOException: Error writing to server
    at sun.net.www.protocol.http.HttpURLConnection.writeRequests(HttpURLConnection.java:622)
    at sun.net.www.protocol.http.HttpURLConnection.writeRequests(HttpURLConnection.java:634)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1317)
    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
    at org.scribe.model.Response.<init>(Response.java:28)
    at org.scribe.model.Request.doSend(Request.java:110)
    at org.scribe.model.Request.send(Request.java:62)
    ... 5 more
Java Result: 1

Edit 1:Updated the code and output. Still need help!

编辑 1：更新了代码和输出。还是需要帮助！

Answer 1

采纳答案by Torious

I think your problem could simply be the result of this line:

我认为您的问题可能只是这一行的结果：

request.addHeader("Content-Range", "bytes%20" + contentRange);

Try and replace "bytes%20"by simply "bytes "

尝试并"bytes%20"简单地替换"bytes "

In your output you see the corresponding header has incorrect content:

在您的输出中，您会看到相应的标题内容不正确：

Headers: {
    Content-Length=15125120,
    Content-Type=video/mp4,
    Content-Range=bytes%200-10485759/15125120     <-- INCORRECT
}

On the topic of Content-Range...

关于Content-Range...的话题

You're right that an example final block of content should have a range like 14680064-15125119/15125120. That's part of the HTTP 1.1 spec.

你是对的，一个示例最终内容块应该有一个像14680064-15125119/15125120. 这是 HTTP 1.1 规范的一部分。

Answer 2

回答by dash1e

Here

这里

 String contentRange = Integer.toString(byteNumber + 1);

you start from 1 and not from 0 at the first iteration.

您在第一次迭代时从 1 开始，而不是从 0 开始。

Here

这里

 request.addHeader("Content-Length", contentLength);

you put the entire file content length and not the length of the current chunk.

你把整个文件内容的长度而不是当前块的长度。

Answer 3

回答by JMD

The vimeo API page says: "The final step is to call vimeo.videos.upload.complete to queue up the video for transcoding. This call will return the video_id, which you can then use in other calls (to set the title, description, privacy, etc.). If you do not call this method, the video will not be processed."

vimeo API 页面说：“最后一步是调用 vimeo.videos.upload.complete 将视频排队进行转码。此调用将返回 video_id，然后您可以在其他调用中使用它（设置标题、描述、隐私等）。如果不调用该方法，视频将不会被处理。”

I added this bit of code to the end and got it to work:

我在最后添加了这段代码并让它工作：

    request = new OAuthRequest(Verb.PUT, "http://vimeo.com/api/rest/v2");
    request.addQuerystringParameter("method", "vimeo.videos.upload.complete");
    request.addQuerystringParameter("filename", video.getName());
    request.addQuerystringParameter("ticket_id", ticket);
    service.signRequest(token, request);        

    response = request.send();

Answer 4

回答by Rajat Verma

Check this :

检查这个：

String contentRange="bytes "+lastBytesSend+"-"+ ((totalSize - lastBytesSend)-1)+"/"+totalSize ;

request.addHeader("Content-Range",contentRange);

java 分块上传视频文件

提问by kentcdodds

采纳答案by Torious

回答by dash1e

回答by JMD

回答by Rajat Verma

相关推荐

最近更新

标签

java 分块上传视频文件

提问by kentcdodds

采纳答案by Torious

回答by dash1e

回答by JMD

回答by Rajat Verma

相关推荐

java 不能从静态上下文中引用非静态方法

java 使用 spring 3 注释发送成功或错误消息以查看

java 将 Jersey 项目（Rest web 服务）运行到 tomcat

java 使用 Collections.sort 对自定义类数组列表字符串进行排序

相关推荐

最近更新

标签