From: "René Scharfe" <rene.scharfe@lsrfire.ath.cx>
To: "Nguyễn Thái Ngọc Duy" <pclouds@gmail.com>
Cc: git@vger.kernel.org, Junio C Hamano <gitster@pobox.com>
Subject: Re: [PATCH 4/5] archive-tar: stream large blobs to tar file
Date: Mon, 30 Apr 2012 23:08:09 +0200 [thread overview]
Message-ID: <4F9EFF39.4010804@lsrfire.ath.cx> (raw)
In-Reply-To: <1335761837-12482-5-git-send-email-pclouds@gmail.com>
Am 30.04.2012 06:57, schrieb Nguyễn Thái Ngọc Duy:
>
> Signed-off-by: Nguyễn Thái Ngọc Duy<pclouds@gmail.com>
> ---
> archive-tar.c | 38 +++++++++++++++++++++++++++++++++++---
> t/t1050-large.sh | 4 ++++
> 2 files changed, 39 insertions(+), 3 deletions(-)
>
> diff --git a/archive-tar.c b/archive-tar.c
> index 61821f4..865ef6d 100644
> --- a/archive-tar.c
> +++ b/archive-tar.c
> @@ -4,6 +4,7 @@
> #include "cache.h"
> #include "tar.h"
> #include "archive.h"
> +#include "streaming.h"
> #include "run-command.h"
>
> #define RECORDSIZE (512)
> @@ -62,6 +63,29 @@ static void write_blocked(const void *data, unsigned long size)
> write_if_needed();
> }
>
> +static int stream_blob_to_file(const unsigned char *sha1)
> +{
> + struct git_istream *st;
> + enum object_type type;
> + unsigned long sz;
> +
> + st = open_istream(sha1,&type,&sz, NULL);
> + if (!st)
> + return error("cannot stream blob %s", sha1_to_hex(sha1));
> + for (;;) {
> + char buf[BLOCKSIZE];
> + ssize_t readlen;
> +
> + readlen = read_istream(st, buf, sizeof(buf));
> +
> + if (readlen <= 0)
> + return readlen;
> + write_blocked(buf, readlen);
> + }
> + close_istream(st);
> + return 0;
> +}
The stream is never closed. Perhaps squash this in?
diff --git a/archive-tar.c b/archive-tar.c
index 506c8cb..6109fd3 100644
--- a/archive-tar.c
+++ b/archive-tar.c
@@ -66,6 +66,7 @@ static void write_blocked(const void *data, unsigned long size)
static int stream_blob_to_file(const unsigned char *sha1)
{
struct git_istream *st;
+ ssize_t readlen;
enum object_type type;
unsigned long sz;
@@ -74,16 +75,15 @@ static int stream_blob_to_file(const unsigned char *sha1)
return error("cannot stream blob %s", sha1_to_hex(sha1));
for (;;) {
char buf[BLOCKSIZE];
- ssize_t readlen;
readlen = read_istream(st, buf, sizeof(buf));
if (readlen <= 0)
- return readlen;
+ break;
write_blocked(buf, readlen);
}
close_istream(st);
- return 0;
+ return readlen;
}
/*
next prev parent reply other threads:[~2012-04-30 21:08 UTC|newest]
Thread overview: 23+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-04-30 4:57 [PATCH 0/5] Large file support for git-archive Nguyễn Thái Ngọc Duy
2012-04-30 4:57 ` [PATCH 1/5] archive-tar: turn write_tar_entry into blob-writing only Nguyễn Thái Ngọc Duy
2012-04-30 18:15 ` Junio C Hamano
2012-04-30 22:11 ` René Scharfe
2012-04-30 4:57 ` [PATCH 2/5] archive-tar: unindent write_tar_entry by one level Nguyễn Thái Ngọc Duy
2012-04-30 4:57 ` [PATCH 3/5] archive: delegate blob reading to backend Nguyễn Thái Ngọc Duy
2012-04-30 21:07 ` René Scharfe
2012-04-30 4:57 ` [PATCH 4/5] archive-tar: stream large blobs to tar file Nguyễn Thái Ngọc Duy
2012-04-30 19:01 ` Junio C Hamano
2012-04-30 21:08 ` René Scharfe [this message]
2012-04-30 21:36 ` Junio C Hamano
2012-04-30 22:12 ` René Scharfe
2012-04-30 4:57 ` [PATCH 5/5] archive-zip: stream large blobs into zip file Nguyễn Thái Ngọc Duy
2012-04-30 19:12 ` Junio C Hamano
2012-04-30 22:54 ` René Scharfe
2012-04-30 22:11 ` [PATCH 5a/5] streaming: void pointer instead of char pointer René Scharfe
2012-04-30 22:12 ` [PATCH 6a/5] archive-zip: remove uncompressed_size René Scharfe
2012-04-30 22:12 ` [PATCH 7a/5] archive-zip: factor out helpers for writing sizes and CRC René Scharfe
2012-04-30 22:12 ` [PATCH 8a/5] archive-zip: streaming for stored files René Scharfe
2012-04-30 22:12 ` [PATCH 9a/5] archive-zip: streaming for deflated files René Scharfe
2012-04-30 19:15 ` [PATCH 0/5] Large file support for git-archive Junio C Hamano
2012-04-30 21:07 ` René Scharfe
2012-05-01 10:19 ` Nguyen Thai Ngoc Duy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4F9EFF39.4010804@lsrfire.ath.cx \
--to=rene.scharfe@lsrfire.ath.cx \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
--cc=pclouds@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).