* 5GB object limit in the RADOS Gateway
@ 2013-05-30 17:42 Wido den Hollander
2013-05-30 17:47 ` Gregory Farnum
0 siblings, 1 reply; 3+ messages in thread
From: Wido den Hollander @ 2013-05-30 17:42 UTC (permalink / raw)
To: ceph-devel@vger.kernel.org
Hi,
I was checking the source code today and found this macro:
#define RGW_MAX_PUT_SIZE (5ULL*1024*1024*1024)
Why is that limit in place? Was that to mimic Amazon S3? (Which is at 5T
now).
I know that object size limit something that should be there, but just
trying to find the reasoning behind this limit.
Couldn't we make this configurable at least?
--
Wido den Hollander
42on B.V.
Phone: +31 (0)20 700 9902
Skype: contact42on
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: 5GB object limit in the RADOS Gateway
2013-05-30 17:42 5GB object limit in the RADOS Gateway Wido den Hollander
@ 2013-05-30 17:47 ` Gregory Farnum
2013-05-30 17:50 ` Wido den Hollander
0 siblings, 1 reply; 3+ messages in thread
From: Gregory Farnum @ 2013-05-30 17:47 UTC (permalink / raw)
To: Wido den Hollander; +Cc: ceph-devel@vger.kernel.org
On Thu, May 30, 2013 at 10:42 AM, Wido den Hollander <wido@42on.com> wrote:
> Hi,
>
> I was checking the source code today and found this macro:
>
> #define RGW_MAX_PUT_SIZE (5ULL*1024*1024*1024)
>
> Why is that limit in place? Was that to mimic Amazon S3? (Which is at 5T
> now).
>
> I know that object size limit something that should be there, but just
> trying to find the reasoning behind this limit.
>
> Couldn't we make this configurable at least?
That's the limit on an individual HTTP PUT operation. You can make
larger objects, but they need to be placed with multi-part uploads.
(I'm not sure what the actual limit is, if there is one.)
-Greg
Software Engineer #42 @ http://inktank.com | http://ceph.com
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: 5GB object limit in the RADOS Gateway
2013-05-30 17:47 ` Gregory Farnum
@ 2013-05-30 17:50 ` Wido den Hollander
0 siblings, 0 replies; 3+ messages in thread
From: Wido den Hollander @ 2013-05-30 17:50 UTC (permalink / raw)
To: Gregory Farnum; +Cc: ceph-devel@vger.kernel.org
On 05/30/2013 07:47 PM, Gregory Farnum wrote:
> On Thu, May 30, 2013 at 10:42 AM, Wido den Hollander <wido@42on.com> wrote:
>> Hi,
>>
>> I was checking the source code today and found this macro:
>>
>> #define RGW_MAX_PUT_SIZE (5ULL*1024*1024*1024)
>>
>> Why is that limit in place? Was that to mimic Amazon S3? (Which is at 5T
>> now).
>>
>> I know that object size limit something that should be there, but just
>> trying to find the reasoning behind this limit.
>>
>> Couldn't we make this configurable at least?
>
> That's the limit on an individual HTTP PUT operation. You can make
> larger objects, but they need to be placed with multi-part uploads.
> (I'm not sure what the actual limit is, if there is one.)
> -Greg
Heh? My client gave me an error today and I thought that was really
doing multipart uploads.
Checking again I see that s3cmd doesn't do multipart. That confused me
So it doesn't seem there is an object size limitation after all, so you
can store object as large as you like.
> Software Engineer #42 @ http://inktank.com | http://ceph.com
>
--
Wido den Hollander
42on B.V.
Phone: +31 (0)20 700 9902
Skype: contact42on
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2013-05-30 17:50 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2013-05-30 17:42 5GB object limit in the RADOS Gateway Wido den Hollander
2013-05-30 17:47 ` Gregory Farnum
2013-05-30 17:50 ` Wido den Hollander
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.