radosgw boto issue

radosgw boto issue

[Derek Yarnell]

Hi,

Has anyone used boto (python amazon S3 library) to upload files to
radosgw?  I have recently upgraded to 0.56.1 and my javascript code that
I wrote to upload from within the browser is working fine.

When I use the boto library I am getting 500 errors in my apache error logs

FastCGI: comm with server "/var/www/ceph/s3gw.fcgi" aborted: error
parsing headers: duplicate header 'Status'

I have captured the incoming request and it seems valid.

PUT /zeta/rhel5.list HTTP/1.1
Host: myobjstore.mydomain.com
Accept-Encoding: identity
Content-Length: 15909
Content-MD5: UZj3mZeD8WbVeeqFqS81vA==
Expect: 100-Continue
Date: Thu, 17 Jan 2013 19:00:37 GMT
User-Agent: Boto/2.6.0 (linux2)
Content-Type: application/octet-stream
Authorization: AWS ###:###

Found this ticket which seems very similar but is 2 years old.

  http://tracker.newdream.net/issues/439

Currently radosgw does not seem to have much in the way of logging of
the connection. It has a log file but I have never been able to get it
to log anything.  Is there anyway to get it to spit out a bit more of
what it is doing or what it is sending back to the client?

Thanks,
derek

-- 
---
Derek T. Yarnell
University of Maryland
Institute for Advanced Computer Studies

Re: radosgw boto issue

[Yehuda Sadeh]

On Thu, Jan 17, 2013 at 1:31 PM, Derek Yarnell <derek@umiacs.umd.edu> wrote:
> Hi,
>
> Has anyone used boto (python amazon S3 library) to upload files to
> radosgw?  I have recently upgraded to 0.56.1 and my javascript code that
> I wrote to upload from within the browser is working fine.
>
> When I use the boto library I am getting 500 errors in my apache error logs
>
> FastCGI: comm with server "/var/www/ceph/s3gw.fcgi" aborted: error
> parsing headers: duplicate header 'Status'
>
> I have captured the incoming request and it seems valid.
>
> PUT /zeta/rhel5.list HTTP/1.1
> Host: myobjstore.mydomain.com
> Accept-Encoding: identity
> Content-Length: 15909
> Content-MD5: UZj3mZeD8WbVeeqFqS81vA==
> Expect: 100-Continue
> Date: Thu, 17 Jan 2013 19:00:37 GMT
> User-Agent: Boto/2.6.0 (linux2)
> Content-Type: application/octet-stream
> Authorization: AWS ###:###
>
> Found this ticket which seems very similar but is 2 years old.
>
>   http://tracker.newdream.net/issues/439
>
> Currently radosgw does not seem to have much in the way of logging of
> the connection. It has a log file but I have never been able to get it
> to log anything.  Is there anyway to get it to spit out a bit more of
> what it is doing or what it is sending back to the client?
>

Are you using apache? What fastcgi module are you using? If it's just
a default mod_fastcgi/mod_fcgid then set the following in your
ceph.conf (under the radosgw related section):

 rgw print continue = false

Yehuda

Re: radosgw boto issue

[Derek Yarnell]

On 1/17/13 4:47 PM, Yehuda Sadeh wrote:
> rgw print continue = false

Hi Yehuda,

Thanks once again for a very helpful answer.  I am running apache with
mod_fastcgi.  Is this a deficiency in mod_fastcgi/apache that doesn't
deal with the 100-continue correctly?

Thanks,
derek

-- 
---
Derek T. Yarnell
University of Maryland
Institute for Advanced Computer Studies

Re: radosgw boto issue

[Yehuda Sadeh]

The vanilla mod_fastcgi doesn't handle 100-continue at all. We've
created a modified version that does handle it.

Yehuda

On Thu, Jan 17, 2013 at 3:26 PM, Derek Yarnell <derek@umiacs.umd.edu> wrote:
> On 1/17/13 4:47 PM, Yehuda Sadeh wrote:
>> rgw print continue = false
>
> Hi Yehuda,
>
> Thanks once again for a very helpful answer.  I am running apache with
> mod_fastcgi.  Is this a deficiency in mod_fastcgi/apache that doesn't
> deal with the 100-continue correctly?
>
> Thanks,
> derek
>
> --
> ---
> Derek T. Yarnell
> University of Maryland
> Institute for Advanced Computer Studies

Re: radosgw boto issue

[Dan Mick]

Derek, see

http://ceph.com/docs/master/radosgw/manual-install/

for details.

On 01/17/2013 04:01 PM, Yehuda Sadeh wrote:
> The vanilla mod_fastcgi doesn't handle 100-continue at all. We've
> created a modified version that does handle it.
>
> Yehuda
>
> On Thu, Jan 17, 2013 at 3:26 PM, Derek Yarnell <derek@umiacs.umd.edu> wrote:
>> On 1/17/13 4:47 PM, Yehuda Sadeh wrote:
>>> rgw print continue = false
>>
>> Hi Yehuda,
>>
>> Thanks once again for a very helpful answer.  I am running apache with
>> mod_fastcgi.  Is this a deficiency in mod_fastcgi/apache that doesn't
>> deal with the 100-continue correctly?
>>
>> Thanks,
>> derek
>>
>> --
>> ---
>> Derek T. Yarnell
>> University of Maryland
>> Institute for Advanced Computer Studies
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>