From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>
To: Sakari Ailus <sakari.ailus@iki.fi>
Cc: Pavel Machek <pavel@ucw.cz>, Hans Verkuil <hverkuil@xs4all.nl>,
pali.rohar@gmail.com, sre@kernel.org,
kernel list <linux-kernel@vger.kernel.org>,
linux-arm-kernel <linux-arm-kernel@lists.infradead.org>,
linux-omap@vger.kernel.org, tony@atomide.com, khilman@kernel.org,
aaro.koskinen@iki.fi, ivo.g.dimitrov.75@gmail.com,
patrikbachan@gmail.com, serge@hallyn.com, tuukkat76@gmail.com,
mchehab@osg.samsung.com, linux-media@vger.kernel.org
Subject: Re: camera application for testing (was Re: v4l subdevs without big device)
Date: Wed, 22 Jun 2016 02:59:40 +0300 [thread overview]
Message-ID: <1500395.gQ70N9eqVS@avalon> (raw)
In-Reply-To: <20160501140831.GH26360@valkosipuli.retiisi.org.uk>
Hi Sakari,
On Sunday 01 May 2016 17:08:31 Sakari Ailus wrote:
> On Sat, Apr 30, 2016 at 12:13:59AM +0200, Pavel Machek wrote:
> > Hi!
> >
> > What is reasonable camera application for testing?
> >
> > N900 looks like a low-end digital camera. I have now have the hardware
> > working (can set focus to X cm using command line), but that's not
> > going to be useful for taking photos.
>
> I guess you already knew about omap3camd; it's proprietary but from purely
> practical point of view it'd be an option to support taking photos on the
> N900. That would not be extensible any way, the best possible functionality
> is limited what the daemon implements.
>
> I'm just mentioning the option of implementing wrapper for the omap3camd so
> that it can work with upsteam APIs, I don't propose that however.
>
> > In particular, who is going to do computation neccessary for
> > autofocus, whitebalance and exposure/gain?
>
> I think libv4l itself has algorithms to control at least some of these. It
> relies on the image data so the CPU time consumption will be high.
>
> AFAIR Laurent has also worked on implementing some algorithms that use the
> histogram and some of the statistics. Add him to cc list.
http://git.ideasonboard.org/omap3-isp-live.git
That's outdated and might not run or compile anymore. The code is more of a
proof of concept implementation, but it could be used as a starting point.
With an infinite amount of free time I'd love to work on an open-source
project for computational cameras, integrating it with libv4l.
> > There's http://fcam.garage.maemo.org/gettingStarted.html that should
> > work on maemo, but a) it is not in Debian, b) it has non-trivial
> > dependencies and c) will be a lot of fun to get working...
> > (and d), will not be too useful, anyway, due to 1sec shutter lag:
>
> I believe this will be shorter nowadays. I don't remember the exact
> technical solution which the text below refers to but I'm pretty sure it'll
> be better with the current upstream. API-wise, there's work to be done there
> (to port FCAM to upsteram APIs) but it's a possibility.
>
> > Fast resolution switching (less shutter lag)
> > FCam is built on top of V4L2, which doesn't handle rapidly varying
> > resolutions. When a Shot with a different resolution to the previous
> > one comes down the pipeline, FCam currently flushes the entire V4L2
> > pipeline, shuts down and restarts the whole camera subsystem, then
> > starts streaming at the new resolution. This takes a long time (nearly
> > a second), and is the cause of the horrible shutter lag on the N900. A
> > brave kernel hacker may be able to reduce this time by fiddling with
> > the FCam ISP kernel modules and the guts of the FCam library source
> > (primarily Daemon.cpp).
> > Anyone who solves this one will have our undying gratitude. An ideal
> > solution would be able to insert a 5MP capture into a stream of
> > 640x480 frames running at 30fps, without skipping more than the frame
> > time of the 5MP capture. That is, the viewfinder would effectively
> > stay live while taking a photograph.
> >
> > )
> >
> > Any other application I should look at? Thanks,
--
Regards,
Laurent Pinchart
WARNING: multiple messages have this Message-ID (diff)
From: laurent.pinchart@ideasonboard.com (Laurent Pinchart)
To: linux-arm-kernel@lists.infradead.org
Subject: camera application for testing (was Re: v4l subdevs without big device)
Date: Wed, 22 Jun 2016 02:59:40 +0300 [thread overview]
Message-ID: <1500395.gQ70N9eqVS@avalon> (raw)
In-Reply-To: <20160501140831.GH26360@valkosipuli.retiisi.org.uk>
Hi Sakari,
On Sunday 01 May 2016 17:08:31 Sakari Ailus wrote:
> On Sat, Apr 30, 2016 at 12:13:59AM +0200, Pavel Machek wrote:
> > Hi!
> >
> > What is reasonable camera application for testing?
> >
> > N900 looks like a low-end digital camera. I have now have the hardware
> > working (can set focus to X cm using command line), but that's not
> > going to be useful for taking photos.
>
> I guess you already knew about omap3camd; it's proprietary but from purely
> practical point of view it'd be an option to support taking photos on the
> N900. That would not be extensible any way, the best possible functionality
> is limited what the daemon implements.
>
> I'm just mentioning the option of implementing wrapper for the omap3camd so
> that it can work with upsteam APIs, I don't propose that however.
>
> > In particular, who is going to do computation neccessary for
> > autofocus, whitebalance and exposure/gain?
>
> I think libv4l itself has algorithms to control at least some of these. It
> relies on the image data so the CPU time consumption will be high.
>
> AFAIR Laurent has also worked on implementing some algorithms that use the
> histogram and some of the statistics. Add him to cc list.
http://git.ideasonboard.org/omap3-isp-live.git
That's outdated and might not run or compile anymore. The code is more of a
proof of concept implementation, but it could be used as a starting point.
With an infinite amount of free time I'd love to work on an open-source
project for computational cameras, integrating it with libv4l.
> > There's http://fcam.garage.maemo.org/gettingStarted.html that should
> > work on maemo, but a) it is not in Debian, b) it has non-trivial
> > dependencies and c) will be a lot of fun to get working...
> > (and d), will not be too useful, anyway, due to 1sec shutter lag:
>
> I believe this will be shorter nowadays. I don't remember the exact
> technical solution which the text below refers to but I'm pretty sure it'll
> be better with the current upstream. API-wise, there's work to be done there
> (to port FCAM to upsteram APIs) but it's a possibility.
>
> > Fast resolution switching (less shutter lag)
> > FCam is built on top of V4L2, which doesn't handle rapidly varying
> > resolutions. When a Shot with a different resolution to the previous
> > one comes down the pipeline, FCam currently flushes the entire V4L2
> > pipeline, shuts down and restarts the whole camera subsystem, then
> > starts streaming at the new resolution. This takes a long time (nearly
> > a second), and is the cause of the horrible shutter lag on the N900. A
> > brave kernel hacker may be able to reduce this time by fiddling with
> > the FCam ISP kernel modules and the guts of the FCam library source
> > (primarily Daemon.cpp).
> > Anyone who solves this one will have our undying gratitude. An ideal
> > solution would be able to insert a 5MP capture into a stream of
> > 640x480 frames running at 30fps, without skipping more than the frame
> > time of the 5MP capture. That is, the viewfinder would effectively
> > stay live while taking a photograph.
> >
> > )
> >
> > Any other application I should look at? Thanks,
--
Regards,
Laurent Pinchart
next prev parent reply other threads:[~2016-06-21 23:59 UTC|newest]
Thread overview: 41+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-04-28 8:45 drivers/media/i2c/adp1653.c: does not show as /dev/video* or v4l-subdev* Pavel Machek
2016-04-28 8:45 ` Pavel Machek
2016-04-28 8:45 ` Pavel Machek
2016-04-29 7:15 ` v4l subdevs without big device was " Pavel Machek
2016-04-29 7:15 ` Pavel Machek
2016-04-29 7:31 ` Hans Verkuil
2016-04-29 7:31 ` Hans Verkuil
2016-04-29 7:56 ` Sakari Ailus
2016-04-29 7:56 ` Sakari Ailus
2016-04-29 9:50 ` Pavel Machek
2016-04-29 9:50 ` Pavel Machek
2016-04-29 9:50 ` Pavel Machek
2016-04-29 10:59 ` Sakari Ailus
2016-04-29 10:59 ` Sakari Ailus
2016-04-29 11:05 ` Pali Rohár
2016-04-29 11:05 ` Pali Rohár
2016-04-29 11:23 ` Sakari Ailus
2016-04-29 11:23 ` Sakari Ailus
2016-04-29 14:06 ` Pavel Machek
2016-04-29 14:06 ` Pavel Machek
2016-04-29 10:15 ` Pavel Machek
2016-04-29 10:15 ` Pavel Machek
2016-04-29 21:30 ` [pre-rfc] focus and flash for Nokia N900 (was Re: v4l subdevs without big device was Re: drivers/media/i2c/adp1653.c: does not show as /dev/video* or v4l-subdev*) Pavel Machek
2016-04-29 21:30 ` Pavel Machek
2016-04-29 22:13 ` camera application for testing (was Re: v4l subdevs without big device) Pavel Machek
2016-04-29 22:13 ` Pavel Machek
2016-04-29 22:20 ` Pali Rohár
2016-04-29 22:20 ` Pali Rohár
2016-04-29 22:47 ` Ivaylo Dimitrov
2016-04-29 22:47 ` Ivaylo Dimitrov
2016-05-01 14:08 ` Sakari Ailus
2016-05-01 14:08 ` Sakari Ailus
2016-05-01 19:21 ` Pavel Machek
2016-05-01 19:21 ` Pavel Machek
2016-06-21 22:32 ` Pavel Machek
2016-06-21 22:32 ` Pavel Machek
2016-06-21 23:59 ` Laurent Pinchart [this message]
2016-06-21 23:59 ` Laurent Pinchart
2016-06-22 11:52 ` Pavel Machek
2016-06-22 11:52 ` Pavel Machek
2016-06-22 11:52 ` Pavel Machek
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1500395.gQ70N9eqVS@avalon \
--to=laurent.pinchart@ideasonboard.com \
--cc=aaro.koskinen@iki.fi \
--cc=hverkuil@xs4all.nl \
--cc=ivo.g.dimitrov.75@gmail.com \
--cc=khilman@kernel.org \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-media@vger.kernel.org \
--cc=linux-omap@vger.kernel.org \
--cc=mchehab@osg.samsung.com \
--cc=pali.rohar@gmail.com \
--cc=patrikbachan@gmail.com \
--cc=pavel@ucw.cz \
--cc=sakari.ailus@iki.fi \
--cc=serge@hallyn.com \
--cc=sre@kernel.org \
--cc=tony@atomide.com \
--cc=tuukkat76@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.