alsa-devel.alsa-project.org archive mirror
 help / color / mirror / Atom feed
From: Thierry Reding <thierry.reding@gmail.com>
To: Daniel Vetter <daniel.vetter@intel.com>
Cc: "Yang, Libin" <libin.yang@intel.com>,
	"alsa-devel@alsa-project.org" <alsa-devel@alsa-project.org>,
	"Nikkanen, Kimmo" <kimmo.nikkanen@intel.com>,
	"Takashi Iwai (tiwai@suse.de)" <tiwai@suse.de>,
	"Babu, Ramesh" <ramesh.babu@intel.com>,
	"Koul, Vinod" <vinod.koul@intel.com>,
	"Girdwood, Liam R" <liam.r.girdwood@intel.com>,
	"intel-gfx@lists.freedesktop.org"
	<intel-gfx@lists.freedesktop.org>
Subject: Re: [alsa-devel] [RFC] set up an sync channel between audio and display driver (i.e. ALSA and DRM)
Date: Tue, 20 May 2014 17:15:37 +0200	[thread overview]
Message-ID: <20140520151531.GA19286@ulmo> (raw)
In-Reply-To: <537B6FC7.9030307@intel.com>


[-- Attachment #1.1: Type: text/plain, Size: 4402 bytes --]

On Tue, May 20, 2014 at 05:07:51PM +0200, Daniel Vetter wrote:
> On 20/05/2014 16:57, Thierry Reding wrote:
> >On Tue, May 20, 2014 at 04:45:56PM +0200, Daniel Vetter wrote:
> >>>On Tue, May 20, 2014 at 4:29 PM, Imre Deak<imre.deak@intel.com>  wrote:
> >>>> >On Tue, 2014-05-20 at 05:52 +0300, Lin, Mengdong wrote:
> >>>>> >>This RFC is based on previous discussion to set up a generic
> >>>>> >>communication channel between display and audio driver and
> >>>>> >>an internal design of Intel MCG/VPG HDMI audio driver. It's still an
> >>>>> >>initial draft and your advice would be appreciated
> >>>>> >>to improve the design.
> >>>>> >>
> >>>>> >>The basic idea is to create a new avsink module and let both drm and
> >>>>> >>alsa depend on it.
> >>>>> >>This new module provides a framework and APIs for synchronization
> >>>>> >>between the display and audio driver.
> >>>>> >>
> >>>>> >>1. Display/Audio Client
> >>>>> >>
> >>>>> >>The avsink core provides APIs to create, register and lookup a
> >>>>> >>display/audio client.
> >>>>> >>A specific display driver (eg. i915) or audio driver (eg. HD-Audio
> >>>>> >>driver) can create a client, add some resources
> >>>>> >>objects (shared power wells, display outputs, and audio inputs,
> >>>>> >>register ops) to the client, and then register this
> >>>>> >>client to avisink core. The peer driver can look up a registered
> >>>>> >>client by a name or type, or both. If a client gives
> >>>>> >>a valid peer client name on registration, avsink core will bind the
> >>>>> >>two clients as peer for each other. And we
> >>>>> >>expect a display client and an audio client to be peers for each other
> >>>>> >>in a system.
> >>>> >
> >>>> >One problem we have at the moment is the order of calling the system
> >>>> >suspend/resume handlers of the display driver wrt. that of the audio
> >>>> >driver. Since the power well control is part of the display HW block, we
> >>>> >need to run the display driver's resume handler first, initialize the
> >>>> >HW, and only then let the audio driver's resume handler run. For similar
> >>>> >reasons we have to call the audio suspend handler first and only then
> >>>> >the display driver resume handler. Currently we solve this using the
> >>>> >display driver's late/early suspend/resume hooks, but we'd need a more
> >>>> >robust solution.
> >>>> >
> >>>> >This seems to be a similar issue to the load time ordering problem that
> >>>> >you describe later. Having a real device for avsync that would be a
> >>>> >child of the display device would solve the ordering issue in both
> >>>> >cases. I admit I haven't looked into it if this is feasible, but I would
> >>>> >like to see some solution to this as part of the plan.
> >>>
> >>>Yeah, this is a big reason why I want real devices - we have piles of
> >>>infrastructure to solve these ordering issues as soon as there's a
> >>>struct device around. If we don't use that, we need to reinvent all
> >>>those wheels ourselves.
> >To make the driver core's magic work I think you'd need to find a way to
> >reparent the audio device under the display device. Presumably they come
> >from two different parts of the device tree (two different PCI devices I
> >would guess for Intel, two different platform devices on SoCs). Changing
> >the parent after a device has been registered doesn't work as far as I
> >know. But even assuming that would work, I have trouble imagining what
> >the implications would be on the rest of the driver model.
> >
> >I faced similar problems with the Tegra DRM driver, and the only way I
> >can see to make this kind of interaction between devices work is by
> >tacking on an extra layer outside the core driver model.
> That's why we need a new avsink device which is a proper child of the gfx
> device, and the audio driver needs to use the componentized device framework
> so that the suspend/resume ordering works correctly. Or at least that's been
> my idea, might be we have some small gaps here and there.

The component/master helpers don't allow you to do that. Essentially
what it does is provide a way to glue together multiple devices (the
components) to produce a meta-device (the master). What you get is a
pair of .bind()/.unbind() functions that are called on each of the
components when the master binds or unbinds the meta-device. I don't
see how that could be made to work for suspend/resume.

Thierry

[-- Attachment #1.2: Type: application/pgp-signature, Size: 836 bytes --]

[-- Attachment #2: Type: text/plain, Size: 159 bytes --]

_______________________________________________
Intel-gfx mailing list
Intel-gfx@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/intel-gfx

  reply	other threads:[~2014-05-20 15:15 UTC|newest]

Thread overview: 24+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-05-20  2:52 [RFC] set up an sync channel between audio and display driver (i.e. ALSA and DRM) Lin, Mengdong
2014-05-20  8:10 ` Takashi Iwai
2014-05-20 10:37   ` Vinod Koul
2014-05-22  2:46   ` [alsa-devel] " Raymond Yau
2014-05-20 10:02 ` Daniel Vetter
2014-05-20 10:04   ` Daniel Vetter
2014-05-20 12:43     ` Thierry Reding
2014-05-20 13:40       ` [Intel-gfx] " Jaroslav Kysela
2014-05-20 14:29 ` Imre Deak
2014-05-20 14:35   ` Vinod Koul
2014-05-20 15:02     ` Imre Deak
2014-05-21 15:56     ` Babu, Ramesh
2014-05-21 16:05       ` Daniel Vetter
2014-05-21 17:07         ` Imre Deak
2014-05-22 14:29           ` Lin, Mengdong
2014-05-20 14:45   ` Daniel Vetter
2014-05-20 14:57     ` [alsa-devel] " Thierry Reding
2014-05-20 15:07       ` Daniel Vetter
2014-05-20 15:15         ` Thierry Reding [this message]
2014-05-20 15:22           ` Daniel Vetter
2014-05-22 14:59         ` Lin, Mengdong
2014-05-22 19:58           ` Daniel Vetter
2014-06-03  1:42             ` Lin, Mengdong
2014-06-03  7:44               ` Daniel Vetter

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20140520151531.GA19286@ulmo \
    --to=thierry.reding@gmail.com \
    --cc=alsa-devel@alsa-project.org \
    --cc=daniel.vetter@intel.com \
    --cc=intel-gfx@lists.freedesktop.org \
    --cc=kimmo.nikkanen@intel.com \
    --cc=liam.r.girdwood@intel.com \
    --cc=libin.yang@intel.com \
    --cc=ramesh.babu@intel.com \
    --cc=tiwai@suse.de \
    --cc=vinod.koul@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).