From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED,DKIM_VALID,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D38EBC433DF for ; Wed, 1 Jul 2020 15:49:49 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id A487F2077D for ; Wed, 1 Jul 2020 15:49:49 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="jYeep6ix"; dkim=fail reason="signature verification failed" (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="fXFRvwbs" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org A487F2077D Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References:Message-ID: Subject:To:From:Date:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=TFiiJUgNr1pIbq7SBbe6zPFRUdcSWpcLVnhqp67m24Y=; b=jYeep6ixkx0pdTTXIEfzp7oZ+ qpyVLTCY8bNaV4kU6D1mImXjdvKCE7HeMW7DtpbFRjNnQF9NAPYb+pPesnLmQXVTxk69QjNZKyjOi fctV6lX3K91LRXIitVuBFdIFFoDpfXUx5ux9r2CtMCRU5nqNOb9Tu+Nj4LzALnoWDV2aQXla+/jFl 45dvxD5q09JOIsUmWxhL0S+E/uH0+Z4zX0rI9ibrW1ueDf8zm++mKPbj/RKFiCnLiYYKgUlThSsdc O0xxLde1E8nXxncN5zoLkGvqVHK1s3N6qT8e0nc5yZYh+G3p5cbm3HsMwnWyrNMinHFxjqCTtZwuL +z61qj18Q==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1jqey3-0003ZY-4d; Wed, 01 Jul 2020 15:48:11 +0000 Received: from mail-wm1-x336.google.com ([2a00:1450:4864:20::336]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1jqey0-0003YF-DT for linux-arm-kernel@lists.infradead.org; Wed, 01 Jul 2020 15:48:09 +0000 Received: by mail-wm1-x336.google.com with SMTP id o8so22937833wmh.4 for ; Wed, 01 Jul 2020 08:48:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=mMNtPXYGOcRO7tLq+pEY3fVgHa7bYP6mmW0sBsz4iyE=; b=fXFRvwbsCOJLj/fmIEHNT63bg9uryP3EE/7dDlwF8jxf9jCt5ybmb3ASo/yDalgM7E iwTdhfdu8M7QgWYlCs2nrUf6HK4eHW44JBNnVDASYA7aewFaeaptanrjcwcrhCY/qWFw xRs1dfvHXYXjViIlp4uGKM8SI52W8+umIvErhAL5ZtHkEXB4AUlZocgMiH4qP9ZODywZ kNOtatYRD/dQ7IQzjEtTzlN3B2yz+0KvtPA3dsPXdI7YG2a0DaXBlW1Z85iOuF4Ty8un GRt3oM8R1MVFoFAlXkQsdAsOUEssjZhG+cTHs37GefShIlCnPHklFfmLNBCbwM6TT/jO 1pEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=mMNtPXYGOcRO7tLq+pEY3fVgHa7bYP6mmW0sBsz4iyE=; b=lmRf7nxT6bSuw02vRdwiB3NUCPRQ6NWOz6oJx9vnHVOfGJ9/AfMPzvQFDNdBq11kgD DIPHq1Z7O0MNBiY4N9j+Hym+8yW6cgdYV+/YQ2UeiKvKz6e6FGSMEADjKPdF4pfZ1MeE 9pwZ5ox2JAqv7geMC0GKZ6wb/3/jC7yDMU/BccXYgkbAG0QTgCCILpapTxHUwQCbUUCE douwvONBceV0oGc1juSEYvsFNb1qU9S9CBkH0b3FqeEPhPCEyhJ7nJfnFRc6fG+jnKcL 0etWjJdnCjChT306NBHyAwnaIJMcO3zIidZzlQj+qexyo+J4bl0nD80Puyu8V+fVYs0J 3TTQ== X-Gm-Message-State: AOAM532vI74ZgrzuMBX9z5A3OXkASe4BD20E7KSP/O8F6XbG/2fZpP3t T6c1U230LGOsYC33EeADbjj1B6WY X-Google-Smtp-Source: ABdhPJwoHEVt0hAkrRlr66NPMNDPJFnAM6h3LAE5obWcBhZRQBZeNju+7ADF5dUGvnRQvhJTsy+gYw== X-Received: by 2002:a7b:c403:: with SMTP id k3mr23338033wmi.35.1593618485682; Wed, 01 Jul 2020 08:48:05 -0700 (PDT) Received: from macmini.local (181.4.199.77.rev.sfr.net. [77.199.4.181]) by smtp.gmail.com with ESMTPSA id d63sm7988050wmc.22.2020.07.01.08.48.04 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 01 Jul 2020 08:48:05 -0700 (PDT) Date: Wed, 1 Jul 2020 17:48:04 +0200 From: Willy Wolff To: Lukasz Luba Subject: Re: brocken devfreq simple_ondemand for Odroid XU3/4? Message-ID: <20200701154804.f4amjgnqmprcfonw@macmini.local> References: <85f5a8c0-7d48-f2cd-3385-c56d662f2c88@arm.com> <4a72fcab-e8da-8323-1fbe-98a6a4b3e0f1@arm.com> <4c3b01af-2337-1eba-4675-6488105144c8@samsung.com> <6f8b1119-62b1-942d-cfde-6f1e9a28c40c@arm.com> <691bc55c-5b04-b519-4575-6dce5ea9914c@samsung.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20200701_114808_481343_B3B0E430 X-CRM114-Status: GOOD ( 43.49 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "linux-samsung-soc@vger.kernel.org" , Bartlomiej Zolnierkiewicz , Kamil Konieczny , linux-pm@vger.kernel.org, "linux-kernel@vger.kernel.org" , Krzysztof Kozlowski , Chanwoo Choi , Kyungmin Park , MyungJoo Ham , Kukjin Kim , Sylwester Nawrocki , linux-arm-kernel@lists.infradead.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On 2020-06-29-12-52-10, Lukasz Luba wrote: > Hi Chanwoo, > > On 6/29/20 2:43 AM, Chanwoo Choi wrote: > > Hi, > > > > Sorry for late reply because of my perfornal issue. I count not check the email. > > I hope you are good now. > > > > > On 6/26/20 8:22 PM, Bartlomiej Zolnierkiewicz wrote: > > > > > > On 6/25/20 2:12 PM, Kamil Konieczny wrote: > > > > On 25.06.2020 14:02, Lukasz Luba wrote: > > > > > > > > > > > > > > > On 6/25/20 12:30 PM, Kamil Konieczny wrote: > > > > > > Hi Lukasz, > > > > > > > > > > > > On 25.06.2020 12:02, Lukasz Luba wrote: > > > > > > > Hi Sylwester, > > > > > > > > > > > > > > On 6/24/20 4:11 PM, Sylwester Nawrocki wrote: > > > > > > > > Hi All, > > > > > > > > > > > > > > > > On 24.06.2020 12:32, Lukasz Luba wrote: > > > > > > > > > I had issues with devfreq governor which wasn't called by devfreq > > > > > > > > > workqueue. The old DELAYED vs DEFERRED work discussions and my patches > > > > > > > > > for it [1]. If the CPU which scheduled the next work went idle, the > > > > > > > > > devfreq workqueue will not be kicked and devfreq governor won't check > > > > > > > > > DMC status and will not decide to decrease the frequency based on low > > > > > > > > > busy_time. > > > > > > > > > The same applies for going up with the frequency. They both are > > > > > > > > > done by the governor but the workqueue must be scheduled periodically. > > > > > > > > > > > > > > > > As I have been working on resolving the video mixer IOMMU fault issue > > > > > > > > described here: https://patchwork.kernel.org/patch/10861757 > > > > > > > > I did some investigation of the devfreq operation, mostly on Odroid U3. > > > > > > > > > > > > > > > > My conclusions are similar to what Lukasz says above. I would like to add > > > > > > > > that broken scheduling of the performance counters read and the devfreq > > > > > > > > updates seems to have one more serious implication. In each call, which > > > > > > > > normally should happen periodically with fixed interval we stop the counters, > > > > > > > > read counter values and start the counters again. But if period between > > > > > > > > calls becomes long enough to let any of the counters overflow, we will > > > > > > > > get wrong performance measurement results. My observations are that > > > > > > > > the workqueue job can be suspended for several seconds and conditions for > > > > > > > > the counter overflow occur sooner or later, depending among others > > > > > > > > on the CPUs load. > > > > > > > > Wrong bus load measurement can lead to setting too low interconnect bus > > > > > > > > clock frequency and then bad things happen in peripheral devices. > > > > > > > > > > > > > > > > I agree the workqueue issue needs to be fixed. I have some WIP code to use > > > > > > > > the performance counters overflow interrupts instead of SW polling and with > > > > > > > > that the interconnect bus clock control seems to work much better. > > > > > > > > > > > > > > > > > > > > > > Thank you for sharing your use case and investigation results. I think > > > > > > > we are reaching a decent number of developers to maybe address this > > > > > > > issue: 'workqueue issue needs to be fixed'. > > > > > > > I have been facing this devfreq workqueue issue ~5 times in different > > > > > > > platforms. > > > > > > > > > > > > > > Regarding the 'performance counters overflow interrupts' there is one > > > > > > > thing worth to keep in mind: variable utilization and frequency. > > > > > > > For example, in order to make a conclusion in algorithm deciding that > > > > > > > the device should increase or decrease the frequency, we fix the period > > > > > > > of observation, i.e. to 500ms. That can cause the long delay if the > > > > > > > utilization of the device suddenly drops. For example we set an > > > > > > > overflow threshold to value i.e. 1000 and we know that at 1000MHz > > > > > > > and full utilization (100%) the counter will reach that threshold > > > > > > > after 500ms (which we want, because we don't want too many interrupts > > > > > > > per sec). What if suddenly utilization drops to 2% (i.e. from 5GB/s > > > > > > > to 250MB/s (what if it drops to 25MB/s?!)), the counter will reach the > > > > > > > threshold after 50*500ms = 25s. It is impossible just for the counters > > > > > > > to predict next utilization and adjust the threshold. [...] > > > > > > > > > > > > irq triggers for underflow and overflow, so driver can adjust freq > > > > > > > > > > > > > > > > Probably possible on some platforms, depends on how many PMU registers > > > > > are available, what information can be can assign to them and type of > > > > > interrupt. A lot of hassle and still - platform and device specific. > > > > > Also, drivers should not adjust the freq, governors (different types > > > > > of them with different settings that they can handle) should do it. > > > > > > > > > > What the framework can do is to take this responsibility and provide > > > > > generic way to monitor the devices (or stop if they are suspended). > > > > > That should work nicely with the governors, which try to predict the > > > > > next best frequency. From my experience the more fluctuating intervals > > > > > the governors are called, the more odd decisions they make. > > > > > That's why I think having a predictable interval i.e. 100ms is something > > > > > desirable. Tuning the governors is easier in this case, statistics > > > > > are easier to trace and interpret, solution is not to platform specific, > > > > > etc. > > > > > > > > > > Kamil do you have plans to refresh and push your next version of the > > > > > workqueue solution? > > > > > > > > I do not, as Bartek takes over my work, > > > > +CC Bartek > > > > > > Hi Lukasz, > > > > > > As you remember in January Chanwoo has proposed another idea (to allow > > > selecting workqueue type by devfreq device driver): > > > > > > "I'm developing the RFC patch and then I'll send it as soon as possible." > > > (https://lore.kernel.org/linux-pm/6107fa2b-81ad-060d-89a2-d8941ac4d17e@samsung.com/) > > > > > > "After posting my suggestion, we can discuss it" > > > (https://lore.kernel.org/linux-pm/f5c5cd64-b72c-2802-f6ea-ab3d28483260@samsung.com/) > > > > > > so we have been waiting on the patch to be posted.. > > > > Sorry for this. I'll send it within few days. > > > Feel free to add me on CC, I can review&test the patches if you like. Please CC me too. > > Stay safe and healthy. > > Regards, > Lukasz > Cheers, Willy _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel