* [PATCH v3 00/11] Tegra114: implement EMC support
@ 2025-09-15 8:01 Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114 Svyatoslav Ryhel
` (10 more replies)
0 siblings, 11 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Add support for External Memory Controller found in Tegra 4 SoC along
with adjustments required for it to work properly.
Tested on ASUS TF701T (T40X) and Nvidia Tegratab (T40S). Both work fine.
---
Changes in v2:
- fix programming completion detection (changed EMC reg to MC reg reading)
- Tegra114 incorporated into Tegra124 dt-bindings schema
Changes in v3:
- adjusted MC and EMC schema to move description and ref into common property
- added Tegra114 support into devfreq driver
- added MC/EMC to DC interconnections
---
Svyatoslav Ryhel (11):
devfreq: tegra30-devfreq: add support for Tegra114
ARM: tegra: Add ACTMON node to Tegra114 device tree
dt-bindings: memory: Document Tegra114 Memory Controller
memory: tegra: implement EMEM regs and ICC ops for Tegra114
dt-bindings: memory: Add Tegra114 memory client IDs
clk: tegra: remove EMC to MC clock mux in Tegra114
dt-bindings: memory: Document Tegra114 External Memory Controller
memory: tegra: Add Tegra114 EMC driver
ARM: tegra: Add External Memory Controller node on Tegra114
ARM: tegra: Add EMC OPP and ICC properties to Tegra114 EMC and ACTMON
device-tree nodes
ARM: tegra: add DC interconnections for Tegra114
.../nvidia,tegra124-emc.yaml | 431 +++--
.../nvidia,tegra124-mc.yaml | 97 +-
.../dts/nvidia/tegra114-peripherals-opp.dtsi | 151 ++
arch/arm/boot/dts/nvidia/tegra114.dtsi | 55 +
drivers/clk/tegra/clk-tegra114.c | 48 +-
drivers/devfreq/tegra30-devfreq.c | 1 +
drivers/memory/tegra/Kconfig | 12 +
drivers/memory/tegra/Makefile | 1 +
drivers/memory/tegra/tegra114-emc.c | 1487 +++++++++++++++++
drivers/memory/tegra/tegra114.c | 193 +++
include/dt-bindings/memory/tegra114-mc.h | 67 +
11 files changed, 2357 insertions(+), 186 deletions(-)
create mode 100644 arch/arm/boot/dts/nvidia/tegra114-peripherals-opp.dtsi
create mode 100644 drivers/memory/tegra/tegra114-emc.c
--
2.48.1
^ permalink raw reply [flat|nested] 32+ messages in thread
* [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-11-11 8:55 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 02/11] ARM: tegra: Add ACTMON node to Tegra114 device tree Svyatoslav Ryhel
` (9 subsequent siblings)
10 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Lets add Tegra114 support to activity monitor device as a preparation to
upcoming EMC controller support.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
drivers/devfreq/tegra30-devfreq.c | 1 +
1 file changed, 1 insertion(+)
diff --git a/drivers/devfreq/tegra30-devfreq.c b/drivers/devfreq/tegra30-devfreq.c
index 8ea5b482bfb3..d976077d4757 100644
--- a/drivers/devfreq/tegra30-devfreq.c
+++ b/drivers/devfreq/tegra30-devfreq.c
@@ -980,6 +980,7 @@ static const struct tegra_devfreq_soc_data tegra30_soc = {
static const struct of_device_id tegra_devfreq_of_match[] = {
{ .compatible = "nvidia,tegra30-actmon", .data = &tegra30_soc, },
+ { .compatible = "nvidia,tegra114-actmon", .data = &tegra124_soc, },
{ .compatible = "nvidia,tegra124-actmon", .data = &tegra124_soc, },
{ },
};
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 02/11] ARM: tegra: Add ACTMON node to Tegra114 device tree
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114 Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-11-11 9:00 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller Svyatoslav Ryhel
` (8 subsequent siblings)
10 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Add support for ACTMON on Tegra114. This is used to monitor activity from
different components. Based on the collected statistics, the rate at which
the external memory needs to be clocked can be derived.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
arch/arm/boot/dts/nvidia/tegra114.dtsi | 12 ++++++++++++
1 file changed, 12 insertions(+)
diff --git a/arch/arm/boot/dts/nvidia/tegra114.dtsi b/arch/arm/boot/dts/nvidia/tegra114.dtsi
index 5e695431ad2e..08f81a3d11de 100644
--- a/arch/arm/boot/dts/nvidia/tegra114.dtsi
+++ b/arch/arm/boot/dts/nvidia/tegra114.dtsi
@@ -248,6 +248,18 @@ ahb: ahb@6000c000 {
reg = <0x6000c000 0x150>;
};
+ actmon: actmon@6000c800 {
+ compatible = "nvidia,tegra114-actmon";
+ reg = <0x6000c800 0x400>;
+ interrupts = <GIC_SPI 45 IRQ_TYPE_LEVEL_HIGH>;
+ clocks = <&tegra_car TEGRA114_CLK_ACTMON>,
+ <&tegra_car TEGRA114_CLK_EMC>;
+ clock-names = "actmon", "emc";
+ resets = <&tegra_car TEGRA114_CLK_ACTMON>;
+ reset-names = "actmon";
+ #cooling-cells = <2>;
+ };
+
gpio: gpio@6000d000 {
compatible = "nvidia,tegra114-gpio", "nvidia,tegra30-gpio";
reg = <0x6000d000 0x1000>;
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114 Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 02/11] ARM: tegra: Add ACTMON node to Tegra114 device tree Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-09-22 16:00 ` Rob Herring
2025-09-15 8:01 ` [PATCH v3 04/11] memory: tegra: implement EMEM regs and ICC ops for Tegra114 Svyatoslav Ryhel
` (7 subsequent siblings)
10 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Add Tegra114 support into existing Tegra124 MC schema with the most
notable difference in the amount of EMEM timings.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
.../nvidia,tegra124-mc.yaml | 97 ++++++++++++++-----
1 file changed, 74 insertions(+), 23 deletions(-)
diff --git a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
index 7b18b4d11e0a..9cc9360d3bd0 100644
--- a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
+++ b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
@@ -19,7 +19,9 @@ description: |
properties:
compatible:
- const: nvidia,tegra124-mc
+ enum:
+ - nvidia,tegra114-mc
+ - nvidia,tegra124-mc
reg:
maxItems: 1
@@ -64,29 +66,10 @@ patternProperties:
nvidia,emem-configuration:
$ref: /schemas/types.yaml#/definitions/uint32-array
- description: |
+ description:
Values to be written to the EMEM register block. See section
- "15.6.1 MC Registers" in the TRM.
- items:
- - description: MC_EMEM_ARB_CFG
- - description: MC_EMEM_ARB_OUTSTANDING_REQ
- - description: MC_EMEM_ARB_TIMING_RCD
- - description: MC_EMEM_ARB_TIMING_RP
- - description: MC_EMEM_ARB_TIMING_RC
- - description: MC_EMEM_ARB_TIMING_RAS
- - description: MC_EMEM_ARB_TIMING_FAW
- - description: MC_EMEM_ARB_TIMING_RRD
- - description: MC_EMEM_ARB_TIMING_RAP2PRE
- - description: MC_EMEM_ARB_TIMING_WAP2PRE
- - description: MC_EMEM_ARB_TIMING_R2R
- - description: MC_EMEM_ARB_TIMING_W2W
- - description: MC_EMEM_ARB_TIMING_R2W
- - description: MC_EMEM_ARB_TIMING_W2R
- - description: MC_EMEM_ARB_DA_TURNS
- - description: MC_EMEM_ARB_DA_COVERS
- - description: MC_EMEM_ARB_MISC0
- - description: MC_EMEM_ARB_MISC1
- - description: MC_EMEM_ARB_RING1_THROTTLE
+ "20.11.1 MC Registers" in the Tegea114 TRM or
+ "15.6.1 MC Registers" in the Tegra124 TRM.
required:
- clock-frequency
@@ -109,6 +92,74 @@ required:
- "#iommu-cells"
- "#interconnect-cells"
+allOf:
+ - if:
+ properties:
+ compatible:
+ contains:
+ enum:
+ - nvidia,tegra114-mc
+ then:
+ patternProperties:
+ "^emc-timings-[0-9]+$":
+ patternProperties:
+ "^timing-[0-9]+$":
+ properties:
+ nvidia,emem-configuration:
+ items:
+ - description: MC_EMEM_ARB_CFG
+ - description: MC_EMEM_ARB_OUTSTANDING_REQ
+ - description: MC_EMEM_ARB_TIMING_RCD
+ - description: MC_EMEM_ARB_TIMING_RP
+ - description: MC_EMEM_ARB_TIMING_RC
+ - description: MC_EMEM_ARB_TIMING_RAS
+ - description: MC_EMEM_ARB_TIMING_FAW
+ - description: MC_EMEM_ARB_TIMING_RRD
+ - description: MC_EMEM_ARB_TIMING_RAP2PRE
+ - description: MC_EMEM_ARB_TIMING_WAP2PRE
+ - description: MC_EMEM_ARB_TIMING_R2R
+ - description: MC_EMEM_ARB_TIMING_W2W
+ - description: MC_EMEM_ARB_TIMING_R2W
+ - description: MC_EMEM_ARB_TIMING_W2R
+ - description: MC_EMEM_ARB_DA_TURNS
+ - description: MC_EMEM_ARB_DA_COVERS
+ - description: MC_EMEM_ARB_MISC0
+ - description: MC_EMEM_ARB_RING1_THROTTLE
+
+ - if:
+ properties:
+ compatible:
+ contains:
+ enum:
+ - nvidia,tegra124-mc
+ then:
+ patternProperties:
+ "^emc-timings-[0-9]+$":
+ patternProperties:
+ "^timing-[0-9]+$":
+ properties:
+ nvidia,emem-configuration:
+ items:
+ - description: MC_EMEM_ARB_CFG
+ - description: MC_EMEM_ARB_OUTSTANDING_REQ
+ - description: MC_EMEM_ARB_TIMING_RCD
+ - description: MC_EMEM_ARB_TIMING_RP
+ - description: MC_EMEM_ARB_TIMING_RC
+ - description: MC_EMEM_ARB_TIMING_RAS
+ - description: MC_EMEM_ARB_TIMING_FAW
+ - description: MC_EMEM_ARB_TIMING_RRD
+ - description: MC_EMEM_ARB_TIMING_RAP2PRE
+ - description: MC_EMEM_ARB_TIMING_WAP2PRE
+ - description: MC_EMEM_ARB_TIMING_R2R
+ - description: MC_EMEM_ARB_TIMING_W2W
+ - description: MC_EMEM_ARB_TIMING_R2W
+ - description: MC_EMEM_ARB_TIMING_W2R
+ - description: MC_EMEM_ARB_DA_TURNS
+ - description: MC_EMEM_ARB_DA_COVERS
+ - description: MC_EMEM_ARB_MISC0
+ - description: MC_EMEM_ARB_MISC1
+ - description: MC_EMEM_ARB_RING1_THROTTLE
+
additionalProperties: false
examples:
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 04/11] memory: tegra: implement EMEM regs and ICC ops for Tegra114
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (2 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-11-13 4:36 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 05/11] dt-bindings: memory: Add Tegra114 memory client IDs Svyatoslav Ryhel
` (6 subsequent siblings)
10 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Prepare Internal Memory Controller for introduction of External Memory
Controller.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
drivers/memory/tegra/tegra114.c | 193 ++++++++++++++++++++++++++++++++
1 file changed, 193 insertions(+)
diff --git a/drivers/memory/tegra/tegra114.c b/drivers/memory/tegra/tegra114.c
index d03a5d162dbd..c615857f7fad 100644
--- a/drivers/memory/tegra/tegra114.c
+++ b/drivers/memory/tegra/tegra114.c
@@ -3,6 +3,7 @@
* Copyright (C) 2014 NVIDIA CORPORATION. All rights reserved.
*/
+#include <linux/device.h>
#include <linux/of.h>
#include <linux/mm.h>
@@ -1165,6 +1166,195 @@ static const struct tegra_mc_reset tegra114_mc_resets[] = {
TEGRA114_MC_RESET(VI, 0x200, 0x204, 17),
};
+static void tegra114_mc_tune_client_latency(struct tegra_mc *mc,
+ const struct tegra_mc_client *client,
+ unsigned int bandwidth_mbytes_sec)
+{
+ u32 arb_tolerance_compensation_nsec, arb_tolerance_compensation_div;
+ unsigned int fifo_size = client->fifo_size;
+ u32 arb_nsec, la_ticks, value;
+
+ /* see 20.3.1.1 Client Configuration in Tegra4 TRM v01p */
+ if (bandwidth_mbytes_sec)
+ arb_nsec = fifo_size * NSEC_PER_USEC / bandwidth_mbytes_sec;
+ else
+ arb_nsec = U32_MAX;
+
+ /*
+ * Latency allowness should be set with consideration for the module's
+ * latency tolerance and internal buffering capabilities.
+ *
+ * Display memory clients use isochronous transfers and have very low
+ * tolerance to a belated transfers. Hence we need to compensate the
+ * memory arbitration imperfection for them in order to prevent FIFO
+ * underflow condition when memory bus is busy.
+ *
+ * VI clients also need a stronger compensation.
+ */
+ switch (client->swgroup) {
+ case TEGRA_SWGROUP_MPCORE:
+ case TEGRA_SWGROUP_PTC:
+ /*
+ * We always want lower latency for these clients, hence
+ * don't touch them.
+ */
+ return;
+
+ case TEGRA_SWGROUP_DC:
+ case TEGRA_SWGROUP_DCB:
+ arb_tolerance_compensation_nsec = 1050;
+ arb_tolerance_compensation_div = 2;
+ break;
+
+ case TEGRA_SWGROUP_VI:
+ arb_tolerance_compensation_nsec = 1050;
+ arb_tolerance_compensation_div = 1;
+ break;
+
+ default:
+ arb_tolerance_compensation_nsec = 150;
+ arb_tolerance_compensation_div = 1;
+ break;
+ }
+
+ if (arb_nsec > arb_tolerance_compensation_nsec)
+ arb_nsec -= arb_tolerance_compensation_nsec;
+ else
+ arb_nsec = 0;
+
+ arb_nsec /= arb_tolerance_compensation_div;
+
+ /*
+ * Latency allowance is a number of ticks a request from a particular
+ * client may wait in the EMEM arbiter before it becomes a high-priority
+ * request.
+ */
+ la_ticks = arb_nsec / mc->tick;
+ la_ticks = min(la_ticks, client->regs.la.mask);
+
+ value = mc_readl(mc, client->regs.la.reg);
+ value &= ~(client->regs.la.mask << client->regs.la.shift);
+ value |= la_ticks << client->regs.la.shift;
+ mc_writel(mc, value, client->regs.la.reg);
+}
+
+static int tegra114_mc_icc_set(struct icc_node *src, struct icc_node *dst)
+{
+ struct tegra_mc *mc = icc_provider_to_tegra_mc(src->provider);
+ const struct tegra_mc_client *client = &mc->soc->clients[src->id];
+ u64 peak_bandwidth = icc_units_to_bps(src->peak_bw);
+
+ /*
+ * Skip pre-initialization that is done by icc_node_add(), which sets
+ * bandwidth to maximum for all clients before drivers are loaded.
+ *
+ * This doesn't make sense for us because we don't have drivers for all
+ * clients and it's okay to keep configuration left from bootloader
+ * during boot, at least for today.
+ */
+ if (src == dst)
+ return 0;
+
+ /* convert bytes/sec to megabytes/sec */
+ do_div(peak_bandwidth, 1000000);
+
+ tegra114_mc_tune_client_latency(mc, client, peak_bandwidth);
+
+ return 0;
+}
+
+static int tegra114_mc_icc_aggreate(struct icc_node *node, u32 tag, u32 avg_bw,
+ u32 peak_bw, u32 *agg_avg, u32 *agg_peak)
+{
+ /*
+ * ISO clients need to reserve extra bandwidth up-front because
+ * there could be high bandwidth pressure during initial filling
+ * of the client's FIFO buffers. Secondly, we need to take into
+ * account impurities of the memory subsystem.
+ */
+ if (tag & TEGRA_MC_ICC_TAG_ISO)
+ peak_bw = tegra_mc_scale_percents(peak_bw, 400);
+
+ *agg_avg += avg_bw;
+ *agg_peak = max(*agg_peak, peak_bw);
+
+ return 0;
+}
+
+static struct icc_node_data *
+tegra114_mc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
+{
+ struct tegra_mc *mc = icc_provider_to_tegra_mc(data);
+ const struct tegra_mc_client *client;
+ unsigned int i, idx = spec->args[0];
+ struct icc_node_data *ndata;
+ struct icc_node *node;
+
+ list_for_each_entry(node, &mc->provider.nodes, node_list) {
+ if (node->id != idx)
+ continue;
+
+ ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
+ if (!ndata)
+ return ERR_PTR(-ENOMEM);
+
+ client = &mc->soc->clients[idx];
+ ndata->node = node;
+
+ switch (client->swgroup) {
+ case TEGRA_SWGROUP_DC:
+ case TEGRA_SWGROUP_DCB:
+ case TEGRA_SWGROUP_PTC:
+ case TEGRA_SWGROUP_VI:
+ /* these clients are isochronous by default */
+ ndata->tag = TEGRA_MC_ICC_TAG_ISO;
+ break;
+
+ default:
+ ndata->tag = TEGRA_MC_ICC_TAG_DEFAULT;
+ break;
+ }
+
+ return ndata;
+ }
+
+ for (i = 0; i < mc->soc->num_clients; i++) {
+ if (mc->soc->clients[i].id == idx)
+ return ERR_PTR(-EPROBE_DEFER);
+ }
+
+ dev_err(mc->dev, "invalid ICC client ID %u\n", idx);
+
+ return ERR_PTR(-EINVAL);
+}
+
+static const struct tegra_mc_icc_ops tegra114_mc_icc_ops = {
+ .xlate_extended = tegra114_mc_of_icc_xlate_extended,
+ .aggregate = tegra114_mc_icc_aggreate,
+ .set = tegra114_mc_icc_set,
+};
+
+static const unsigned long tegra114_mc_emem_regs[] = {
+ MC_EMEM_ARB_CFG,
+ MC_EMEM_ARB_OUTSTANDING_REQ,
+ MC_EMEM_ARB_TIMING_RCD,
+ MC_EMEM_ARB_TIMING_RP,
+ MC_EMEM_ARB_TIMING_RC,
+ MC_EMEM_ARB_TIMING_RAS,
+ MC_EMEM_ARB_TIMING_FAW,
+ MC_EMEM_ARB_TIMING_RRD,
+ MC_EMEM_ARB_TIMING_RAP2PRE,
+ MC_EMEM_ARB_TIMING_WAP2PRE,
+ MC_EMEM_ARB_TIMING_R2R,
+ MC_EMEM_ARB_TIMING_W2W,
+ MC_EMEM_ARB_TIMING_R2W,
+ MC_EMEM_ARB_TIMING_W2R,
+ MC_EMEM_ARB_DA_TURNS,
+ MC_EMEM_ARB_DA_COVERS,
+ MC_EMEM_ARB_MISC0,
+ MC_EMEM_ARB_RING1_THROTTLE,
+};
+
const struct tegra_mc_soc tegra114_mc_soc = {
.clients = tegra114_mc_clients,
.num_clients = ARRAY_SIZE(tegra114_mc_clients),
@@ -1172,10 +1362,13 @@ const struct tegra_mc_soc tegra114_mc_soc = {
.atom_size = 32,
.client_id_mask = 0x7f,
.smmu = &tegra114_smmu_soc,
+ .emem_regs = tegra114_mc_emem_regs,
+ .num_emem_regs = ARRAY_SIZE(tegra114_mc_emem_regs),
.intmask = MC_INT_INVALID_SMMU_PAGE | MC_INT_SECURITY_VIOLATION |
MC_INT_DECERR_EMEM,
.reset_ops = &tegra_mc_reset_ops_common,
.resets = tegra114_mc_resets,
.num_resets = ARRAY_SIZE(tegra114_mc_resets),
+ .icc_ops = &tegra114_mc_icc_ops,
.ops = &tegra30_mc_ops,
};
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 05/11] dt-bindings: memory: Add Tegra114 memory client IDs
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (3 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 04/11] memory: tegra: implement EMEM regs and ICC ops for Tegra114 Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-11-13 4:47 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114 Svyatoslav Ryhel
` (5 subsequent siblings)
10 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Each memory client has unique hardware ID, add these IDs.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
Acked-by: Rob Herring (Arm) <robh@kernel.org>
---
include/dt-bindings/memory/tegra114-mc.h | 67 ++++++++++++++++++++++++
1 file changed, 67 insertions(+)
diff --git a/include/dt-bindings/memory/tegra114-mc.h b/include/dt-bindings/memory/tegra114-mc.h
index dfe99c8a5ba5..5e0d6a1b91f2 100644
--- a/include/dt-bindings/memory/tegra114-mc.h
+++ b/include/dt-bindings/memory/tegra114-mc.h
@@ -40,4 +40,71 @@
#define TEGRA114_MC_RESET_VDE 14
#define TEGRA114_MC_RESET_VI 15
+#define TEGRA114_MC_PTCR 0
+#define TEGRA114_MC_DISPLAY0A 1
+#define TEGRA114_MC_DISPLAY0AB 2
+#define TEGRA114_MC_DISPLAY0B 3
+#define TEGRA114_MC_DISPLAY0BB 4
+#define TEGRA114_MC_DISPLAY0C 5
+#define TEGRA114_MC_DISPLAY0CB 6
+#define TEGRA114_MC_DISPLAY1B 7
+#define TEGRA114_MC_DISPLAY1BB 8
+#define TEGRA114_MC_EPPUP 9
+#define TEGRA114_MC_G2PR 10
+#define TEGRA114_MC_G2SR 11
+#define TEGRA114_MC_MPEUNIFBR 12
+#define TEGRA114_MC_VIRUV 13
+#define TEGRA114_MC_AFIR 14
+#define TEGRA114_MC_AVPCARM7R 15
+#define TEGRA114_MC_DISPLAYHC 16
+#define TEGRA114_MC_DISPLAYHCB 17
+#define TEGRA114_MC_FDCDRD 18
+#define TEGRA114_MC_FDCDRD2 19
+#define TEGRA114_MC_G2DR 20
+#define TEGRA114_MC_HDAR 21
+#define TEGRA114_MC_HOST1XDMAR 22
+#define TEGRA114_MC_HOST1XR 23
+#define TEGRA114_MC_IDXSRD 24
+#define TEGRA114_MC_IDXSRD2 25
+#define TEGRA114_MC_MPE_IPRED 26
+#define TEGRA114_MC_MPEAMEMRD 27
+#define TEGRA114_MC_MPECSRD 28
+#define TEGRA114_MC_PPCSAHBDMAR 29
+#define TEGRA114_MC_PPCSAHBSLVR 30
+#define TEGRA114_MC_SATAR 31
+#define TEGRA114_MC_TEXSRD 32
+#define TEGRA114_MC_TEXSRD2 33
+#define TEGRA114_MC_VDEBSEVR 34
+#define TEGRA114_MC_VDEMBER 35
+#define TEGRA114_MC_VDEMCER 36
+#define TEGRA114_MC_VDETPER 37
+#define TEGRA114_MC_MPCORELPR 38
+#define TEGRA114_MC_MPCORER 39
+#define TEGRA114_MC_EPPU 40
+#define TEGRA114_MC_EPPV 41
+#define TEGRA114_MC_EPPY 42
+#define TEGRA114_MC_MPEUNIFBW 43
+#define TEGRA114_MC_VIWSB 44
+#define TEGRA114_MC_VIWU 45
+#define TEGRA114_MC_VIWV 46
+#define TEGRA114_MC_VIWY 47
+#define TEGRA114_MC_G2DW 48
+#define TEGRA114_MC_AFIW 49
+#define TEGRA114_MC_AVPCARM7W 50
+#define TEGRA114_MC_FDCDWR 51
+#define TEGRA114_MC_FDCDWR2 52
+#define TEGRA114_MC_HDAW 53
+#define TEGRA114_MC_HOST1XW 54
+#define TEGRA114_MC_ISPW 55
+#define TEGRA114_MC_MPCORELPW 56
+#define TEGRA114_MC_MPCOREW 57
+#define TEGRA114_MC_MPECSWR 58
+#define TEGRA114_MC_PPCSAHBDMAW 59
+#define TEGRA114_MC_PPCSAHBSLVW 60
+#define TEGRA114_MC_SATAW 61
+#define TEGRA114_MC_VDEBSEVW 62
+#define TEGRA114_MC_VDEDBGW 63
+#define TEGRA114_MC_VDEMBEW 64
+#define TEGRA114_MC_VDETPMW 65
+
#endif
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (4 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 05/11] dt-bindings: memory: Add Tegra114 memory client IDs Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-09-21 17:54 ` Stephen Boyd
2025-11-13 5:05 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 07/11] dt-bindings: memory: Document Tegra114 External Memory Controller Svyatoslav Ryhel
` (4 subsequent siblings)
10 siblings, 2 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Configure EMC without mux for correct EMC driver support.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
drivers/clk/tegra/clk-tegra114.c | 48 ++++++++++++++++++++++----------
1 file changed, 33 insertions(+), 15 deletions(-)
diff --git a/drivers/clk/tegra/clk-tegra114.c b/drivers/clk/tegra/clk-tegra114.c
index 8bde72aa5e68..6b3a140772c2 100644
--- a/drivers/clk/tegra/clk-tegra114.c
+++ b/drivers/clk/tegra/clk-tegra114.c
@@ -622,10 +622,6 @@ static const char *mux_plld_out0_plld2_out0[] = {
};
#define mux_plld_out0_plld2_out0_idx NULL
-static const char *mux_pllmcp_clkm[] = {
- "pll_m_out0", "pll_c_out0", "pll_p_out0", "clk_m", "pll_m_ud",
-};
-
static const struct clk_div_table pll_re_div_table[] = {
{ .val = 0, .div = 1 },
{ .val = 1, .div = 2 },
@@ -672,7 +668,6 @@ static struct tegra_clk tegra114_clks[tegra_clk_max] __initdata = {
[tegra_clk_csi] = { .dt_id = TEGRA114_CLK_CSI, .present = true },
[tegra_clk_i2c2] = { .dt_id = TEGRA114_CLK_I2C2, .present = true },
[tegra_clk_uartc] = { .dt_id = TEGRA114_CLK_UARTC, .present = true },
- [tegra_clk_emc] = { .dt_id = TEGRA114_CLK_EMC, .present = true },
[tegra_clk_usb2] = { .dt_id = TEGRA114_CLK_USB2, .present = true },
[tegra_clk_usb3] = { .dt_id = TEGRA114_CLK_USB3, .present = true },
[tegra_clk_vde_8] = { .dt_id = TEGRA114_CLK_VDE, .present = true },
@@ -1048,14 +1043,7 @@ static __init void tegra114_periph_clk_init(void __iomem *clk_base,
0, 82, periph_clk_enb_refcnt);
clks[TEGRA114_CLK_DSIB] = clk;
- /* emc mux */
- clk = clk_register_mux(NULL, "emc_mux", mux_pllmcp_clkm,
- ARRAY_SIZE(mux_pllmcp_clkm),
- CLK_SET_RATE_NO_REPARENT,
- clk_base + CLK_SOURCE_EMC,
- 29, 3, 0, &emc_lock);
-
- clk = tegra_clk_register_mc("mc", "emc_mux", clk_base + CLK_SOURCE_EMC,
+ clk = tegra_clk_register_mc("mc", "emc", clk_base + CLK_SOURCE_EMC,
&emc_lock);
clks[TEGRA114_CLK_MC] = clk;
@@ -1321,6 +1309,28 @@ static int tegra114_reset_deassert(unsigned long id)
return 0;
}
+#ifdef CONFIG_TEGRA124_CLK_EMC
+static struct clk *tegra114_clk_src_onecell_get(struct of_phandle_args *clkspec,
+ void *data)
+{
+ struct clk_hw *hw;
+ struct clk *clk;
+
+ clk = of_clk_src_onecell_get(clkspec, data);
+ if (IS_ERR(clk))
+ return clk;
+
+ hw = __clk_get_hw(clk);
+
+ if (clkspec->args[0] == TEGRA114_CLK_EMC) {
+ if (!tegra124_clk_emc_driver_available(hw))
+ return ERR_PTR(-EPROBE_DEFER);
+ }
+
+ return clk;
+}
+#endif
+
static void __init tegra114_clock_init(struct device_node *np)
{
struct device_node *node;
@@ -1362,16 +1372,24 @@ static void __init tegra114_clock_init(struct device_node *np)
tegra_audio_clk_init(clk_base, pmc_base, tegra114_clks,
tegra114_audio_plls,
ARRAY_SIZE(tegra114_audio_plls), 24000000);
+
+ tegra_clk_apply_init_table = tegra114_clock_apply_init_table;
+
tegra_super_clk_gen4_init(clk_base, pmc_base, tegra114_clks,
&pll_x_params);
tegra_init_special_resets(1, tegra114_reset_assert,
tegra114_reset_deassert);
+#ifdef CONFIG_TEGRA124_CLK_EMC
+ tegra_add_of_provider(np, tegra114_clk_src_onecell_get);
+ clks[TEGRA114_CLK_EMC] = tegra124_clk_register_emc(clk_base, np,
+ &emc_lock);
+#else
tegra_add_of_provider(np, of_clk_src_onecell_get);
- tegra_register_devclks(devclks, ARRAY_SIZE(devclks));
+#endif
- tegra_clk_apply_init_table = tegra114_clock_apply_init_table;
+ tegra_register_devclks(devclks, ARRAY_SIZE(devclks));
tegra_cpu_car_ops = &tegra114_cpu_car_ops;
}
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 07/11] dt-bindings: memory: Document Tegra114 External Memory Controller
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (5 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114 Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver Svyatoslav Ryhel
` (3 subsequent siblings)
10 siblings, 0 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Include Tegra114 support into existing Tegra124 EMC schema with the most
notable difference being the amount of EMC timings and a few SoC unique
entries.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
.../nvidia,tegra124-emc.yaml | 431 ++++++++++++------
1 file changed, 283 insertions(+), 148 deletions(-)
diff --git a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-emc.yaml b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-emc.yaml
index f5f03bf36413..1aeff06c3efe 100644
--- a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-emc.yaml
+++ b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-emc.yaml
@@ -16,7 +16,9 @@ description: |
properties:
compatible:
- const: nvidia,tegra124-emc
+ enum:
+ - nvidia,tegra114-emc
+ - nvidia,tegra124-emc
reg:
maxItems: 1
@@ -29,6 +31,9 @@ properties:
items:
- const: emc
+ interrupts:
+ maxItems: 1
+
"#interconnect-cells":
const: 0
@@ -164,153 +169,10 @@ patternProperties:
nvidia,emc-configuration:
description:
EMC timing characterization data. These are the registers (see
- section "15.6.2 EMC Registers" in the TRM) whose values need to
+ section "20.11.2 EMC Registers" in the Tegra114 TRM or section
+ "15.6.2 EMC Registers" in the Tegra124 TRM) whose values need to
be specified, according to the board documentation.
$ref: /schemas/types.yaml#/definitions/uint32-array
- items:
- - description: EMC_RC
- - description: EMC_RFC
- - description: EMC_RFC_SLR
- - description: EMC_RAS
- - description: EMC_RP
- - description: EMC_R2W
- - description: EMC_W2R
- - description: EMC_R2P
- - description: EMC_W2P
- - description: EMC_RD_RCD
- - description: EMC_WR_RCD
- - description: EMC_RRD
- - description: EMC_REXT
- - description: EMC_WEXT
- - description: EMC_WDV
- - description: EMC_WDV_MASK
- - description: EMC_QUSE
- - description: EMC_QUSE_WIDTH
- - description: EMC_IBDLY
- - description: EMC_EINPUT
- - description: EMC_EINPUT_DURATION
- - description: EMC_PUTERM_EXTRA
- - description: EMC_PUTERM_WIDTH
- - description: EMC_PUTERM_ADJ
- - description: EMC_CDB_CNTL_1
- - description: EMC_CDB_CNTL_2
- - description: EMC_CDB_CNTL_3
- - description: EMC_QRST
- - description: EMC_QSAFE
- - description: EMC_RDV
- - description: EMC_RDV_MASK
- - description: EMC_REFRESH
- - description: EMC_BURST_REFRESH_NUM
- - description: EMC_PRE_REFRESH_REQ_CNT
- - description: EMC_PDEX2WR
- - description: EMC_PDEX2RD
- - description: EMC_PCHG2PDEN
- - description: EMC_ACT2PDEN
- - description: EMC_AR2PDEN
- - description: EMC_RW2PDEN
- - description: EMC_TXSR
- - description: EMC_TXSRDLL
- - description: EMC_TCKE
- - description: EMC_TCKESR
- - description: EMC_TPD
- - description: EMC_TFAW
- - description: EMC_TRPAB
- - description: EMC_TCLKSTABLE
- - description: EMC_TCLKSTOP
- - description: EMC_TREFBW
- - description: EMC_FBIO_CFG6
- - description: EMC_ODT_WRITE
- - description: EMC_ODT_READ
- - description: EMC_FBIO_CFG5
- - description: EMC_CFG_DIG_DLL
- - description: EMC_CFG_DIG_DLL_PERIOD
- - description: EMC_DLL_XFORM_DQS0
- - description: EMC_DLL_XFORM_DQS1
- - description: EMC_DLL_XFORM_DQS2
- - description: EMC_DLL_XFORM_DQS3
- - description: EMC_DLL_XFORM_DQS4
- - description: EMC_DLL_XFORM_DQS5
- - description: EMC_DLL_XFORM_DQS6
- - description: EMC_DLL_XFORM_DQS7
- - description: EMC_DLL_XFORM_DQS8
- - description: EMC_DLL_XFORM_DQS9
- - description: EMC_DLL_XFORM_DQS10
- - description: EMC_DLL_XFORM_DQS11
- - description: EMC_DLL_XFORM_DQS12
- - description: EMC_DLL_XFORM_DQS13
- - description: EMC_DLL_XFORM_DQS14
- - description: EMC_DLL_XFORM_DQS15
- - description: EMC_DLL_XFORM_QUSE0
- - description: EMC_DLL_XFORM_QUSE1
- - description: EMC_DLL_XFORM_QUSE2
- - description: EMC_DLL_XFORM_QUSE3
- - description: EMC_DLL_XFORM_QUSE4
- - description: EMC_DLL_XFORM_QUSE5
- - description: EMC_DLL_XFORM_QUSE6
- - description: EMC_DLL_XFORM_QUSE7
- - description: EMC_DLL_XFORM_ADDR0
- - description: EMC_DLL_XFORM_ADDR1
- - description: EMC_DLL_XFORM_ADDR2
- - description: EMC_DLL_XFORM_ADDR3
- - description: EMC_DLL_XFORM_ADDR4
- - description: EMC_DLL_XFORM_ADDR5
- - description: EMC_DLL_XFORM_QUSE8
- - description: EMC_DLL_XFORM_QUSE9
- - description: EMC_DLL_XFORM_QUSE10
- - description: EMC_DLL_XFORM_QUSE11
- - description: EMC_DLL_XFORM_QUSE12
- - description: EMC_DLL_XFORM_QUSE13
- - description: EMC_DLL_XFORM_QUSE14
- - description: EMC_DLL_XFORM_QUSE15
- - description: EMC_DLI_TRIM_TXDQS0
- - description: EMC_DLI_TRIM_TXDQS1
- - description: EMC_DLI_TRIM_TXDQS2
- - description: EMC_DLI_TRIM_TXDQS3
- - description: EMC_DLI_TRIM_TXDQS4
- - description: EMC_DLI_TRIM_TXDQS5
- - description: EMC_DLI_TRIM_TXDQS6
- - description: EMC_DLI_TRIM_TXDQS7
- - description: EMC_DLI_TRIM_TXDQS8
- - description: EMC_DLI_TRIM_TXDQS9
- - description: EMC_DLI_TRIM_TXDQS10
- - description: EMC_DLI_TRIM_TXDQS11
- - description: EMC_DLI_TRIM_TXDQS12
- - description: EMC_DLI_TRIM_TXDQS13
- - description: EMC_DLI_TRIM_TXDQS14
- - description: EMC_DLI_TRIM_TXDQS15
- - description: EMC_DLL_XFORM_DQ0
- - description: EMC_DLL_XFORM_DQ1
- - description: EMC_DLL_XFORM_DQ2
- - description: EMC_DLL_XFORM_DQ3
- - description: EMC_DLL_XFORM_DQ4
- - description: EMC_DLL_XFORM_DQ5
- - description: EMC_DLL_XFORM_DQ6
- - description: EMC_DLL_XFORM_DQ7
- - description: EMC_XM2CMDPADCTRL
- - description: EMC_XM2CMDPADCTRL4
- - description: EMC_XM2CMDPADCTRL5
- - description: EMC_XM2DQPADCTRL2
- - description: EMC_XM2DQPADCTRL3
- - description: EMC_XM2CLKPADCTRL
- - description: EMC_XM2CLKPADCTRL2
- - description: EMC_XM2COMPPADCTRL
- - description: EMC_XM2VTTGENPADCTRL
- - description: EMC_XM2VTTGENPADCTRL2
- - description: EMC_XM2VTTGENPADCTRL3
- - description: EMC_XM2DQSPADCTRL3
- - description: EMC_XM2DQSPADCTRL4
- - description: EMC_XM2DQSPADCTRL5
- - description: EMC_XM2DQSPADCTRL6
- - description: EMC_DSR_VTTGEN_DRV
- - description: EMC_TXDSRVTTGEN
- - description: EMC_FBIO_SPARE
- - description: EMC_ZCAL_WAIT_CNT
- - description: EMC_MRS_WAIT_CNT2
- - description: EMC_CTT
- - description: EMC_CTT_DURATION
- - description: EMC_CFG_PIPE
- - description: EMC_DYN_SELF_REF_CONTROL
- - description: EMC_QPOP
required:
- clock-frequency
@@ -318,9 +180,7 @@ patternProperties:
- nvidia,emc-auto-cal-config2
- nvidia,emc-auto-cal-config3
- nvidia,emc-auto-cal-interval
- - nvidia,emc-bgbias-ctl0
- nvidia,emc-cfg
- - nvidia,emc-cfg-2
- nvidia,emc-ctt-term-ctrl
- nvidia,emc-mode-1
- nvidia,emc-mode-2
@@ -344,6 +204,281 @@ required:
- "#interconnect-cells"
- operating-points-v2
+allOf:
+ - if:
+ properties:
+ compatible:
+ contains:
+ enum:
+ - nvidia,tegra114-emc
+ then:
+ patternProperties:
+ "^emc-timings-[0-9]+$":
+ patternProperties:
+ "^timing-[0-9]+$":
+ properties:
+ nvidia,emc-configuration:
+ items:
+ - description: EMC_RC
+ - description: EMC_RFC
+ - description: EMC_RAS
+ - description: EMC_RP
+ - description: EMC_R2W
+ - description: EMC_W2R
+ - description: EMC_R2P
+ - description: EMC_W2P
+ - description: EMC_RD_RCD
+ - description: EMC_WR_RCD
+ - description: EMC_RRD
+ - description: EMC_REXT
+ - description: EMC_WEXT
+ - description: EMC_WDV
+ - description: EMC_WDV_MASK
+ - description: EMC_QUSE
+ - description: EMC_IBDLY
+ - description: EMC_EINPUT
+ - description: EMC_EINPUT_DURATION
+ - description: EMC_PUTERM_EXTRA
+ - description: EMC_CDB_CNTL_1
+ - description: EMC_CDB_CNTL_2
+ - description: EMC_QRST
+ - description: EMC_QSAFE
+ - description: EMC_RDV
+ - description: EMC_RDV_MASK
+ - description: EMC_REFRESH
+ - description: EMC_BURST_REFRESH_NUM
+ - description: EMC_PRE_REFRESH_REQ_CNT
+ - description: EMC_PDEX2WR
+ - description: EMC_PDEX2RD
+ - description: EMC_PCHG2PDEN
+ - description: EMC_ACT2PDEN
+ - description: EMC_AR2PDEN
+ - description: EMC_RW2PDEN
+ - description: EMC_TXSR
+ - description: EMC_TXSRDLL
+ - description: EMC_TCKE
+ - description: EMC_TCKESR
+ - description: EMC_TPD
+ - description: EMC_TFAW
+ - description: EMC_TRPAB
+ - description: EMC_TCLKSTABLE
+ - description: EMC_TCLKSTOP
+ - description: EMC_TREFBW
+ - description: EMC_QUSE_EXTRA
+ - description: EMC_FBIO_CFG6
+ - description: EMC_ODT_WRITE
+ - description: EMC_ODT_READ
+ - description: EMC_FBIO_CFG5
+ - description: EMC_CFG_DIG_DLL
+ - description: EMC_CFG_DIG_DLL_PERIOD
+ - description: EMC_DLL_XFORM_DQS0
+ - description: EMC_DLL_XFORM_DQS1
+ - description: EMC_DLL_XFORM_DQS2
+ - description: EMC_DLL_XFORM_DQS3
+ - description: EMC_DLL_XFORM_DQS4
+ - description: EMC_DLL_XFORM_DQS5
+ - description: EMC_DLL_XFORM_DQS6
+ - description: EMC_DLL_XFORM_DQS7
+ - description: EMC_DLL_XFORM_QUSE0
+ - description: EMC_DLL_XFORM_QUSE1
+ - description: EMC_DLL_XFORM_QUSE2
+ - description: EMC_DLL_XFORM_QUSE3
+ - description: EMC_DLL_XFORM_QUSE4
+ - description: EMC_DLL_XFORM_QUSE5
+ - description: EMC_DLL_XFORM_QUSE6
+ - description: EMC_DLL_XFORM_QUSE7
+ - description: EMC_DLI_TRIM_TXDQS0
+ - description: EMC_DLI_TRIM_TXDQS1
+ - description: EMC_DLI_TRIM_TXDQS2
+ - description: EMC_DLI_TRIM_TXDQS3
+ - description: EMC_DLI_TRIM_TXDQS4
+ - description: EMC_DLI_TRIM_TXDQS5
+ - description: EMC_DLI_TRIM_TXDQS6
+ - description: EMC_DLI_TRIM_TXDQS7
+ - description: EMC_DLL_XFORM_DQ0
+ - description: EMC_DLL_XFORM_DQ1
+ - description: EMC_DLL_XFORM_DQ2
+ - description: EMC_DLL_XFORM_DQ3
+ - description: EMC_XM2CMDPADCTRL
+ - description: EMC_XM2CMDPADCTRL4
+ - description: EMC_XM2DQPADCTRL2
+ - description: EMC_XM2CLKPADCTRL
+ - description: EMC_XM2COMPPADCTRL
+ - description: EMC_XM2VTTGENPADCTRL
+ - description: EMC_XM2VTTGENPADCTRL2
+ - description: EMC_XM2DQSPADCTRL3
+ - description: EMC_XM2DQSPADCTRL4
+ - description: EMC_DSR_VTTGEN_DRV
+ - description: EMC_TXDSRVTTGEN
+ - description: EMC_FBIO_SPARE
+ - description: EMC_ZCAL_WAIT_CNT
+ - description: EMC_MRS_WAIT_CNT2
+ - description: EMC_CTT
+ - description: EMC_CTT_DURATION
+ - description: EMC_DYN_SELF_REF_CONTROL
+
+ - if:
+ properties:
+ compatible:
+ contains:
+ enum:
+ - nvidia,tegra124-emc
+ then:
+ patternProperties:
+ "^emc-timings-[0-9]+$":
+ patternProperties:
+ "^timing-[0-9]+$":
+ properties:
+ nvidia,emc-configuration:
+ items:
+ - description: EMC_RC
+ - description: EMC_RFC
+ - description: EMC_RFC_SLR
+ - description: EMC_RAS
+ - description: EMC_RP
+ - description: EMC_R2W
+ - description: EMC_W2R
+ - description: EMC_R2P
+ - description: EMC_W2P
+ - description: EMC_RD_RCD
+ - description: EMC_WR_RCD
+ - description: EMC_RRD
+ - description: EMC_REXT
+ - description: EMC_WEXT
+ - description: EMC_WDV
+ - description: EMC_WDV_MASK
+ - description: EMC_QUSE
+ - description: EMC_QUSE_WIDTH
+ - description: EMC_IBDLY
+ - description: EMC_EINPUT
+ - description: EMC_EINPUT_DURATION
+ - description: EMC_PUTERM_EXTRA
+ - description: EMC_PUTERM_WIDTH
+ - description: EMC_PUTERM_ADJ
+ - description: EMC_CDB_CNTL_1
+ - description: EMC_CDB_CNTL_2
+ - description: EMC_CDB_CNTL_3
+ - description: EMC_QRST
+ - description: EMC_QSAFE
+ - description: EMC_RDV
+ - description: EMC_RDV_MASK
+ - description: EMC_REFRESH
+ - description: EMC_BURST_REFRESH_NUM
+ - description: EMC_PRE_REFRESH_REQ_CNT
+ - description: EMC_PDEX2WR
+ - description: EMC_PDEX2RD
+ - description: EMC_PCHG2PDEN
+ - description: EMC_ACT2PDEN
+ - description: EMC_AR2PDEN
+ - description: EMC_RW2PDEN
+ - description: EMC_TXSR
+ - description: EMC_TXSRDLL
+ - description: EMC_TCKE
+ - description: EMC_TCKESR
+ - description: EMC_TPD
+ - description: EMC_TFAW
+ - description: EMC_TRPAB
+ - description: EMC_TCLKSTABLE
+ - description: EMC_TCLKSTOP
+ - description: EMC_TREFBW
+ - description: EMC_FBIO_CFG6
+ - description: EMC_ODT_WRITE
+ - description: EMC_ODT_READ
+ - description: EMC_FBIO_CFG5
+ - description: EMC_CFG_DIG_DLL
+ - description: EMC_CFG_DIG_DLL_PERIOD
+ - description: EMC_DLL_XFORM_DQS0
+ - description: EMC_DLL_XFORM_DQS1
+ - description: EMC_DLL_XFORM_DQS2
+ - description: EMC_DLL_XFORM_DQS3
+ - description: EMC_DLL_XFORM_DQS4
+ - description: EMC_DLL_XFORM_DQS5
+ - description: EMC_DLL_XFORM_DQS6
+ - description: EMC_DLL_XFORM_DQS7
+ - description: EMC_DLL_XFORM_DQS8
+ - description: EMC_DLL_XFORM_DQS9
+ - description: EMC_DLL_XFORM_DQS10
+ - description: EMC_DLL_XFORM_DQS11
+ - description: EMC_DLL_XFORM_DQS12
+ - description: EMC_DLL_XFORM_DQS13
+ - description: EMC_DLL_XFORM_DQS14
+ - description: EMC_DLL_XFORM_DQS15
+ - description: EMC_DLL_XFORM_QUSE0
+ - description: EMC_DLL_XFORM_QUSE1
+ - description: EMC_DLL_XFORM_QUSE2
+ - description: EMC_DLL_XFORM_QUSE3
+ - description: EMC_DLL_XFORM_QUSE4
+ - description: EMC_DLL_XFORM_QUSE5
+ - description: EMC_DLL_XFORM_QUSE6
+ - description: EMC_DLL_XFORM_QUSE7
+ - description: EMC_DLL_XFORM_ADDR0
+ - description: EMC_DLL_XFORM_ADDR1
+ - description: EMC_DLL_XFORM_ADDR2
+ - description: EMC_DLL_XFORM_ADDR3
+ - description: EMC_DLL_XFORM_ADDR4
+ - description: EMC_DLL_XFORM_ADDR5
+ - description: EMC_DLL_XFORM_QUSE8
+ - description: EMC_DLL_XFORM_QUSE9
+ - description: EMC_DLL_XFORM_QUSE10
+ - description: EMC_DLL_XFORM_QUSE11
+ - description: EMC_DLL_XFORM_QUSE12
+ - description: EMC_DLL_XFORM_QUSE13
+ - description: EMC_DLL_XFORM_QUSE14
+ - description: EMC_DLL_XFORM_QUSE15
+ - description: EMC_DLI_TRIM_TXDQS0
+ - description: EMC_DLI_TRIM_TXDQS1
+ - description: EMC_DLI_TRIM_TXDQS2
+ - description: EMC_DLI_TRIM_TXDQS3
+ - description: EMC_DLI_TRIM_TXDQS4
+ - description: EMC_DLI_TRIM_TXDQS5
+ - description: EMC_DLI_TRIM_TXDQS6
+ - description: EMC_DLI_TRIM_TXDQS7
+ - description: EMC_DLI_TRIM_TXDQS8
+ - description: EMC_DLI_TRIM_TXDQS9
+ - description: EMC_DLI_TRIM_TXDQS10
+ - description: EMC_DLI_TRIM_TXDQS11
+ - description: EMC_DLI_TRIM_TXDQS12
+ - description: EMC_DLI_TRIM_TXDQS13
+ - description: EMC_DLI_TRIM_TXDQS14
+ - description: EMC_DLI_TRIM_TXDQS15
+ - description: EMC_DLL_XFORM_DQ0
+ - description: EMC_DLL_XFORM_DQ1
+ - description: EMC_DLL_XFORM_DQ2
+ - description: EMC_DLL_XFORM_DQ3
+ - description: EMC_DLL_XFORM_DQ4
+ - description: EMC_DLL_XFORM_DQ5
+ - description: EMC_DLL_XFORM_DQ6
+ - description: EMC_DLL_XFORM_DQ7
+ - description: EMC_XM2CMDPADCTRL
+ - description: EMC_XM2CMDPADCTRL4
+ - description: EMC_XM2CMDPADCTRL5
+ - description: EMC_XM2DQPADCTRL2
+ - description: EMC_XM2DQPADCTRL3
+ - description: EMC_XM2CLKPADCTRL
+ - description: EMC_XM2CLKPADCTRL2
+ - description: EMC_XM2COMPPADCTRL
+ - description: EMC_XM2VTTGENPADCTRL
+ - description: EMC_XM2VTTGENPADCTRL2
+ - description: EMC_XM2VTTGENPADCTRL3
+ - description: EMC_XM2DQSPADCTRL3
+ - description: EMC_XM2DQSPADCTRL4
+ - description: EMC_XM2DQSPADCTRL5
+ - description: EMC_XM2DQSPADCTRL6
+ - description: EMC_DSR_VTTGEN_DRV
+ - description: EMC_TXDSRVTTGEN
+ - description: EMC_FBIO_SPARE
+ - description: EMC_ZCAL_WAIT_CNT
+ - description: EMC_MRS_WAIT_CNT2
+ - description: EMC_CTT
+ - description: EMC_CTT_DURATION
+ - description: EMC_CFG_PIPE
+ - description: EMC_DYN_SELF_REF_CONTROL
+ - description: EMC_QPOP
+
+ required:
+ - nvidia,emc-bgbias-ctl0
+ - nvidia,emc-cfg-2
+
additionalProperties: false
examples:
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (6 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 07/11] dt-bindings: memory: Document Tegra114 External Memory Controller Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-11-18 7:08 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 09/11] ARM: tegra: Add External Memory Controller node on Tegra114 Svyatoslav Ryhel
` (2 subsequent siblings)
10 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Introduce driver for the External Memory Controller (EMC) found in Tegra114
SoC. It controls the external DRAM on the board. The purpose of this
driver is to program memory timing for external memory on the EMC clock
rate change.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
drivers/memory/tegra/Kconfig | 12 +
drivers/memory/tegra/Makefile | 1 +
drivers/memory/tegra/tegra114-emc.c | 1487 +++++++++++++++++++++++++++
3 files changed, 1500 insertions(+)
create mode 100644 drivers/memory/tegra/tegra114-emc.c
diff --git a/drivers/memory/tegra/Kconfig b/drivers/memory/tegra/Kconfig
index fc5a27791826..11e7cc357d39 100644
--- a/drivers/memory/tegra/Kconfig
+++ b/drivers/memory/tegra/Kconfig
@@ -35,6 +35,18 @@ config TEGRA30_EMC
This driver is required to change memory timings / clock rate for
external memory.
+config TEGRA114_EMC
+ tristate "NVIDIA Tegra114 External Memory Controller driver"
+ default y
+ depends on ARCH_TEGRA_114_SOC || COMPILE_TEST
+ select TEGRA124_CLK_EMC if ARCH_TEGRA
+ select PM_OPP
+ help
+ This driver is for the External Memory Controller (EMC) found on
+ Tegra114 chips. The EMC controls the external DRAM on the board.
+ This driver is required to change memory timings / clock rate for
+ external memory.
+
config TEGRA124_EMC
tristate "NVIDIA Tegra124 External Memory Controller driver"
default ARCH_TEGRA_124_SOC
diff --git a/drivers/memory/tegra/Makefile b/drivers/memory/tegra/Makefile
index 0750847dac3c..d36be28efc4a 100644
--- a/drivers/memory/tegra/Makefile
+++ b/drivers/memory/tegra/Makefile
@@ -15,6 +15,7 @@ obj-$(CONFIG_TEGRA_MC) += tegra-mc.o
obj-$(CONFIG_TEGRA20_EMC) += tegra20-emc.o
obj-$(CONFIG_TEGRA30_EMC) += tegra30-emc.o
+obj-$(CONFIG_TEGRA114_EMC) += tegra114-emc.o
obj-$(CONFIG_TEGRA124_EMC) += tegra124-emc.o
obj-$(CONFIG_TEGRA210_EMC_TABLE) += tegra210-emc-table.o
obj-$(CONFIG_TEGRA210_EMC) += tegra210-emc.o
diff --git a/drivers/memory/tegra/tegra114-emc.c b/drivers/memory/tegra/tegra114-emc.c
new file mode 100644
index 000000000000..b986b5509f41
--- /dev/null
+++ b/drivers/memory/tegra/tegra114-emc.c
@@ -0,0 +1,1487 @@
+// SPDX-License-Identifier: GPL-2.0-only
+/*
+ * Tegra114 External Memory Controller driver
+ *
+ * Based on downstream driver from NVIDIA and tegra124-emc.c
+ * Copyright (C) 2011-2014 NVIDIA Corporation
+ *
+ * Copyright (C) 2024 Svyatoslav Ryhel <clamor95@gmail.com>
+ */
+
+#include <linux/clk-provider.h>
+#include <linux/clk.h>
+#include <linux/clkdev.h>
+#include <linux/clk/tegra.h>
+#include <linux/debugfs.h>
+#include <linux/delay.h>
+#include <linux/interconnect-provider.h>
+#include <linux/interrupt.h>
+#include <linux/io.h>
+#include <linux/module.h>
+#include <linux/mutex.h>
+#include <linux/of_address.h>
+#include <linux/of_platform.h>
+#include <linux/platform_device.h>
+#include <linux/pm_opp.h>
+#include <linux/sort.h>
+#include <linux/string.h>
+
+#include <soc/tegra/fuse.h>
+#include <soc/tegra/mc.h>
+
+#include "mc.h"
+
+#define EMC_INTSTATUS 0x0
+#define EMC_REFRESH_OVERFLOW_INT BIT(3)
+#define EMC_INTSTATUS_CLKCHANGE_COMPLETE BIT(4)
+
+#define EMC_INTMASK 0x4
+
+#define EMC_DBG 0x8
+#define EMC_DBG_READ_MUX_ASSEMBLY BIT(0)
+#define EMC_DBG_WRITE_MUX_ACTIVE BIT(1)
+#define EMC_DBG_FORCE_UPDATE BIT(2)
+#define EMC_DBG_CFG_PRIORITY BIT(24)
+
+#define EMC_CFG 0xc
+#define EMC_CFG_DRAM_CLKSTOP_PD BIT(31)
+#define EMC_CFG_DRAM_CLKSTOP_SR BIT(30)
+#define EMC_CFG_DRAM_ACPD BIT(29)
+#define EMC_CFG_DYN_SREF BIT(28)
+#define EMC_CFG_PWR_MASK ((0xF << 28) | BIT(18))
+#define EMC_CFG_DSR_VTTGEN_DRV_EN BIT(18)
+
+#define EMC_ADR_CFG 0x10
+#define EMC_ADR_CFG_EMEM_NUMDEV BIT(0)
+
+#define EMC_REFCTRL 0x20
+#define EMC_REFCTRL_DEV_SEL_SHIFT 0
+#define EMC_REFCTRL_ENABLE BIT(31)
+
+#define EMC_TIMING_CONTROL 0x28
+#define EMC_RC 0x2c
+#define EMC_RFC 0x30
+#define EMC_RAS 0x34
+#define EMC_RP 0x38
+#define EMC_R2W 0x3c
+#define EMC_W2R 0x40
+#define EMC_R2P 0x44
+#define EMC_W2P 0x48
+#define EMC_RD_RCD 0x4c
+#define EMC_WR_RCD 0x50
+#define EMC_RRD 0x54
+#define EMC_REXT 0x58
+#define EMC_WDV 0x5c
+#define EMC_QUSE 0x60
+#define EMC_QRST 0x64
+#define EMC_QSAFE 0x68
+#define EMC_RDV 0x6c
+#define EMC_REFRESH 0x70
+#define EMC_BURST_REFRESH_NUM 0x74
+#define EMC_PDEX2WR 0x78
+#define EMC_PDEX2RD 0x7c
+#define EMC_PCHG2PDEN 0x80
+#define EMC_ACT2PDEN 0x84
+#define EMC_AR2PDEN 0x88
+#define EMC_RW2PDEN 0x8c
+#define EMC_TXSR 0x90
+#define EMC_TCKE 0x94
+#define EMC_TFAW 0x98
+#define EMC_TRPAB 0x9c
+#define EMC_TCLKSTABLE 0xa0
+#define EMC_TCLKSTOP 0xa4
+#define EMC_TREFBW 0xa8
+#define EMC_QUSE_EXTRA 0xac
+#define EMC_ODT_WRITE 0xb0
+#define EMC_ODT_READ 0xb4
+#define EMC_WEXT 0xb8
+#define EMC_CTT 0xbc
+#define EMC_RFC_SLR 0xc0
+#define EMC_MRS_WAIT_CNT2 0xc4
+
+#define EMC_MRS_WAIT_CNT 0xc8
+#define EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT 0
+#define EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK \
+ (0x3FF << EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT)
+#define EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT 16
+#define EMC_MRS_WAIT_CNT_LONG_WAIT_MASK \
+ (0x3FF << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
+
+#define EMC_MRS 0xcc
+#define EMC_MODE_SET_DLL_RESET BIT(8)
+#define EMC_MODE_SET_LONG_CNT BIT(26)
+#define EMC_EMRS 0xd0
+#define EMC_REF 0xd4
+#define EMC_PRE 0xd8
+
+#define EMC_SELF_REF 0xe0
+#define EMC_SELF_REF_CMD_ENABLED BIT(0)
+#define EMC_SELF_REF_DEV_SEL_SHIFT 30
+
+#define EMC_MRW 0xe8
+
+#define EMC_MRR 0xec
+#define EMC_MRR_MA_SHIFT 16
+#define LPDDR2_MR4_TEMP_SHIFT 0
+
+#define EMC_XM2DQSPADCTRL3 0xf8
+#define EMC_FBIO_SPARE 0x100
+
+#define EMC_FBIO_CFG5 0x104
+#define EMC_FBIO_CFG5_DRAM_TYPE_MASK 0x3
+#define EMC_FBIO_CFG5_DRAM_TYPE_SHIFT 0
+
+#define EMC_FBIO_CFG6 0x114
+#define EMC_EMRS2 0x12c
+#define EMC_MRW2 0x134
+#define EMC_MRW4 0x13c
+#define EMC_EINPUT 0x14c
+#define EMC_EINPUT_DURATION 0x150
+#define EMC_PUTERM_EXTRA 0x154
+#define EMC_TCKESR 0x158
+#define EMC_TPD 0x15c
+
+#define EMC_AUTO_CAL_CONFIG 0x2a4
+#define EMC_AUTO_CAL_CONFIG_AUTO_CAL_START BIT(31)
+#define EMC_AUTO_CAL_INTERVAL 0x2a8
+#define EMC_AUTO_CAL_STATUS 0x2ac
+#define EMC_AUTO_CAL_STATUS_ACTIVE BIT(31)
+#define EMC_STATUS 0x2b4
+#define EMC_STATUS_TIMING_UPDATE_STALLED BIT(23)
+
+#define EMC_CFG_2 0x2b8
+#define EMC_CLKCHANGE_REQ_ENABLE BIT(0)
+#define EMC_CLKCHANGE_PD_ENABLE BIT(1)
+#define EMC_CLKCHANGE_SR_ENABLE BIT(2)
+
+#define EMC_CFG_DIG_DLL 0x2bc
+#define EMC_CFG_DIG_DLL_PERIOD 0x2c0
+#define EMC_RDV_MASK 0x2cc
+#define EMC_WDV_MASK 0x2d0
+#define EMC_CTT_DURATION 0x2d8
+#define EMC_CTT_TERM_CTRL 0x2dc
+#define EMC_ZCAL_INTERVAL 0x2e0
+#define EMC_ZCAL_WAIT_CNT 0x2e4
+
+#define EMC_ZQ_CAL 0x2ec
+#define EMC_ZQ_CAL_CMD BIT(0)
+#define EMC_ZQ_CAL_LONG BIT(4)
+#define EMC_ZQ_CAL_LONG_CMD_DEV0 \
+ (DRAM_DEV_SEL_0 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
+#define EMC_ZQ_CAL_LONG_CMD_DEV1 \
+ (DRAM_DEV_SEL_1 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
+
+#define EMC_XM2CMDPADCTRL 0x2f0
+#define EMC_XM2DQSPADCTRL 0x2f8
+#define EMC_XM2DQSPADCTRL2 0x2fc
+#define EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE BIT(0)
+#define EMC_XM2DQSPADCTRL2_VREF_ENABLE BIT(5)
+#define EMC_XM2DQPADCTRL 0x300
+#define EMC_XM2DQPADCTRL2 0x304
+#define EMC_XM2CLKPADCTRL 0x308
+#define EMC_XM2COMPPADCTRL 0x30c
+#define EMC_XM2VTTGENPADCTRL 0x310
+#define EMC_XM2VTTGENPADCTRL2 0x314
+#define EMC_XM2QUSEPADCTRL 0x318
+#define EMC_XM2DQSPADCTRL4 0x320
+#define EMC_DLL_XFORM_DQS0 0x328
+#define EMC_DLL_XFORM_DQS1 0x32c
+#define EMC_DLL_XFORM_DQS2 0x330
+#define EMC_DLL_XFORM_DQS3 0x334
+#define EMC_DLL_XFORM_DQS4 0x338
+#define EMC_DLL_XFORM_DQS5 0x33c
+#define EMC_DLL_XFORM_DQS6 0x340
+#define EMC_DLL_XFORM_DQS7 0x344
+#define EMC_DLL_XFORM_QUSE0 0x348
+#define EMC_DLL_XFORM_QUSE1 0x34c
+#define EMC_DLL_XFORM_QUSE2 0x350
+#define EMC_DLL_XFORM_QUSE3 0x354
+#define EMC_DLL_XFORM_QUSE4 0x358
+#define EMC_DLL_XFORM_QUSE5 0x35c
+#define EMC_DLL_XFORM_QUSE6 0x360
+#define EMC_DLL_XFORM_QUSE7 0x364
+#define EMC_DLL_XFORM_DQ0 0x368
+#define EMC_DLL_XFORM_DQ1 0x36c
+#define EMC_DLL_XFORM_DQ2 0x370
+#define EMC_DLL_XFORM_DQ3 0x374
+#define EMC_DLI_TRIM_TXDQS0 0x3a8
+#define EMC_DLI_TRIM_TXDQS1 0x3ac
+#define EMC_DLI_TRIM_TXDQS2 0x3b0
+#define EMC_DLI_TRIM_TXDQS3 0x3b4
+#define EMC_DLI_TRIM_TXDQS4 0x3b8
+#define EMC_DLI_TRIM_TXDQS5 0x3bc
+#define EMC_DLI_TRIM_TXDQS6 0x3c0
+#define EMC_DLI_TRIM_TXDQS7 0x3c4
+#define EMC_STALL_THEN_EXE_AFTER_CLKCHANGE 0x3cc
+#define EMC_SEL_DPD_CTRL 0x3d8
+#define EMC_SEL_DPD_CTRL_DATA_SEL_DPD BIT(8)
+#define EMC_SEL_DPD_CTRL_ODT_SEL_DPD BIT(5)
+#define EMC_SEL_DPD_CTRL_RESET_SEL_DPD BIT(4)
+#define EMC_SEL_DPD_CTRL_CA_SEL_DPD BIT(3)
+#define EMC_SEL_DPD_CTRL_CLK_SEL_DPD BIT(2)
+#define EMC_SEL_DPD_CTRL_DDR3_MASK \
+ ((0xf << 2) | BIT(8))
+#define EMC_SEL_DPD_CTRL_MASK \
+ ((0x3 << 2) | BIT(5) | BIT(8))
+#define EMC_PRE_REFRESH_REQ_CNT 0x3dc
+#define EMC_DYN_SELF_REF_CONTROL 0x3e0
+#define EMC_TXSRDLL 0x3e4
+#define EMC_CCFIFO_ADDR 0x3e8
+#define EMC_CCFIFO_DATA 0x3ec
+#define EMC_CCFIFO_STATUS 0x3f0
+#define EMC_CDB_CNTL_1 0x3f4
+#define EMC_CDB_CNTL_2 0x3f8
+#define EMC_XM2CLKPADCTRL2 0x3fc
+#define EMC_AUTO_CAL_CONFIG2 0x458
+#define EMC_AUTO_CAL_CONFIG3 0x45c
+#define EMC_IBDLY 0x468
+#define EMC_DLL_XFORM_ADDR0 0x46c
+#define EMC_DLL_XFORM_ADDR1 0x470
+#define EMC_DLL_XFORM_ADDR2 0x474
+#define EMC_DSR_VTTGEN_DRV 0x47c
+#define EMC_TXDSRVTTGEN 0x480
+#define EMC_XM2CMDPADCTRL4 0x484
+
+#define DRAM_DEV_SEL_ALL 0
+#define DRAM_DEV_SEL_0 BIT(31)
+#define DRAM_DEV_SEL_1 BIT(30)
+
+#define EMC_CFG_POWER_FEATURES_MASK \
+ (EMC_CFG_DYN_SREF | EMC_CFG_DRAM_ACPD | EMC_CFG_DRAM_CLKSTOP_SR | \
+ EMC_CFG_DRAM_CLKSTOP_PD | EMC_CFG_DSR_VTTGEN_DRV_EN)
+#define EMC_REFCTRL_DEV_SEL(n) ((((n) > 1) ? 0 : 2) << EMC_REFCTRL_DEV_SEL_SHIFT)
+#define EMC_DRAM_DEV_SEL(n) (((n) > 1) ? DRAM_DEV_SEL_ALL : DRAM_DEV_SEL_0)
+
+/* Maximum amount of time in us. to wait for changes to become effective */
+#define EMC_STATUS_UPDATE_TIMEOUT 1000
+
+enum emc_dram_type {
+ DRAM_TYPE_DDR3,
+ DRAM_TYPE_DDR1,
+ DRAM_TYPE_LPDDR2,
+ DRAM_TYPE_DDR2
+};
+
+enum emc_dll_change {
+ DLL_CHANGE_NONE,
+ DLL_CHANGE_ON,
+ DLL_CHANGE_OFF
+};
+
+static const unsigned long emc_burst_regs[] = {
+ EMC_RC,
+ EMC_RFC,
+ EMC_RAS,
+ EMC_RP,
+ EMC_R2W,
+ EMC_W2R,
+ EMC_R2P,
+ EMC_W2P,
+ EMC_RD_RCD,
+ EMC_WR_RCD,
+ EMC_RRD,
+ EMC_REXT,
+ EMC_WEXT,
+ EMC_WDV,
+ EMC_WDV_MASK,
+ EMC_QUSE,
+ EMC_IBDLY,
+ EMC_EINPUT,
+ EMC_EINPUT_DURATION,
+ EMC_PUTERM_EXTRA,
+ EMC_CDB_CNTL_1,
+ EMC_CDB_CNTL_2,
+ EMC_QRST,
+ EMC_QSAFE,
+ EMC_RDV,
+ EMC_RDV_MASK,
+ EMC_REFRESH,
+ EMC_BURST_REFRESH_NUM,
+ EMC_PRE_REFRESH_REQ_CNT,
+ EMC_PDEX2WR,
+ EMC_PDEX2RD,
+ EMC_PCHG2PDEN,
+ EMC_ACT2PDEN,
+ EMC_AR2PDEN,
+ EMC_RW2PDEN,
+ EMC_TXSR,
+ EMC_TXSRDLL,
+ EMC_TCKE,
+ EMC_TCKESR,
+ EMC_TPD,
+ EMC_TFAW,
+ EMC_TRPAB,
+ EMC_TCLKSTABLE,
+ EMC_TCLKSTOP,
+ EMC_TREFBW,
+ EMC_QUSE_EXTRA,
+ EMC_FBIO_CFG6,
+ EMC_ODT_WRITE,
+ EMC_ODT_READ,
+ EMC_FBIO_CFG5,
+ EMC_CFG_DIG_DLL,
+ EMC_CFG_DIG_DLL_PERIOD,
+ EMC_DLL_XFORM_DQS0,
+ EMC_DLL_XFORM_DQS1,
+ EMC_DLL_XFORM_DQS2,
+ EMC_DLL_XFORM_DQS3,
+ EMC_DLL_XFORM_DQS4,
+ EMC_DLL_XFORM_DQS5,
+ EMC_DLL_XFORM_DQS6,
+ EMC_DLL_XFORM_DQS7,
+ EMC_DLL_XFORM_QUSE0,
+ EMC_DLL_XFORM_QUSE1,
+ EMC_DLL_XFORM_QUSE2,
+ EMC_DLL_XFORM_QUSE3,
+ EMC_DLL_XFORM_QUSE4,
+ EMC_DLL_XFORM_QUSE5,
+ EMC_DLL_XFORM_QUSE6,
+ EMC_DLL_XFORM_QUSE7,
+ EMC_DLI_TRIM_TXDQS0,
+ EMC_DLI_TRIM_TXDQS1,
+ EMC_DLI_TRIM_TXDQS2,
+ EMC_DLI_TRIM_TXDQS3,
+ EMC_DLI_TRIM_TXDQS4,
+ EMC_DLI_TRIM_TXDQS5,
+ EMC_DLI_TRIM_TXDQS6,
+ EMC_DLI_TRIM_TXDQS7,
+ EMC_DLL_XFORM_DQ0,
+ EMC_DLL_XFORM_DQ1,
+ EMC_DLL_XFORM_DQ2,
+ EMC_DLL_XFORM_DQ3,
+ EMC_XM2CMDPADCTRL,
+ EMC_XM2CMDPADCTRL4,
+ EMC_XM2DQPADCTRL2,
+ EMC_XM2CLKPADCTRL,
+ EMC_XM2COMPPADCTRL,
+ EMC_XM2VTTGENPADCTRL,
+ EMC_XM2VTTGENPADCTRL2,
+ EMC_XM2DQSPADCTRL3,
+ EMC_XM2DQSPADCTRL4,
+ EMC_DSR_VTTGEN_DRV,
+ EMC_TXDSRVTTGEN,
+ EMC_FBIO_SPARE,
+ EMC_ZCAL_WAIT_CNT,
+ EMC_MRS_WAIT_CNT2,
+ EMC_CTT,
+ EMC_CTT_DURATION,
+ EMC_DYN_SELF_REF_CONTROL,
+};
+
+struct emc_timing {
+ unsigned long rate;
+
+ u32 emc_burst_data[ARRAY_SIZE(emc_burst_regs)];
+
+ u32 emc_auto_cal_config;
+ u32 emc_auto_cal_config2;
+ u32 emc_auto_cal_config3;
+ u32 emc_auto_cal_interval;
+ u32 emc_cfg;
+ u32 emc_ctt_term_ctrl;
+ u32 emc_mode_1;
+ u32 emc_mode_2;
+ u32 emc_mode_4;
+ u32 emc_mode_reset;
+ u32 emc_mrs_wait_cnt;
+ u32 emc_sel_dpd_ctrl;
+ u32 emc_xm2dqspadctrl2;
+ u32 emc_zcal_cnt_long;
+ u32 emc_zcal_interval;
+};
+
+enum emc_rate_request_type {
+ EMC_RATE_DEBUG,
+ EMC_RATE_ICC,
+ EMC_RATE_TYPE_MAX,
+};
+
+struct emc_rate_request {
+ unsigned long min_rate;
+ unsigned long max_rate;
+};
+
+struct tegra_emc {
+ struct device *dev;
+
+ struct tegra_mc *mc;
+
+ void __iomem *regs;
+
+ unsigned int irq;
+
+ struct clk *clk;
+
+ enum emc_dram_type dram_type;
+ unsigned int dram_num;
+
+ struct emc_timing last_timing;
+ struct emc_timing *timings;
+ unsigned int num_timings;
+
+ struct {
+ struct dentry *root;
+ unsigned long min_rate;
+ unsigned long max_rate;
+ } debugfs;
+
+ struct icc_provider provider;
+
+ /*
+ * There are multiple sources in the EMC driver which could request
+ * a min/max clock rate, these rates are contained in this array.
+ */
+ struct emc_rate_request requested_rate[EMC_RATE_TYPE_MAX];
+
+ /* protect shared rate-change code path */
+ struct mutex rate_lock;
+};
+
+static irqreturn_t tegra_emc_isr(int irq, void *data)
+{
+ struct tegra_emc *emc = data;
+ u32 intmask = EMC_REFRESH_OVERFLOW_INT;
+ u32 status;
+
+ status = readl_relaxed(emc->regs + EMC_INTSTATUS) & intmask;
+ if (!status)
+ return IRQ_NONE;
+
+ /* notify about HW problem */
+ if (status & EMC_REFRESH_OVERFLOW_INT)
+ dev_err_ratelimited(emc->dev,
+ "refresh request overflow timeout\n");
+
+ /* clear interrupts */
+ writel_relaxed(status, emc->regs + EMC_INTSTATUS);
+
+ return IRQ_HANDLED;
+}
+
+/* Timing change sequence functions */
+
+static void emc_ccfifo_writel(struct tegra_emc *emc, u32 value,
+ unsigned long offset)
+{
+ writel(value, emc->regs + EMC_CCFIFO_DATA);
+ writel(offset, emc->regs + EMC_CCFIFO_ADDR);
+}
+
+static void emc_seq_update_timing(struct tegra_emc *emc)
+{
+ unsigned int i;
+ u32 value;
+
+ writel(1, emc->regs + EMC_TIMING_CONTROL);
+
+ for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
+ value = readl(emc->regs + EMC_STATUS);
+ if ((value & EMC_STATUS_TIMING_UPDATE_STALLED) == 0)
+ return;
+ udelay(1);
+ }
+
+ dev_err(emc->dev, "timing update timed out\n");
+}
+
+static void emc_seq_disable_auto_cal(struct tegra_emc *emc)
+{
+ unsigned int i;
+ u32 value;
+
+ writel(0, emc->regs + EMC_AUTO_CAL_INTERVAL);
+
+ for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
+ value = readl(emc->regs + EMC_AUTO_CAL_STATUS);
+ if ((value & EMC_AUTO_CAL_STATUS_ACTIVE) == 0)
+ return;
+ udelay(1);
+ }
+
+ dev_err(emc->dev, "auto cal disable timed out\n");
+}
+
+static void emc_seq_wait_clkchange(struct tegra_emc *emc)
+{
+ unsigned int i;
+ u32 value;
+
+ for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
+ value = readl(emc->regs + EMC_INTSTATUS);
+ if (value & EMC_INTSTATUS_CLKCHANGE_COMPLETE)
+ return;
+ udelay(1);
+ }
+
+ dev_err(emc->dev, "clock change timed out\n");
+}
+
+static struct emc_timing *tegra_emc_find_timing(struct tegra_emc *emc,
+ unsigned long rate)
+{
+ struct emc_timing *timing = NULL;
+ unsigned int i;
+
+ for (i = 0; i < emc->num_timings; i++) {
+ if (emc->timings[i].rate == rate) {
+ timing = &emc->timings[i];
+ break;
+ }
+ }
+
+ if (!timing) {
+ dev_err(emc->dev, "no timing for rate %lu\n", rate);
+ return NULL;
+ }
+
+ return timing;
+}
+
+static int tegra_emc_prepare_timing_change(struct tegra_emc *emc,
+ unsigned long rate)
+{
+ struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
+ struct emc_timing *last = &emc->last_timing;
+ enum emc_dll_change dll_change;
+ unsigned int pre_wait = 0;
+ u32 val, mask;
+ bool update = false;
+ unsigned int i;
+
+ if (!timing)
+ return -ENOENT;
+
+ if ((last->emc_mode_1 & 0x1) == (timing->emc_mode_1 & 0x1))
+ dll_change = DLL_CHANGE_NONE;
+ else if (timing->emc_mode_1 & 0x1)
+ dll_change = DLL_CHANGE_ON;
+ else
+ dll_change = DLL_CHANGE_OFF;
+
+ /* Clear CLKCHANGE_COMPLETE interrupts */
+ writel(EMC_INTSTATUS_CLKCHANGE_COMPLETE, emc->regs + EMC_INTSTATUS);
+
+ /* Disable dynamic self-refresh */
+ val = readl(emc->regs + EMC_CFG);
+ if (val & EMC_CFG_PWR_MASK) {
+ val &= ~EMC_CFG_POWER_FEATURES_MASK;
+ writel(val, emc->regs + EMC_CFG);
+
+ pre_wait = 5;
+ }
+
+ /* Disable SEL_DPD_CTRL for clock change */
+ if (emc->dram_type == DRAM_TYPE_DDR3)
+ mask = EMC_SEL_DPD_CTRL_DDR3_MASK;
+ else
+ mask = EMC_SEL_DPD_CTRL_MASK;
+
+ val = readl(emc->regs + EMC_SEL_DPD_CTRL);
+ if (val & mask) {
+ val &= ~mask;
+ writel(val, emc->regs + EMC_SEL_DPD_CTRL);
+ }
+
+ /* Prepare DQ/DQS for clock change */
+ val = readl(emc->regs + EMC_XM2DQSPADCTRL2);
+ if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_VREF_ENABLE &&
+ !(val & EMC_XM2DQSPADCTRL2_VREF_ENABLE)) {
+ val |= EMC_XM2DQSPADCTRL2_VREF_ENABLE;
+ update = true;
+ }
+
+ if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE &&
+ !(val & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE)) {
+ val |= EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE;
+ update = true;
+ }
+
+ if (update) {
+ writel(val, emc->regs + EMC_XM2DQSPADCTRL2);
+ if (pre_wait < 30)
+ pre_wait = 30;
+ }
+
+ /* Wait to settle */
+ if (pre_wait) {
+ emc_seq_update_timing(emc);
+ udelay(pre_wait);
+ }
+
+ /* Program CTT_TERM control */
+ if (last->emc_ctt_term_ctrl != timing->emc_ctt_term_ctrl) {
+ emc_seq_disable_auto_cal(emc);
+ writel(timing->emc_ctt_term_ctrl,
+ emc->regs + EMC_CTT_TERM_CTRL);
+ emc_seq_update_timing(emc);
+ }
+
+ /* Program burst shadow registers */
+ for (i = 0; i < ARRAY_SIZE(timing->emc_burst_data); ++i)
+ writel(timing->emc_burst_data[i],
+ emc->regs + emc_burst_regs[i]);
+
+ writel(timing->emc_xm2dqspadctrl2, emc->regs + EMC_XM2DQSPADCTRL2);
+ writel(timing->emc_zcal_interval, emc->regs + EMC_ZCAL_INTERVAL);
+
+ tegra_mc_write_emem_configuration(emc->mc, timing->rate);
+
+ val = timing->emc_cfg & ~EMC_CFG_POWER_FEATURES_MASK;
+ emc_ccfifo_writel(emc, val, EMC_CFG);
+
+ /* Program AUTO_CAL_CONFIG */
+ if (timing->emc_auto_cal_config2 != last->emc_auto_cal_config2)
+ emc_ccfifo_writel(emc, timing->emc_auto_cal_config2,
+ EMC_AUTO_CAL_CONFIG2);
+
+ if (timing->emc_auto_cal_config3 != last->emc_auto_cal_config3)
+ emc_ccfifo_writel(emc, timing->emc_auto_cal_config3,
+ EMC_AUTO_CAL_CONFIG3);
+
+ if (timing->emc_auto_cal_config != last->emc_auto_cal_config) {
+ val = timing->emc_auto_cal_config;
+ val &= EMC_AUTO_CAL_CONFIG_AUTO_CAL_START;
+ emc_ccfifo_writel(emc, val, EMC_AUTO_CAL_CONFIG);
+ }
+
+ /* DDR3: predict MRS long wait count */
+ if (emc->dram_type == DRAM_TYPE_DDR3 &&
+ dll_change == DLL_CHANGE_ON) {
+ u32 cnt = 512;
+
+ if (timing->emc_zcal_interval != 0 &&
+ last->emc_zcal_interval == 0)
+ cnt -= emc->dram_num * 256;
+
+ val = (timing->emc_mrs_wait_cnt
+ & EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK)
+ >> EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT;
+ if (cnt < val)
+ cnt = val;
+
+ val = timing->emc_mrs_wait_cnt
+ & ~EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
+ val |= (cnt << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
+ & EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
+
+ writel(val, emc->regs + EMC_MRS_WAIT_CNT);
+ }
+
+ /* DDR3: Turn off DLL and enter self-refresh */
+ if (emc->dram_type == DRAM_TYPE_DDR3 && dll_change == DLL_CHANGE_OFF)
+ emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
+
+ /* Disable refresh controller */
+ emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num),
+ EMC_REFCTRL);
+ if (emc->dram_type == DRAM_TYPE_DDR3)
+ emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num) |
+ EMC_SELF_REF_CMD_ENABLED,
+ EMC_SELF_REF);
+
+ /* Flow control marker */
+ emc_ccfifo_writel(emc, 1, EMC_STALL_THEN_EXE_AFTER_CLKCHANGE);
+
+ /* DDR3: Exit self-refresh */
+ if (emc->dram_type == DRAM_TYPE_DDR3)
+ emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num),
+ EMC_SELF_REF);
+ emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num) |
+ EMC_REFCTRL_ENABLE,
+ EMC_REFCTRL);
+
+ /* Set DRAM mode registers */
+ if (emc->dram_type == DRAM_TYPE_DDR3) {
+ if (timing->emc_mode_1 != last->emc_mode_1)
+ emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
+ if (timing->emc_mode_2 != last->emc_mode_2)
+ emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_EMRS2);
+
+ if (timing->emc_mode_reset != last->emc_mode_reset ||
+ dll_change == DLL_CHANGE_ON) {
+ val = timing->emc_mode_reset;
+ if (dll_change == DLL_CHANGE_ON) {
+ val |= EMC_MODE_SET_DLL_RESET;
+ val |= EMC_MODE_SET_LONG_CNT;
+ } else {
+ val &= ~EMC_MODE_SET_DLL_RESET;
+ }
+ emc_ccfifo_writel(emc, val, EMC_MRS);
+ }
+ } else {
+ if (timing->emc_mode_2 != last->emc_mode_2)
+ emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_MRW2);
+ if (timing->emc_mode_1 != last->emc_mode_1)
+ emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_MRW);
+ if (timing->emc_mode_4 != last->emc_mode_4)
+ emc_ccfifo_writel(emc, timing->emc_mode_4, EMC_MRW4);
+ }
+
+ /* Issue ZCAL command if turning ZCAL on */
+ if (timing->emc_zcal_interval != 0 && last->emc_zcal_interval == 0) {
+ emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV0, EMC_ZQ_CAL);
+ if (emc->dram_num > 1)
+ emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV1,
+ EMC_ZQ_CAL);
+ }
+
+ /* Write to RO register to remove stall after change */
+ emc_ccfifo_writel(emc, 0, EMC_CCFIFO_STATUS);
+
+ /* Disable AUTO_CAL for clock change */
+ emc_seq_disable_auto_cal(emc);
+
+ /* Read register to wait until programming has settled */
+ mc_readl(emc->mc, MC_EMEM_ADR_CFG);
+
+ return 0;
+}
+
+static void tegra_emc_complete_timing_change(struct tegra_emc *emc,
+ unsigned long rate)
+{
+ struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
+ struct emc_timing *last = &emc->last_timing;
+
+ if (!timing)
+ return;
+
+ /* Wait until the state machine has settled */
+ emc_seq_wait_clkchange(emc);
+
+ /* Restore AUTO_CAL */
+ if (timing->emc_ctt_term_ctrl != last->emc_ctt_term_ctrl)
+ writel(timing->emc_auto_cal_interval,
+ emc->regs + EMC_AUTO_CAL_INTERVAL);
+
+ /* Restore dynamic self-refresh */
+ if (timing->emc_cfg & EMC_CFG_PWR_MASK)
+ writel(timing->emc_cfg, emc->regs + EMC_CFG);
+
+ /* Set ZCAL wait count */
+ writel(timing->emc_zcal_cnt_long, emc->regs + EMC_ZCAL_WAIT_CNT);
+
+ /* Wait for timing to settle */
+ udelay(2);
+
+ /* Reprogram SEL_DPD_CTRL */
+ writel(timing->emc_sel_dpd_ctrl, emc->regs + EMC_SEL_DPD_CTRL);
+ emc_seq_update_timing(emc);
+
+ emc->last_timing = *timing;
+}
+
+/* Initialization and deinitialization */
+
+static void emc_read_current_timing(struct tegra_emc *emc,
+ struct emc_timing *timing)
+{
+ unsigned int i;
+
+ for (i = 0; i < ARRAY_SIZE(emc_burst_regs); ++i)
+ timing->emc_burst_data[i] =
+ readl(emc->regs + emc_burst_regs[i]);
+
+ timing->emc_cfg = readl(emc->regs + EMC_CFG);
+
+ timing->emc_auto_cal_interval = 0;
+ timing->emc_zcal_cnt_long = 0;
+ timing->emc_mode_1 = 0;
+ timing->emc_mode_2 = 0;
+ timing->emc_mode_4 = 0;
+ timing->emc_mode_reset = 0;
+}
+
+static int emc_init(struct tegra_emc *emc)
+{
+ u32 emc_cfg, emc_dbg;
+ u32 intmask = EMC_REFRESH_OVERFLOW_INT;
+ const char *dram_type_str;
+
+ emc->dram_type = readl(emc->regs + EMC_FBIO_CFG5);
+
+ emc->dram_type &= EMC_FBIO_CFG5_DRAM_TYPE_MASK;
+ emc->dram_type >>= EMC_FBIO_CFG5_DRAM_TYPE_SHIFT;
+
+ emc->dram_num = tegra_mc_get_emem_device_count(emc->mc);
+
+ emc_cfg = readl_relaxed(emc->regs + EMC_CFG_2);
+
+ /* enable EMC and CAR to handshake on PLL divider/source changes */
+ emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
+
+ /* configure clock change mode accordingly to DRAM type */
+ switch (emc->dram_type) {
+ case DRAM_TYPE_LPDDR2:
+ emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
+ emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
+ break;
+
+ default:
+ emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
+ emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
+ break;
+ }
+
+ writel_relaxed(emc_cfg, emc->regs + EMC_CFG_2);
+
+ /* initialize interrupt */
+ writel_relaxed(intmask, emc->regs + EMC_INTMASK);
+ writel_relaxed(0xffffffff, emc->regs + EMC_INTSTATUS);
+
+ /* ensure that unwanted debug features are disabled */
+ emc_dbg = readl_relaxed(emc->regs + EMC_DBG);
+ emc_dbg |= EMC_DBG_CFG_PRIORITY;
+ emc_dbg &= ~EMC_DBG_READ_MUX_ASSEMBLY;
+ emc_dbg &= ~EMC_DBG_WRITE_MUX_ACTIVE;
+ emc_dbg &= ~EMC_DBG_FORCE_UPDATE;
+ writel_relaxed(emc_dbg, emc->regs + EMC_DBG);
+
+ switch (emc->dram_type) {
+ case DRAM_TYPE_DDR1:
+ dram_type_str = "DDR1";
+ break;
+ case DRAM_TYPE_LPDDR2:
+ dram_type_str = "LPDDR2";
+ break;
+ case DRAM_TYPE_DDR2:
+ dram_type_str = "DDR2";
+ break;
+ case DRAM_TYPE_DDR3:
+ dram_type_str = "DDR3";
+ break;
+ }
+
+ dev_info_once(emc->dev, "%u %s %s attached\n", emc->dram_num,
+ dram_type_str, emc->dram_num == 2 ? "devices" : "device");
+
+ emc_read_current_timing(emc, &emc->last_timing);
+
+ return 0;
+}
+
+static int load_one_timing_from_dt(struct tegra_emc *emc,
+ struct emc_timing *timing,
+ struct device_node *node)
+{
+ u32 value;
+ int err;
+
+ err = of_property_read_u32(node, "clock-frequency", &value);
+ if (err) {
+ dev_err(emc->dev, "timing %pOFn: failed to read rate: %d\n",
+ node, err);
+ return err;
+ }
+
+ timing->rate = value;
+
+ err = of_property_read_u32_array(node, "nvidia,emc-configuration",
+ timing->emc_burst_data,
+ ARRAY_SIZE(timing->emc_burst_data));
+ if (err) {
+ dev_err(emc->dev,
+ "timing %pOFn: failed to read emc burst data: %d\n",
+ node, err);
+ return err;
+ }
+
+#define EMC_READ_PROP(prop, dtprop) { \
+ err = of_property_read_u32(node, dtprop, &timing->prop); \
+ if (err) { \
+ dev_err(emc->dev, "timing %pOFn: failed to read " #prop ": %d\n", \
+ node, err); \
+ return err; \
+ } \
+}
+
+ EMC_READ_PROP(emc_auto_cal_config, "nvidia,emc-auto-cal-config")
+ EMC_READ_PROP(emc_auto_cal_config2, "nvidia,emc-auto-cal-config2")
+ EMC_READ_PROP(emc_auto_cal_config3, "nvidia,emc-auto-cal-config3")
+ EMC_READ_PROP(emc_auto_cal_interval, "nvidia,emc-auto-cal-interval")
+ EMC_READ_PROP(emc_cfg, "nvidia,emc-cfg")
+ EMC_READ_PROP(emc_ctt_term_ctrl, "nvidia,emc-ctt-term-ctrl")
+ EMC_READ_PROP(emc_mode_1, "nvidia,emc-mode-1")
+ EMC_READ_PROP(emc_mode_2, "nvidia,emc-mode-2")
+ EMC_READ_PROP(emc_mode_4, "nvidia,emc-mode-4")
+ EMC_READ_PROP(emc_mode_reset, "nvidia,emc-mode-reset")
+ EMC_READ_PROP(emc_mrs_wait_cnt, "nvidia,emc-mrs-wait-cnt")
+ EMC_READ_PROP(emc_sel_dpd_ctrl, "nvidia,emc-sel-dpd-ctrl")
+ EMC_READ_PROP(emc_xm2dqspadctrl2, "nvidia,emc-xm2dqspadctrl2")
+ EMC_READ_PROP(emc_zcal_cnt_long, "nvidia,emc-zcal-cnt-long")
+ EMC_READ_PROP(emc_zcal_interval, "nvidia,emc-zcal-interval")
+
+#undef EMC_READ_PROP
+
+ return 0;
+}
+
+static int cmp_timings(const void *_a, const void *_b)
+{
+ const struct emc_timing *a = _a;
+ const struct emc_timing *b = _b;
+
+ if (a->rate < b->rate)
+ return -1;
+ else if (a->rate == b->rate)
+ return 0;
+ else
+ return 1;
+}
+
+static int tegra_emc_load_timings_from_dt(struct tegra_emc *emc,
+ struct device_node *node)
+{
+ int child_count = of_get_child_count(node);
+ struct device_node *child;
+ struct emc_timing *timing;
+ unsigned int i = 0;
+ int err;
+
+ emc->timings = devm_kcalloc(emc->dev, child_count, sizeof(*timing),
+ GFP_KERNEL);
+ if (!emc->timings)
+ return -ENOMEM;
+
+ emc->num_timings = child_count;
+
+ for_each_child_of_node(node, child) {
+ timing = &emc->timings[i++];
+
+ err = load_one_timing_from_dt(emc, timing, child);
+ if (err) {
+ of_node_put(child);
+ return err;
+ }
+ }
+
+ sort(emc->timings, emc->num_timings, sizeof(*timing), cmp_timings,
+ NULL);
+
+ return 0;
+}
+
+static struct device_node *
+tegra_emc_find_node_by_ram_code(struct device_node *node, u32 ram_code)
+{
+ struct device_node *np;
+ int err;
+
+ for_each_child_of_node(node, np) {
+ u32 value;
+
+ err = of_property_read_u32(np, "nvidia,ram-code", &value);
+ if (err || value != ram_code)
+ continue;
+
+ return np;
+ }
+
+ return NULL;
+}
+
+static void tegra_emc_rate_requests_init(struct tegra_emc *emc)
+{
+ unsigned int i;
+
+ for (i = 0; i < EMC_RATE_TYPE_MAX; i++) {
+ emc->requested_rate[i].min_rate = 0;
+ emc->requested_rate[i].max_rate = ULONG_MAX;
+ }
+}
+
+static int emc_request_rate(struct tegra_emc *emc,
+ unsigned long new_min_rate,
+ unsigned long new_max_rate,
+ enum emc_rate_request_type type)
+{
+ struct emc_rate_request *req = emc->requested_rate;
+ unsigned long min_rate = 0, max_rate = ULONG_MAX;
+ unsigned int i;
+ int err;
+
+ /* select minimum and maximum rates among the requested rates */
+ for (i = 0; i < EMC_RATE_TYPE_MAX; i++, req++) {
+ if (i == type) {
+ min_rate = max(new_min_rate, min_rate);
+ max_rate = min(new_max_rate, max_rate);
+ } else {
+ min_rate = max(req->min_rate, min_rate);
+ max_rate = min(req->max_rate, max_rate);
+ }
+ }
+
+ if (min_rate > max_rate) {
+ dev_err_ratelimited(emc->dev, "%s: type %u: out of range: %lu %lu\n",
+ __func__, type, min_rate, max_rate);
+ return -ERANGE;
+ }
+
+ /*
+ * EMC rate-changes should go via OPP API because it manages voltage
+ * changes.
+ */
+ err = dev_pm_opp_set_rate(emc->dev, min_rate);
+ if (err)
+ return err;
+
+ emc->requested_rate[type].min_rate = new_min_rate;
+ emc->requested_rate[type].max_rate = new_max_rate;
+
+ return 0;
+}
+
+static int emc_set_min_rate(struct tegra_emc *emc, unsigned long rate,
+ enum emc_rate_request_type type)
+{
+ struct emc_rate_request *req = &emc->requested_rate[type];
+ int ret;
+
+ mutex_lock(&emc->rate_lock);
+ ret = emc_request_rate(emc, rate, req->max_rate, type);
+ mutex_unlock(&emc->rate_lock);
+
+ return ret;
+}
+
+static int emc_set_max_rate(struct tegra_emc *emc, unsigned long rate,
+ enum emc_rate_request_type type)
+{
+ struct emc_rate_request *req = &emc->requested_rate[type];
+ int ret;
+
+ mutex_lock(&emc->rate_lock);
+ ret = emc_request_rate(emc, req->min_rate, rate, type);
+ mutex_unlock(&emc->rate_lock);
+
+ return ret;
+}
+
+/*
+ * debugfs interface
+ *
+ * The memory controller driver exposes some files in debugfs that can be used
+ * to control the EMC frequency. The top-level directory can be found here:
+ *
+ * /sys/kernel/debug/emc
+ *
+ * It contains the following files:
+ *
+ * - available_rates: This file contains a list of valid, space-separated
+ * EMC frequencies.
+ *
+ * - min_rate: Writing a value to this file sets the given frequency as the
+ * floor of the permitted range. If this is higher than the currently
+ * configured EMC frequency, this will cause the frequency to be
+ * increased so that it stays within the valid range.
+ *
+ * - max_rate: Similarly to the min_rate file, writing a value to this file
+ * sets the given frequency as the ceiling of the permitted range. If
+ * the value is lower than the currently configured EMC frequency, this
+ * will cause the frequency to be decreased so that it stays within the
+ * valid range.
+ */
+
+static bool tegra_emc_validate_rate(struct tegra_emc *emc, unsigned long rate)
+{
+ unsigned int i;
+
+ for (i = 0; i < emc->num_timings; i++)
+ if (rate == emc->timings[i].rate)
+ return true;
+
+ return false;
+}
+
+static int tegra_emc_debug_available_rates_show(struct seq_file *s,
+ void *data)
+{
+ struct tegra_emc *emc = s->private;
+ const char *prefix = "";
+ unsigned int i;
+
+ for (i = 0; i < emc->num_timings; i++) {
+ seq_printf(s, "%s%lu", prefix, emc->timings[i].rate);
+ prefix = " ";
+ }
+
+ seq_puts(s, "\n");
+
+ return 0;
+}
+
+DEFINE_SHOW_ATTRIBUTE(tegra_emc_debug_available_rates);
+
+static int tegra_emc_debug_min_rate_get(void *data, u64 *rate)
+{
+ struct tegra_emc *emc = data;
+
+ *rate = emc->debugfs.min_rate;
+
+ return 0;
+}
+
+static int tegra_emc_debug_min_rate_set(void *data, u64 rate)
+{
+ struct tegra_emc *emc = data;
+ int err;
+
+ if (!tegra_emc_validate_rate(emc, rate))
+ return -EINVAL;
+
+ err = emc_set_min_rate(emc, rate, EMC_RATE_DEBUG);
+ if (err < 0)
+ return err;
+
+ emc->debugfs.min_rate = rate;
+
+ return 0;
+}
+
+DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_min_rate_fops,
+ tegra_emc_debug_min_rate_get,
+ tegra_emc_debug_min_rate_set, "%llu\n");
+
+static int tegra_emc_debug_max_rate_get(void *data, u64 *rate)
+{
+ struct tegra_emc *emc = data;
+
+ *rate = emc->debugfs.max_rate;
+
+ return 0;
+}
+
+static int tegra_emc_debug_max_rate_set(void *data, u64 rate)
+{
+ struct tegra_emc *emc = data;
+ int err;
+
+ if (!tegra_emc_validate_rate(emc, rate))
+ return -EINVAL;
+
+ err = emc_set_max_rate(emc, rate, EMC_RATE_DEBUG);
+ if (err < 0)
+ return err;
+
+ emc->debugfs.max_rate = rate;
+
+ return 0;
+}
+
+DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_max_rate_fops,
+ tegra_emc_debug_max_rate_get,
+ tegra_emc_debug_max_rate_set, "%llu\n");
+
+static void emc_debugfs_init(struct device *dev, struct tegra_emc *emc)
+{
+ unsigned int i;
+ int err;
+
+ emc->debugfs.min_rate = ULONG_MAX;
+ emc->debugfs.max_rate = 0;
+
+ for (i = 0; i < emc->num_timings; i++) {
+ if (emc->timings[i].rate < emc->debugfs.min_rate)
+ emc->debugfs.min_rate = emc->timings[i].rate;
+
+ if (emc->timings[i].rate > emc->debugfs.max_rate)
+ emc->debugfs.max_rate = emc->timings[i].rate;
+ }
+
+ if (!emc->num_timings) {
+ emc->debugfs.min_rate = clk_get_rate(emc->clk);
+ emc->debugfs.max_rate = emc->debugfs.min_rate;
+ }
+
+ err = clk_set_rate_range(emc->clk, emc->debugfs.min_rate,
+ emc->debugfs.max_rate);
+ if (err < 0) {
+ dev_err(dev, "failed to set rate range [%lu-%lu] for %pC\n",
+ emc->debugfs.min_rate, emc->debugfs.max_rate,
+ emc->clk);
+ return;
+ }
+
+ emc->debugfs.root = debugfs_create_dir("emc", NULL);
+
+ debugfs_create_file("available_rates", 0444, emc->debugfs.root, emc,
+ &tegra_emc_debug_available_rates_fops);
+ debugfs_create_file("min_rate", 0644, emc->debugfs.root,
+ emc, &tegra_emc_debug_min_rate_fops);
+ debugfs_create_file("max_rate", 0644, emc->debugfs.root,
+ emc, &tegra_emc_debug_max_rate_fops);
+}
+
+static inline struct tegra_emc *
+to_tegra_emc_provider(struct icc_provider *provider)
+{
+ return container_of(provider, struct tegra_emc, provider);
+}
+
+static struct icc_node_data *
+emc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
+{
+ struct icc_provider *provider = data;
+ struct icc_node_data *ndata;
+ struct icc_node *node;
+
+ /* External Memory is the only possible ICC route */
+ list_for_each_entry(node, &provider->nodes, node_list) {
+ if (node->id != TEGRA_ICC_EMEM)
+ continue;
+
+ ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
+ if (!ndata)
+ return ERR_PTR(-ENOMEM);
+
+ /*
+ * SRC and DST nodes should have matching TAG in order to have
+ * it set by default for a requested path.
+ */
+ ndata->tag = TEGRA_MC_ICC_TAG_ISO;
+ ndata->node = node;
+
+ return ndata;
+ }
+
+ return ERR_PTR(-EPROBE_DEFER);
+}
+
+static int emc_icc_set(struct icc_node *src, struct icc_node *dst)
+{
+ struct tegra_emc *emc = to_tegra_emc_provider(dst->provider);
+ unsigned long long peak_bw = icc_units_to_bps(dst->peak_bw);
+ unsigned long long avg_bw = icc_units_to_bps(dst->avg_bw);
+ unsigned long long rate = max(avg_bw, peak_bw);
+ unsigned int dram_data_bus_width_bytes = 4;
+ const unsigned int ddr = 2;
+ int err;
+
+ /*
+ * Tegra114 EMC runs on a clock rate of SDRAM bus. This means that
+ * EMC clock rate is twice smaller than the peak data rate because
+ * data is sampled on both EMC clock edges.
+ */
+ do_div(rate, ddr * dram_data_bus_width_bytes);
+ rate = min_t(u64, rate, U32_MAX);
+
+ err = emc_set_min_rate(emc, rate, EMC_RATE_ICC);
+ if (err)
+ return err;
+
+ return 0;
+}
+
+static int tegra_emc_interconnect_init(struct tegra_emc *emc)
+{
+ const struct tegra_mc_soc *soc = emc->mc->soc;
+ struct icc_node *node;
+ int err;
+
+ emc->provider.dev = emc->dev;
+ emc->provider.set = emc_icc_set;
+ emc->provider.data = &emc->provider;
+ emc->provider.aggregate = soc->icc_ops->aggregate;
+ emc->provider.xlate_extended = emc_of_icc_xlate_extended;
+
+ icc_provider_init(&emc->provider);
+
+ /* create External Memory Controller node */
+ node = icc_node_create(TEGRA_ICC_EMC);
+ if (IS_ERR(node)) {
+ err = PTR_ERR(node);
+ goto err_msg;
+ }
+
+ node->name = "External Memory Controller";
+ icc_node_add(node, &emc->provider);
+
+ /* link External Memory Controller to External Memory (DRAM) */
+ err = icc_link_create(node, TEGRA_ICC_EMEM);
+ if (err)
+ goto remove_nodes;
+
+ /* create External Memory node */
+ node = icc_node_create(TEGRA_ICC_EMEM);
+ if (IS_ERR(node)) {
+ err = PTR_ERR(node);
+ goto remove_nodes;
+ }
+
+ node->name = "External Memory (DRAM)";
+ icc_node_add(node, &emc->provider);
+
+ err = icc_provider_register(&emc->provider);
+ if (err)
+ goto remove_nodes;
+
+ return 0;
+
+remove_nodes:
+ icc_nodes_remove(&emc->provider);
+err_msg:
+ dev_err(emc->dev, "failed to initialize ICC: %d\n", err);
+
+ return err;
+}
+
+static int tegra_emc_opp_table_init(struct tegra_emc *emc)
+{
+ u32 hw_version = BIT(tegra_sku_info.soc_speedo_id);
+ int opp_token, err;
+
+ err = dev_pm_opp_set_supported_hw(emc->dev, &hw_version, 1);
+ if (err < 0) {
+ dev_err(emc->dev, "failed to set OPP supported HW: %d\n", err);
+ return err;
+ }
+ opp_token = err;
+
+ err = dev_pm_opp_of_add_table(emc->dev);
+ if (err) {
+ if (err == -ENODEV)
+ dev_err(emc->dev, "OPP table not found, please update your device tree\n");
+ else
+ dev_err(emc->dev, "failed to add OPP table: %d\n", err);
+
+ goto put_hw_table;
+ }
+
+ dev_info_once(emc->dev, "OPP HW ver. 0x%x, current clock rate %lu MHz\n",
+ hw_version, clk_get_rate(emc->clk) / 1000000);
+
+ /* first dummy rate-set initializes voltage state */
+ err = dev_pm_opp_set_rate(emc->dev, clk_get_rate(emc->clk));
+ if (err) {
+ dev_err(emc->dev, "failed to initialize OPP clock: %d\n", err);
+ goto remove_table;
+ }
+
+ return 0;
+
+remove_table:
+ dev_pm_opp_of_remove_table(emc->dev);
+put_hw_table:
+ dev_pm_opp_put_supported_hw(opp_token);
+
+ return err;
+}
+
+static void devm_tegra_emc_unset_callback(void *data)
+{
+ tegra124_clk_set_emc_callbacks(NULL, NULL);
+}
+
+static int tegra_emc_probe(struct platform_device *pdev)
+{
+ struct device_node *np;
+ struct tegra_emc *emc;
+ u32 ram_code;
+ int err;
+
+ emc = devm_kzalloc(&pdev->dev, sizeof(*emc), GFP_KERNEL);
+ if (!emc)
+ return -ENOMEM;
+
+ mutex_init(&emc->rate_lock);
+ emc->dev = &pdev->dev;
+
+ emc->regs = devm_platform_ioremap_resource(pdev, 0);
+ if (IS_ERR(emc->regs))
+ return PTR_ERR(emc->regs);
+
+ emc->mc = devm_tegra_memory_controller_get(&pdev->dev);
+ if (IS_ERR(emc->mc))
+ return PTR_ERR(emc->mc);
+
+ ram_code = tegra_read_ram_code();
+
+ np = tegra_emc_find_node_by_ram_code(pdev->dev.of_node, ram_code);
+ if (np) {
+ err = tegra_emc_load_timings_from_dt(emc, np);
+ of_node_put(np);
+ if (err)
+ return err;
+ } else {
+ dev_info_once(&pdev->dev,
+ "no memory timings for RAM code %u found in DT\n",
+ ram_code);
+ }
+
+ err = emc_init(emc);
+ if (err) {
+ dev_err(&pdev->dev, "EMC initialization failed: %d\n", err);
+ return err;
+ }
+
+ platform_set_drvdata(pdev, emc);
+
+ tegra124_clk_set_emc_callbacks(tegra_emc_prepare_timing_change,
+ tegra_emc_complete_timing_change);
+
+ err = devm_add_action_or_reset(&pdev->dev, devm_tegra_emc_unset_callback,
+ NULL);
+ if (err)
+ return err;
+
+ err = platform_get_irq(pdev, 0);
+ if (err < 0)
+ return err;
+
+ emc->irq = err;
+
+ err = devm_request_irq(&pdev->dev, emc->irq, tegra_emc_isr, 0,
+ dev_name(&pdev->dev), emc);
+ if (err) {
+ dev_err(&pdev->dev, "failed to request irq: %d\n", err);
+ return err;
+ }
+
+ emc->clk = devm_clk_get(&pdev->dev, "emc");
+ if (IS_ERR(emc->clk)) {
+ err = PTR_ERR(emc->clk);
+ dev_err(&pdev->dev, "failed to get EMC clock: %d\n", err);
+ return err;
+ }
+
+ err = tegra_emc_opp_table_init(emc);
+ if (err)
+ return err;
+
+ tegra_emc_rate_requests_init(emc);
+
+ if (IS_ENABLED(CONFIG_DEBUG_FS))
+ emc_debugfs_init(&pdev->dev, emc);
+
+ tegra_emc_interconnect_init(emc);
+
+ /*
+ * Don't allow the kernel module to be unloaded. Unloading adds some
+ * extra complexity which doesn't really worth the effort in a case of
+ * this driver.
+ */
+ try_module_get(THIS_MODULE);
+
+ return 0;
+};
+
+static const struct of_device_id tegra_emc_of_match[] = {
+ { .compatible = "nvidia,tegra114-emc" },
+ {}
+};
+MODULE_DEVICE_TABLE(of, tegra_emc_of_match);
+
+static struct platform_driver tegra_emc_driver = {
+ .probe = tegra_emc_probe,
+ .driver = {
+ .name = "tegra114-emc",
+ .of_match_table = tegra_emc_of_match,
+ .suppress_bind_attrs = true,
+ .sync_state = icc_sync_state,
+ },
+};
+module_platform_driver(tegra_emc_driver);
+
+MODULE_AUTHOR("Svyatoslav Ryhel <clamor95@gmail.com>");
+MODULE_DESCRIPTION("NVIDIA Tegra114 EMC driver");
+MODULE_LICENSE("GPL");
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 09/11] ARM: tegra: Add External Memory Controller node on Tegra114
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (7 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 10/11] ARM: tegra: Add EMC OPP and ICC properties to Tegra114 EMC and ACTMON device-tree nodes Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 11/11] ARM: tegra: add DC interconnections for Tegra114 Svyatoslav Ryhel
10 siblings, 0 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Add External Memory Controller node to the device-tree.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
arch/arm/boot/dts/nvidia/tegra114.dtsi | 12 ++++++++++++
1 file changed, 12 insertions(+)
diff --git a/arch/arm/boot/dts/nvidia/tegra114.dtsi b/arch/arm/boot/dts/nvidia/tegra114.dtsi
index 08f81a3d11de..e386425c3fdf 100644
--- a/arch/arm/boot/dts/nvidia/tegra114.dtsi
+++ b/arch/arm/boot/dts/nvidia/tegra114.dtsi
@@ -195,6 +195,8 @@ tegra_car: clock@60006000 {
reg = <0x60006000 0x1000>;
#clock-cells = <1>;
#reset-cells = <1>;
+
+ nvidia,external-memory-controller = <&emc>;
};
flow-controller@60007000 {
@@ -591,6 +593,16 @@ mc: memory-controller@70019000 {
#iommu-cells = <1>;
};
+ emc: external-memory-controller@7001b000 {
+ compatible = "nvidia,tegra114-emc";
+ reg = <0x7001b000 0x1000>;
+ interrupts = <GIC_SPI 78 IRQ_TYPE_LEVEL_HIGH>;
+ clocks = <&tegra_car TEGRA114_CLK_EMC>;
+ clock-names = "emc";
+
+ nvidia,memory-controller = <&mc>;
+ };
+
hda@70030000 {
compatible = "nvidia,tegra114-hda", "nvidia,tegra30-hda";
reg = <0x70030000 0x10000>;
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 10/11] ARM: tegra: Add EMC OPP and ICC properties to Tegra114 EMC and ACTMON device-tree nodes
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (8 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 09/11] ARM: tegra: Add External Memory Controller node on Tegra114 Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 11/11] ARM: tegra: add DC interconnections for Tegra114 Svyatoslav Ryhel
10 siblings, 0 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Add EMC OPP tables and interconnect paths that will be used for
dynamic memory bandwidth scaling based on memory utilization statistics.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
.../dts/nvidia/tegra114-peripherals-opp.dtsi | 151 ++++++++++++++++++
arch/arm/boot/dts/nvidia/tegra114.dtsi | 9 ++
2 files changed, 160 insertions(+)
create mode 100644 arch/arm/boot/dts/nvidia/tegra114-peripherals-opp.dtsi
diff --git a/arch/arm/boot/dts/nvidia/tegra114-peripherals-opp.dtsi b/arch/arm/boot/dts/nvidia/tegra114-peripherals-opp.dtsi
new file mode 100644
index 000000000000..1a0e68f22039
--- /dev/null
+++ b/arch/arm/boot/dts/nvidia/tegra114-peripherals-opp.dtsi
@@ -0,0 +1,151 @@
+// SPDX-License-Identifier: GPL-2.0
+
+/ {
+ emc_icc_dvfs_opp_table: opp-table-emc {
+ compatible = "operating-points-v2";
+
+ opp-12750000-900 {
+ opp-microvolt = <900000 900000 1390000>;
+ opp-hz = /bits/ 64 <12750000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-20400000-900 {
+ opp-microvolt = <900000 900000 1390000>;
+ opp-hz = /bits/ 64 <20400000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-40800000-900 {
+ opp-microvolt = <900000 900000 1390000>;
+ opp-hz = /bits/ 64 <40800000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-68000000-900 {
+ opp-microvolt = <900000 900000 1390000>;
+ opp-hz = /bits/ 64 <68000000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-102000000-900 {
+ opp-microvolt = <900000 900000 1390000>;
+ opp-hz = /bits/ 64 <102000000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-204000000-900 {
+ opp-microvolt = <900000 900000 1390000>;
+ opp-hz = /bits/ 64 <204000000>;
+ opp-supported-hw = <0x000F>;
+ opp-suspend;
+ };
+
+ opp-312000000-1000 {
+ opp-microvolt = <1000000 1000000 1390000>;
+ opp-hz = /bits/ 64 <312000000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-408000000-1000 {
+ opp-microvolt = <1000000 1000000 1390000>;
+ opp-hz = /bits/ 64 <408000000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-528000000-1050 {
+ opp-microvolt = <1050000 1050000 1390000>;
+ opp-hz = /bits/ 64 <528000000>;
+ opp-supported-hw = <0x000E>;
+ };
+
+ opp-528000000-1100 {
+ opp-microvolt = <1100000 1100000 1390000>;
+ opp-hz = /bits/ 64 <528000000>;
+ opp-supported-hw = <0x0001>;
+ };
+
+ opp-624000000-1100 {
+ opp-microvolt = <1100000 1100000 1390000>;
+ opp-hz = /bits/ 64 <624000000>;
+ opp-supported-hw = <0x000F>;
+ };
+
+ opp-792000000-1100 {
+ opp-microvolt = <1100000 1100000 1390000>;
+ opp-hz = /bits/ 64 <792000000>;
+ opp-supported-hw = <0x000F>;
+ };
+ };
+
+ emc_bw_dfs_opp_table: opp-table-actmon {
+ compatible = "operating-points-v2";
+
+ opp-12750000 {
+ opp-hz = /bits/ 64 <12750000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <204000>;
+ };
+
+ opp-20400000 {
+ opp-hz = /bits/ 64 <20400000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <326400>;
+ };
+
+ opp-40800000 {
+ opp-hz = /bits/ 64 <40800000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <652800>;
+ };
+
+ opp-68000000 {
+ opp-hz = /bits/ 64 <68000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <1088000>;
+ };
+
+ opp-102000000 {
+ opp-hz = /bits/ 64 <102000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <1632000>;
+ };
+
+ opp-204000000 {
+ opp-hz = /bits/ 64 <204000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <3264000>;
+ opp-suspend;
+ };
+
+ opp-312000000 {
+ opp-hz = /bits/ 64 <312000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <4992000>;
+ };
+
+ opp-408000000 {
+ opp-hz = /bits/ 64 <408000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <6528000>;
+ };
+
+ opp-528000000 {
+ opp-hz = /bits/ 64 <528000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <8448000>;
+ };
+
+ opp-624000000 {
+ opp-hz = /bits/ 64 <624000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <9984000>;
+ };
+
+ opp-792000000 {
+ opp-hz = /bits/ 64 <792000000>;
+ opp-supported-hw = <0x000F>;
+ opp-peak-kBps = <12672000>;
+ };
+ };
+};
diff --git a/arch/arm/boot/dts/nvidia/tegra114.dtsi b/arch/arm/boot/dts/nvidia/tegra114.dtsi
index e386425c3fdf..e2bc8c2cc73c 100644
--- a/arch/arm/boot/dts/nvidia/tegra114.dtsi
+++ b/arch/arm/boot/dts/nvidia/tegra114.dtsi
@@ -8,6 +8,8 @@
#include <dt-bindings/soc/tegra-pmc.h>
#include <dt-bindings/thermal/tegra114-soctherm.h>
+#include "tegra114-peripherals-opp.dtsi"
+
/ {
compatible = "nvidia,tegra114";
interrupt-parent = <&lic>;
@@ -259,6 +261,9 @@ actmon: actmon@6000c800 {
clock-names = "actmon", "emc";
resets = <&tegra_car TEGRA114_CLK_ACTMON>;
reset-names = "actmon";
+ operating-points-v2 = <&emc_bw_dfs_opp_table>;
+ interconnects = <&mc TEGRA114_MC_MPCORER &emc>;
+ interconnect-names = "cpu-read";
#cooling-cells = <2>;
};
@@ -591,6 +596,7 @@ mc: memory-controller@70019000 {
#reset-cells = <1>;
#iommu-cells = <1>;
+ #interconnect-cells = <1>;
};
emc: external-memory-controller@7001b000 {
@@ -601,6 +607,9 @@ emc: external-memory-controller@7001b000 {
clock-names = "emc";
nvidia,memory-controller = <&mc>;
+ operating-points-v2 = <&emc_icc_dvfs_opp_table>;
+
+ #interconnect-cells = <0>;
};
hda@70030000 {
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* [PATCH v3 11/11] ARM: tegra: add DC interconnections for Tegra114
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
` (9 preceding siblings ...)
2025-09-15 8:01 ` [PATCH v3 10/11] ARM: tegra: Add EMC OPP and ICC properties to Tegra114 EMC and ACTMON device-tree nodes Svyatoslav Ryhel
@ 2025-09-15 8:01 ` Svyatoslav Ryhel
10 siblings, 0 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-15 8:01 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Add DC interconnections to Tegra114 device tree to reflect connections
between MC, EMC and DC.
Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
---
arch/arm/boot/dts/nvidia/tegra114.dtsi | 22 ++++++++++++++++++++++
1 file changed, 22 insertions(+)
diff --git a/arch/arm/boot/dts/nvidia/tegra114.dtsi b/arch/arm/boot/dts/nvidia/tegra114.dtsi
index e2bc8c2cc73c..63214109ec00 100644
--- a/arch/arm/boot/dts/nvidia/tegra114.dtsi
+++ b/arch/arm/boot/dts/nvidia/tegra114.dtsi
@@ -86,6 +86,17 @@ dc@54200000 {
nvidia,head = <0>;
+ interconnects = <&mc TEGRA114_MC_DISPLAY0A &emc>,
+ <&mc TEGRA114_MC_DISPLAY0B &emc>,
+ <&mc TEGRA114_MC_DISPLAY1B &emc>,
+ <&mc TEGRA114_MC_DISPLAY0C &emc>,
+ <&mc TEGRA114_MC_DISPLAYHC &emc>;
+ interconnect-names = "wina",
+ "winb",
+ "winb-vfilter",
+ "winc",
+ "cursor";
+
rgb {
status = "disabled";
};
@@ -105,6 +116,17 @@ dc@54240000 {
nvidia,head = <1>;
+ interconnects = <&mc TEGRA114_MC_DISPLAY0AB &emc>,
+ <&mc TEGRA114_MC_DISPLAY0BB &emc>,
+ <&mc TEGRA114_MC_DISPLAY1BB &emc>,
+ <&mc TEGRA114_MC_DISPLAY0CB &emc>,
+ <&mc TEGRA114_MC_DISPLAYHCB &emc>;
+ interconnect-names = "wina",
+ "winb",
+ "winb-vfilter",
+ "winc",
+ "cursor";
+
rgb {
status = "disabled";
};
--
2.48.1
^ permalink raw reply related [flat|nested] 32+ messages in thread
* Re: [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114
2025-09-15 8:01 ` [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114 Svyatoslav Ryhel
@ 2025-09-21 17:54 ` Stephen Boyd
2025-11-13 14:21 ` Svyatoslav Ryhel
2025-11-25 10:21 ` Svyatoslav Ryhel
2025-11-13 5:05 ` Mikko Perttunen
1 sibling, 2 replies; 32+ messages in thread
From: Stephen Boyd @ 2025-09-21 17:54 UTC (permalink / raw)
To: Chanwoo Choi, Conor Dooley, Dmitry Osipenko, Jonathan Hunter,
Krzysztof Kozlowski, Kyungmin Park, Michael Turquette,
Mikko Perttunen, MyungJoo Ham, Prashant Gaikwad, Rob Herring,
Svyatoslav Ryhel, Thierry Reding, Thierry Reding
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
Quoting Svyatoslav Ryhel (2025-09-15 01:01:52)
> diff --git a/drivers/clk/tegra/clk-tegra114.c b/drivers/clk/tegra/clk-tegra114.c
> index 8bde72aa5e68..6b3a140772c2 100644
> --- a/drivers/clk/tegra/clk-tegra114.c
> +++ b/drivers/clk/tegra/clk-tegra114.c
> @@ -1321,6 +1309,28 @@ static int tegra114_reset_deassert(unsigned long id)
> return 0;
> }
>
> +#ifdef CONFIG_TEGRA124_CLK_EMC
> +static struct clk *tegra114_clk_src_onecell_get(struct of_phandle_args *clkspec,
> + void *data)
> +{
> + struct clk_hw *hw;
> + struct clk *clk;
> +
> + clk = of_clk_src_onecell_get(clkspec, data);
> + if (IS_ERR(clk))
> + return clk;
> +
> + hw = __clk_get_hw(clk);
Can you just use of_clk_hw_onecell_get() instead? Then we don't need to
use __clk_get_hw(). Or is this whole function used to return a clk
pointer to something that isn't the clk framework?
> +
> + if (clkspec->args[0] == TEGRA114_CLK_EMC) {
> + if (!tegra124_clk_emc_driver_available(hw))
> + return ERR_PTR(-EPROBE_DEFER);
> + }
> +
> + return clk;
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller
2025-09-15 8:01 ` [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller Svyatoslav Ryhel
@ 2025-09-22 16:00 ` Rob Herring
2025-09-22 16:18 ` Svyatoslav Ryhel
0 siblings, 1 reply; 32+ messages in thread
From: Rob Herring @ 2025-09-22 16:00 UTC (permalink / raw)
To: Svyatoslav Ryhel
Cc: Krzysztof Kozlowski, Conor Dooley, Thierry Reding, Thierry Reding,
Jonathan Hunter, Prashant Gaikwad, Mikko Perttunen,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
On Mon, Sep 15, 2025 at 11:01:49AM +0300, Svyatoslav Ryhel wrote:
> Add Tegra114 support into existing Tegra124 MC schema with the most
> notable difference in the amount of EMEM timings.
>
> Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> ---
> .../nvidia,tegra124-mc.yaml | 97 ++++++++++++++-----
> 1 file changed, 74 insertions(+), 23 deletions(-)
>
> diff --git a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> index 7b18b4d11e0a..9cc9360d3bd0 100644
> --- a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> +++ b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> @@ -19,7 +19,9 @@ description: |
>
> properties:
> compatible:
> - const: nvidia,tegra124-mc
> + enum:
> + - nvidia,tegra114-mc
> + - nvidia,tegra124-mc
>
> reg:
> maxItems: 1
> @@ -64,29 +66,10 @@ patternProperties:
>
> nvidia,emem-configuration:
> $ref: /schemas/types.yaml#/definitions/uint32-array
> - description: |
> + description:
> Values to be written to the EMEM register block. See section
> - "15.6.1 MC Registers" in the TRM.
> - items:
> - - description: MC_EMEM_ARB_CFG
> - - description: MC_EMEM_ARB_OUTSTANDING_REQ
> - - description: MC_EMEM_ARB_TIMING_RCD
> - - description: MC_EMEM_ARB_TIMING_RP
> - - description: MC_EMEM_ARB_TIMING_RC
> - - description: MC_EMEM_ARB_TIMING_RAS
> - - description: MC_EMEM_ARB_TIMING_FAW
> - - description: MC_EMEM_ARB_TIMING_RRD
> - - description: MC_EMEM_ARB_TIMING_RAP2PRE
> - - description: MC_EMEM_ARB_TIMING_WAP2PRE
> - - description: MC_EMEM_ARB_TIMING_R2R
> - - description: MC_EMEM_ARB_TIMING_W2W
> - - description: MC_EMEM_ARB_TIMING_R2W
> - - description: MC_EMEM_ARB_TIMING_W2R
> - - description: MC_EMEM_ARB_DA_TURNS
> - - description: MC_EMEM_ARB_DA_COVERS
> - - description: MC_EMEM_ARB_MISC0
> - - description: MC_EMEM_ARB_MISC1
> - - description: MC_EMEM_ARB_RING1_THROTTLE
> + "20.11.1 MC Registers" in the Tegea114 TRM or
> + "15.6.1 MC Registers" in the Tegra124 TRM.
>
> required:
> - clock-frequency
> @@ -109,6 +92,74 @@ required:
> - "#iommu-cells"
> - "#interconnect-cells"
>
> +allOf:
> + - if:
> + properties:
> + compatible:
> + contains:
> + enum:
> + - nvidia,tegra114-mc
> + then:
> + patternProperties:
> + "^emc-timings-[0-9]+$":
> + patternProperties:
> + "^timing-[0-9]+$":
> + properties:
> + nvidia,emem-configuration:
> + items:
> + - description: MC_EMEM_ARB_CFG
> + - description: MC_EMEM_ARB_OUTSTANDING_REQ
> + - description: MC_EMEM_ARB_TIMING_RCD
> + - description: MC_EMEM_ARB_TIMING_RP
> + - description: MC_EMEM_ARB_TIMING_RC
> + - description: MC_EMEM_ARB_TIMING_RAS
> + - description: MC_EMEM_ARB_TIMING_FAW
> + - description: MC_EMEM_ARB_TIMING_RRD
> + - description: MC_EMEM_ARB_TIMING_RAP2PRE
> + - description: MC_EMEM_ARB_TIMING_WAP2PRE
> + - description: MC_EMEM_ARB_TIMING_R2R
> + - description: MC_EMEM_ARB_TIMING_W2W
> + - description: MC_EMEM_ARB_TIMING_R2W
> + - description: MC_EMEM_ARB_TIMING_W2R
> + - description: MC_EMEM_ARB_DA_TURNS
> + - description: MC_EMEM_ARB_DA_COVERS
> + - description: MC_EMEM_ARB_MISC0
> + - description: MC_EMEM_ARB_RING1_THROTTLE
Like I said before, I don't think it is worth enumerating the list of
registers for every variant. If you want to define the length
(minItems/maxItems), then that is fine.
Rob
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller
2025-09-22 16:00 ` Rob Herring
@ 2025-09-22 16:18 ` Svyatoslav Ryhel
2025-09-24 15:24 ` Rob Herring
0 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-09-22 16:18 UTC (permalink / raw)
To: Rob Herring
Cc: Krzysztof Kozlowski, Conor Dooley, Thierry Reding, Thierry Reding,
Jonathan Hunter, Prashant Gaikwad, Mikko Perttunen,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
пн, 22 вер. 2025 р. о 19:00 Rob Herring <robh@kernel.org> пише:
>
> On Mon, Sep 15, 2025 at 11:01:49AM +0300, Svyatoslav Ryhel wrote:
> > Add Tegra114 support into existing Tegra124 MC schema with the most
> > notable difference in the amount of EMEM timings.
> >
> > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > ---
> > .../nvidia,tegra124-mc.yaml | 97 ++++++++++++++-----
> > 1 file changed, 74 insertions(+), 23 deletions(-)
> >
> > diff --git a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > index 7b18b4d11e0a..9cc9360d3bd0 100644
> > --- a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > +++ b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > @@ -19,7 +19,9 @@ description: |
> >
> > properties:
> > compatible:
> > - const: nvidia,tegra124-mc
> > + enum:
> > + - nvidia,tegra114-mc
> > + - nvidia,tegra124-mc
> >
> > reg:
> > maxItems: 1
> > @@ -64,29 +66,10 @@ patternProperties:
> >
> > nvidia,emem-configuration:
> > $ref: /schemas/types.yaml#/definitions/uint32-array
> > - description: |
> > + description:
> > Values to be written to the EMEM register block. See section
> > - "15.6.1 MC Registers" in the TRM.
> > - items:
> > - - description: MC_EMEM_ARB_CFG
> > - - description: MC_EMEM_ARB_OUTSTANDING_REQ
> > - - description: MC_EMEM_ARB_TIMING_RCD
> > - - description: MC_EMEM_ARB_TIMING_RP
> > - - description: MC_EMEM_ARB_TIMING_RC
> > - - description: MC_EMEM_ARB_TIMING_RAS
> > - - description: MC_EMEM_ARB_TIMING_FAW
> > - - description: MC_EMEM_ARB_TIMING_RRD
> > - - description: MC_EMEM_ARB_TIMING_RAP2PRE
> > - - description: MC_EMEM_ARB_TIMING_WAP2PRE
> > - - description: MC_EMEM_ARB_TIMING_R2R
> > - - description: MC_EMEM_ARB_TIMING_W2W
> > - - description: MC_EMEM_ARB_TIMING_R2W
> > - - description: MC_EMEM_ARB_TIMING_W2R
> > - - description: MC_EMEM_ARB_DA_TURNS
> > - - description: MC_EMEM_ARB_DA_COVERS
> > - - description: MC_EMEM_ARB_MISC0
> > - - description: MC_EMEM_ARB_MISC1
> > - - description: MC_EMEM_ARB_RING1_THROTTLE
> > + "20.11.1 MC Registers" in the Tegea114 TRM or
> > + "15.6.1 MC Registers" in the Tegra124 TRM.
> >
> > required:
> > - clock-frequency
> > @@ -109,6 +92,74 @@ required:
> > - "#iommu-cells"
> > - "#interconnect-cells"
> >
> > +allOf:
> > + - if:
> > + properties:
> > + compatible:
> > + contains:
> > + enum:
> > + - nvidia,tegra114-mc
> > + then:
> > + patternProperties:
> > + "^emc-timings-[0-9]+$":
> > + patternProperties:
> > + "^timing-[0-9]+$":
> > + properties:
> > + nvidia,emem-configuration:
> > + items:
> > + - description: MC_EMEM_ARB_CFG
> > + - description: MC_EMEM_ARB_OUTSTANDING_REQ
> > + - description: MC_EMEM_ARB_TIMING_RCD
> > + - description: MC_EMEM_ARB_TIMING_RP
> > + - description: MC_EMEM_ARB_TIMING_RC
> > + - description: MC_EMEM_ARB_TIMING_RAS
> > + - description: MC_EMEM_ARB_TIMING_FAW
> > + - description: MC_EMEM_ARB_TIMING_RRD
> > + - description: MC_EMEM_ARB_TIMING_RAP2PRE
> > + - description: MC_EMEM_ARB_TIMING_WAP2PRE
> > + - description: MC_EMEM_ARB_TIMING_R2R
> > + - description: MC_EMEM_ARB_TIMING_W2W
> > + - description: MC_EMEM_ARB_TIMING_R2W
> > + - description: MC_EMEM_ARB_TIMING_W2R
> > + - description: MC_EMEM_ARB_DA_TURNS
> > + - description: MC_EMEM_ARB_DA_COVERS
> > + - description: MC_EMEM_ARB_MISC0
> > + - description: MC_EMEM_ARB_RING1_THROTTLE
>
> Like I said before, I don't think it is worth enumerating the list of
> registers for every variant. If you want to define the length
> (minItems/maxItems), then that is fine.
>
It worth because position of value matters when reading and list above
provides a reference to the order in which register values should be
grouped.
> Rob
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller
2025-09-22 16:18 ` Svyatoslav Ryhel
@ 2025-09-24 15:24 ` Rob Herring
2025-12-01 14:18 ` Thierry Reding
0 siblings, 1 reply; 32+ messages in thread
From: Rob Herring @ 2025-09-24 15:24 UTC (permalink / raw)
To: Svyatoslav Ryhel
Cc: Krzysztof Kozlowski, Conor Dooley, Thierry Reding, Thierry Reding,
Jonathan Hunter, Prashant Gaikwad, Mikko Perttunen,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
On Mon, Sep 22, 2025 at 07:18:00PM +0300, Svyatoslav Ryhel wrote:
> пн, 22 вер. 2025 р. о 19:00 Rob Herring <robh@kernel.org> пише:
> >
> > On Mon, Sep 15, 2025 at 11:01:49AM +0300, Svyatoslav Ryhel wrote:
> > > Add Tegra114 support into existing Tegra124 MC schema with the most
> > > notable difference in the amount of EMEM timings.
> > >
> > > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > > ---
> > > .../nvidia,tegra124-mc.yaml | 97 ++++++++++++++-----
> > > 1 file changed, 74 insertions(+), 23 deletions(-)
> > >
> > > diff --git a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > > index 7b18b4d11e0a..9cc9360d3bd0 100644
> > > --- a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > > +++ b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > > @@ -19,7 +19,9 @@ description: |
> > >
> > > properties:
> > > compatible:
> > > - const: nvidia,tegra124-mc
> > > + enum:
> > > + - nvidia,tegra114-mc
> > > + - nvidia,tegra124-mc
> > >
> > > reg:
> > > maxItems: 1
> > > @@ -64,29 +66,10 @@ patternProperties:
> > >
> > > nvidia,emem-configuration:
> > > $ref: /schemas/types.yaml#/definitions/uint32-array
> > > - description: |
> > > + description:
> > > Values to be written to the EMEM register block. See section
> > > - "15.6.1 MC Registers" in the TRM.
> > > - items:
> > > - - description: MC_EMEM_ARB_CFG
> > > - - description: MC_EMEM_ARB_OUTSTANDING_REQ
> > > - - description: MC_EMEM_ARB_TIMING_RCD
> > > - - description: MC_EMEM_ARB_TIMING_RP
> > > - - description: MC_EMEM_ARB_TIMING_RC
> > > - - description: MC_EMEM_ARB_TIMING_RAS
> > > - - description: MC_EMEM_ARB_TIMING_FAW
> > > - - description: MC_EMEM_ARB_TIMING_RRD
> > > - - description: MC_EMEM_ARB_TIMING_RAP2PRE
> > > - - description: MC_EMEM_ARB_TIMING_WAP2PRE
> > > - - description: MC_EMEM_ARB_TIMING_R2R
> > > - - description: MC_EMEM_ARB_TIMING_W2W
> > > - - description: MC_EMEM_ARB_TIMING_R2W
> > > - - description: MC_EMEM_ARB_TIMING_W2R
> > > - - description: MC_EMEM_ARB_DA_TURNS
> > > - - description: MC_EMEM_ARB_DA_COVERS
> > > - - description: MC_EMEM_ARB_MISC0
> > > - - description: MC_EMEM_ARB_MISC1
> > > - - description: MC_EMEM_ARB_RING1_THROTTLE
> > > + "20.11.1 MC Registers" in the Tegea114 TRM or
> > > + "15.6.1 MC Registers" in the Tegra124 TRM.
> > >
> > > required:
> > > - clock-frequency
> > > @@ -109,6 +92,74 @@ required:
> > > - "#iommu-cells"
> > > - "#interconnect-cells"
> > >
> > > +allOf:
> > > + - if:
> > > + properties:
> > > + compatible:
> > > + contains:
> > > + enum:
> > > + - nvidia,tegra114-mc
> > > + then:
> > > + patternProperties:
> > > + "^emc-timings-[0-9]+$":
> > > + patternProperties:
> > > + "^timing-[0-9]+$":
> > > + properties:
> > > + nvidia,emem-configuration:
> > > + items:
> > > + - description: MC_EMEM_ARB_CFG
> > > + - description: MC_EMEM_ARB_OUTSTANDING_REQ
> > > + - description: MC_EMEM_ARB_TIMING_RCD
> > > + - description: MC_EMEM_ARB_TIMING_RP
> > > + - description: MC_EMEM_ARB_TIMING_RC
> > > + - description: MC_EMEM_ARB_TIMING_RAS
> > > + - description: MC_EMEM_ARB_TIMING_FAW
> > > + - description: MC_EMEM_ARB_TIMING_RRD
> > > + - description: MC_EMEM_ARB_TIMING_RAP2PRE
> > > + - description: MC_EMEM_ARB_TIMING_WAP2PRE
> > > + - description: MC_EMEM_ARB_TIMING_R2R
> > > + - description: MC_EMEM_ARB_TIMING_W2W
> > > + - description: MC_EMEM_ARB_TIMING_R2W
> > > + - description: MC_EMEM_ARB_TIMING_W2R
> > > + - description: MC_EMEM_ARB_DA_TURNS
> > > + - description: MC_EMEM_ARB_DA_COVERS
> > > + - description: MC_EMEM_ARB_MISC0
> > > + - description: MC_EMEM_ARB_RING1_THROTTLE
> >
> > Like I said before, I don't think it is worth enumerating the list of
> > registers for every variant. If you want to define the length
> > (minItems/maxItems), then that is fine.
> >
>
> It worth because position of value matters when reading and list above
> provides a reference to the order in which register values should be
> grouped.
The schema does nothing to validate that. The only thing that gets
validated is the length. It is just an opaque blob of data. I'm sure you
have to define the order in the driver as well. One place is enough.
Rob
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114
2025-09-15 8:01 ` [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114 Svyatoslav Ryhel
@ 2025-11-11 8:55 ` Mikko Perttunen
2025-11-11 13:34 ` Svyatoslav Ryhel
0 siblings, 1 reply; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-11 8:55 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> Lets add Tegra114 support to activity monitor device as a preparation to
> upcoming EMC controller support.
>
> Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> ---
> drivers/devfreq/tegra30-devfreq.c | 1 +
> 1 file changed, 1 insertion(+)
>
> diff --git a/drivers/devfreq/tegra30-devfreq.c b/drivers/devfreq/tegra30-devfreq.c
> index 8ea5b482bfb3..d976077d4757 100644
> --- a/drivers/devfreq/tegra30-devfreq.c
> +++ b/drivers/devfreq/tegra30-devfreq.c
> @@ -980,6 +980,7 @@ static const struct tegra_devfreq_soc_data tegra30_soc = {
>
> static const struct of_device_id tegra_devfreq_of_match[] = {
> { .compatible = "nvidia,tegra30-actmon", .data = &tegra30_soc, },
> + { .compatible = "nvidia,tegra114-actmon", .data = &tegra124_soc, },
> { .compatible = "nvidia,tegra124-actmon", .data = &tegra124_soc, },
> { },
> };
>
Looking at my copy of L4T r21, the EMC count_weight should be 256 on Tegra114, while it is 4*256 on Tegra124, so different SoC data should be used. (I haven't checked if anything else is different)
Cheers,
Mikko
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 02/11] ARM: tegra: Add ACTMON node to Tegra114 device tree
2025-09-15 8:01 ` [PATCH v3 02/11] ARM: tegra: Add ACTMON node to Tegra114 device tree Svyatoslav Ryhel
@ 2025-11-11 9:00 ` Mikko Perttunen
0 siblings, 0 replies; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-11 9:00 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> Add support for ACTMON on Tegra114. This is used to monitor activity from
> different components. Based on the collected statistics, the rate at which
> the external memory needs to be clocked can be derived.
>
> Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> ---
> arch/arm/boot/dts/nvidia/tegra114.dtsi | 12 ++++++++++++
> 1 file changed, 12 insertions(+)
>
> diff --git a/arch/arm/boot/dts/nvidia/tegra114.dtsi b/arch/arm/boot/dts/nvidia/tegra114.dtsi
> index 5e695431ad2e..08f81a3d11de 100644
> --- a/arch/arm/boot/dts/nvidia/tegra114.dtsi
> +++ b/arch/arm/boot/dts/nvidia/tegra114.dtsi
> @@ -248,6 +248,18 @@ ahb: ahb@6000c000 {
> reg = <0x6000c000 0x150>;
> };
>
> + actmon: actmon@6000c800 {
> + compatible = "nvidia,tegra114-actmon";
> + reg = <0x6000c800 0x400>;
> + interrupts = <GIC_SPI 45 IRQ_TYPE_LEVEL_HIGH>;
> + clocks = <&tegra_car TEGRA114_CLK_ACTMON>,
> + <&tegra_car TEGRA114_CLK_EMC>;
> + clock-names = "actmon", "emc";
> + resets = <&tegra_car TEGRA114_CLK_ACTMON>;
> + reset-names = "actmon";
> + #cooling-cells = <2>;
> + };
> +
> gpio: gpio@6000d000 {
> compatible = "nvidia,tegra114-gpio", "nvidia,tegra30-gpio";
> reg = <0x6000d000 0x1000>;
>
Reviewed-by: Mikko Perttunen <mperttunen@nvidia.com>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114
2025-11-11 8:55 ` Mikko Perttunen
@ 2025-11-11 13:34 ` Svyatoslav Ryhel
2025-11-13 4:20 ` Mikko Perttunen
0 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-11-11 13:34 UTC (permalink / raw)
To: Mikko Perttunen
Cc: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
вт, 11 лист. 2025 р. о 10:55 Mikko Perttunen <mperttunen@nvidia.com> пише:
>
> On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> > Lets add Tegra114 support to activity monitor device as a preparation to
> > upcoming EMC controller support.
> >
> > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > ---
> > drivers/devfreq/tegra30-devfreq.c | 1 +
> > 1 file changed, 1 insertion(+)
> >
> > diff --git a/drivers/devfreq/tegra30-devfreq.c b/drivers/devfreq/tegra30-devfreq.c
> > index 8ea5b482bfb3..d976077d4757 100644
> > --- a/drivers/devfreq/tegra30-devfreq.c
> > +++ b/drivers/devfreq/tegra30-devfreq.c
> > @@ -980,6 +980,7 @@ static const struct tegra_devfreq_soc_data tegra30_soc = {
> >
> > static const struct of_device_id tegra_devfreq_of_match[] = {
> > { .compatible = "nvidia,tegra30-actmon", .data = &tegra30_soc, },
> > + { .compatible = "nvidia,tegra114-actmon", .data = &tegra124_soc, },
> > { .compatible = "nvidia,tegra124-actmon", .data = &tegra124_soc, },
> > { },
> > };
> >
>
> Looking at my copy of L4T r21, the EMC count_weight should be 256 on Tegra114, while it is 4*256 on Tegra124, so different SoC data should be used. (I haven't checked if anything else is different)
>
You are correct, tegra114 seems to use 1 EMC clock per transaction. I
will move and expand comment from tegra124 entry regarding
count_weight to include info about all 3 supported entries if you
don't mind.
I have a question regarding tegra_devfreq_device_config to be used
with tegra114. From tegratab kernel I have, existing
tegra124_device_configs configuration seems to fit tegra114, may you
confirm this? Or, if L4T r21 you use, uses different values, may you
provide those to fill up tegra_devfreq_device_config for tegra114.
> Cheers,
> Mikko
>
>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114
2025-11-11 13:34 ` Svyatoslav Ryhel
@ 2025-11-13 4:20 ` Mikko Perttunen
0 siblings, 0 replies; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-13 4:20 UTC (permalink / raw)
To: Svyatoslav Ryhel
Cc: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
On Tuesday, November 11, 2025 10:34 PM Svyatoslav Ryhel wrote:
> вт, 11 лист. 2025 р. о 10:55 Mikko Perttunen <mperttunen@nvidia.com> пише:
> >
> > On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> > > Lets add Tegra114 support to activity monitor device as a preparation to
> > > upcoming EMC controller support.
> > >
> > > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > > ---
> > > drivers/devfreq/tegra30-devfreq.c | 1 +
> > > 1 file changed, 1 insertion(+)
> > >
> > > diff --git a/drivers/devfreq/tegra30-devfreq.c b/drivers/devfreq/tegra30-devfreq.c
> > > index 8ea5b482bfb3..d976077d4757 100644
> > > --- a/drivers/devfreq/tegra30-devfreq.c
> > > +++ b/drivers/devfreq/tegra30-devfreq.c
> > > @@ -980,6 +980,7 @@ static const struct tegra_devfreq_soc_data tegra30_soc = {
> > >
> > > static const struct of_device_id tegra_devfreq_of_match[] = {
> > > { .compatible = "nvidia,tegra30-actmon", .data = &tegra30_soc, },
> > > + { .compatible = "nvidia,tegra114-actmon", .data = &tegra124_soc, },
> > > { .compatible = "nvidia,tegra124-actmon", .data = &tegra124_soc, },
> > > { },
> > > };
> > >
> >
> > Looking at my copy of L4T r21, the EMC count_weight should be 256 on Tegra114, while it is 4*256 on Tegra124, so different SoC data should be used. (I haven't checked if anything else is different)
> >
>
> You are correct, tegra114 seems to use 1 EMC clock per transaction. I
> will move and expand comment from tegra124 entry regarding
> count_weight to include info about all 3 supported entries if you
> don't mind.
>
> I have a question regarding tegra_devfreq_device_config to be used
> with tegra114. From tegratab kernel I have, existing
> tegra124_device_configs configuration seems to fit tegra114, may you
> confirm this? Or, if L4T r21 you use, uses different values, may you
> provide those to fill up tegra_devfreq_device_config for tegra114.
Can confirm the offset and irq mask are the same. The coefficients are a bit different in the L4T tree but they don't match the upstream tegra124 values either so I guess that's fine.
Here's the exact values:
static struct actmon_dev actmon_dev_emc = {
.reg = 0x1c0,
.glb_status_irq_mask = (0x1 << 26),
.dev_id = "tegra_actmon",
.con_id = "emc",
/* EMC suspend floor to guarantee suspend entry on PLLM */
.suspend_freq = EMC_PLLP_FREQ_MAX + 2000,
.boost_freq_step = 16000,
.boost_up_coef = 200,
.boost_down_coef = 50,
#if (defined(CONFIG_ARCH_TEGRA_14x_SOC) || \
defined(CONFIG_ARCH_TEGRA_12x_SOC) || \
defined(CONFIG_ARCH_TEGRA_13x_SOC))
.boost_up_threshold = 70,
.boost_down_threshold = 50,
#else
.boost_up_threshold = 60,
.boost_down_threshold = 40,
#endif
.up_wmark_window = 1,
.down_wmark_window = 3,
.avg_window_log2 = ACTMON_DEFAULT_AVG_WINDOW_LOG2,
#if defined(CONFIG_ARCH_TEGRA_3x_SOC) || defined(CONFIG_ARCH_TEGRA_14x_SOC)
.count_weight = 0x200,
#elif defined(CONFIG_ARCH_TEGRA_12x_SOC) || defined(CONFIG_ARCH_TEGRA_13x_SOC)
.count_weight = 0x400,
#else
.count_weight = 0x100,
#endif
.type = ACTMON_FREQ_SAMPLER,
.state = ACTMON_UNINITIALIZED,
.rate_change_nb = {
.notifier_call = actmon_rate_notify_cb,
},
};
#if defined(CONFIG_ARCH_TEGRA_12x_SOC) || defined(CONFIG_ARCH_TEGRA_13x_SOC)
#define CPU_AVG_ACT_THRESHOLD 2000
#else
#define CPU_AVG_ACT_THRESHOLD 50000
#endif
/* EMC-cpu activity monitor: frequency sampling device:
* activity counter is incremented every 256 memory transactions, and
* each transaction takes 2 EMC clocks; count_weight = 512 on Tegra3.
* On Tegra11 there is only 1 clock per transaction, hence weight = 256.
*/
static struct actmon_dev actmon_dev_cpu_emc = {
.reg = 0x200,
.glb_status_irq_mask = (0x1 << 25),
.dev_id = "tegra_mon",
.con_id = "cpu_emc",
.boost_freq_step = 16000,
.boost_up_coef = 800,
.boost_down_coef = 90,
.boost_up_threshold = 27,
.boost_down_threshold = 10,
.avg_dependency_threshold = CPU_AVG_ACT_THRESHOLD,
.up_wmark_window = 1,
.down_wmark_window = 3,
.avg_window_log2 = ACTMON_DEFAULT_AVG_WINDOW_LOG2,
#if defined(CONFIG_ARCH_TEGRA_3x_SOC) || defined(CONFIG_ARCH_TEGRA_14x_SOC)
.count_weight = 0x200,
#elif defined(CONFIG_ARCH_TEGRA_12x_SOC) || defined(CONFIG_ARCH_TEGRA_13x_SOC)
.count_weight = 0x400,
#else
.count_weight = 0x100,
#endif
.type = ACTMON_FREQ_SAMPLER,
.state = ACTMON_UNINITIALIZED,
.rate_change_nb = {
.notifier_call = actmon_rate_notify_cb,
},
};
>
> > Cheers,
> > Mikko
> >
> >
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 04/11] memory: tegra: implement EMEM regs and ICC ops for Tegra114
2025-09-15 8:01 ` [PATCH v3 04/11] memory: tegra: implement EMEM regs and ICC ops for Tegra114 Svyatoslav Ryhel
@ 2025-11-13 4:36 ` Mikko Perttunen
0 siblings, 0 replies; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-13 4:36 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> Prepare Internal Memory Controller for introduction of External Memory
> Controller.
>
> Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> ---
> drivers/memory/tegra/tegra114.c | 193 ++++++++++++++++++++++++++++++++
> 1 file changed, 193 insertions(+)
>
> diff --git a/drivers/memory/tegra/tegra114.c b/drivers/memory/tegra/tegra114.c
> index d03a5d162dbd..c615857f7fad 100644
> --- a/drivers/memory/tegra/tegra114.c
> +++ b/drivers/memory/tegra/tegra114.c
> @@ -3,6 +3,7 @@
> * Copyright (C) 2014 NVIDIA CORPORATION. All rights reserved.
> */
>
> +#include <linux/device.h>
> #include <linux/of.h>
> #include <linux/mm.h>
>
> @@ -1165,6 +1166,195 @@ static const struct tegra_mc_reset tegra114_mc_resets[] = {
> TEGRA114_MC_RESET(VI, 0x200, 0x204, 17),
> };
>
> +static void tegra114_mc_tune_client_latency(struct tegra_mc *mc,
> + const struct tegra_mc_client *client,
> + unsigned int bandwidth_mbytes_sec)
> +{
> + u32 arb_tolerance_compensation_nsec, arb_tolerance_compensation_div;
> + unsigned int fifo_size = client->fifo_size;
> + u32 arb_nsec, la_ticks, value;
> +
> + /* see 20.3.1.1 Client Configuration in Tegra4 TRM v01p */
> + if (bandwidth_mbytes_sec)
> + arb_nsec = fifo_size * NSEC_PER_USEC / bandwidth_mbytes_sec;
> + else
> + arb_nsec = U32_MAX;
> +
> + /*
> + * Latency allowness should be set with consideration for the module's
> + * latency tolerance and internal buffering capabilities.
> + *
> + * Display memory clients use isochronous transfers and have very low
> + * tolerance to a belated transfers. Hence we need to compensate the
> + * memory arbitration imperfection for them in order to prevent FIFO
> + * underflow condition when memory bus is busy.
> + *
> + * VI clients also need a stronger compensation.
> + */
> + switch (client->swgroup) {
> + case TEGRA_SWGROUP_MPCORE:
> + case TEGRA_SWGROUP_PTC:
> + /*
> + * We always want lower latency for these clients, hence
> + * don't touch them.
> + */
> + return;
> +
> + case TEGRA_SWGROUP_DC:
> + case TEGRA_SWGROUP_DCB:
> + arb_tolerance_compensation_nsec = 1050;
> + arb_tolerance_compensation_div = 2;
> + break;
> +
> + case TEGRA_SWGROUP_VI:
> + arb_tolerance_compensation_nsec = 1050;
> + arb_tolerance_compensation_div = 1;
> + break;
> +
> + default:
> + arb_tolerance_compensation_nsec = 150;
> + arb_tolerance_compensation_div = 1;
> + break;
> + }
> +
> + if (arb_nsec > arb_tolerance_compensation_nsec)
> + arb_nsec -= arb_tolerance_compensation_nsec;
> + else
> + arb_nsec = 0;
> +
> + arb_nsec /= arb_tolerance_compensation_div;
> +
> + /*
> + * Latency allowance is a number of ticks a request from a particular
> + * client may wait in the EMEM arbiter before it becomes a high-priority
> + * request.
> + */
> + la_ticks = arb_nsec / mc->tick;
> + la_ticks = min(la_ticks, client->regs.la.mask);
> +
> + value = mc_readl(mc, client->regs.la.reg);
> + value &= ~(client->regs.la.mask << client->regs.la.shift);
> + value |= la_ticks << client->regs.la.shift;
> + mc_writel(mc, value, client->regs.la.reg);
> +}
> +
> +static int tegra114_mc_icc_set(struct icc_node *src, struct icc_node *dst)
> +{
> + struct tegra_mc *mc = icc_provider_to_tegra_mc(src->provider);
> + const struct tegra_mc_client *client = &mc->soc->clients[src->id];
> + u64 peak_bandwidth = icc_units_to_bps(src->peak_bw);
> +
> + /*
> + * Skip pre-initialization that is done by icc_node_add(), which sets
> + * bandwidth to maximum for all clients before drivers are loaded.
> + *
> + * This doesn't make sense for us because we don't have drivers for all
> + * clients and it's okay to keep configuration left from bootloader
> + * during boot, at least for today.
> + */
> + if (src == dst)
> + return 0;
> +
> + /* convert bytes/sec to megabytes/sec */
> + do_div(peak_bandwidth, 1000000);
> +
> + tegra114_mc_tune_client_latency(mc, client, peak_bandwidth);
> +
> + return 0;
> +}
> +
> +static int tegra114_mc_icc_aggreate(struct icc_node *node, u32 tag, u32 avg_bw,
> + u32 peak_bw, u32 *agg_avg, u32 *agg_peak)
> +{
> + /*
> + * ISO clients need to reserve extra bandwidth up-front because
> + * there could be high bandwidth pressure during initial filling
> + * of the client's FIFO buffers. Secondly, we need to take into
> + * account impurities of the memory subsystem.
> + */
> + if (tag & TEGRA_MC_ICC_TAG_ISO)
> + peak_bw = tegra_mc_scale_percents(peak_bw, 400);
> +
> + *agg_avg += avg_bw;
> + *agg_peak = max(*agg_peak, peak_bw);
> +
> + return 0;
> +}
> +
> +static struct icc_node_data *
> +tegra114_mc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
> +{
> + struct tegra_mc *mc = icc_provider_to_tegra_mc(data);
> + const struct tegra_mc_client *client;
> + unsigned int i, idx = spec->args[0];
> + struct icc_node_data *ndata;
> + struct icc_node *node;
> +
> + list_for_each_entry(node, &mc->provider.nodes, node_list) {
> + if (node->id != idx)
> + continue;
> +
> + ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
> + if (!ndata)
> + return ERR_PTR(-ENOMEM);
> +
> + client = &mc->soc->clients[idx];
> + ndata->node = node;
> +
> + switch (client->swgroup) {
> + case TEGRA_SWGROUP_DC:
> + case TEGRA_SWGROUP_DCB:
> + case TEGRA_SWGROUP_PTC:
> + case TEGRA_SWGROUP_VI:
> + /* these clients are isochronous by default */
> + ndata->tag = TEGRA_MC_ICC_TAG_ISO;
> + break;
> +
> + default:
> + ndata->tag = TEGRA_MC_ICC_TAG_DEFAULT;
> + break;
> + }
> +
> + return ndata;
> + }
> +
> + for (i = 0; i < mc->soc->num_clients; i++) {
> + if (mc->soc->clients[i].id == idx)
> + return ERR_PTR(-EPROBE_DEFER);
> + }
> +
> + dev_err(mc->dev, "invalid ICC client ID %u\n", idx);
> +
> + return ERR_PTR(-EINVAL);
> +}
> +
> +static const struct tegra_mc_icc_ops tegra114_mc_icc_ops = {
> + .xlate_extended = tegra114_mc_of_icc_xlate_extended,
> + .aggregate = tegra114_mc_icc_aggreate,
> + .set = tegra114_mc_icc_set,
> +};
> +
> +static const unsigned long tegra114_mc_emem_regs[] = {
> + MC_EMEM_ARB_CFG,
> + MC_EMEM_ARB_OUTSTANDING_REQ,
> + MC_EMEM_ARB_TIMING_RCD,
> + MC_EMEM_ARB_TIMING_RP,
> + MC_EMEM_ARB_TIMING_RC,
> + MC_EMEM_ARB_TIMING_RAS,
> + MC_EMEM_ARB_TIMING_FAW,
> + MC_EMEM_ARB_TIMING_RRD,
> + MC_EMEM_ARB_TIMING_RAP2PRE,
> + MC_EMEM_ARB_TIMING_WAP2PRE,
> + MC_EMEM_ARB_TIMING_R2R,
> + MC_EMEM_ARB_TIMING_W2W,
> + MC_EMEM_ARB_TIMING_R2W,
> + MC_EMEM_ARB_TIMING_W2R,
> + MC_EMEM_ARB_DA_TURNS,
> + MC_EMEM_ARB_DA_COVERS,
> + MC_EMEM_ARB_MISC0,
> + MC_EMEM_ARB_RING1_THROTTLE,
> +};
> +
> const struct tegra_mc_soc tegra114_mc_soc = {
> .clients = tegra114_mc_clients,
> .num_clients = ARRAY_SIZE(tegra114_mc_clients),
> @@ -1172,10 +1362,13 @@ const struct tegra_mc_soc tegra114_mc_soc = {
> .atom_size = 32,
> .client_id_mask = 0x7f,
> .smmu = &tegra114_smmu_soc,
> + .emem_regs = tegra114_mc_emem_regs,
> + .num_emem_regs = ARRAY_SIZE(tegra114_mc_emem_regs),
> .intmask = MC_INT_INVALID_SMMU_PAGE | MC_INT_SECURITY_VIOLATION |
> MC_INT_DECERR_EMEM,
> .reset_ops = &tegra_mc_reset_ops_common,
> .resets = tegra114_mc_resets,
> .num_resets = ARRAY_SIZE(tegra114_mc_resets),
> + .icc_ops = &tegra114_mc_icc_ops,
> .ops = &tegra30_mc_ops,
> };
>
Reviewed-by: Mikko Perttunen <mperttunen@nvidia.com>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 05/11] dt-bindings: memory: Add Tegra114 memory client IDs
2025-09-15 8:01 ` [PATCH v3 05/11] dt-bindings: memory: Add Tegra114 memory client IDs Svyatoslav Ryhel
@ 2025-11-13 4:47 ` Mikko Perttunen
0 siblings, 0 replies; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-13 4:47 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> Each memory client has unique hardware ID, add these IDs.
>
> Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> Acked-by: Rob Herring (Arm) <robh@kernel.org>
> ---
> include/dt-bindings/memory/tegra114-mc.h | 67 ++++++++++++++++++++++++
> 1 file changed, 67 insertions(+)
>
> diff --git a/include/dt-bindings/memory/tegra114-mc.h b/include/dt-bindings/memory/tegra114-mc.h
> index dfe99c8a5ba5..5e0d6a1b91f2 100644
> --- a/include/dt-bindings/memory/tegra114-mc.h
> +++ b/include/dt-bindings/memory/tegra114-mc.h
> @@ -40,4 +40,71 @@
> #define TEGRA114_MC_RESET_VDE 14
> #define TEGRA114_MC_RESET_VI 15
>
> +#define TEGRA114_MC_PTCR 0
> +#define TEGRA114_MC_DISPLAY0A 1
> +#define TEGRA114_MC_DISPLAY0AB 2
> +#define TEGRA114_MC_DISPLAY0B 3
> +#define TEGRA114_MC_DISPLAY0BB 4
> +#define TEGRA114_MC_DISPLAY0C 5
> +#define TEGRA114_MC_DISPLAY0CB 6
> +#define TEGRA114_MC_DISPLAY1B 7
> +#define TEGRA114_MC_DISPLAY1BB 8
> +#define TEGRA114_MC_EPPUP 9
> +#define TEGRA114_MC_G2PR 10
> +#define TEGRA114_MC_G2SR 11
> +#define TEGRA114_MC_MPEUNIFBR 12
> +#define TEGRA114_MC_VIRUV 13
> +#define TEGRA114_MC_AFIR 14
> +#define TEGRA114_MC_AVPCARM7R 15
> +#define TEGRA114_MC_DISPLAYHC 16
> +#define TEGRA114_MC_DISPLAYHCB 17
> +#define TEGRA114_MC_FDCDRD 18
> +#define TEGRA114_MC_FDCDRD2 19
> +#define TEGRA114_MC_G2DR 20
> +#define TEGRA114_MC_HDAR 21
> +#define TEGRA114_MC_HOST1XDMAR 22
> +#define TEGRA114_MC_HOST1XR 23
> +#define TEGRA114_MC_IDXSRD 24
> +#define TEGRA114_MC_IDXSRD2 25
> +#define TEGRA114_MC_MPE_IPRED 26
> +#define TEGRA114_MC_MPEAMEMRD 27
> +#define TEGRA114_MC_MPECSRD 28
> +#define TEGRA114_MC_PPCSAHBDMAR 29
> +#define TEGRA114_MC_PPCSAHBSLVR 30
> +#define TEGRA114_MC_SATAR 31
> +#define TEGRA114_MC_TEXSRD 32
> +#define TEGRA114_MC_TEXSRD2 33
> +#define TEGRA114_MC_VDEBSEVR 34
> +#define TEGRA114_MC_VDEMBER 35
> +#define TEGRA114_MC_VDEMCER 36
> +#define TEGRA114_MC_VDETPER 37
> +#define TEGRA114_MC_MPCORELPR 38
> +#define TEGRA114_MC_MPCORER 39
> +#define TEGRA114_MC_EPPU 40
> +#define TEGRA114_MC_EPPV 41
> +#define TEGRA114_MC_EPPY 42
> +#define TEGRA114_MC_MPEUNIFBW 43
> +#define TEGRA114_MC_VIWSB 44
> +#define TEGRA114_MC_VIWU 45
> +#define TEGRA114_MC_VIWV 46
> +#define TEGRA114_MC_VIWY 47
> +#define TEGRA114_MC_G2DW 48
> +#define TEGRA114_MC_AFIW 49
> +#define TEGRA114_MC_AVPCARM7W 50
> +#define TEGRA114_MC_FDCDWR 51
> +#define TEGRA114_MC_FDCDWR2 52
> +#define TEGRA114_MC_HDAW 53
> +#define TEGRA114_MC_HOST1XW 54
> +#define TEGRA114_MC_ISPW 55
> +#define TEGRA114_MC_MPCORELPW 56
> +#define TEGRA114_MC_MPCOREW 57
> +#define TEGRA114_MC_MPECSWR 58
> +#define TEGRA114_MC_PPCSAHBDMAW 59
> +#define TEGRA114_MC_PPCSAHBSLVW 60
> +#define TEGRA114_MC_SATAW 61
> +#define TEGRA114_MC_VDEBSEVW 62
> +#define TEGRA114_MC_VDEDBGW 63
> +#define TEGRA114_MC_VDEMBEW 64
> +#define TEGRA114_MC_VDETPMW 65
> +
> #endif
>
Reviewed-by: Mikko Perttunen <mperttunen@nvidia.com>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114
2025-09-15 8:01 ` [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114 Svyatoslav Ryhel
2025-09-21 17:54 ` Stephen Boyd
@ 2025-11-13 5:05 ` Mikko Perttunen
2025-11-13 14:29 ` Svyatoslav Ryhel
1 sibling, 1 reply; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-13 5:05 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> Configure EMC without mux for correct EMC driver support.
Rather than just 'removing EMC to MC clock mux in Tegra114', I would say this patch removes current emc and emc_mux clocks and replaces them with the proper EMC clock implementation. I would edit the commit subject and commit message along those lines.
>
> Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> ---
> drivers/clk/tegra/clk-tegra114.c | 48 ++++++++++++++++++++++----------
> 1 file changed, 33 insertions(+), 15 deletions(-)
>
> diff --git a/drivers/clk/tegra/clk-tegra114.c b/drivers/clk/tegra/clk-tegra114.c
> index 8bde72aa5e68..6b3a140772c2 100644
> --- a/drivers/clk/tegra/clk-tegra114.c
> +++ b/drivers/clk/tegra/clk-tegra114.c
> @@ -622,10 +622,6 @@ static const char *mux_plld_out0_plld2_out0[] = {
> };
> #define mux_plld_out0_plld2_out0_idx NULL
>
> -static const char *mux_pllmcp_clkm[] = {
> - "pll_m_out0", "pll_c_out0", "pll_p_out0", "clk_m", "pll_m_ud",
> -};
> -
> static const struct clk_div_table pll_re_div_table[] = {
> { .val = 0, .div = 1 },
> { .val = 1, .div = 2 },
> @@ -672,7 +668,6 @@ static struct tegra_clk tegra114_clks[tegra_clk_max] __initdata = {
> [tegra_clk_csi] = { .dt_id = TEGRA114_CLK_CSI, .present = true },
> [tegra_clk_i2c2] = { .dt_id = TEGRA114_CLK_I2C2, .present = true },
> [tegra_clk_uartc] = { .dt_id = TEGRA114_CLK_UARTC, .present = true },
> - [tegra_clk_emc] = { .dt_id = TEGRA114_CLK_EMC, .present = true },
> [tegra_clk_usb2] = { .dt_id = TEGRA114_CLK_USB2, .present = true },
> [tegra_clk_usb3] = { .dt_id = TEGRA114_CLK_USB3, .present = true },
> [tegra_clk_vde_8] = { .dt_id = TEGRA114_CLK_VDE, .present = true },
> @@ -1048,14 +1043,7 @@ static __init void tegra114_periph_clk_init(void __iomem *clk_base,
> 0, 82, periph_clk_enb_refcnt);
> clks[TEGRA114_CLK_DSIB] = clk;
>
> - /* emc mux */
> - clk = clk_register_mux(NULL, "emc_mux", mux_pllmcp_clkm,
> - ARRAY_SIZE(mux_pllmcp_clkm),
> - CLK_SET_RATE_NO_REPARENT,
> - clk_base + CLK_SOURCE_EMC,
> - 29, 3, 0, &emc_lock);
> -
> - clk = tegra_clk_register_mc("mc", "emc_mux", clk_base + CLK_SOURCE_EMC,
> + clk = tegra_clk_register_mc("mc", "emc", clk_base + CLK_SOURCE_EMC,
> &emc_lock);
> clks[TEGRA114_CLK_MC] = clk;
>
> @@ -1321,6 +1309,28 @@ static int tegra114_reset_deassert(unsigned long id)
> return 0;
> }
>
> +#ifdef CONFIG_TEGRA124_CLK_EMC
> +static struct clk *tegra114_clk_src_onecell_get(struct of_phandle_args *clkspec,
> + void *data)
> +{
> + struct clk_hw *hw;
> + struct clk *clk;
> +
> + clk = of_clk_src_onecell_get(clkspec, data);
> + if (IS_ERR(clk))
> + return clk;
> +
> + hw = __clk_get_hw(clk);
> +
> + if (clkspec->args[0] == TEGRA114_CLK_EMC) {
> + if (!tegra124_clk_emc_driver_available(hw))
> + return ERR_PTR(-EPROBE_DEFER);
> + }
> +
> + return clk;
> +}
> +#endif
> +
> static void __init tegra114_clock_init(struct device_node *np)
> {
> struct device_node *node;
> @@ -1362,16 +1372,24 @@ static void __init tegra114_clock_init(struct device_node *np)
> tegra_audio_clk_init(clk_base, pmc_base, tegra114_clks,
> tegra114_audio_plls,
> ARRAY_SIZE(tegra114_audio_plls), 24000000);
> +
> + tegra_clk_apply_init_table = tegra114_clock_apply_init_table;
> +
Is there any particular reason for moving this here? If not, omitting the change would simplify the patch a bit.
> tegra_super_clk_gen4_init(clk_base, pmc_base, tegra114_clks,
> &pll_x_params);
>
> tegra_init_special_resets(1, tegra114_reset_assert,
> tegra114_reset_deassert);
>
> +#ifdef CONFIG_TEGRA124_CLK_EMC
> + tegra_add_of_provider(np, tegra114_clk_src_onecell_get);
> + clks[TEGRA114_CLK_EMC] = tegra124_clk_register_emc(clk_base, np,
> + &emc_lock);
> +#else
> tegra_add_of_provider(np, of_clk_src_onecell_get);
> - tegra_register_devclks(devclks, ARRAY_SIZE(devclks));
> +#endif
tegra124_clk_register_emc and tegra124_clk_emc_driver_available have stub implementations when CONFIG_TEGRA124_CLK_EMC is not enabled, so it would be cleaner to just call them always.
>
> - tegra_clk_apply_init_table = tegra114_clock_apply_init_table;
> + tegra_register_devclks(devclks, ARRAY_SIZE(devclks));
>
> tegra_cpu_car_ops = &tegra114_cpu_car_ops;
> }
>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114
2025-09-21 17:54 ` Stephen Boyd
@ 2025-11-13 14:21 ` Svyatoslav Ryhel
2025-11-25 10:21 ` Svyatoslav Ryhel
1 sibling, 0 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-11-13 14:21 UTC (permalink / raw)
To: Stephen Boyd
Cc: Chanwoo Choi, Conor Dooley, Dmitry Osipenko, Jonathan Hunter,
Krzysztof Kozlowski, Kyungmin Park, Michael Turquette,
Mikko Perttunen, MyungJoo Ham, Prashant Gaikwad, Rob Herring,
Thierry Reding, Thierry Reding, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
нд, 21 вер. 2025 р. о 20:54 Stephen Boyd <sboyd@kernel.org> пише:
>
> Quoting Svyatoslav Ryhel (2025-09-15 01:01:52)
> > diff --git a/drivers/clk/tegra/clk-tegra114.c b/drivers/clk/tegra/clk-tegra114.c
> > index 8bde72aa5e68..6b3a140772c2 100644
> > --- a/drivers/clk/tegra/clk-tegra114.c
> > +++ b/drivers/clk/tegra/clk-tegra114.c
> > @@ -1321,6 +1309,28 @@ static int tegra114_reset_deassert(unsigned long id)
> > return 0;
> > }
> >
> > +#ifdef CONFIG_TEGRA124_CLK_EMC
> > +static struct clk *tegra114_clk_src_onecell_get(struct of_phandle_args *clkspec,
> > + void *data)
> > +{
> > + struct clk_hw *hw;
> > + struct clk *clk;
> > +
> > + clk = of_clk_src_onecell_get(clkspec, data);
> > + if (IS_ERR(clk))
> > + return clk;
> > +
> > + hw = __clk_get_hw(clk);
>
> Can you just use of_clk_hw_onecell_get() instead? Then we don't need to
> use __clk_get_hw(). Or is this whole function used to return a clk
> pointer to something that isn't the clk framework?
>
This logic was adopted from Tegra124 driver, but of_clk_hw_onecell_get
might be applicable. I will adjust to use it and if all works as
expected, I will apply it in v4. Thank you.
> > +
> > + if (clkspec->args[0] == TEGRA114_CLK_EMC) {
> > + if (!tegra124_clk_emc_driver_available(hw))
> > + return ERR_PTR(-EPROBE_DEFER);
> > + }
> > +
> > + return clk;
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114
2025-11-13 5:05 ` Mikko Perttunen
@ 2025-11-13 14:29 ` Svyatoslav Ryhel
0 siblings, 0 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-11-13 14:29 UTC (permalink / raw)
To: Mikko Perttunen
Cc: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
чт, 13 лист. 2025 р. о 07:05 Mikko Perttunen <mperttunen@nvidia.com> пише:
>
> On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> > Configure EMC without mux for correct EMC driver support.
>
> Rather than just 'removing EMC to MC clock mux in Tegra114', I would say this patch removes current emc and emc_mux clocks and replaces them with the proper EMC clock implementation. I would edit the commit subject and commit message along those lines.
>
Noted
> >
> > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > ---
> > drivers/clk/tegra/clk-tegra114.c | 48 ++++++++++++++++++++++----------
> > 1 file changed, 33 insertions(+), 15 deletions(-)
> >
> > diff --git a/drivers/clk/tegra/clk-tegra114.c b/drivers/clk/tegra/clk-tegra114.c
> > index 8bde72aa5e68..6b3a140772c2 100644
> > --- a/drivers/clk/tegra/clk-tegra114.c
> > +++ b/drivers/clk/tegra/clk-tegra114.c
> > @@ -622,10 +622,6 @@ static const char *mux_plld_out0_plld2_out0[] = {
> > };
> > #define mux_plld_out0_plld2_out0_idx NULL
> >
> > -static const char *mux_pllmcp_clkm[] = {
> > - "pll_m_out0", "pll_c_out0", "pll_p_out0", "clk_m", "pll_m_ud",
> > -};
> > -
> > static const struct clk_div_table pll_re_div_table[] = {
> > { .val = 0, .div = 1 },
> > { .val = 1, .div = 2 },
> > @@ -672,7 +668,6 @@ static struct tegra_clk tegra114_clks[tegra_clk_max] __initdata = {
> > [tegra_clk_csi] = { .dt_id = TEGRA114_CLK_CSI, .present = true },
> > [tegra_clk_i2c2] = { .dt_id = TEGRA114_CLK_I2C2, .present = true },
> > [tegra_clk_uartc] = { .dt_id = TEGRA114_CLK_UARTC, .present = true },
> > - [tegra_clk_emc] = { .dt_id = TEGRA114_CLK_EMC, .present = true },
> > [tegra_clk_usb2] = { .dt_id = TEGRA114_CLK_USB2, .present = true },
> > [tegra_clk_usb3] = { .dt_id = TEGRA114_CLK_USB3, .present = true },
> > [tegra_clk_vde_8] = { .dt_id = TEGRA114_CLK_VDE, .present = true },
> > @@ -1048,14 +1043,7 @@ static __init void tegra114_periph_clk_init(void __iomem *clk_base,
> > 0, 82, periph_clk_enb_refcnt);
> > clks[TEGRA114_CLK_DSIB] = clk;
> >
> > - /* emc mux */
> > - clk = clk_register_mux(NULL, "emc_mux", mux_pllmcp_clkm,
> > - ARRAY_SIZE(mux_pllmcp_clkm),
> > - CLK_SET_RATE_NO_REPARENT,
> > - clk_base + CLK_SOURCE_EMC,
> > - 29, 3, 0, &emc_lock);
> > -
> > - clk = tegra_clk_register_mc("mc", "emc_mux", clk_base + CLK_SOURCE_EMC,
> > + clk = tegra_clk_register_mc("mc", "emc", clk_base + CLK_SOURCE_EMC,
> > &emc_lock);
> > clks[TEGRA114_CLK_MC] = clk;
> >
> > @@ -1321,6 +1309,28 @@ static int tegra114_reset_deassert(unsigned long id)
> > return 0;
> > }
> >
> > +#ifdef CONFIG_TEGRA124_CLK_EMC
> > +static struct clk *tegra114_clk_src_onecell_get(struct of_phandle_args *clkspec,
> > + void *data)
> > +{
> > + struct clk_hw *hw;
> > + struct clk *clk;
> > +
> > + clk = of_clk_src_onecell_get(clkspec, data);
> > + if (IS_ERR(clk))
> > + return clk;
> > +
> > + hw = __clk_get_hw(clk);
> > +
> > + if (clkspec->args[0] == TEGRA114_CLK_EMC) {
> > + if (!tegra124_clk_emc_driver_available(hw))
> > + return ERR_PTR(-EPROBE_DEFER);
> > + }
> > +
> > + return clk;
> > +}
> > +#endif
> > +
> > static void __init tegra114_clock_init(struct device_node *np)
> > {
> > struct device_node *node;
> > @@ -1362,16 +1372,24 @@ static void __init tegra114_clock_init(struct device_node *np)
> > tegra_audio_clk_init(clk_base, pmc_base, tegra114_clks,
> > tegra114_audio_plls,
> > ARRAY_SIZE(tegra114_audio_plls), 24000000);
> > +
> > + tegra_clk_apply_init_table = tegra114_clock_apply_init_table;
> > +
>
> Is there any particular reason for moving this here? If not, omitting the change would simplify the patch a bit.
>
IIRC, I tried to align with Tegra124 EMC clk driver, I will try to
drop this change and check if all works as expected.
> > tegra_super_clk_gen4_init(clk_base, pmc_base, tegra114_clks,
> > &pll_x_params);
> >
> > tegra_init_special_resets(1, tegra114_reset_assert,
> > tegra114_reset_deassert);
> >
> > +#ifdef CONFIG_TEGRA124_CLK_EMC
> > + tegra_add_of_provider(np, tegra114_clk_src_onecell_get);
> > + clks[TEGRA114_CLK_EMC] = tegra124_clk_register_emc(clk_base, np,
> > + &emc_lock);
> > +#else
> > tegra_add_of_provider(np, of_clk_src_onecell_get);
> > - tegra_register_devclks(devclks, ARRAY_SIZE(devclks));
> > +#endif
>
> tegra124_clk_register_emc and tegra124_clk_emc_driver_available have stub implementations when CONFIG_TEGRA124_CLK_EMC is not enabled, so it would be cleaner to just call them always.
>
Yes, I will adjust this in v4. Thank you.
> >
> > - tegra_clk_apply_init_table = tegra114_clock_apply_init_table;
> > + tegra_register_devclks(devclks, ARRAY_SIZE(devclks));
> >
> > tegra_cpu_car_ops = &tegra114_cpu_car_ops;
> > }
> >
>
>
>
>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver
2025-09-15 8:01 ` [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver Svyatoslav Ryhel
@ 2025-11-18 7:08 ` Mikko Perttunen
2025-11-18 8:05 ` Svyatoslav Ryhel
0 siblings, 1 reply; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-18 7:08 UTC (permalink / raw)
To: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, Svyatoslav Ryhel, Svyatoslav Ryhel
Cc: linux-kernel, devicetree, linux-tegra, linux-clk, linux-pm
On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> Introduce driver for the External Memory Controller (EMC) found in Tegra114
> SoC. It controls the external DRAM on the board. The purpose of this
> driver is to program memory timing for external memory on the EMC clock
> rate change.
>
> Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> ---
> drivers/memory/tegra/Kconfig | 12 +
> drivers/memory/tegra/Makefile | 1 +
> drivers/memory/tegra/tegra114-emc.c | 1487 +++++++++++++++++++++++++++
> 3 files changed, 1500 insertions(+)
> create mode 100644 drivers/memory/tegra/tegra114-emc.c
>
> diff --git a/drivers/memory/tegra/Kconfig b/drivers/memory/tegra/Kconfig
> index fc5a27791826..11e7cc357d39 100644
> --- a/drivers/memory/tegra/Kconfig
> +++ b/drivers/memory/tegra/Kconfig
> @@ -35,6 +35,18 @@ config TEGRA30_EMC
> This driver is required to change memory timings / clock rate for
> external memory.
>
> +config TEGRA114_EMC
> + tristate "NVIDIA Tegra114 External Memory Controller driver"
> + default y
> + depends on ARCH_TEGRA_114_SOC || COMPILE_TEST
> + select TEGRA124_CLK_EMC if ARCH_TEGRA
> + select PM_OPP
> + help
> + This driver is for the External Memory Controller (EMC) found on
> + Tegra114 chips. The EMC controls the external DRAM on the board.
> + This driver is required to change memory timings / clock rate for
> + external memory.
> +
> config TEGRA124_EMC
> tristate "NVIDIA Tegra124 External Memory Controller driver"
> default ARCH_TEGRA_124_SOC
> diff --git a/drivers/memory/tegra/Makefile b/drivers/memory/tegra/Makefile
> index 0750847dac3c..d36be28efc4a 100644
> --- a/drivers/memory/tegra/Makefile
> +++ b/drivers/memory/tegra/Makefile
> @@ -15,6 +15,7 @@ obj-$(CONFIG_TEGRA_MC) += tegra-mc.o
>
> obj-$(CONFIG_TEGRA20_EMC) += tegra20-emc.o
> obj-$(CONFIG_TEGRA30_EMC) += tegra30-emc.o
> +obj-$(CONFIG_TEGRA114_EMC) += tegra114-emc.o
> obj-$(CONFIG_TEGRA124_EMC) += tegra124-emc.o
> obj-$(CONFIG_TEGRA210_EMC_TABLE) += tegra210-emc-table.o
> obj-$(CONFIG_TEGRA210_EMC) += tegra210-emc.o
> diff --git a/drivers/memory/tegra/tegra114-emc.c b/drivers/memory/tegra/tegra114-emc.c
> new file mode 100644
> index 000000000000..b986b5509f41
> --- /dev/null
> +++ b/drivers/memory/tegra/tegra114-emc.c
> @@ -0,0 +1,1487 @@
> +// SPDX-License-Identifier: GPL-2.0-only
> +/*
> + * Tegra114 External Memory Controller driver
> + *
> + * Based on downstream driver from NVIDIA and tegra124-emc.c
> + * Copyright (C) 2011-2014 NVIDIA Corporation
> + *
> + * Copyright (C) 2024 Svyatoslav Ryhel <clamor95@gmail.com>
> + */
> +
> +#include <linux/clk-provider.h>
> +#include <linux/clk.h>
> +#include <linux/clkdev.h>
> +#include <linux/clk/tegra.h>
> +#include <linux/debugfs.h>
> +#include <linux/delay.h>
> +#include <linux/interconnect-provider.h>
> +#include <linux/interrupt.h>
> +#include <linux/io.h>
> +#include <linux/module.h>
> +#include <linux/mutex.h>
> +#include <linux/of_address.h>
> +#include <linux/of_platform.h>
> +#include <linux/platform_device.h>
> +#include <linux/pm_opp.h>
> +#include <linux/sort.h>
> +#include <linux/string.h>
> +
> +#include <soc/tegra/fuse.h>
> +#include <soc/tegra/mc.h>
> +
> +#include "mc.h"
> +
> +#define EMC_INTSTATUS 0x0
> +#define EMC_REFRESH_OVERFLOW_INT BIT(3)
> +#define EMC_INTSTATUS_CLKCHANGE_COMPLETE BIT(4)
This naming is inconsistent. I'd prefer using EMC_INTSTATUS_REFRESH_OVERFLOW and EMC_INTSTATUS_CLKCHANGE_COMPLETE.
> +
> +#define EMC_INTMASK 0x4
> +
> +#define EMC_DBG 0x8
> +#define EMC_DBG_READ_MUX_ASSEMBLY BIT(0)
> +#define EMC_DBG_WRITE_MUX_ACTIVE BIT(1)
> +#define EMC_DBG_FORCE_UPDATE BIT(2)
> +#define EMC_DBG_CFG_PRIORITY BIT(24)
> +
> +#define EMC_CFG 0xc
> +#define EMC_CFG_DRAM_CLKSTOP_PD BIT(31)
> +#define EMC_CFG_DRAM_CLKSTOP_SR BIT(30)
> +#define EMC_CFG_DRAM_ACPD BIT(29)
> +#define EMC_CFG_DYN_SREF BIT(28)
> +#define EMC_CFG_PWR_MASK ((0xF << 28) | BIT(18))
> +#define EMC_CFG_DSR_VTTGEN_DRV_EN BIT(18)
Ordering from first to last register would be more consistent.
> +
> +#define EMC_ADR_CFG 0x10
> +#define EMC_ADR_CFG_EMEM_NUMDEV BIT(0)
> +
> +#define EMC_REFCTRL 0x20
> +#define EMC_REFCTRL_DEV_SEL_SHIFT 0
> +#define EMC_REFCTRL_ENABLE BIT(31)
> +
> +#define EMC_TIMING_CONTROL 0x28
> +#define EMC_RC 0x2c
> +#define EMC_RFC 0x30
> +#define EMC_RAS 0x34
> +#define EMC_RP 0x38
> +#define EMC_R2W 0x3c
> +#define EMC_W2R 0x40
> +#define EMC_R2P 0x44
> +#define EMC_W2P 0x48
> +#define EMC_RD_RCD 0x4c
> +#define EMC_WR_RCD 0x50
> +#define EMC_RRD 0x54
> +#define EMC_REXT 0x58
> +#define EMC_WDV 0x5c
> +#define EMC_QUSE 0x60
> +#define EMC_QRST 0x64
> +#define EMC_QSAFE 0x68
> +#define EMC_RDV 0x6c
> +#define EMC_REFRESH 0x70
> +#define EMC_BURST_REFRESH_NUM 0x74
> +#define EMC_PDEX2WR 0x78
> +#define EMC_PDEX2RD 0x7c
> +#define EMC_PCHG2PDEN 0x80
> +#define EMC_ACT2PDEN 0x84
> +#define EMC_AR2PDEN 0x88
> +#define EMC_RW2PDEN 0x8c
> +#define EMC_TXSR 0x90
> +#define EMC_TCKE 0x94
> +#define EMC_TFAW 0x98
> +#define EMC_TRPAB 0x9c
> +#define EMC_TCLKSTABLE 0xa0
> +#define EMC_TCLKSTOP 0xa4
> +#define EMC_TREFBW 0xa8
> +#define EMC_QUSE_EXTRA 0xac
> +#define EMC_ODT_WRITE 0xb0
> +#define EMC_ODT_READ 0xb4
> +#define EMC_WEXT 0xb8
> +#define EMC_CTT 0xbc
> +#define EMC_RFC_SLR 0xc0
> +#define EMC_MRS_WAIT_CNT2 0xc4
> +
> +#define EMC_MRS_WAIT_CNT 0xc8
> +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT 0
> +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK \
> + (0x3FF << EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT)
> +#define EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT 16
> +#define EMC_MRS_WAIT_CNT_LONG_WAIT_MASK \
> + (0x3FF << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> +
> +#define EMC_MRS 0xcc
> +#define EMC_MODE_SET_DLL_RESET BIT(8)
> +#define EMC_MODE_SET_LONG_CNT BIT(26)
> +#define EMC_EMRS 0xd0
> +#define EMC_REF 0xd4
> +#define EMC_PRE 0xd8
> +
> +#define EMC_SELF_REF 0xe0
> +#define EMC_SELF_REF_CMD_ENABLED BIT(0)
> +#define EMC_SELF_REF_DEV_SEL_SHIFT 30
> +
> +#define EMC_MRW 0xe8
> +
> +#define EMC_MRR 0xec
> +#define EMC_MRR_MA_SHIFT 16
> +#define LPDDR2_MR4_TEMP_SHIFT 0
> +
> +#define EMC_XM2DQSPADCTRL3 0xf8
> +#define EMC_FBIO_SPARE 0x100
> +
> +#define EMC_FBIO_CFG5 0x104
> +#define EMC_FBIO_CFG5_DRAM_TYPE_MASK 0x3
> +#define EMC_FBIO_CFG5_DRAM_TYPE_SHIFT 0
Inconsistent to indent here and not elsewhere. My preference is not to indent.
> +
> +#define EMC_FBIO_CFG6 0x114
> +#define EMC_EMRS2 0x12c
> +#define EMC_MRW2 0x134
> +#define EMC_MRW4 0x13c
> +#define EMC_EINPUT 0x14c
> +#define EMC_EINPUT_DURATION 0x150
> +#define EMC_PUTERM_EXTRA 0x154
> +#define EMC_TCKESR 0x158
> +#define EMC_TPD 0x15c
> +
> +#define EMC_AUTO_CAL_CONFIG 0x2a4
> +#define EMC_AUTO_CAL_CONFIG_AUTO_CAL_START BIT(31)
> +#define EMC_AUTO_CAL_INTERVAL 0x2a8
> +#define EMC_AUTO_CAL_STATUS 0x2ac
> +#define EMC_AUTO_CAL_STATUS_ACTIVE BIT(31)
> +#define EMC_STATUS 0x2b4
> +#define EMC_STATUS_TIMING_UPDATE_STALLED BIT(23)
> +
> +#define EMC_CFG_2 0x2b8
> +#define EMC_CLKCHANGE_REQ_ENABLE BIT(0)
> +#define EMC_CLKCHANGE_PD_ENABLE BIT(1)
> +#define EMC_CLKCHANGE_SR_ENABLE BIT(2)
Better to prefix with EMC_CFG_2
> +
> +#define EMC_CFG_DIG_DLL 0x2bc
> +#define EMC_CFG_DIG_DLL_PERIOD 0x2c0
> +#define EMC_RDV_MASK 0x2cc
> +#define EMC_WDV_MASK 0x2d0
> +#define EMC_CTT_DURATION 0x2d8
> +#define EMC_CTT_TERM_CTRL 0x2dc
> +#define EMC_ZCAL_INTERVAL 0x2e0
> +#define EMC_ZCAL_WAIT_CNT 0x2e4
> +
> +#define EMC_ZQ_CAL 0x2ec
> +#define EMC_ZQ_CAL_CMD BIT(0)
> +#define EMC_ZQ_CAL_LONG BIT(4)
> +#define EMC_ZQ_CAL_LONG_CMD_DEV0 \
> + (DRAM_DEV_SEL_0 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> +#define EMC_ZQ_CAL_LONG_CMD_DEV1 \
> + (DRAM_DEV_SEL_1 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> +
> +#define EMC_XM2CMDPADCTRL 0x2f0
> +#define EMC_XM2DQSPADCTRL 0x2f8
> +#define EMC_XM2DQSPADCTRL2 0x2fc
> +#define EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE BIT(0)
> +#define EMC_XM2DQSPADCTRL2_VREF_ENABLE BIT(5)
> +#define EMC_XM2DQPADCTRL 0x300
> +#define EMC_XM2DQPADCTRL2 0x304
> +#define EMC_XM2CLKPADCTRL 0x308
> +#define EMC_XM2COMPPADCTRL 0x30c
> +#define EMC_XM2VTTGENPADCTRL 0x310
> +#define EMC_XM2VTTGENPADCTRL2 0x314
> +#define EMC_XM2QUSEPADCTRL 0x318
> +#define EMC_XM2DQSPADCTRL4 0x320
> +#define EMC_DLL_XFORM_DQS0 0x328
> +#define EMC_DLL_XFORM_DQS1 0x32c
> +#define EMC_DLL_XFORM_DQS2 0x330
> +#define EMC_DLL_XFORM_DQS3 0x334
> +#define EMC_DLL_XFORM_DQS4 0x338
> +#define EMC_DLL_XFORM_DQS5 0x33c
> +#define EMC_DLL_XFORM_DQS6 0x340
> +#define EMC_DLL_XFORM_DQS7 0x344
> +#define EMC_DLL_XFORM_QUSE0 0x348
> +#define EMC_DLL_XFORM_QUSE1 0x34c
> +#define EMC_DLL_XFORM_QUSE2 0x350
> +#define EMC_DLL_XFORM_QUSE3 0x354
> +#define EMC_DLL_XFORM_QUSE4 0x358
> +#define EMC_DLL_XFORM_QUSE5 0x35c
> +#define EMC_DLL_XFORM_QUSE6 0x360
> +#define EMC_DLL_XFORM_QUSE7 0x364
> +#define EMC_DLL_XFORM_DQ0 0x368
> +#define EMC_DLL_XFORM_DQ1 0x36c
> +#define EMC_DLL_XFORM_DQ2 0x370
> +#define EMC_DLL_XFORM_DQ3 0x374
> +#define EMC_DLI_TRIM_TXDQS0 0x3a8
> +#define EMC_DLI_TRIM_TXDQS1 0x3ac
> +#define EMC_DLI_TRIM_TXDQS2 0x3b0
> +#define EMC_DLI_TRIM_TXDQS3 0x3b4
> +#define EMC_DLI_TRIM_TXDQS4 0x3b8
> +#define EMC_DLI_TRIM_TXDQS5 0x3bc
> +#define EMC_DLI_TRIM_TXDQS6 0x3c0
> +#define EMC_DLI_TRIM_TXDQS7 0x3c4
> +#define EMC_STALL_THEN_EXE_AFTER_CLKCHANGE 0x3cc
> +#define EMC_SEL_DPD_CTRL 0x3d8
> +#define EMC_SEL_DPD_CTRL_DATA_SEL_DPD BIT(8)
> +#define EMC_SEL_DPD_CTRL_ODT_SEL_DPD BIT(5)
> +#define EMC_SEL_DPD_CTRL_RESET_SEL_DPD BIT(4)
> +#define EMC_SEL_DPD_CTRL_CA_SEL_DPD BIT(3)
> +#define EMC_SEL_DPD_CTRL_CLK_SEL_DPD BIT(2)
> +#define EMC_SEL_DPD_CTRL_DDR3_MASK \
> + ((0xf << 2) | BIT(8))
> +#define EMC_SEL_DPD_CTRL_MASK \
> + ((0x3 << 2) | BIT(5) | BIT(8))
> +#define EMC_PRE_REFRESH_REQ_CNT 0x3dc
> +#define EMC_DYN_SELF_REF_CONTROL 0x3e0
> +#define EMC_TXSRDLL 0x3e4
> +#define EMC_CCFIFO_ADDR 0x3e8
> +#define EMC_CCFIFO_DATA 0x3ec
> +#define EMC_CCFIFO_STATUS 0x3f0
> +#define EMC_CDB_CNTL_1 0x3f4
> +#define EMC_CDB_CNTL_2 0x3f8
> +#define EMC_XM2CLKPADCTRL2 0x3fc
> +#define EMC_AUTO_CAL_CONFIG2 0x458
> +#define EMC_AUTO_CAL_CONFIG3 0x45c
> +#define EMC_IBDLY 0x468
> +#define EMC_DLL_XFORM_ADDR0 0x46c
> +#define EMC_DLL_XFORM_ADDR1 0x470
> +#define EMC_DLL_XFORM_ADDR2 0x474
> +#define EMC_DSR_VTTGEN_DRV 0x47c
> +#define EMC_TXDSRVTTGEN 0x480
> +#define EMC_XM2CMDPADCTRL4 0x484
> +
> +#define DRAM_DEV_SEL_ALL 0
> +#define DRAM_DEV_SEL_0 BIT(31)
> +#define DRAM_DEV_SEL_1 BIT(30)
> +
> +#define EMC_CFG_POWER_FEATURES_MASK \
> + (EMC_CFG_DYN_SREF | EMC_CFG_DRAM_ACPD | EMC_CFG_DRAM_CLKSTOP_SR | \
> + EMC_CFG_DRAM_CLKSTOP_PD | EMC_CFG_DSR_VTTGEN_DRV_EN)
> +#define EMC_REFCTRL_DEV_SEL(n) ((((n) > 1) ? 0 : 2) << EMC_REFCTRL_DEV_SEL_SHIFT)
> +#define EMC_DRAM_DEV_SEL(n) (((n) > 1) ? DRAM_DEV_SEL_ALL : DRAM_DEV_SEL_0)
> +
> +/* Maximum amount of time in us. to wait for changes to become effective */
> +#define EMC_STATUS_UPDATE_TIMEOUT 1000
> +
> +enum emc_dram_type {
> + DRAM_TYPE_DDR3,
> + DRAM_TYPE_DDR1,
> + DRAM_TYPE_LPDDR2,
> + DRAM_TYPE_DDR2
> +};
> +
> +enum emc_dll_change {
> + DLL_CHANGE_NONE,
> + DLL_CHANGE_ON,
> + DLL_CHANGE_OFF
> +};
> +
> +static const unsigned long emc_burst_regs[] = {
> + EMC_RC,
> + EMC_RFC,
> + EMC_RAS,
> + EMC_RP,
> + EMC_R2W,
> + EMC_W2R,
> + EMC_R2P,
> + EMC_W2P,
> + EMC_RD_RCD,
> + EMC_WR_RCD,
> + EMC_RRD,
> + EMC_REXT,
> + EMC_WEXT,
> + EMC_WDV,
> + EMC_WDV_MASK,
> + EMC_QUSE,
> + EMC_IBDLY,
> + EMC_EINPUT,
> + EMC_EINPUT_DURATION,
> + EMC_PUTERM_EXTRA,
> + EMC_CDB_CNTL_1,
> + EMC_CDB_CNTL_2,
> + EMC_QRST,
> + EMC_QSAFE,
> + EMC_RDV,
> + EMC_RDV_MASK,
> + EMC_REFRESH,
> + EMC_BURST_REFRESH_NUM,
> + EMC_PRE_REFRESH_REQ_CNT,
> + EMC_PDEX2WR,
> + EMC_PDEX2RD,
> + EMC_PCHG2PDEN,
> + EMC_ACT2PDEN,
> + EMC_AR2PDEN,
> + EMC_RW2PDEN,
> + EMC_TXSR,
> + EMC_TXSRDLL,
> + EMC_TCKE,
> + EMC_TCKESR,
> + EMC_TPD,
> + EMC_TFAW,
> + EMC_TRPAB,
> + EMC_TCLKSTABLE,
> + EMC_TCLKSTOP,
> + EMC_TREFBW,
> + EMC_QUSE_EXTRA,
> + EMC_FBIO_CFG6,
> + EMC_ODT_WRITE,
> + EMC_ODT_READ,
> + EMC_FBIO_CFG5,
> + EMC_CFG_DIG_DLL,
> + EMC_CFG_DIG_DLL_PERIOD,
> + EMC_DLL_XFORM_DQS0,
> + EMC_DLL_XFORM_DQS1,
> + EMC_DLL_XFORM_DQS2,
> + EMC_DLL_XFORM_DQS3,
> + EMC_DLL_XFORM_DQS4,
> + EMC_DLL_XFORM_DQS5,
> + EMC_DLL_XFORM_DQS6,
> + EMC_DLL_XFORM_DQS7,
> + EMC_DLL_XFORM_QUSE0,
> + EMC_DLL_XFORM_QUSE1,
> + EMC_DLL_XFORM_QUSE2,
> + EMC_DLL_XFORM_QUSE3,
> + EMC_DLL_XFORM_QUSE4,
> + EMC_DLL_XFORM_QUSE5,
> + EMC_DLL_XFORM_QUSE6,
> + EMC_DLL_XFORM_QUSE7,
> + EMC_DLI_TRIM_TXDQS0,
> + EMC_DLI_TRIM_TXDQS1,
> + EMC_DLI_TRIM_TXDQS2,
> + EMC_DLI_TRIM_TXDQS3,
> + EMC_DLI_TRIM_TXDQS4,
> + EMC_DLI_TRIM_TXDQS5,
> + EMC_DLI_TRIM_TXDQS6,
> + EMC_DLI_TRIM_TXDQS7,
> + EMC_DLL_XFORM_DQ0,
> + EMC_DLL_XFORM_DQ1,
> + EMC_DLL_XFORM_DQ2,
> + EMC_DLL_XFORM_DQ3,
> + EMC_XM2CMDPADCTRL,
> + EMC_XM2CMDPADCTRL4,
> + EMC_XM2DQPADCTRL2,
> + EMC_XM2CLKPADCTRL,
> + EMC_XM2COMPPADCTRL,
> + EMC_XM2VTTGENPADCTRL,
> + EMC_XM2VTTGENPADCTRL2,
> + EMC_XM2DQSPADCTRL3,
> + EMC_XM2DQSPADCTRL4,
> + EMC_DSR_VTTGEN_DRV,
> + EMC_TXDSRVTTGEN,
> + EMC_FBIO_SPARE,
> + EMC_ZCAL_WAIT_CNT,
> + EMC_MRS_WAIT_CNT2,
> + EMC_CTT,
> + EMC_CTT_DURATION,
> + EMC_DYN_SELF_REF_CONTROL,
> +};
How was this list determined? It doesn't seem to match the trees I can find, or the list in the TRM (which is also different from the downstream source code).
> +
> +struct emc_timing {
> + unsigned long rate;
> +
> + u32 emc_burst_data[ARRAY_SIZE(emc_burst_regs)];
> +
> + u32 emc_auto_cal_config;
> + u32 emc_auto_cal_config2;
> + u32 emc_auto_cal_config3;
> + u32 emc_auto_cal_interval;
> + u32 emc_cfg;
> + u32 emc_ctt_term_ctrl;
> + u32 emc_mode_1;
> + u32 emc_mode_2;
> + u32 emc_mode_4;
> + u32 emc_mode_reset;
> + u32 emc_mrs_wait_cnt;
> + u32 emc_sel_dpd_ctrl;
> + u32 emc_xm2dqspadctrl2;
> + u32 emc_zcal_cnt_long;
> + u32 emc_zcal_interval;
> +};
> +
> +enum emc_rate_request_type {
> + EMC_RATE_DEBUG,
> + EMC_RATE_ICC,
> + EMC_RATE_TYPE_MAX,
> +};
> +
> +struct emc_rate_request {
> + unsigned long min_rate;
> + unsigned long max_rate;
> +};
> +
> +struct tegra_emc {
> + struct device *dev;
> +
> + struct tegra_mc *mc;
> +
> + void __iomem *regs;
> +
> + unsigned int irq;
> +
> + struct clk *clk;
Nit: I don't think all the empty lines are needed.
> +
> + enum emc_dram_type dram_type;
> + unsigned int dram_num;
> +
> + struct emc_timing last_timing;
> + struct emc_timing *timings;
> + unsigned int num_timings;
> +
> + struct {
> + struct dentry *root;
> + unsigned long min_rate;
> + unsigned long max_rate;
> + } debugfs;
> +
> + struct icc_provider provider;
> +
> + /*
> + * There are multiple sources in the EMC driver which could request
> + * a min/max clock rate, these rates are contained in this array.
> + */
> + struct emc_rate_request requested_rate[EMC_RATE_TYPE_MAX];
> +
> + /* protect shared rate-change code path */
> + struct mutex rate_lock;
> +};
> +
> +static irqreturn_t tegra_emc_isr(int irq, void *data)
> +{
> + struct tegra_emc *emc = data;
> + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> + u32 status;
> +
> + status = readl_relaxed(emc->regs + EMC_INTSTATUS) & intmask;
> + if (!status)
> + return IRQ_NONE;
> +
> + /* notify about HW problem */
> + if (status & EMC_REFRESH_OVERFLOW_INT)
> + dev_err_ratelimited(emc->dev,
> + "refresh request overflow timeout\n");
> +
> + /* clear interrupts */
> + writel_relaxed(status, emc->regs + EMC_INTSTATUS);
> +
> + return IRQ_HANDLED;
> +}
> +
> +/* Timing change sequence functions */
> +
> +static void emc_ccfifo_writel(struct tegra_emc *emc, u32 value,
> + unsigned long offset)
> +{
> + writel(value, emc->regs + EMC_CCFIFO_DATA);
> + writel(offset, emc->regs + EMC_CCFIFO_ADDR);
> +}
> +
> +static void emc_seq_update_timing(struct tegra_emc *emc)
> +{
> + unsigned int i;
> + u32 value;
> +
> + writel(1, emc->regs + EMC_TIMING_CONTROL);
> +
> + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> + value = readl(emc->regs + EMC_STATUS);
> + if ((value & EMC_STATUS_TIMING_UPDATE_STALLED) == 0)
> + return;
> + udelay(1);
> + }
This can be replaced with readl_poll_timeout_atomic
> +
> + dev_err(emc->dev, "timing update timed out\n");
> +}
> +
> +static void emc_seq_disable_auto_cal(struct tegra_emc *emc)
> +{
> + unsigned int i;
> + u32 value;
> +
> + writel(0, emc->regs + EMC_AUTO_CAL_INTERVAL);
> +
> + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> + value = readl(emc->regs + EMC_AUTO_CAL_STATUS);
> + if ((value & EMC_AUTO_CAL_STATUS_ACTIVE) == 0)
> + return;
> + udelay(1);
> + }
Likewise
> +
> + dev_err(emc->dev, "auto cal disable timed out\n");
> +}
> +
> +static void emc_seq_wait_clkchange(struct tegra_emc *emc)
> +{
> + unsigned int i;
> + u32 value;
> +
> + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> + value = readl(emc->regs + EMC_INTSTATUS);
> + if (value & EMC_INTSTATUS_CLKCHANGE_COMPLETE)
> + return;
> + udelay(1);
> + }
Likewise
> +
> + dev_err(emc->dev, "clock change timed out\n");
> +}
> +
> +static struct emc_timing *tegra_emc_find_timing(struct tegra_emc *emc,
> + unsigned long rate)
> +{
> + struct emc_timing *timing = NULL;
> + unsigned int i;
> +
> + for (i = 0; i < emc->num_timings; i++) {
> + if (emc->timings[i].rate == rate) {
> + timing = &emc->timings[i];
> + break;
> + }
> + }
> +
> + if (!timing) {
> + dev_err(emc->dev, "no timing for rate %lu\n", rate);
> + return NULL;
> + }
> +
> + return timing;
> +}
> +
> +static int tegra_emc_prepare_timing_change(struct tegra_emc *emc,
> + unsigned long rate)
> +{
> + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> + struct emc_timing *last = &emc->last_timing;
> + enum emc_dll_change dll_change;
> + unsigned int pre_wait = 0;
> + u32 val, mask;
> + bool update = false;
> + unsigned int i;
> +
> + if (!timing)
> + return -ENOENT;
> +
> + if ((last->emc_mode_1 & 0x1) == (timing->emc_mode_1 & 0x1))
> + dll_change = DLL_CHANGE_NONE;
> + else if (timing->emc_mode_1 & 0x1)
This looks incorrect. DLL is enabled if bit 0 is off. Now, I'm guessing that comes from the other drivers, originally from tegra124-emc.c, which was written by.. me :) I can send a patch for the other chips.
> + dll_change = DLL_CHANGE_ON;
> + else
> + dll_change = DLL_CHANGE_OFF;
> +
> + /* Clear CLKCHANGE_COMPLETE interrupts */
> + writel(EMC_INTSTATUS_CLKCHANGE_COMPLETE, emc->regs + EMC_INTSTATUS);
> +
> + /* Disable dynamic self-refresh */
> + val = readl(emc->regs + EMC_CFG);
> + if (val & EMC_CFG_PWR_MASK) {
This doesn't strictly match downstream Tegra114 EMC code or the TRM -- it is the later sequence version for Tegra124. However, my hunch is that the Tegra124 sequence would be compatible and probably more reliable as it would have received more testing. So it's probably not a bad idea to use it.
There are other places in the sequence that have changed between versions, but I don't think we need to change them. If issues are seen in the future, we can check again.
> + val &= ~EMC_CFG_POWER_FEATURES_MASK;
> + writel(val, emc->regs + EMC_CFG);
> +
> + pre_wait = 5;
> + }
> +
> + /* Disable SEL_DPD_CTRL for clock change */
> + if (emc->dram_type == DRAM_TYPE_DDR3)
> + mask = EMC_SEL_DPD_CTRL_DDR3_MASK;
> + else
> + mask = EMC_SEL_DPD_CTRL_MASK;
> +
> + val = readl(emc->regs + EMC_SEL_DPD_CTRL);
> + if (val & mask) {
> + val &= ~mask;
> + writel(val, emc->regs + EMC_SEL_DPD_CTRL);
> + }
> +
> + /* Prepare DQ/DQS for clock change */
> + val = readl(emc->regs + EMC_XM2DQSPADCTRL2);
> + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_VREF_ENABLE &&
> + !(val & EMC_XM2DQSPADCTRL2_VREF_ENABLE)) {
> + val |= EMC_XM2DQSPADCTRL2_VREF_ENABLE;
> + update = true;
> + }
> +
> + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE &&
> + !(val & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE)) {
> + val |= EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE;
> + update = true;
> + }
> +
> + if (update) {
> + writel(val, emc->regs + EMC_XM2DQSPADCTRL2);
> + if (pre_wait < 30)
> + pre_wait = 30;
> + }
> +
> + /* Wait to settle */
> + if (pre_wait) {
> + emc_seq_update_timing(emc);
> + udelay(pre_wait);
> + }
> +
> + /* Program CTT_TERM control */
> + if (last->emc_ctt_term_ctrl != timing->emc_ctt_term_ctrl) {
> + emc_seq_disable_auto_cal(emc);
> + writel(timing->emc_ctt_term_ctrl,
> + emc->regs + EMC_CTT_TERM_CTRL);
> + emc_seq_update_timing(emc);
> + }
> +
> + /* Program burst shadow registers */
> + for (i = 0; i < ARRAY_SIZE(timing->emc_burst_data); ++i)
> + writel(timing->emc_burst_data[i],
> + emc->regs + emc_burst_regs[i]);
> +
> + writel(timing->emc_xm2dqspadctrl2, emc->regs + EMC_XM2DQSPADCTRL2);
> + writel(timing->emc_zcal_interval, emc->regs + EMC_ZCAL_INTERVAL);
> +
> + tegra_mc_write_emem_configuration(emc->mc, timing->rate);
> +
> + val = timing->emc_cfg & ~EMC_CFG_POWER_FEATURES_MASK;
> + emc_ccfifo_writel(emc, val, EMC_CFG);
> +
> + /* Program AUTO_CAL_CONFIG */
> + if (timing->emc_auto_cal_config2 != last->emc_auto_cal_config2)
> + emc_ccfifo_writel(emc, timing->emc_auto_cal_config2,
> + EMC_AUTO_CAL_CONFIG2);
> +
> + if (timing->emc_auto_cal_config3 != last->emc_auto_cal_config3)
> + emc_ccfifo_writel(emc, timing->emc_auto_cal_config3,
> + EMC_AUTO_CAL_CONFIG3);
> +
> + if (timing->emc_auto_cal_config != last->emc_auto_cal_config) {
> + val = timing->emc_auto_cal_config;
> + val &= EMC_AUTO_CAL_CONFIG_AUTO_CAL_START;
> + emc_ccfifo_writel(emc, val, EMC_AUTO_CAL_CONFIG);
> + }
> +
> + /* DDR3: predict MRS long wait count */
> + if (emc->dram_type == DRAM_TYPE_DDR3 &&
> + dll_change == DLL_CHANGE_ON) {
> + u32 cnt = 512;
> +
> + if (timing->emc_zcal_interval != 0 &&
> + last->emc_zcal_interval == 0)
> + cnt -= emc->dram_num * 256;
> +
> + val = (timing->emc_mrs_wait_cnt
> + & EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK)
> + >> EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT;
> + if (cnt < val)
> + cnt = val;
> +
> + val = timing->emc_mrs_wait_cnt
> + & ~EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> + val |= (cnt << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> + & EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> +
> + writel(val, emc->regs + EMC_MRS_WAIT_CNT);
> + }
> +
> + /* DDR3: Turn off DLL and enter self-refresh */
> + if (emc->dram_type == DRAM_TYPE_DDR3 && dll_change == DLL_CHANGE_OFF)
> + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> +
> + /* Disable refresh controller */
> + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num),
> + EMC_REFCTRL);
> + if (emc->dram_type == DRAM_TYPE_DDR3)
> + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num) |
> + EMC_SELF_REF_CMD_ENABLED,
> + EMC_SELF_REF);
> +
> + /* Flow control marker */
> + emc_ccfifo_writel(emc, 1, EMC_STALL_THEN_EXE_AFTER_CLKCHANGE);
> +
> + /* DDR3: Exit self-refresh */
> + if (emc->dram_type == DRAM_TYPE_DDR3)
> + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num),
> + EMC_SELF_REF);
> + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num) |
> + EMC_REFCTRL_ENABLE,
> + EMC_REFCTRL);
> +
> + /* Set DRAM mode registers */
> + if (emc->dram_type == DRAM_TYPE_DDR3) {
> + if (timing->emc_mode_1 != last->emc_mode_1)
> + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> + if (timing->emc_mode_2 != last->emc_mode_2)
> + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_EMRS2);
> +
> + if (timing->emc_mode_reset != last->emc_mode_reset ||
> + dll_change == DLL_CHANGE_ON) {
> + val = timing->emc_mode_reset;
> + if (dll_change == DLL_CHANGE_ON) {
> + val |= EMC_MODE_SET_DLL_RESET;
> + val |= EMC_MODE_SET_LONG_CNT;
> + } else {
> + val &= ~EMC_MODE_SET_DLL_RESET;
> + }
> + emc_ccfifo_writel(emc, val, EMC_MRS);
> + }
> + } else {
> + if (timing->emc_mode_2 != last->emc_mode_2)
> + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_MRW2);
> + if (timing->emc_mode_1 != last->emc_mode_1)
> + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_MRW);
> + if (timing->emc_mode_4 != last->emc_mode_4)
> + emc_ccfifo_writel(emc, timing->emc_mode_4, EMC_MRW4);
> + }
> +
> + /* Issue ZCAL command if turning ZCAL on */
> + if (timing->emc_zcal_interval != 0 && last->emc_zcal_interval == 0) {
> + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV0, EMC_ZQ_CAL);
> + if (emc->dram_num > 1)
> + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV1,
> + EMC_ZQ_CAL);
> + }
> +
> + /* Write to RO register to remove stall after change */
> + emc_ccfifo_writel(emc, 0, EMC_CCFIFO_STATUS);
> +
> + /* Disable AUTO_CAL for clock change */
> + emc_seq_disable_auto_cal(emc);
> +
> + /* Read register to wait until programming has settled */
> + mc_readl(emc->mc, MC_EMEM_ADR_CFG);
> +
> + return 0;
> +}
> +
> +static void tegra_emc_complete_timing_change(struct tegra_emc *emc,
> + unsigned long rate)
> +{
> + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> + struct emc_timing *last = &emc->last_timing;
> +
> + if (!timing)
> + return;
> +
> + /* Wait until the state machine has settled */
> + emc_seq_wait_clkchange(emc);
> +
> + /* Restore AUTO_CAL */
> + if (timing->emc_ctt_term_ctrl != last->emc_ctt_term_ctrl)
> + writel(timing->emc_auto_cal_interval,
> + emc->regs + EMC_AUTO_CAL_INTERVAL);
> +
> + /* Restore dynamic self-refresh */
> + if (timing->emc_cfg & EMC_CFG_PWR_MASK)
> + writel(timing->emc_cfg, emc->regs + EMC_CFG);
> +
> + /* Set ZCAL wait count */
> + writel(timing->emc_zcal_cnt_long, emc->regs + EMC_ZCAL_WAIT_CNT);
> +
> + /* Wait for timing to settle */
> + udelay(2);
> +
> + /* Reprogram SEL_DPD_CTRL */
> + writel(timing->emc_sel_dpd_ctrl, emc->regs + EMC_SEL_DPD_CTRL);
> + emc_seq_update_timing(emc);
> +
> + emc->last_timing = *timing;
> +}
> +
> +/* Initialization and deinitialization */
> +
> +static void emc_read_current_timing(struct tegra_emc *emc,
> + struct emc_timing *timing)
> +{
> + unsigned int i;
> +
> + for (i = 0; i < ARRAY_SIZE(emc_burst_regs); ++i)
> + timing->emc_burst_data[i] =
> + readl(emc->regs + emc_burst_regs[i]);
> +
> + timing->emc_cfg = readl(emc->regs + EMC_CFG);
> +
> + timing->emc_auto_cal_interval = 0;
> + timing->emc_zcal_cnt_long = 0;
> + timing->emc_mode_1 = 0;
> + timing->emc_mode_2 = 0;
> + timing->emc_mode_4 = 0;
> + timing->emc_mode_reset = 0;
Hmm. I wonder why these aren't being read. It seems like it would be a good idea, since the some of these are checked for last_timing in the sequence.
> +}
> +
> +static int emc_init(struct tegra_emc *emc)
> +{
> + u32 emc_cfg, emc_dbg;
> + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> + const char *dram_type_str;
> +
> + emc->dram_type = readl(emc->regs + EMC_FBIO_CFG5);
> +
> + emc->dram_type &= EMC_FBIO_CFG5_DRAM_TYPE_MASK;
> + emc->dram_type >>= EMC_FBIO_CFG5_DRAM_TYPE_SHIFT;
> +
> + emc->dram_num = tegra_mc_get_emem_device_count(emc->mc);
> +
> + emc_cfg = readl_relaxed(emc->regs + EMC_CFG_2);
> +
> + /* enable EMC and CAR to handshake on PLL divider/source changes */
> + emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> +
> + /* configure clock change mode accordingly to DRAM type */
> + switch (emc->dram_type) {
> + case DRAM_TYPE_LPDDR2:
> + emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> + break;
> +
> + default:
> + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> + emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> + break;
> + }
This doesn't match the source trees I have (either Tegra114 or Tegra124). Those don't touch EMC_CLKCHANGE_SR_ENABLE. TRM seems to be contradictory about this. It says to leave it at reset value of DISABLED, but then later says that the reset value is ENABLED. I would err on the side of the code. In any case, I think this would be cleaner to write as an if statement
emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
if (emc->dram_type == DRAM_TYPE_LPDDR2)
emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
else
emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> +
> + writel_relaxed(emc_cfg, emc->regs + EMC_CFG_2);
> +
> + /* initialize interrupt */
> + writel_relaxed(intmask, emc->regs + EMC_INTMASK);
> + writel_relaxed(0xffffffff, emc->regs + EMC_INTSTATUS);
> +
> + /* ensure that unwanted debug features are disabled */
> + emc_dbg = readl_relaxed(emc->regs + EMC_DBG);
> + emc_dbg |= EMC_DBG_CFG_PRIORITY;
> + emc_dbg &= ~EMC_DBG_READ_MUX_ASSEMBLY;
> + emc_dbg &= ~EMC_DBG_WRITE_MUX_ACTIVE;
> + emc_dbg &= ~EMC_DBG_FORCE_UPDATE;
> + writel_relaxed(emc_dbg, emc->regs + EMC_DBG);
> +
> + switch (emc->dram_type) {
> + case DRAM_TYPE_DDR1:
> + dram_type_str = "DDR1";
> + break;
> + case DRAM_TYPE_LPDDR2:
> + dram_type_str = "LPDDR2";
> + break;
> + case DRAM_TYPE_DDR2:
> + dram_type_str = "DDR2";
> + break;
> + case DRAM_TYPE_DDR3:
> + dram_type_str = "DDR3";
> + break;
> + }
> +
> + dev_info_once(emc->dev, "%u %s %s attached\n", emc->dram_num,
> + dram_type_str, emc->dram_num == 2 ? "devices" : "device");
> +
> + emc_read_current_timing(emc, &emc->last_timing);
> +
> + return 0;
> +}
> +
> +static int load_one_timing_from_dt(struct tegra_emc *emc,
> + struct emc_timing *timing,
> + struct device_node *node)
> +{
> + u32 value;
> + int err;
> +
> + err = of_property_read_u32(node, "clock-frequency", &value);
> + if (err) {
> + dev_err(emc->dev, "timing %pOFn: failed to read rate: %d\n",
> + node, err);
> + return err;
> + }
> +
> + timing->rate = value;
> +
> + err = of_property_read_u32_array(node, "nvidia,emc-configuration",
> + timing->emc_burst_data,
> + ARRAY_SIZE(timing->emc_burst_data));
> + if (err) {
> + dev_err(emc->dev,
> + "timing %pOFn: failed to read emc burst data: %d\n",
> + node, err);
> + return err;
> + }
> +
> +#define EMC_READ_PROP(prop, dtprop) { \
> + err = of_property_read_u32(node, dtprop, &timing->prop); \
> + if (err) { \
> + dev_err(emc->dev, "timing %pOFn: failed to read " #prop ": %d\n", \
> + node, err); \
> + return err; \
> + } \
> +}
> +
> + EMC_READ_PROP(emc_auto_cal_config, "nvidia,emc-auto-cal-config")
> + EMC_READ_PROP(emc_auto_cal_config2, "nvidia,emc-auto-cal-config2")
> + EMC_READ_PROP(emc_auto_cal_config3, "nvidia,emc-auto-cal-config3")
> + EMC_READ_PROP(emc_auto_cal_interval, "nvidia,emc-auto-cal-interval")
> + EMC_READ_PROP(emc_cfg, "nvidia,emc-cfg")
> + EMC_READ_PROP(emc_ctt_term_ctrl, "nvidia,emc-ctt-term-ctrl")
> + EMC_READ_PROP(emc_mode_1, "nvidia,emc-mode-1")
> + EMC_READ_PROP(emc_mode_2, "nvidia,emc-mode-2")
> + EMC_READ_PROP(emc_mode_4, "nvidia,emc-mode-4")
> + EMC_READ_PROP(emc_mode_reset, "nvidia,emc-mode-reset")
> + EMC_READ_PROP(emc_mrs_wait_cnt, "nvidia,emc-mrs-wait-cnt")
> + EMC_READ_PROP(emc_sel_dpd_ctrl, "nvidia,emc-sel-dpd-ctrl")
> + EMC_READ_PROP(emc_xm2dqspadctrl2, "nvidia,emc-xm2dqspadctrl2")
> + EMC_READ_PROP(emc_zcal_cnt_long, "nvidia,emc-zcal-cnt-long")
> + EMC_READ_PROP(emc_zcal_interval, "nvidia,emc-zcal-interval")
> +
> +#undef EMC_READ_PROP
> +
> + return 0;
> +}
> +
> +static int cmp_timings(const void *_a, const void *_b)
> +{
> + const struct emc_timing *a = _a;
> + const struct emc_timing *b = _b;
> +
> + if (a->rate < b->rate)
> + return -1;
> + else if (a->rate == b->rate)
> + return 0;
> + else
> + return 1;
> +}
> +
> +static int tegra_emc_load_timings_from_dt(struct tegra_emc *emc,
> + struct device_node *node)
> +{
> + int child_count = of_get_child_count(node);
> + struct device_node *child;
> + struct emc_timing *timing;
> + unsigned int i = 0;
> + int err;
> +
> + emc->timings = devm_kcalloc(emc->dev, child_count, sizeof(*timing),
> + GFP_KERNEL);
> + if (!emc->timings)
> + return -ENOMEM;
> +
> + emc->num_timings = child_count;
> +
> + for_each_child_of_node(node, child) {
> + timing = &emc->timings[i++];
> +
> + err = load_one_timing_from_dt(emc, timing, child);
> + if (err) {
> + of_node_put(child);
> + return err;
> + }
> + }
> +
> + sort(emc->timings, emc->num_timings, sizeof(*timing), cmp_timings,
> + NULL);
> +
> + return 0;
> +}
> +
> +static struct device_node *
> +tegra_emc_find_node_by_ram_code(struct device_node *node, u32 ram_code)
> +{
> + struct device_node *np;
> + int err;
> +
> + for_each_child_of_node(node, np) {
> + u32 value;
> +
> + err = of_property_read_u32(np, "nvidia,ram-code", &value);
> + if (err || value != ram_code)
> + continue;
> +
> + return np;
> + }
> +
> + return NULL;
> +}
> +
> +static void tegra_emc_rate_requests_init(struct tegra_emc *emc)
> +{
> + unsigned int i;
> +
> + for (i = 0; i < EMC_RATE_TYPE_MAX; i++) {
> + emc->requested_rate[i].min_rate = 0;
> + emc->requested_rate[i].max_rate = ULONG_MAX;
> + }
> +}
> +
> +static int emc_request_rate(struct tegra_emc *emc,
> + unsigned long new_min_rate,
> + unsigned long new_max_rate,
> + enum emc_rate_request_type type)
> +{
> + struct emc_rate_request *req = emc->requested_rate;
> + unsigned long min_rate = 0, max_rate = ULONG_MAX;
> + unsigned int i;
> + int err;
> +
> + /* select minimum and maximum rates among the requested rates */
> + for (i = 0; i < EMC_RATE_TYPE_MAX; i++, req++) {
> + if (i == type) {
> + min_rate = max(new_min_rate, min_rate);
> + max_rate = min(new_max_rate, max_rate);
> + } else {
> + min_rate = max(req->min_rate, min_rate);
> + max_rate = min(req->max_rate, max_rate);
> + }
> + }
> +
> + if (min_rate > max_rate) {
> + dev_err_ratelimited(emc->dev, "%s: type %u: out of range: %lu %lu\n",
> + __func__, type, min_rate, max_rate);
> + return -ERANGE;
> + }
> +
> + /*
> + * EMC rate-changes should go via OPP API because it manages voltage
> + * changes.
> + */
> + err = dev_pm_opp_set_rate(emc->dev, min_rate);
> + if (err)
> + return err;
> +
> + emc->requested_rate[type].min_rate = new_min_rate;
> + emc->requested_rate[type].max_rate = new_max_rate;
> +
> + return 0;
> +}
> +
> +static int emc_set_min_rate(struct tegra_emc *emc, unsigned long rate,
> + enum emc_rate_request_type type)
> +{
> + struct emc_rate_request *req = &emc->requested_rate[type];
> + int ret;
> +
> + mutex_lock(&emc->rate_lock);
> + ret = emc_request_rate(emc, rate, req->max_rate, type);
> + mutex_unlock(&emc->rate_lock);
> +
> + return ret;
> +}
> +
> +static int emc_set_max_rate(struct tegra_emc *emc, unsigned long rate,
> + enum emc_rate_request_type type)
> +{
> + struct emc_rate_request *req = &emc->requested_rate[type];
> + int ret;
> +
> + mutex_lock(&emc->rate_lock);
> + ret = emc_request_rate(emc, req->min_rate, rate, type);
> + mutex_unlock(&emc->rate_lock);
> +
> + return ret;
> +}
> +
> +/*
> + * debugfs interface
> + *
> + * The memory controller driver exposes some files in debugfs that can be used
> + * to control the EMC frequency. The top-level directory can be found here:
> + *
> + * /sys/kernel/debug/emc
> + *
> + * It contains the following files:
> + *
> + * - available_rates: This file contains a list of valid, space-separated
> + * EMC frequencies.
> + *
> + * - min_rate: Writing a value to this file sets the given frequency as the
> + * floor of the permitted range. If this is higher than the currently
> + * configured EMC frequency, this will cause the frequency to be
> + * increased so that it stays within the valid range.
> + *
> + * - max_rate: Similarly to the min_rate file, writing a value to this file
> + * sets the given frequency as the ceiling of the permitted range. If
> + * the value is lower than the currently configured EMC frequency, this
> + * will cause the frequency to be decreased so that it stays within the
> + * valid range.
> + */
> +
> +static bool tegra_emc_validate_rate(struct tegra_emc *emc, unsigned long rate)
> +{
> + unsigned int i;
> +
> + for (i = 0; i < emc->num_timings; i++)
> + if (rate == emc->timings[i].rate)
> + return true;
> +
> + return false;
> +}
> +
> +static int tegra_emc_debug_available_rates_show(struct seq_file *s,
> + void *data)
> +{
> + struct tegra_emc *emc = s->private;
> + const char *prefix = "";
> + unsigned int i;
> +
> + for (i = 0; i < emc->num_timings; i++) {
> + seq_printf(s, "%s%lu", prefix, emc->timings[i].rate);
> + prefix = " ";
> + }
> +
> + seq_puts(s, "\n");
> +
> + return 0;
> +}
> +
> +DEFINE_SHOW_ATTRIBUTE(tegra_emc_debug_available_rates);
> +
> +static int tegra_emc_debug_min_rate_get(void *data, u64 *rate)
> +{
> + struct tegra_emc *emc = data;
> +
> + *rate = emc->debugfs.min_rate;
> +
> + return 0;
> +}
> +
> +static int tegra_emc_debug_min_rate_set(void *data, u64 rate)
> +{
> + struct tegra_emc *emc = data;
> + int err;
> +
> + if (!tegra_emc_validate_rate(emc, rate))
> + return -EINVAL;
> +
> + err = emc_set_min_rate(emc, rate, EMC_RATE_DEBUG);
> + if (err < 0)
> + return err;
> +
> + emc->debugfs.min_rate = rate;
> +
> + return 0;
> +}
> +
> +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_min_rate_fops,
> + tegra_emc_debug_min_rate_get,
> + tegra_emc_debug_min_rate_set, "%llu\n");
> +
> +static int tegra_emc_debug_max_rate_get(void *data, u64 *rate)
> +{
> + struct tegra_emc *emc = data;
> +
> + *rate = emc->debugfs.max_rate;
> +
> + return 0;
> +}
> +
> +static int tegra_emc_debug_max_rate_set(void *data, u64 rate)
> +{
> + struct tegra_emc *emc = data;
> + int err;
> +
> + if (!tegra_emc_validate_rate(emc, rate))
> + return -EINVAL;
> +
> + err = emc_set_max_rate(emc, rate, EMC_RATE_DEBUG);
> + if (err < 0)
> + return err;
> +
> + emc->debugfs.max_rate = rate;
> +
> + return 0;
> +}
> +
> +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_max_rate_fops,
> + tegra_emc_debug_max_rate_get,
> + tegra_emc_debug_max_rate_set, "%llu\n");
> +
> +static void emc_debugfs_init(struct device *dev, struct tegra_emc *emc)
> +{
> + unsigned int i;
> + int err;
> +
> + emc->debugfs.min_rate = ULONG_MAX;
> + emc->debugfs.max_rate = 0;
> +
> + for (i = 0; i < emc->num_timings; i++) {
> + if (emc->timings[i].rate < emc->debugfs.min_rate)
> + emc->debugfs.min_rate = emc->timings[i].rate;
> +
> + if (emc->timings[i].rate > emc->debugfs.max_rate)
> + emc->debugfs.max_rate = emc->timings[i].rate;
> + }
> +
> + if (!emc->num_timings) {
> + emc->debugfs.min_rate = clk_get_rate(emc->clk);
> + emc->debugfs.max_rate = emc->debugfs.min_rate;
> + }
> +
> + err = clk_set_rate_range(emc->clk, emc->debugfs.min_rate,
> + emc->debugfs.max_rate);
> + if (err < 0) {
> + dev_err(dev, "failed to set rate range [%lu-%lu] for %pC\n",
> + emc->debugfs.min_rate, emc->debugfs.max_rate,
> + emc->clk);
> + return;
> + }
> +
> + emc->debugfs.root = debugfs_create_dir("emc", NULL);
> +
> + debugfs_create_file("available_rates", 0444, emc->debugfs.root, emc,
> + &tegra_emc_debug_available_rates_fops);
> + debugfs_create_file("min_rate", 0644, emc->debugfs.root,
> + emc, &tegra_emc_debug_min_rate_fops);
> + debugfs_create_file("max_rate", 0644, emc->debugfs.root,
> + emc, &tegra_emc_debug_max_rate_fops);
> +}
> +
> +static inline struct tegra_emc *
> +to_tegra_emc_provider(struct icc_provider *provider)
> +{
> + return container_of(provider, struct tegra_emc, provider);
> +}
> +
> +static struct icc_node_data *
> +emc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
> +{
> + struct icc_provider *provider = data;
> + struct icc_node_data *ndata;
> + struct icc_node *node;
> +
> + /* External Memory is the only possible ICC route */
> + list_for_each_entry(node, &provider->nodes, node_list) {
> + if (node->id != TEGRA_ICC_EMEM)
> + continue;
> +
> + ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
> + if (!ndata)
> + return ERR_PTR(-ENOMEM);
> +
> + /*
> + * SRC and DST nodes should have matching TAG in order to have
> + * it set by default for a requested path.
> + */
> + ndata->tag = TEGRA_MC_ICC_TAG_ISO;
> + ndata->node = node;
> +
> + return ndata;
> + }
> +
> + return ERR_PTR(-EPROBE_DEFER);
> +}
> +
> +static int emc_icc_set(struct icc_node *src, struct icc_node *dst)
> +{
> + struct tegra_emc *emc = to_tegra_emc_provider(dst->provider);
> + unsigned long long peak_bw = icc_units_to_bps(dst->peak_bw);
> + unsigned long long avg_bw = icc_units_to_bps(dst->avg_bw);
> + unsigned long long rate = max(avg_bw, peak_bw);
> + unsigned int dram_data_bus_width_bytes = 4;
> + const unsigned int ddr = 2;
> + int err;
> +
> + /*
> + * Tegra114 EMC runs on a clock rate of SDRAM bus. This means that
> + * EMC clock rate is twice smaller than the peak data rate because
> + * data is sampled on both EMC clock edges.
> + */
> + do_div(rate, ddr * dram_data_bus_width_bytes);
> + rate = min_t(u64, rate, U32_MAX);
> +
> + err = emc_set_min_rate(emc, rate, EMC_RATE_ICC);
> + if (err)
> + return err;
> +
> + return 0;
> +}
> +
> +static int tegra_emc_interconnect_init(struct tegra_emc *emc)
> +{
> + const struct tegra_mc_soc *soc = emc->mc->soc;
> + struct icc_node *node;
> + int err;
> +
> + emc->provider.dev = emc->dev;
> + emc->provider.set = emc_icc_set;
> + emc->provider.data = &emc->provider;
> + emc->provider.aggregate = soc->icc_ops->aggregate;
> + emc->provider.xlate_extended = emc_of_icc_xlate_extended;
> +
> + icc_provider_init(&emc->provider);
> +
> + /* create External Memory Controller node */
> + node = icc_node_create(TEGRA_ICC_EMC);
> + if (IS_ERR(node)) {
> + err = PTR_ERR(node);
> + goto err_msg;
> + }
> +
> + node->name = "External Memory Controller";
> + icc_node_add(node, &emc->provider);
> +
> + /* link External Memory Controller to External Memory (DRAM) */
> + err = icc_link_create(node, TEGRA_ICC_EMEM);
> + if (err)
> + goto remove_nodes;
> +
> + /* create External Memory node */
> + node = icc_node_create(TEGRA_ICC_EMEM);
> + if (IS_ERR(node)) {
> + err = PTR_ERR(node);
> + goto remove_nodes;
> + }
> +
> + node->name = "External Memory (DRAM)";
> + icc_node_add(node, &emc->provider);
> +
> + err = icc_provider_register(&emc->provider);
> + if (err)
> + goto remove_nodes;
> +
> + return 0;
> +
> +remove_nodes:
> + icc_nodes_remove(&emc->provider);
> +err_msg:
> + dev_err(emc->dev, "failed to initialize ICC: %d\n", err);
> +
> + return err;
> +}
> +
> +static int tegra_emc_opp_table_init(struct tegra_emc *emc)
> +{
> + u32 hw_version = BIT(tegra_sku_info.soc_speedo_id);
> + int opp_token, err;
> +
> + err = dev_pm_opp_set_supported_hw(emc->dev, &hw_version, 1);
> + if (err < 0) {
> + dev_err(emc->dev, "failed to set OPP supported HW: %d\n", err);
> + return err;
> + }
> + opp_token = err;
> +
> + err = dev_pm_opp_of_add_table(emc->dev);
> + if (err) {
> + if (err == -ENODEV)
> + dev_err(emc->dev, "OPP table not found, please update your device tree\n");
> + else
> + dev_err(emc->dev, "failed to add OPP table: %d\n", err);
> +
> + goto put_hw_table;
> + }
> +
> + dev_info_once(emc->dev, "OPP HW ver. 0x%x, current clock rate %lu MHz\n",
> + hw_version, clk_get_rate(emc->clk) / 1000000);
> +
> + /* first dummy rate-set initializes voltage state */
> + err = dev_pm_opp_set_rate(emc->dev, clk_get_rate(emc->clk));
> + if (err) {
> + dev_err(emc->dev, "failed to initialize OPP clock: %d\n", err);
> + goto remove_table;
> + }
> +
> + return 0;
> +
> +remove_table:
> + dev_pm_opp_of_remove_table(emc->dev);
> +put_hw_table:
> + dev_pm_opp_put_supported_hw(opp_token);
> +
> + return err;
> +}
> +
> +static void devm_tegra_emc_unset_callback(void *data)
> +{
> + tegra124_clk_set_emc_callbacks(NULL, NULL);
> +}
> +
> +static int tegra_emc_probe(struct platform_device *pdev)
> +{
> + struct device_node *np;
> + struct tegra_emc *emc;
> + u32 ram_code;
> + int err;
> +
> + emc = devm_kzalloc(&pdev->dev, sizeof(*emc), GFP_KERNEL);
> + if (!emc)
> + return -ENOMEM;
> +
> + mutex_init(&emc->rate_lock);
> + emc->dev = &pdev->dev;
> +
> + emc->regs = devm_platform_ioremap_resource(pdev, 0);
> + if (IS_ERR(emc->regs))
> + return PTR_ERR(emc->regs);
> +
> + emc->mc = devm_tegra_memory_controller_get(&pdev->dev);
> + if (IS_ERR(emc->mc))
> + return PTR_ERR(emc->mc);
> +
> + ram_code = tegra_read_ram_code();
> +
> + np = tegra_emc_find_node_by_ram_code(pdev->dev.of_node, ram_code);
> + if (np) {
> + err = tegra_emc_load_timings_from_dt(emc, np);
> + of_node_put(np);
> + if (err)
> + return err;
> + } else {
> + dev_info_once(&pdev->dev,
> + "no memory timings for RAM code %u found in DT\n",
> + ram_code);
> + }
> +
> + err = emc_init(emc);
> + if (err) {
> + dev_err(&pdev->dev, "EMC initialization failed: %d\n", err);
> + return err;
> + }
> +
> + platform_set_drvdata(pdev, emc);
> +
> + tegra124_clk_set_emc_callbacks(tegra_emc_prepare_timing_change,
> + tegra_emc_complete_timing_change);
> +
> + err = devm_add_action_or_reset(&pdev->dev, devm_tegra_emc_unset_callback,
> + NULL);
> + if (err)
> + return err;
> +
> + err = platform_get_irq(pdev, 0);
> + if (err < 0)
> + return err;
> +
> + emc->irq = err;
> +
> + err = devm_request_irq(&pdev->dev, emc->irq, tegra_emc_isr, 0,
> + dev_name(&pdev->dev), emc);
> + if (err) {
> + dev_err(&pdev->dev, "failed to request irq: %d\n", err);
> + return err;
> + }
> +
> + emc->clk = devm_clk_get(&pdev->dev, "emc");
> + if (IS_ERR(emc->clk)) {
> + err = PTR_ERR(emc->clk);
> + dev_err(&pdev->dev, "failed to get EMC clock: %d\n", err);
> + return err;
> + }
> +
> + err = tegra_emc_opp_table_init(emc);
> + if (err)
> + return err;
> +
> + tegra_emc_rate_requests_init(emc);
> +
> + if (IS_ENABLED(CONFIG_DEBUG_FS))
> + emc_debugfs_init(&pdev->dev, emc);
> +
> + tegra_emc_interconnect_init(emc);
> +
> + /*
> + * Don't allow the kernel module to be unloaded. Unloading adds some
> + * extra complexity which doesn't really worth the effort in a case of
> + * this driver.
> + */
> + try_module_get(THIS_MODULE);
> +
> + return 0;
> +};
> +
> +static const struct of_device_id tegra_emc_of_match[] = {
> + { .compatible = "nvidia,tegra114-emc" },
> + {}
> +};
> +MODULE_DEVICE_TABLE(of, tegra_emc_of_match);
> +
> +static struct platform_driver tegra_emc_driver = {
> + .probe = tegra_emc_probe,
> + .driver = {
> + .name = "tegra114-emc",
> + .of_match_table = tegra_emc_of_match,
> + .suppress_bind_attrs = true,
> + .sync_state = icc_sync_state,
> + },
> +};
> +module_platform_driver(tegra_emc_driver);
> +
> +MODULE_AUTHOR("Svyatoslav Ryhel <clamor95@gmail.com>");
> +MODULE_DESCRIPTION("NVIDIA Tegra114 EMC driver");
> +MODULE_LICENSE("GPL");
>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver
2025-11-18 7:08 ` Mikko Perttunen
@ 2025-11-18 8:05 ` Svyatoslav Ryhel
2025-11-21 4:03 ` Mikko Perttunen
0 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-11-18 8:05 UTC (permalink / raw)
To: Mikko Perttunen
Cc: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
вт, 18 лист. 2025 р. о 09:08 Mikko Perttunen <mperttunen@nvidia.com> пише:
>
> On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> > Introduce driver for the External Memory Controller (EMC) found in Tegra114
> > SoC. It controls the external DRAM on the board. The purpose of this
> > driver is to program memory timing for external memory on the EMC clock
> > rate change.
> >
> > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > ---
> > drivers/memory/tegra/Kconfig | 12 +
> > drivers/memory/tegra/Makefile | 1 +
> > drivers/memory/tegra/tegra114-emc.c | 1487 +++++++++++++++++++++++++++
> > 3 files changed, 1500 insertions(+)
> > create mode 100644 drivers/memory/tegra/tegra114-emc.c
> >
> > diff --git a/drivers/memory/tegra/Kconfig b/drivers/memory/tegra/Kconfig
> > index fc5a27791826..11e7cc357d39 100644
> > --- a/drivers/memory/tegra/Kconfig
> > +++ b/drivers/memory/tegra/Kconfig
> > @@ -35,6 +35,18 @@ config TEGRA30_EMC
> > This driver is required to change memory timings / clock rate for
> > external memory.
> >
> > +config TEGRA114_EMC
> > + tristate "NVIDIA Tegra114 External Memory Controller driver"
> > + default y
> > + depends on ARCH_TEGRA_114_SOC || COMPILE_TEST
> > + select TEGRA124_CLK_EMC if ARCH_TEGRA
> > + select PM_OPP
> > + help
> > + This driver is for the External Memory Controller (EMC) found on
> > + Tegra114 chips. The EMC controls the external DRAM on the board.
> > + This driver is required to change memory timings / clock rate for
> > + external memory.
> > +
> > config TEGRA124_EMC
> > tristate "NVIDIA Tegra124 External Memory Controller driver"
> > default ARCH_TEGRA_124_SOC
> > diff --git a/drivers/memory/tegra/Makefile b/drivers/memory/tegra/Makefile
> > index 0750847dac3c..d36be28efc4a 100644
> > --- a/drivers/memory/tegra/Makefile
> > +++ b/drivers/memory/tegra/Makefile
> > @@ -15,6 +15,7 @@ obj-$(CONFIG_TEGRA_MC) += tegra-mc.o
> >
> > obj-$(CONFIG_TEGRA20_EMC) += tegra20-emc.o
> > obj-$(CONFIG_TEGRA30_EMC) += tegra30-emc.o
> > +obj-$(CONFIG_TEGRA114_EMC) += tegra114-emc.o
> > obj-$(CONFIG_TEGRA124_EMC) += tegra124-emc.o
> > obj-$(CONFIG_TEGRA210_EMC_TABLE) += tegra210-emc-table.o
> > obj-$(CONFIG_TEGRA210_EMC) += tegra210-emc.o
> > diff --git a/drivers/memory/tegra/tegra114-emc.c b/drivers/memory/tegra/tegra114-emc.c
> > new file mode 100644
> > index 000000000000..b986b5509f41
> > --- /dev/null
> > +++ b/drivers/memory/tegra/tegra114-emc.c
> > @@ -0,0 +1,1487 @@
> > +// SPDX-License-Identifier: GPL-2.0-only
> > +/*
> > + * Tegra114 External Memory Controller driver
> > + *
> > + * Based on downstream driver from NVIDIA and tegra124-emc.c
> > + * Copyright (C) 2011-2014 NVIDIA Corporation
> > + *
> > + * Copyright (C) 2024 Svyatoslav Ryhel <clamor95@gmail.com>
> > + */
> > +
> > +#include <linux/clk-provider.h>
> > +#include <linux/clk.h>
> > +#include <linux/clkdev.h>
> > +#include <linux/clk/tegra.h>
> > +#include <linux/debugfs.h>
> > +#include <linux/delay.h>
> > +#include <linux/interconnect-provider.h>
> > +#include <linux/interrupt.h>
> > +#include <linux/io.h>
> > +#include <linux/module.h>
> > +#include <linux/mutex.h>
> > +#include <linux/of_address.h>
> > +#include <linux/of_platform.h>
> > +#include <linux/platform_device.h>
> > +#include <linux/pm_opp.h>
> > +#include <linux/sort.h>
> > +#include <linux/string.h>
> > +
> > +#include <soc/tegra/fuse.h>
> > +#include <soc/tegra/mc.h>
> > +
> > +#include "mc.h"
> > +
> > +#define EMC_INTSTATUS 0x0
> > +#define EMC_REFRESH_OVERFLOW_INT BIT(3)
> > +#define EMC_INTSTATUS_CLKCHANGE_COMPLETE BIT(4)
>
> This naming is inconsistent. I'd prefer using EMC_INTSTATUS_REFRESH_OVERFLOW and EMC_INTSTATUS_CLKCHANGE_COMPLETE.
>
> > +
> > +#define EMC_INTMASK 0x4
> > +
> > +#define EMC_DBG 0x8
> > +#define EMC_DBG_READ_MUX_ASSEMBLY BIT(0)
> > +#define EMC_DBG_WRITE_MUX_ACTIVE BIT(1)
> > +#define EMC_DBG_FORCE_UPDATE BIT(2)
> > +#define EMC_DBG_CFG_PRIORITY BIT(24)
> > +
> > +#define EMC_CFG 0xc
> > +#define EMC_CFG_DRAM_CLKSTOP_PD BIT(31)
> > +#define EMC_CFG_DRAM_CLKSTOP_SR BIT(30)
> > +#define EMC_CFG_DRAM_ACPD BIT(29)
> > +#define EMC_CFG_DYN_SREF BIT(28)
> > +#define EMC_CFG_PWR_MASK ((0xF << 28) | BIT(18))
> > +#define EMC_CFG_DSR_VTTGEN_DRV_EN BIT(18)
>
> Ordering from first to last register would be more consistent.
>
> > +
> > +#define EMC_ADR_CFG 0x10
> > +#define EMC_ADR_CFG_EMEM_NUMDEV BIT(0)
> > +
> > +#define EMC_REFCTRL 0x20
> > +#define EMC_REFCTRL_DEV_SEL_SHIFT 0
> > +#define EMC_REFCTRL_ENABLE BIT(31)
> > +
> > +#define EMC_TIMING_CONTROL 0x28
> > +#define EMC_RC 0x2c
> > +#define EMC_RFC 0x30
> > +#define EMC_RAS 0x34
> > +#define EMC_RP 0x38
> > +#define EMC_R2W 0x3c
> > +#define EMC_W2R 0x40
> > +#define EMC_R2P 0x44
> > +#define EMC_W2P 0x48
> > +#define EMC_RD_RCD 0x4c
> > +#define EMC_WR_RCD 0x50
> > +#define EMC_RRD 0x54
> > +#define EMC_REXT 0x58
> > +#define EMC_WDV 0x5c
> > +#define EMC_QUSE 0x60
> > +#define EMC_QRST 0x64
> > +#define EMC_QSAFE 0x68
> > +#define EMC_RDV 0x6c
> > +#define EMC_REFRESH 0x70
> > +#define EMC_BURST_REFRESH_NUM 0x74
> > +#define EMC_PDEX2WR 0x78
> > +#define EMC_PDEX2RD 0x7c
> > +#define EMC_PCHG2PDEN 0x80
> > +#define EMC_ACT2PDEN 0x84
> > +#define EMC_AR2PDEN 0x88
> > +#define EMC_RW2PDEN 0x8c
> > +#define EMC_TXSR 0x90
> > +#define EMC_TCKE 0x94
> > +#define EMC_TFAW 0x98
> > +#define EMC_TRPAB 0x9c
> > +#define EMC_TCLKSTABLE 0xa0
> > +#define EMC_TCLKSTOP 0xa4
> > +#define EMC_TREFBW 0xa8
> > +#define EMC_QUSE_EXTRA 0xac
> > +#define EMC_ODT_WRITE 0xb0
> > +#define EMC_ODT_READ 0xb4
> > +#define EMC_WEXT 0xb8
> > +#define EMC_CTT 0xbc
> > +#define EMC_RFC_SLR 0xc0
> > +#define EMC_MRS_WAIT_CNT2 0xc4
> > +
> > +#define EMC_MRS_WAIT_CNT 0xc8
> > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT 0
> > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK \
> > + (0x3FF << EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT)
> > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT 16
> > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_MASK \
> > + (0x3FF << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > +
> > +#define EMC_MRS 0xcc
> > +#define EMC_MODE_SET_DLL_RESET BIT(8)
> > +#define EMC_MODE_SET_LONG_CNT BIT(26)
> > +#define EMC_EMRS 0xd0
> > +#define EMC_REF 0xd4
> > +#define EMC_PRE 0xd8
> > +
> > +#define EMC_SELF_REF 0xe0
> > +#define EMC_SELF_REF_CMD_ENABLED BIT(0)
> > +#define EMC_SELF_REF_DEV_SEL_SHIFT 30
> > +
> > +#define EMC_MRW 0xe8
> > +
> > +#define EMC_MRR 0xec
> > +#define EMC_MRR_MA_SHIFT 16
> > +#define LPDDR2_MR4_TEMP_SHIFT 0
> > +
> > +#define EMC_XM2DQSPADCTRL3 0xf8
> > +#define EMC_FBIO_SPARE 0x100
> > +
> > +#define EMC_FBIO_CFG5 0x104
> > +#define EMC_FBIO_CFG5_DRAM_TYPE_MASK 0x3
> > +#define EMC_FBIO_CFG5_DRAM_TYPE_SHIFT 0
>
> Inconsistent to indent here and not elsewhere. My preference is not to indent.
>
> > +
> > +#define EMC_FBIO_CFG6 0x114
> > +#define EMC_EMRS2 0x12c
> > +#define EMC_MRW2 0x134
> > +#define EMC_MRW4 0x13c
> > +#define EMC_EINPUT 0x14c
> > +#define EMC_EINPUT_DURATION 0x150
> > +#define EMC_PUTERM_EXTRA 0x154
> > +#define EMC_TCKESR 0x158
> > +#define EMC_TPD 0x15c
> > +
> > +#define EMC_AUTO_CAL_CONFIG 0x2a4
> > +#define EMC_AUTO_CAL_CONFIG_AUTO_CAL_START BIT(31)
> > +#define EMC_AUTO_CAL_INTERVAL 0x2a8
> > +#define EMC_AUTO_CAL_STATUS 0x2ac
> > +#define EMC_AUTO_CAL_STATUS_ACTIVE BIT(31)
> > +#define EMC_STATUS 0x2b4
> > +#define EMC_STATUS_TIMING_UPDATE_STALLED BIT(23)
> > +
> > +#define EMC_CFG_2 0x2b8
> > +#define EMC_CLKCHANGE_REQ_ENABLE BIT(0)
> > +#define EMC_CLKCHANGE_PD_ENABLE BIT(1)
> > +#define EMC_CLKCHANGE_SR_ENABLE BIT(2)
>
> Better to prefix with EMC_CFG_2
>
> > +
> > +#define EMC_CFG_DIG_DLL 0x2bc
> > +#define EMC_CFG_DIG_DLL_PERIOD 0x2c0
> > +#define EMC_RDV_MASK 0x2cc
> > +#define EMC_WDV_MASK 0x2d0
> > +#define EMC_CTT_DURATION 0x2d8
> > +#define EMC_CTT_TERM_CTRL 0x2dc
> > +#define EMC_ZCAL_INTERVAL 0x2e0
> > +#define EMC_ZCAL_WAIT_CNT 0x2e4
> > +
> > +#define EMC_ZQ_CAL 0x2ec
> > +#define EMC_ZQ_CAL_CMD BIT(0)
> > +#define EMC_ZQ_CAL_LONG BIT(4)
> > +#define EMC_ZQ_CAL_LONG_CMD_DEV0 \
> > + (DRAM_DEV_SEL_0 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > +#define EMC_ZQ_CAL_LONG_CMD_DEV1 \
> > + (DRAM_DEV_SEL_1 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > +
> > +#define EMC_XM2CMDPADCTRL 0x2f0
> > +#define EMC_XM2DQSPADCTRL 0x2f8
> > +#define EMC_XM2DQSPADCTRL2 0x2fc
> > +#define EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE BIT(0)
> > +#define EMC_XM2DQSPADCTRL2_VREF_ENABLE BIT(5)
> > +#define EMC_XM2DQPADCTRL 0x300
> > +#define EMC_XM2DQPADCTRL2 0x304
> > +#define EMC_XM2CLKPADCTRL 0x308
> > +#define EMC_XM2COMPPADCTRL 0x30c
> > +#define EMC_XM2VTTGENPADCTRL 0x310
> > +#define EMC_XM2VTTGENPADCTRL2 0x314
> > +#define EMC_XM2QUSEPADCTRL 0x318
> > +#define EMC_XM2DQSPADCTRL4 0x320
> > +#define EMC_DLL_XFORM_DQS0 0x328
> > +#define EMC_DLL_XFORM_DQS1 0x32c
> > +#define EMC_DLL_XFORM_DQS2 0x330
> > +#define EMC_DLL_XFORM_DQS3 0x334
> > +#define EMC_DLL_XFORM_DQS4 0x338
> > +#define EMC_DLL_XFORM_DQS5 0x33c
> > +#define EMC_DLL_XFORM_DQS6 0x340
> > +#define EMC_DLL_XFORM_DQS7 0x344
> > +#define EMC_DLL_XFORM_QUSE0 0x348
> > +#define EMC_DLL_XFORM_QUSE1 0x34c
> > +#define EMC_DLL_XFORM_QUSE2 0x350
> > +#define EMC_DLL_XFORM_QUSE3 0x354
> > +#define EMC_DLL_XFORM_QUSE4 0x358
> > +#define EMC_DLL_XFORM_QUSE5 0x35c
> > +#define EMC_DLL_XFORM_QUSE6 0x360
> > +#define EMC_DLL_XFORM_QUSE7 0x364
> > +#define EMC_DLL_XFORM_DQ0 0x368
> > +#define EMC_DLL_XFORM_DQ1 0x36c
> > +#define EMC_DLL_XFORM_DQ2 0x370
> > +#define EMC_DLL_XFORM_DQ3 0x374
> > +#define EMC_DLI_TRIM_TXDQS0 0x3a8
> > +#define EMC_DLI_TRIM_TXDQS1 0x3ac
> > +#define EMC_DLI_TRIM_TXDQS2 0x3b0
> > +#define EMC_DLI_TRIM_TXDQS3 0x3b4
> > +#define EMC_DLI_TRIM_TXDQS4 0x3b8
> > +#define EMC_DLI_TRIM_TXDQS5 0x3bc
> > +#define EMC_DLI_TRIM_TXDQS6 0x3c0
> > +#define EMC_DLI_TRIM_TXDQS7 0x3c4
> > +#define EMC_STALL_THEN_EXE_AFTER_CLKCHANGE 0x3cc
> > +#define EMC_SEL_DPD_CTRL 0x3d8
> > +#define EMC_SEL_DPD_CTRL_DATA_SEL_DPD BIT(8)
> > +#define EMC_SEL_DPD_CTRL_ODT_SEL_DPD BIT(5)
> > +#define EMC_SEL_DPD_CTRL_RESET_SEL_DPD BIT(4)
> > +#define EMC_SEL_DPD_CTRL_CA_SEL_DPD BIT(3)
> > +#define EMC_SEL_DPD_CTRL_CLK_SEL_DPD BIT(2)
> > +#define EMC_SEL_DPD_CTRL_DDR3_MASK \
> > + ((0xf << 2) | BIT(8))
> > +#define EMC_SEL_DPD_CTRL_MASK \
> > + ((0x3 << 2) | BIT(5) | BIT(8))
> > +#define EMC_PRE_REFRESH_REQ_CNT 0x3dc
> > +#define EMC_DYN_SELF_REF_CONTROL 0x3e0
> > +#define EMC_TXSRDLL 0x3e4
> > +#define EMC_CCFIFO_ADDR 0x3e8
> > +#define EMC_CCFIFO_DATA 0x3ec
> > +#define EMC_CCFIFO_STATUS 0x3f0
> > +#define EMC_CDB_CNTL_1 0x3f4
> > +#define EMC_CDB_CNTL_2 0x3f8
> > +#define EMC_XM2CLKPADCTRL2 0x3fc
> > +#define EMC_AUTO_CAL_CONFIG2 0x458
> > +#define EMC_AUTO_CAL_CONFIG3 0x45c
> > +#define EMC_IBDLY 0x468
> > +#define EMC_DLL_XFORM_ADDR0 0x46c
> > +#define EMC_DLL_XFORM_ADDR1 0x470
> > +#define EMC_DLL_XFORM_ADDR2 0x474
> > +#define EMC_DSR_VTTGEN_DRV 0x47c
> > +#define EMC_TXDSRVTTGEN 0x480
> > +#define EMC_XM2CMDPADCTRL4 0x484
> > +
> > +#define DRAM_DEV_SEL_ALL 0
> > +#define DRAM_DEV_SEL_0 BIT(31)
> > +#define DRAM_DEV_SEL_1 BIT(30)
> > +
> > +#define EMC_CFG_POWER_FEATURES_MASK \
> > + (EMC_CFG_DYN_SREF | EMC_CFG_DRAM_ACPD | EMC_CFG_DRAM_CLKSTOP_SR | \
> > + EMC_CFG_DRAM_CLKSTOP_PD | EMC_CFG_DSR_VTTGEN_DRV_EN)
> > +#define EMC_REFCTRL_DEV_SEL(n) ((((n) > 1) ? 0 : 2) << EMC_REFCTRL_DEV_SEL_SHIFT)
> > +#define EMC_DRAM_DEV_SEL(n) (((n) > 1) ? DRAM_DEV_SEL_ALL : DRAM_DEV_SEL_0)
> > +
> > +/* Maximum amount of time in us. to wait for changes to become effective */
> > +#define EMC_STATUS_UPDATE_TIMEOUT 1000
> > +
> > +enum emc_dram_type {
> > + DRAM_TYPE_DDR3,
> > + DRAM_TYPE_DDR1,
> > + DRAM_TYPE_LPDDR2,
> > + DRAM_TYPE_DDR2
> > +};
> > +
> > +enum emc_dll_change {
> > + DLL_CHANGE_NONE,
> > + DLL_CHANGE_ON,
> > + DLL_CHANGE_OFF
> > +};
> > +
> > +static const unsigned long emc_burst_regs[] = {
> > + EMC_RC,
> > + EMC_RFC,
> > + EMC_RAS,
> > + EMC_RP,
> > + EMC_R2W,
> > + EMC_W2R,
> > + EMC_R2P,
> > + EMC_W2P,
> > + EMC_RD_RCD,
> > + EMC_WR_RCD,
> > + EMC_RRD,
> > + EMC_REXT,
> > + EMC_WEXT,
> > + EMC_WDV,
> > + EMC_WDV_MASK,
> > + EMC_QUSE,
> > + EMC_IBDLY,
> > + EMC_EINPUT,
> > + EMC_EINPUT_DURATION,
> > + EMC_PUTERM_EXTRA,
> > + EMC_CDB_CNTL_1,
> > + EMC_CDB_CNTL_2,
> > + EMC_QRST,
> > + EMC_QSAFE,
> > + EMC_RDV,
> > + EMC_RDV_MASK,
> > + EMC_REFRESH,
> > + EMC_BURST_REFRESH_NUM,
> > + EMC_PRE_REFRESH_REQ_CNT,
> > + EMC_PDEX2WR,
> > + EMC_PDEX2RD,
> > + EMC_PCHG2PDEN,
> > + EMC_ACT2PDEN,
> > + EMC_AR2PDEN,
> > + EMC_RW2PDEN,
> > + EMC_TXSR,
> > + EMC_TXSRDLL,
> > + EMC_TCKE,
> > + EMC_TCKESR,
> > + EMC_TPD,
> > + EMC_TFAW,
> > + EMC_TRPAB,
> > + EMC_TCLKSTABLE,
> > + EMC_TCLKSTOP,
> > + EMC_TREFBW,
> > + EMC_QUSE_EXTRA,
> > + EMC_FBIO_CFG6,
> > + EMC_ODT_WRITE,
> > + EMC_ODT_READ,
> > + EMC_FBIO_CFG5,
> > + EMC_CFG_DIG_DLL,
> > + EMC_CFG_DIG_DLL_PERIOD,
> > + EMC_DLL_XFORM_DQS0,
> > + EMC_DLL_XFORM_DQS1,
> > + EMC_DLL_XFORM_DQS2,
> > + EMC_DLL_XFORM_DQS3,
> > + EMC_DLL_XFORM_DQS4,
> > + EMC_DLL_XFORM_DQS5,
> > + EMC_DLL_XFORM_DQS6,
> > + EMC_DLL_XFORM_DQS7,
> > + EMC_DLL_XFORM_QUSE0,
> > + EMC_DLL_XFORM_QUSE1,
> > + EMC_DLL_XFORM_QUSE2,
> > + EMC_DLL_XFORM_QUSE3,
> > + EMC_DLL_XFORM_QUSE4,
> > + EMC_DLL_XFORM_QUSE5,
> > + EMC_DLL_XFORM_QUSE6,
> > + EMC_DLL_XFORM_QUSE7,
> > + EMC_DLI_TRIM_TXDQS0,
> > + EMC_DLI_TRIM_TXDQS1,
> > + EMC_DLI_TRIM_TXDQS2,
> > + EMC_DLI_TRIM_TXDQS3,
> > + EMC_DLI_TRIM_TXDQS4,
> > + EMC_DLI_TRIM_TXDQS5,
> > + EMC_DLI_TRIM_TXDQS6,
> > + EMC_DLI_TRIM_TXDQS7,
> > + EMC_DLL_XFORM_DQ0,
> > + EMC_DLL_XFORM_DQ1,
> > + EMC_DLL_XFORM_DQ2,
> > + EMC_DLL_XFORM_DQ3,
> > + EMC_XM2CMDPADCTRL,
> > + EMC_XM2CMDPADCTRL4,
> > + EMC_XM2DQPADCTRL2,
> > + EMC_XM2CLKPADCTRL,
> > + EMC_XM2COMPPADCTRL,
> > + EMC_XM2VTTGENPADCTRL,
> > + EMC_XM2VTTGENPADCTRL2,
> > + EMC_XM2DQSPADCTRL3,
> > + EMC_XM2DQSPADCTRL4,
> > + EMC_DSR_VTTGEN_DRV,
> > + EMC_TXDSRVTTGEN,
> > + EMC_FBIO_SPARE,
> > + EMC_ZCAL_WAIT_CNT,
> > + EMC_MRS_WAIT_CNT2,
> > + EMC_CTT,
> > + EMC_CTT_DURATION,
> > + EMC_DYN_SELF_REF_CONTROL,
> > +};
>
> How was this list determined? It doesn't seem to match the trees I can find, or the list in the TRM (which is also different from the downstream source code).
>
Hm, IIRC, I used Tegra114 3.4 kernel sources, specifically
tegratab/macallan memory board files as my base and then tried to
align them closer to list used by Tegra124 (not identical obviously
since lists have different lengths). This list contains burst and
trimmer registers with some of them excluded as a dedicated entries in
emc_timing structure below (yet again - similar to Tegra124). If you
have any ideas how to group registers better I would be happy to hear.
> > +
> > +struct emc_timing {
> > + unsigned long rate;
> > +
> > + u32 emc_burst_data[ARRAY_SIZE(emc_burst_regs)];
> > +
> > + u32 emc_auto_cal_config;
> > + u32 emc_auto_cal_config2;
> > + u32 emc_auto_cal_config3;
> > + u32 emc_auto_cal_interval;
> > + u32 emc_cfg;
> > + u32 emc_ctt_term_ctrl;
> > + u32 emc_mode_1;
> > + u32 emc_mode_2;
> > + u32 emc_mode_4;
> > + u32 emc_mode_reset;
> > + u32 emc_mrs_wait_cnt;
> > + u32 emc_sel_dpd_ctrl;
> > + u32 emc_xm2dqspadctrl2;
> > + u32 emc_zcal_cnt_long;
> > + u32 emc_zcal_interval;
> > +};
> > +
> > +enum emc_rate_request_type {
> > + EMC_RATE_DEBUG,
> > + EMC_RATE_ICC,
> > + EMC_RATE_TYPE_MAX,
> > +};
> > +
> > +struct emc_rate_request {
> > + unsigned long min_rate;
> > + unsigned long max_rate;
> > +};
> > +
> > +struct tegra_emc {
> > + struct device *dev;
> > +
> > + struct tegra_mc *mc;
> > +
> > + void __iomem *regs;
> > +
> > + unsigned int irq;
> > +
> > + struct clk *clk;
>
> Nit: I don't think all the empty lines are needed.
>
> > +
> > + enum emc_dram_type dram_type;
> > + unsigned int dram_num;
> > +
> > + struct emc_timing last_timing;
> > + struct emc_timing *timings;
> > + unsigned int num_timings;
> > +
> > + struct {
> > + struct dentry *root;
> > + unsigned long min_rate;
> > + unsigned long max_rate;
> > + } debugfs;
> > +
> > + struct icc_provider provider;
> > +
> > + /*
> > + * There are multiple sources in the EMC driver which could request
> > + * a min/max clock rate, these rates are contained in this array.
> > + */
> > + struct emc_rate_request requested_rate[EMC_RATE_TYPE_MAX];
> > +
> > + /* protect shared rate-change code path */
> > + struct mutex rate_lock;
> > +};
> > +
> > +static irqreturn_t tegra_emc_isr(int irq, void *data)
> > +{
> > + struct tegra_emc *emc = data;
> > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > + u32 status;
> > +
> > + status = readl_relaxed(emc->regs + EMC_INTSTATUS) & intmask;
> > + if (!status)
> > + return IRQ_NONE;
> > +
> > + /* notify about HW problem */
> > + if (status & EMC_REFRESH_OVERFLOW_INT)
> > + dev_err_ratelimited(emc->dev,
> > + "refresh request overflow timeout\n");
> > +
> > + /* clear interrupts */
> > + writel_relaxed(status, emc->regs + EMC_INTSTATUS);
> > +
> > + return IRQ_HANDLED;
> > +}
> > +
> > +/* Timing change sequence functions */
> > +
> > +static void emc_ccfifo_writel(struct tegra_emc *emc, u32 value,
> > + unsigned long offset)
> > +{
> > + writel(value, emc->regs + EMC_CCFIFO_DATA);
> > + writel(offset, emc->regs + EMC_CCFIFO_ADDR);
> > +}
> > +
> > +static void emc_seq_update_timing(struct tegra_emc *emc)
> > +{
> > + unsigned int i;
> > + u32 value;
> > +
> > + writel(1, emc->regs + EMC_TIMING_CONTROL);
> > +
> > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > + value = readl(emc->regs + EMC_STATUS);
> > + if ((value & EMC_STATUS_TIMING_UPDATE_STALLED) == 0)
> > + return;
> > + udelay(1);
> > + }
>
> This can be replaced with readl_poll_timeout_atomic
>
> > +
> > + dev_err(emc->dev, "timing update timed out\n");
> > +}
> > +
> > +static void emc_seq_disable_auto_cal(struct tegra_emc *emc)
> > +{
> > + unsigned int i;
> > + u32 value;
> > +
> > + writel(0, emc->regs + EMC_AUTO_CAL_INTERVAL);
> > +
> > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > + value = readl(emc->regs + EMC_AUTO_CAL_STATUS);
> > + if ((value & EMC_AUTO_CAL_STATUS_ACTIVE) == 0)
> > + return;
> > + udelay(1);
> > + }
>
> Likewise
>
> > +
> > + dev_err(emc->dev, "auto cal disable timed out\n");
> > +}
> > +
> > +static void emc_seq_wait_clkchange(struct tegra_emc *emc)
> > +{
> > + unsigned int i;
> > + u32 value;
> > +
> > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > + value = readl(emc->regs + EMC_INTSTATUS);
> > + if (value & EMC_INTSTATUS_CLKCHANGE_COMPLETE)
> > + return;
> > + udelay(1);
> > + }
>
> Likewise
>
> > +
> > + dev_err(emc->dev, "clock change timed out\n");
> > +}
> > +
> > +static struct emc_timing *tegra_emc_find_timing(struct tegra_emc *emc,
> > + unsigned long rate)
> > +{
> > + struct emc_timing *timing = NULL;
> > + unsigned int i;
> > +
> > + for (i = 0; i < emc->num_timings; i++) {
> > + if (emc->timings[i].rate == rate) {
> > + timing = &emc->timings[i];
> > + break;
> > + }
> > + }
> > +
> > + if (!timing) {
> > + dev_err(emc->dev, "no timing for rate %lu\n", rate);
> > + return NULL;
> > + }
> > +
> > + return timing;
> > +}
> > +
> > +static int tegra_emc_prepare_timing_change(struct tegra_emc *emc,
> > + unsigned long rate)
> > +{
> > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > + struct emc_timing *last = &emc->last_timing;
> > + enum emc_dll_change dll_change;
> > + unsigned int pre_wait = 0;
> > + u32 val, mask;
> > + bool update = false;
> > + unsigned int i;
> > +
> > + if (!timing)
> > + return -ENOENT;
> > +
> > + if ((last->emc_mode_1 & 0x1) == (timing->emc_mode_1 & 0x1))
> > + dll_change = DLL_CHANGE_NONE;
> > + else if (timing->emc_mode_1 & 0x1)
>
> This looks incorrect. DLL is enabled if bit 0 is off. Now, I'm guessing that comes from the other drivers, originally from tegra124-emc.c, which was written by.. me :) I can send a patch for the other chips.
>
Noted
> > + dll_change = DLL_CHANGE_ON;
> > + else
> > + dll_change = DLL_CHANGE_OFF;
> > +
> > + /* Clear CLKCHANGE_COMPLETE interrupts */
> > + writel(EMC_INTSTATUS_CLKCHANGE_COMPLETE, emc->regs + EMC_INTSTATUS);
> > +
> > + /* Disable dynamic self-refresh */
> > + val = readl(emc->regs + EMC_CFG);
> > + if (val & EMC_CFG_PWR_MASK) {
>
> This doesn't strictly match downstream Tegra114 EMC code or the TRM -- it is the later sequence version for Tegra124. However, my hunch is that the Tegra124 sequence would be compatible and probably more reliable as it would have received more testing. So it's probably not a bad idea to use it.
>
> There are other places in the sequence that have changed between versions, but I don't think we need to change them. If issues are seen in the future, we can check again.
>
It does not strictly match, yes, but overall logic is preserved. I
have tested these on my Tegra114 devices and I did not observe any
notable issues.
> > + val &= ~EMC_CFG_POWER_FEATURES_MASK;
> > + writel(val, emc->regs + EMC_CFG);
> > +
> > + pre_wait = 5;
> > + }
> > +
> > + /* Disable SEL_DPD_CTRL for clock change */
> > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > + mask = EMC_SEL_DPD_CTRL_DDR3_MASK;
> > + else
> > + mask = EMC_SEL_DPD_CTRL_MASK;
> > +
> > + val = readl(emc->regs + EMC_SEL_DPD_CTRL);
> > + if (val & mask) {
> > + val &= ~mask;
> > + writel(val, emc->regs + EMC_SEL_DPD_CTRL);
> > + }
> > +
> > + /* Prepare DQ/DQS for clock change */
> > + val = readl(emc->regs + EMC_XM2DQSPADCTRL2);
> > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_VREF_ENABLE &&
> > + !(val & EMC_XM2DQSPADCTRL2_VREF_ENABLE)) {
> > + val |= EMC_XM2DQSPADCTRL2_VREF_ENABLE;
> > + update = true;
> > + }
> > +
> > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE &&
> > + !(val & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE)) {
> > + val |= EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE;
> > + update = true;
> > + }
> > +
> > + if (update) {
> > + writel(val, emc->regs + EMC_XM2DQSPADCTRL2);
> > + if (pre_wait < 30)
> > + pre_wait = 30;
> > + }
> > +
> > + /* Wait to settle */
> > + if (pre_wait) {
> > + emc_seq_update_timing(emc);
> > + udelay(pre_wait);
> > + }
> > +
> > + /* Program CTT_TERM control */
> > + if (last->emc_ctt_term_ctrl != timing->emc_ctt_term_ctrl) {
> > + emc_seq_disable_auto_cal(emc);
> > + writel(timing->emc_ctt_term_ctrl,
> > + emc->regs + EMC_CTT_TERM_CTRL);
> > + emc_seq_update_timing(emc);
> > + }
> > +
> > + /* Program burst shadow registers */
> > + for (i = 0; i < ARRAY_SIZE(timing->emc_burst_data); ++i)
> > + writel(timing->emc_burst_data[i],
> > + emc->regs + emc_burst_regs[i]);
> > +
> > + writel(timing->emc_xm2dqspadctrl2, emc->regs + EMC_XM2DQSPADCTRL2);
> > + writel(timing->emc_zcal_interval, emc->regs + EMC_ZCAL_INTERVAL);
> > +
> > + tegra_mc_write_emem_configuration(emc->mc, timing->rate);
> > +
> > + val = timing->emc_cfg & ~EMC_CFG_POWER_FEATURES_MASK;
> > + emc_ccfifo_writel(emc, val, EMC_CFG);
> > +
> > + /* Program AUTO_CAL_CONFIG */
> > + if (timing->emc_auto_cal_config2 != last->emc_auto_cal_config2)
> > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config2,
> > + EMC_AUTO_CAL_CONFIG2);
> > +
> > + if (timing->emc_auto_cal_config3 != last->emc_auto_cal_config3)
> > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config3,
> > + EMC_AUTO_CAL_CONFIG3);
> > +
> > + if (timing->emc_auto_cal_config != last->emc_auto_cal_config) {
> > + val = timing->emc_auto_cal_config;
> > + val &= EMC_AUTO_CAL_CONFIG_AUTO_CAL_START;
> > + emc_ccfifo_writel(emc, val, EMC_AUTO_CAL_CONFIG);
> > + }
> > +
> > + /* DDR3: predict MRS long wait count */
> > + if (emc->dram_type == DRAM_TYPE_DDR3 &&
> > + dll_change == DLL_CHANGE_ON) {
> > + u32 cnt = 512;
> > +
> > + if (timing->emc_zcal_interval != 0 &&
> > + last->emc_zcal_interval == 0)
> > + cnt -= emc->dram_num * 256;
> > +
> > + val = (timing->emc_mrs_wait_cnt
> > + & EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK)
> > + >> EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT;
> > + if (cnt < val)
> > + cnt = val;
> > +
> > + val = timing->emc_mrs_wait_cnt
> > + & ~EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > + val |= (cnt << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > + & EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > +
> > + writel(val, emc->regs + EMC_MRS_WAIT_CNT);
> > + }
> > +
> > + /* DDR3: Turn off DLL and enter self-refresh */
> > + if (emc->dram_type == DRAM_TYPE_DDR3 && dll_change == DLL_CHANGE_OFF)
> > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > +
> > + /* Disable refresh controller */
> > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num),
> > + EMC_REFCTRL);
> > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num) |
> > + EMC_SELF_REF_CMD_ENABLED,
> > + EMC_SELF_REF);
> > +
> > + /* Flow control marker */
> > + emc_ccfifo_writel(emc, 1, EMC_STALL_THEN_EXE_AFTER_CLKCHANGE);
> > +
> > + /* DDR3: Exit self-refresh */
> > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num),
> > + EMC_SELF_REF);
> > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num) |
> > + EMC_REFCTRL_ENABLE,
> > + EMC_REFCTRL);
> > +
> > + /* Set DRAM mode registers */
> > + if (emc->dram_type == DRAM_TYPE_DDR3) {
> > + if (timing->emc_mode_1 != last->emc_mode_1)
> > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > + if (timing->emc_mode_2 != last->emc_mode_2)
> > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_EMRS2);
> > +
> > + if (timing->emc_mode_reset != last->emc_mode_reset ||
> > + dll_change == DLL_CHANGE_ON) {
> > + val = timing->emc_mode_reset;
> > + if (dll_change == DLL_CHANGE_ON) {
> > + val |= EMC_MODE_SET_DLL_RESET;
> > + val |= EMC_MODE_SET_LONG_CNT;
> > + } else {
> > + val &= ~EMC_MODE_SET_DLL_RESET;
> > + }
> > + emc_ccfifo_writel(emc, val, EMC_MRS);
> > + }
> > + } else {
> > + if (timing->emc_mode_2 != last->emc_mode_2)
> > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_MRW2);
> > + if (timing->emc_mode_1 != last->emc_mode_1)
> > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_MRW);
> > + if (timing->emc_mode_4 != last->emc_mode_4)
> > + emc_ccfifo_writel(emc, timing->emc_mode_4, EMC_MRW4);
> > + }
> > +
> > + /* Issue ZCAL command if turning ZCAL on */
> > + if (timing->emc_zcal_interval != 0 && last->emc_zcal_interval == 0) {
> > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV0, EMC_ZQ_CAL);
> > + if (emc->dram_num > 1)
> > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV1,
> > + EMC_ZQ_CAL);
> > + }
> > +
> > + /* Write to RO register to remove stall after change */
> > + emc_ccfifo_writel(emc, 0, EMC_CCFIFO_STATUS);
> > +
> > + /* Disable AUTO_CAL for clock change */
> > + emc_seq_disable_auto_cal(emc);
> > +
> > + /* Read register to wait until programming has settled */
> > + mc_readl(emc->mc, MC_EMEM_ADR_CFG);
> > +
> > + return 0;
> > +}
> > +
> > +static void tegra_emc_complete_timing_change(struct tegra_emc *emc,
> > + unsigned long rate)
> > +{
> > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > + struct emc_timing *last = &emc->last_timing;
> > +
> > + if (!timing)
> > + return;
> > +
> > + /* Wait until the state machine has settled */
> > + emc_seq_wait_clkchange(emc);
> > +
> > + /* Restore AUTO_CAL */
> > + if (timing->emc_ctt_term_ctrl != last->emc_ctt_term_ctrl)
> > + writel(timing->emc_auto_cal_interval,
> > + emc->regs + EMC_AUTO_CAL_INTERVAL);
> > +
> > + /* Restore dynamic self-refresh */
> > + if (timing->emc_cfg & EMC_CFG_PWR_MASK)
> > + writel(timing->emc_cfg, emc->regs + EMC_CFG);
> > +
> > + /* Set ZCAL wait count */
> > + writel(timing->emc_zcal_cnt_long, emc->regs + EMC_ZCAL_WAIT_CNT);
> > +
> > + /* Wait for timing to settle */
> > + udelay(2);
> > +
> > + /* Reprogram SEL_DPD_CTRL */
> > + writel(timing->emc_sel_dpd_ctrl, emc->regs + EMC_SEL_DPD_CTRL);
> > + emc_seq_update_timing(emc);
> > +
> > + emc->last_timing = *timing;
> > +}
> > +
> > +/* Initialization and deinitialization */
> > +
> > +static void emc_read_current_timing(struct tegra_emc *emc,
> > + struct emc_timing *timing)
> > +{
> > + unsigned int i;
> > +
> > + for (i = 0; i < ARRAY_SIZE(emc_burst_regs); ++i)
> > + timing->emc_burst_data[i] =
> > + readl(emc->regs + emc_burst_regs[i]);
> > +
> > + timing->emc_cfg = readl(emc->regs + EMC_CFG);
> > +
> > + timing->emc_auto_cal_interval = 0;
> > + timing->emc_zcal_cnt_long = 0;
> > + timing->emc_mode_1 = 0;
> > + timing->emc_mode_2 = 0;
> > + timing->emc_mode_4 = 0;
> > + timing->emc_mode_reset = 0;
>
> Hmm. I wonder why these aren't being read. It seems like it would be a good idea, since the some of these are checked for last_timing in the sequence.
>
This stems from Tegra124 emc driver, so maybe it has some sense. In
any case, adding readl is not an issue whatsoever.
> > +}
> > +
> > +static int emc_init(struct tegra_emc *emc)
> > +{
> > + u32 emc_cfg, emc_dbg;
> > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > + const char *dram_type_str;
> > +
> > + emc->dram_type = readl(emc->regs + EMC_FBIO_CFG5);
> > +
> > + emc->dram_type &= EMC_FBIO_CFG5_DRAM_TYPE_MASK;
> > + emc->dram_type >>= EMC_FBIO_CFG5_DRAM_TYPE_SHIFT;
> > +
> > + emc->dram_num = tegra_mc_get_emem_device_count(emc->mc);
> > +
> > + emc_cfg = readl_relaxed(emc->regs + EMC_CFG_2);
> > +
> > + /* enable EMC and CAR to handshake on PLL divider/source changes */
> > + emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> > +
> > + /* configure clock change mode accordingly to DRAM type */
> > + switch (emc->dram_type) {
> > + case DRAM_TYPE_LPDDR2:
> > + emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > + break;
> > +
> > + default:
> > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > + emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> > + break;
> > + }
>
> This doesn't match the source trees I have (either Tegra114 or Tegra124). Those don't touch EMC_CLKCHANGE_SR_ENABLE. TRM seems to be contradictory about this. It says to leave it at reset value of DISABLED, but then later says that the reset value is ENABLED. I would err on the side of the code. In any case, I think this would be cleaner to write as an if statement
>
> emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
>
> if (emc->dram_type == DRAM_TYPE_LPDDR2)
> emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> else
> emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
>
Noted. Yes, TRM in Software programming sequence on the Tegra 4 clock
change sequence states Keep these register fields in reset values:
CLKCHANGE_REQ_ENABLE = ENABLED
CLKCHANGE_SR_ENABLE = DISABLED
Hence I have added emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE
> > +
> > + writel_relaxed(emc_cfg, emc->regs + EMC_CFG_2);
> > +
> > + /* initialize interrupt */
> > + writel_relaxed(intmask, emc->regs + EMC_INTMASK);
> > + writel_relaxed(0xffffffff, emc->regs + EMC_INTSTATUS);
> > +
> > + /* ensure that unwanted debug features are disabled */
> > + emc_dbg = readl_relaxed(emc->regs + EMC_DBG);
> > + emc_dbg |= EMC_DBG_CFG_PRIORITY;
> > + emc_dbg &= ~EMC_DBG_READ_MUX_ASSEMBLY;
> > + emc_dbg &= ~EMC_DBG_WRITE_MUX_ACTIVE;
> > + emc_dbg &= ~EMC_DBG_FORCE_UPDATE;
> > + writel_relaxed(emc_dbg, emc->regs + EMC_DBG);
> > +
> > + switch (emc->dram_type) {
> > + case DRAM_TYPE_DDR1:
> > + dram_type_str = "DDR1";
> > + break;
> > + case DRAM_TYPE_LPDDR2:
> > + dram_type_str = "LPDDR2";
> > + break;
> > + case DRAM_TYPE_DDR2:
> > + dram_type_str = "DDR2";
> > + break;
> > + case DRAM_TYPE_DDR3:
> > + dram_type_str = "DDR3";
> > + break;
> > + }
> > +
> > + dev_info_once(emc->dev, "%u %s %s attached\n", emc->dram_num,
> > + dram_type_str, emc->dram_num == 2 ? "devices" : "device");
> > +
> > + emc_read_current_timing(emc, &emc->last_timing);
> > +
> > + return 0;
> > +}
> > +
> > +static int load_one_timing_from_dt(struct tegra_emc *emc,
> > + struct emc_timing *timing,
> > + struct device_node *node)
> > +{
> > + u32 value;
> > + int err;
> > +
> > + err = of_property_read_u32(node, "clock-frequency", &value);
> > + if (err) {
> > + dev_err(emc->dev, "timing %pOFn: failed to read rate: %d\n",
> > + node, err);
> > + return err;
> > + }
> > +
> > + timing->rate = value;
> > +
> > + err = of_property_read_u32_array(node, "nvidia,emc-configuration",
> > + timing->emc_burst_data,
> > + ARRAY_SIZE(timing->emc_burst_data));
> > + if (err) {
> > + dev_err(emc->dev,
> > + "timing %pOFn: failed to read emc burst data: %d\n",
> > + node, err);
> > + return err;
> > + }
> > +
> > +#define EMC_READ_PROP(prop, dtprop) { \
> > + err = of_property_read_u32(node, dtprop, &timing->prop); \
> > + if (err) { \
> > + dev_err(emc->dev, "timing %pOFn: failed to read " #prop ": %d\n", \
> > + node, err); \
> > + return err; \
> > + } \
> > +}
> > +
> > + EMC_READ_PROP(emc_auto_cal_config, "nvidia,emc-auto-cal-config")
> > + EMC_READ_PROP(emc_auto_cal_config2, "nvidia,emc-auto-cal-config2")
> > + EMC_READ_PROP(emc_auto_cal_config3, "nvidia,emc-auto-cal-config3")
> > + EMC_READ_PROP(emc_auto_cal_interval, "nvidia,emc-auto-cal-interval")
> > + EMC_READ_PROP(emc_cfg, "nvidia,emc-cfg")
> > + EMC_READ_PROP(emc_ctt_term_ctrl, "nvidia,emc-ctt-term-ctrl")
> > + EMC_READ_PROP(emc_mode_1, "nvidia,emc-mode-1")
> > + EMC_READ_PROP(emc_mode_2, "nvidia,emc-mode-2")
> > + EMC_READ_PROP(emc_mode_4, "nvidia,emc-mode-4")
> > + EMC_READ_PROP(emc_mode_reset, "nvidia,emc-mode-reset")
> > + EMC_READ_PROP(emc_mrs_wait_cnt, "nvidia,emc-mrs-wait-cnt")
> > + EMC_READ_PROP(emc_sel_dpd_ctrl, "nvidia,emc-sel-dpd-ctrl")
> > + EMC_READ_PROP(emc_xm2dqspadctrl2, "nvidia,emc-xm2dqspadctrl2")
> > + EMC_READ_PROP(emc_zcal_cnt_long, "nvidia,emc-zcal-cnt-long")
> > + EMC_READ_PROP(emc_zcal_interval, "nvidia,emc-zcal-interval")
> > +
> > +#undef EMC_READ_PROP
> > +
> > + return 0;
> > +}
> > +
> > +static int cmp_timings(const void *_a, const void *_b)
> > +{
> > + const struct emc_timing *a = _a;
> > + const struct emc_timing *b = _b;
> > +
> > + if (a->rate < b->rate)
> > + return -1;
> > + else if (a->rate == b->rate)
> > + return 0;
> > + else
> > + return 1;
> > +}
> > +
> > +static int tegra_emc_load_timings_from_dt(struct tegra_emc *emc,
> > + struct device_node *node)
> > +{
> > + int child_count = of_get_child_count(node);
> > + struct device_node *child;
> > + struct emc_timing *timing;
> > + unsigned int i = 0;
> > + int err;
> > +
> > + emc->timings = devm_kcalloc(emc->dev, child_count, sizeof(*timing),
> > + GFP_KERNEL);
> > + if (!emc->timings)
> > + return -ENOMEM;
> > +
> > + emc->num_timings = child_count;
> > +
> > + for_each_child_of_node(node, child) {
> > + timing = &emc->timings[i++];
> > +
> > + err = load_one_timing_from_dt(emc, timing, child);
> > + if (err) {
> > + of_node_put(child);
> > + return err;
> > + }
> > + }
> > +
> > + sort(emc->timings, emc->num_timings, sizeof(*timing), cmp_timings,
> > + NULL);
> > +
> > + return 0;
> > +}
> > +
> > +static struct device_node *
> > +tegra_emc_find_node_by_ram_code(struct device_node *node, u32 ram_code)
> > +{
> > + struct device_node *np;
> > + int err;
> > +
> > + for_each_child_of_node(node, np) {
> > + u32 value;
> > +
> > + err = of_property_read_u32(np, "nvidia,ram-code", &value);
> > + if (err || value != ram_code)
> > + continue;
> > +
> > + return np;
> > + }
> > +
> > + return NULL;
> > +}
> > +
> > +static void tegra_emc_rate_requests_init(struct tegra_emc *emc)
> > +{
> > + unsigned int i;
> > +
> > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++) {
> > + emc->requested_rate[i].min_rate = 0;
> > + emc->requested_rate[i].max_rate = ULONG_MAX;
> > + }
> > +}
> > +
> > +static int emc_request_rate(struct tegra_emc *emc,
> > + unsigned long new_min_rate,
> > + unsigned long new_max_rate,
> > + enum emc_rate_request_type type)
> > +{
> > + struct emc_rate_request *req = emc->requested_rate;
> > + unsigned long min_rate = 0, max_rate = ULONG_MAX;
> > + unsigned int i;
> > + int err;
> > +
> > + /* select minimum and maximum rates among the requested rates */
> > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++, req++) {
> > + if (i == type) {
> > + min_rate = max(new_min_rate, min_rate);
> > + max_rate = min(new_max_rate, max_rate);
> > + } else {
> > + min_rate = max(req->min_rate, min_rate);
> > + max_rate = min(req->max_rate, max_rate);
> > + }
> > + }
> > +
> > + if (min_rate > max_rate) {
> > + dev_err_ratelimited(emc->dev, "%s: type %u: out of range: %lu %lu\n",
> > + __func__, type, min_rate, max_rate);
> > + return -ERANGE;
> > + }
> > +
> > + /*
> > + * EMC rate-changes should go via OPP API because it manages voltage
> > + * changes.
> > + */
> > + err = dev_pm_opp_set_rate(emc->dev, min_rate);
> > + if (err)
> > + return err;
> > +
> > + emc->requested_rate[type].min_rate = new_min_rate;
> > + emc->requested_rate[type].max_rate = new_max_rate;
> > +
> > + return 0;
> > +}
> > +
> > +static int emc_set_min_rate(struct tegra_emc *emc, unsigned long rate,
> > + enum emc_rate_request_type type)
> > +{
> > + struct emc_rate_request *req = &emc->requested_rate[type];
> > + int ret;
> > +
> > + mutex_lock(&emc->rate_lock);
> > + ret = emc_request_rate(emc, rate, req->max_rate, type);
> > + mutex_unlock(&emc->rate_lock);
> > +
> > + return ret;
> > +}
> > +
> > +static int emc_set_max_rate(struct tegra_emc *emc, unsigned long rate,
> > + enum emc_rate_request_type type)
> > +{
> > + struct emc_rate_request *req = &emc->requested_rate[type];
> > + int ret;
> > +
> > + mutex_lock(&emc->rate_lock);
> > + ret = emc_request_rate(emc, req->min_rate, rate, type);
> > + mutex_unlock(&emc->rate_lock);
> > +
> > + return ret;
> > +}
> > +
> > +/*
> > + * debugfs interface
> > + *
> > + * The memory controller driver exposes some files in debugfs that can be used
> > + * to control the EMC frequency. The top-level directory can be found here:
> > + *
> > + * /sys/kernel/debug/emc
> > + *
> > + * It contains the following files:
> > + *
> > + * - available_rates: This file contains a list of valid, space-separated
> > + * EMC frequencies.
> > + *
> > + * - min_rate: Writing a value to this file sets the given frequency as the
> > + * floor of the permitted range. If this is higher than the currently
> > + * configured EMC frequency, this will cause the frequency to be
> > + * increased so that it stays within the valid range.
> > + *
> > + * - max_rate: Similarly to the min_rate file, writing a value to this file
> > + * sets the given frequency as the ceiling of the permitted range. If
> > + * the value is lower than the currently configured EMC frequency, this
> > + * will cause the frequency to be decreased so that it stays within the
> > + * valid range.
> > + */
> > +
> > +static bool tegra_emc_validate_rate(struct tegra_emc *emc, unsigned long rate)
> > +{
> > + unsigned int i;
> > +
> > + for (i = 0; i < emc->num_timings; i++)
> > + if (rate == emc->timings[i].rate)
> > + return true;
> > +
> > + return false;
> > +}
> > +
> > +static int tegra_emc_debug_available_rates_show(struct seq_file *s,
> > + void *data)
> > +{
> > + struct tegra_emc *emc = s->private;
> > + const char *prefix = "";
> > + unsigned int i;
> > +
> > + for (i = 0; i < emc->num_timings; i++) {
> > + seq_printf(s, "%s%lu", prefix, emc->timings[i].rate);
> > + prefix = " ";
> > + }
> > +
> > + seq_puts(s, "\n");
> > +
> > + return 0;
> > +}
> > +
> > +DEFINE_SHOW_ATTRIBUTE(tegra_emc_debug_available_rates);
> > +
> > +static int tegra_emc_debug_min_rate_get(void *data, u64 *rate)
> > +{
> > + struct tegra_emc *emc = data;
> > +
> > + *rate = emc->debugfs.min_rate;
> > +
> > + return 0;
> > +}
> > +
> > +static int tegra_emc_debug_min_rate_set(void *data, u64 rate)
> > +{
> > + struct tegra_emc *emc = data;
> > + int err;
> > +
> > + if (!tegra_emc_validate_rate(emc, rate))
> > + return -EINVAL;
> > +
> > + err = emc_set_min_rate(emc, rate, EMC_RATE_DEBUG);
> > + if (err < 0)
> > + return err;
> > +
> > + emc->debugfs.min_rate = rate;
> > +
> > + return 0;
> > +}
> > +
> > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_min_rate_fops,
> > + tegra_emc_debug_min_rate_get,
> > + tegra_emc_debug_min_rate_set, "%llu\n");
> > +
> > +static int tegra_emc_debug_max_rate_get(void *data, u64 *rate)
> > +{
> > + struct tegra_emc *emc = data;
> > +
> > + *rate = emc->debugfs.max_rate;
> > +
> > + return 0;
> > +}
> > +
> > +static int tegra_emc_debug_max_rate_set(void *data, u64 rate)
> > +{
> > + struct tegra_emc *emc = data;
> > + int err;
> > +
> > + if (!tegra_emc_validate_rate(emc, rate))
> > + return -EINVAL;
> > +
> > + err = emc_set_max_rate(emc, rate, EMC_RATE_DEBUG);
> > + if (err < 0)
> > + return err;
> > +
> > + emc->debugfs.max_rate = rate;
> > +
> > + return 0;
> > +}
> > +
> > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_max_rate_fops,
> > + tegra_emc_debug_max_rate_get,
> > + tegra_emc_debug_max_rate_set, "%llu\n");
> > +
> > +static void emc_debugfs_init(struct device *dev, struct tegra_emc *emc)
> > +{
> > + unsigned int i;
> > + int err;
> > +
> > + emc->debugfs.min_rate = ULONG_MAX;
> > + emc->debugfs.max_rate = 0;
> > +
> > + for (i = 0; i < emc->num_timings; i++) {
> > + if (emc->timings[i].rate < emc->debugfs.min_rate)
> > + emc->debugfs.min_rate = emc->timings[i].rate;
> > +
> > + if (emc->timings[i].rate > emc->debugfs.max_rate)
> > + emc->debugfs.max_rate = emc->timings[i].rate;
> > + }
> > +
> > + if (!emc->num_timings) {
> > + emc->debugfs.min_rate = clk_get_rate(emc->clk);
> > + emc->debugfs.max_rate = emc->debugfs.min_rate;
> > + }
> > +
> > + err = clk_set_rate_range(emc->clk, emc->debugfs.min_rate,
> > + emc->debugfs.max_rate);
> > + if (err < 0) {
> > + dev_err(dev, "failed to set rate range [%lu-%lu] for %pC\n",
> > + emc->debugfs.min_rate, emc->debugfs.max_rate,
> > + emc->clk);
> > + return;
> > + }
> > +
> > + emc->debugfs.root = debugfs_create_dir("emc", NULL);
> > +
> > + debugfs_create_file("available_rates", 0444, emc->debugfs.root, emc,
> > + &tegra_emc_debug_available_rates_fops);
> > + debugfs_create_file("min_rate", 0644, emc->debugfs.root,
> > + emc, &tegra_emc_debug_min_rate_fops);
> > + debugfs_create_file("max_rate", 0644, emc->debugfs.root,
> > + emc, &tegra_emc_debug_max_rate_fops);
> > +}
> > +
> > +static inline struct tegra_emc *
> > +to_tegra_emc_provider(struct icc_provider *provider)
> > +{
> > + return container_of(provider, struct tegra_emc, provider);
> > +}
> > +
> > +static struct icc_node_data *
> > +emc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
> > +{
> > + struct icc_provider *provider = data;
> > + struct icc_node_data *ndata;
> > + struct icc_node *node;
> > +
> > + /* External Memory is the only possible ICC route */
> > + list_for_each_entry(node, &provider->nodes, node_list) {
> > + if (node->id != TEGRA_ICC_EMEM)
> > + continue;
> > +
> > + ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
> > + if (!ndata)
> > + return ERR_PTR(-ENOMEM);
> > +
> > + /*
> > + * SRC and DST nodes should have matching TAG in order to have
> > + * it set by default for a requested path.
> > + */
> > + ndata->tag = TEGRA_MC_ICC_TAG_ISO;
> > + ndata->node = node;
> > +
> > + return ndata;
> > + }
> > +
> > + return ERR_PTR(-EPROBE_DEFER);
> > +}
> > +
> > +static int emc_icc_set(struct icc_node *src, struct icc_node *dst)
> > +{
> > + struct tegra_emc *emc = to_tegra_emc_provider(dst->provider);
> > + unsigned long long peak_bw = icc_units_to_bps(dst->peak_bw);
> > + unsigned long long avg_bw = icc_units_to_bps(dst->avg_bw);
> > + unsigned long long rate = max(avg_bw, peak_bw);
> > + unsigned int dram_data_bus_width_bytes = 4;
> > + const unsigned int ddr = 2;
> > + int err;
> > +
> > + /*
> > + * Tegra114 EMC runs on a clock rate of SDRAM bus. This means that
> > + * EMC clock rate is twice smaller than the peak data rate because
> > + * data is sampled on both EMC clock edges.
> > + */
> > + do_div(rate, ddr * dram_data_bus_width_bytes);
> > + rate = min_t(u64, rate, U32_MAX);
> > +
> > + err = emc_set_min_rate(emc, rate, EMC_RATE_ICC);
> > + if (err)
> > + return err;
> > +
> > + return 0;
> > +}
> > +
> > +static int tegra_emc_interconnect_init(struct tegra_emc *emc)
> > +{
> > + const struct tegra_mc_soc *soc = emc->mc->soc;
> > + struct icc_node *node;
> > + int err;
> > +
> > + emc->provider.dev = emc->dev;
> > + emc->provider.set = emc_icc_set;
> > + emc->provider.data = &emc->provider;
> > + emc->provider.aggregate = soc->icc_ops->aggregate;
> > + emc->provider.xlate_extended = emc_of_icc_xlate_extended;
> > +
> > + icc_provider_init(&emc->provider);
> > +
> > + /* create External Memory Controller node */
> > + node = icc_node_create(TEGRA_ICC_EMC);
> > + if (IS_ERR(node)) {
> > + err = PTR_ERR(node);
> > + goto err_msg;
> > + }
> > +
> > + node->name = "External Memory Controller";
> > + icc_node_add(node, &emc->provider);
> > +
> > + /* link External Memory Controller to External Memory (DRAM) */
> > + err = icc_link_create(node, TEGRA_ICC_EMEM);
> > + if (err)
> > + goto remove_nodes;
> > +
> > + /* create External Memory node */
> > + node = icc_node_create(TEGRA_ICC_EMEM);
> > + if (IS_ERR(node)) {
> > + err = PTR_ERR(node);
> > + goto remove_nodes;
> > + }
> > +
> > + node->name = "External Memory (DRAM)";
> > + icc_node_add(node, &emc->provider);
> > +
> > + err = icc_provider_register(&emc->provider);
> > + if (err)
> > + goto remove_nodes;
> > +
> > + return 0;
> > +
> > +remove_nodes:
> > + icc_nodes_remove(&emc->provider);
> > +err_msg:
> > + dev_err(emc->dev, "failed to initialize ICC: %d\n", err);
> > +
> > + return err;
> > +}
> > +
> > +static int tegra_emc_opp_table_init(struct tegra_emc *emc)
In v4 I will switch to devm_tegra_core_dev_init_opp_table used in
tegra30 emc with required adjustments to it if you don't mind.
> > +{
> > + u32 hw_version = BIT(tegra_sku_info.soc_speedo_id);
> > + int opp_token, err;
> > +
> > + err = dev_pm_opp_set_supported_hw(emc->dev, &hw_version, 1);
> > + if (err < 0) {
> > + dev_err(emc->dev, "failed to set OPP supported HW: %d\n", err);
> > + return err;
> > + }
> > + opp_token = err;
> > +
> > + err = dev_pm_opp_of_add_table(emc->dev);
> > + if (err) {
> > + if (err == -ENODEV)
> > + dev_err(emc->dev, "OPP table not found, please update your device tree\n");
> > + else
> > + dev_err(emc->dev, "failed to add OPP table: %d\n", err);
> > +
> > + goto put_hw_table;
> > + }
> > +
> > + dev_info_once(emc->dev, "OPP HW ver. 0x%x, current clock rate %lu MHz\n",
> > + hw_version, clk_get_rate(emc->clk) / 1000000);
> > +
> > + /* first dummy rate-set initializes voltage state */
> > + err = dev_pm_opp_set_rate(emc->dev, clk_get_rate(emc->clk));
> > + if (err) {
> > + dev_err(emc->dev, "failed to initialize OPP clock: %d\n", err);
> > + goto remove_table;
> > + }
> > +
> > + return 0;
> > +
> > +remove_table:
> > + dev_pm_opp_of_remove_table(emc->dev);
> > +put_hw_table:
> > + dev_pm_opp_put_supported_hw(opp_token);
> > +
> > + return err;
> > +}
> > +
> > +static void devm_tegra_emc_unset_callback(void *data)
> > +{
> > + tegra124_clk_set_emc_callbacks(NULL, NULL);
> > +}
> > +
> > +static int tegra_emc_probe(struct platform_device *pdev)
> > +{
> > + struct device_node *np;
> > + struct tegra_emc *emc;
> > + u32 ram_code;
> > + int err;
> > +
> > + emc = devm_kzalloc(&pdev->dev, sizeof(*emc), GFP_KERNEL);
> > + if (!emc)
> > + return -ENOMEM;
> > +
> > + mutex_init(&emc->rate_lock);
> > + emc->dev = &pdev->dev;
> > +
> > + emc->regs = devm_platform_ioremap_resource(pdev, 0);
> > + if (IS_ERR(emc->regs))
> > + return PTR_ERR(emc->regs);
> > +
> > + emc->mc = devm_tegra_memory_controller_get(&pdev->dev);
> > + if (IS_ERR(emc->mc))
> > + return PTR_ERR(emc->mc);
> > +
> > + ram_code = tegra_read_ram_code();
> > +
> > + np = tegra_emc_find_node_by_ram_code(pdev->dev.of_node, ram_code);
> > + if (np) {
> > + err = tegra_emc_load_timings_from_dt(emc, np);
> > + of_node_put(np);
> > + if (err)
> > + return err;
> > + } else {
> > + dev_info_once(&pdev->dev,
> > + "no memory timings for RAM code %u found in DT\n",
> > + ram_code);
> > + }
> > +
> > + err = emc_init(emc);
> > + if (err) {
> > + dev_err(&pdev->dev, "EMC initialization failed: %d\n", err);
> > + return err;
> > + }
> > +
> > + platform_set_drvdata(pdev, emc);
> > +
> > + tegra124_clk_set_emc_callbacks(tegra_emc_prepare_timing_change,
> > + tegra_emc_complete_timing_change);
> > +
> > + err = devm_add_action_or_reset(&pdev->dev, devm_tegra_emc_unset_callback,
> > + NULL);
> > + if (err)
> > + return err;
> > +
> > + err = platform_get_irq(pdev, 0);
> > + if (err < 0)
> > + return err;
> > +
> > + emc->irq = err;
> > +
> > + err = devm_request_irq(&pdev->dev, emc->irq, tegra_emc_isr, 0,
> > + dev_name(&pdev->dev), emc);
> > + if (err) {
> > + dev_err(&pdev->dev, "failed to request irq: %d\n", err);
> > + return err;
> > + }
> > +
> > + emc->clk = devm_clk_get(&pdev->dev, "emc");
> > + if (IS_ERR(emc->clk)) {
> > + err = PTR_ERR(emc->clk);
> > + dev_err(&pdev->dev, "failed to get EMC clock: %d\n", err);
> > + return err;
> > + }
> > +
> > + err = tegra_emc_opp_table_init(emc);
> > + if (err)
> > + return err;
> > +
> > + tegra_emc_rate_requests_init(emc);
> > +
> > + if (IS_ENABLED(CONFIG_DEBUG_FS))
> > + emc_debugfs_init(&pdev->dev, emc);
> > +
> > + tegra_emc_interconnect_init(emc);
> > +
> > + /*
> > + * Don't allow the kernel module to be unloaded. Unloading adds some
> > + * extra complexity which doesn't really worth the effort in a case of
> > + * this driver.
> > + */
> > + try_module_get(THIS_MODULE);
> > +
> > + return 0;
> > +};
> > +
> > +static const struct of_device_id tegra_emc_of_match[] = {
> > + { .compatible = "nvidia,tegra114-emc" },
> > + {}
> > +};
> > +MODULE_DEVICE_TABLE(of, tegra_emc_of_match);
> > +
> > +static struct platform_driver tegra_emc_driver = {
> > + .probe = tegra_emc_probe,
> > + .driver = {
> > + .name = "tegra114-emc",
> > + .of_match_table = tegra_emc_of_match,
> > + .suppress_bind_attrs = true,
> > + .sync_state = icc_sync_state,
> > + },
> > +};
> > +module_platform_driver(tegra_emc_driver);
> > +
> > +MODULE_AUTHOR("Svyatoslav Ryhel <clamor95@gmail.com>");
> > +MODULE_DESCRIPTION("NVIDIA Tegra114 EMC driver");
> > +MODULE_LICENSE("GPL");
> >
>
>
>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver
2025-11-18 8:05 ` Svyatoslav Ryhel
@ 2025-11-21 4:03 ` Mikko Perttunen
2025-11-21 8:54 ` Svyatoslav Ryhel
0 siblings, 1 reply; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-21 4:03 UTC (permalink / raw)
To: Svyatoslav Ryhel
Cc: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
On Tuesday, November 18, 2025 5:05 PM Svyatoslav Ryhel wrote:
> вт, 18 лист. 2025 р. о 09:08 Mikko Perttunen <mperttunen@nvidia.com> пише:
> >
> > On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> > > Introduce driver for the External Memory Controller (EMC) found in Tegra114
> > > SoC. It controls the external DRAM on the board. The purpose of this
> > > driver is to program memory timing for external memory on the EMC clock
> > > rate change.
> > >
> > > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > > ---
> > > drivers/memory/tegra/Kconfig | 12 +
> > > drivers/memory/tegra/Makefile | 1 +
> > > drivers/memory/tegra/tegra114-emc.c | 1487 +++++++++++++++++++++++++++
> > > 3 files changed, 1500 insertions(+)
> > > create mode 100644 drivers/memory/tegra/tegra114-emc.c
> > >
> > > diff --git a/drivers/memory/tegra/Kconfig b/drivers/memory/tegra/Kconfig
> > > index fc5a27791826..11e7cc357d39 100644
> > > --- a/drivers/memory/tegra/Kconfig
> > > +++ b/drivers/memory/tegra/Kconfig
> > > @@ -35,6 +35,18 @@ config TEGRA30_EMC
> > > This driver is required to change memory timings / clock rate for
> > > external memory.
> > >
> > > +config TEGRA114_EMC
> > > + tristate "NVIDIA Tegra114 External Memory Controller driver"
> > > + default y
> > > + depends on ARCH_TEGRA_114_SOC || COMPILE_TEST
> > > + select TEGRA124_CLK_EMC if ARCH_TEGRA
> > > + select PM_OPP
> > > + help
> > > + This driver is for the External Memory Controller (EMC) found on
> > > + Tegra114 chips. The EMC controls the external DRAM on the board.
> > > + This driver is required to change memory timings / clock rate for
> > > + external memory.
> > > +
> > > config TEGRA124_EMC
> > > tristate "NVIDIA Tegra124 External Memory Controller driver"
> > > default ARCH_TEGRA_124_SOC
> > > diff --git a/drivers/memory/tegra/Makefile b/drivers/memory/tegra/Makefile
> > > index 0750847dac3c..d36be28efc4a 100644
> > > --- a/drivers/memory/tegra/Makefile
> > > +++ b/drivers/memory/tegra/Makefile
> > > @@ -15,6 +15,7 @@ obj-$(CONFIG_TEGRA_MC) += tegra-mc.o
> > >
> > > obj-$(CONFIG_TEGRA20_EMC) += tegra20-emc.o
> > > obj-$(CONFIG_TEGRA30_EMC) += tegra30-emc.o
> > > +obj-$(CONFIG_TEGRA114_EMC) += tegra114-emc.o
> > > obj-$(CONFIG_TEGRA124_EMC) += tegra124-emc.o
> > > obj-$(CONFIG_TEGRA210_EMC_TABLE) += tegra210-emc-table.o
> > > obj-$(CONFIG_TEGRA210_EMC) += tegra210-emc.o
> > > diff --git a/drivers/memory/tegra/tegra114-emc.c b/drivers/memory/tegra/tegra114-emc.c
> > > new file mode 100644
> > > index 000000000000..b986b5509f41
> > > --- /dev/null
> > > +++ b/drivers/memory/tegra/tegra114-emc.c
> > > @@ -0,0 +1,1487 @@
> > > +// SPDX-License-Identifier: GPL-2.0-only
> > > +/*
> > > + * Tegra114 External Memory Controller driver
> > > + *
> > > + * Based on downstream driver from NVIDIA and tegra124-emc.c
> > > + * Copyright (C) 2011-2014 NVIDIA Corporation
> > > + *
> > > + * Copyright (C) 2024 Svyatoslav Ryhel <clamor95@gmail.com>
> > > + */
> > > +
> > > +#include <linux/clk-provider.h>
> > > +#include <linux/clk.h>
> > > +#include <linux/clkdev.h>
> > > +#include <linux/clk/tegra.h>
> > > +#include <linux/debugfs.h>
> > > +#include <linux/delay.h>
> > > +#include <linux/interconnect-provider.h>
> > > +#include <linux/interrupt.h>
> > > +#include <linux/io.h>
> > > +#include <linux/module.h>
> > > +#include <linux/mutex.h>
> > > +#include <linux/of_address.h>
> > > +#include <linux/of_platform.h>
> > > +#include <linux/platform_device.h>
> > > +#include <linux/pm_opp.h>
> > > +#include <linux/sort.h>
> > > +#include <linux/string.h>
> > > +
> > > +#include <soc/tegra/fuse.h>
> > > +#include <soc/tegra/mc.h>
> > > +
> > > +#include "mc.h"
> > > +
> > > +#define EMC_INTSTATUS 0x0
> > > +#define EMC_REFRESH_OVERFLOW_INT BIT(3)
> > > +#define EMC_INTSTATUS_CLKCHANGE_COMPLETE BIT(4)
> >
> > This naming is inconsistent. I'd prefer using EMC_INTSTATUS_REFRESH_OVERFLOW and EMC_INTSTATUS_CLKCHANGE_COMPLETE.
> >
> > > +
> > > +#define EMC_INTMASK 0x4
> > > +
> > > +#define EMC_DBG 0x8
> > > +#define EMC_DBG_READ_MUX_ASSEMBLY BIT(0)
> > > +#define EMC_DBG_WRITE_MUX_ACTIVE BIT(1)
> > > +#define EMC_DBG_FORCE_UPDATE BIT(2)
> > > +#define EMC_DBG_CFG_PRIORITY BIT(24)
> > > +
> > > +#define EMC_CFG 0xc
> > > +#define EMC_CFG_DRAM_CLKSTOP_PD BIT(31)
> > > +#define EMC_CFG_DRAM_CLKSTOP_SR BIT(30)
> > > +#define EMC_CFG_DRAM_ACPD BIT(29)
> > > +#define EMC_CFG_DYN_SREF BIT(28)
> > > +#define EMC_CFG_PWR_MASK ((0xF << 28) | BIT(18))
> > > +#define EMC_CFG_DSR_VTTGEN_DRV_EN BIT(18)
> >
> > Ordering from first to last register would be more consistent.
> >
> > > +
> > > +#define EMC_ADR_CFG 0x10
> > > +#define EMC_ADR_CFG_EMEM_NUMDEV BIT(0)
> > > +
> > > +#define EMC_REFCTRL 0x20
> > > +#define EMC_REFCTRL_DEV_SEL_SHIFT 0
> > > +#define EMC_REFCTRL_ENABLE BIT(31)
> > > +
> > > +#define EMC_TIMING_CONTROL 0x28
> > > +#define EMC_RC 0x2c
> > > +#define EMC_RFC 0x30
> > > +#define EMC_RAS 0x34
> > > +#define EMC_RP 0x38
> > > +#define EMC_R2W 0x3c
> > > +#define EMC_W2R 0x40
> > > +#define EMC_R2P 0x44
> > > +#define EMC_W2P 0x48
> > > +#define EMC_RD_RCD 0x4c
> > > +#define EMC_WR_RCD 0x50
> > > +#define EMC_RRD 0x54
> > > +#define EMC_REXT 0x58
> > > +#define EMC_WDV 0x5c
> > > +#define EMC_QUSE 0x60
> > > +#define EMC_QRST 0x64
> > > +#define EMC_QSAFE 0x68
> > > +#define EMC_RDV 0x6c
> > > +#define EMC_REFRESH 0x70
> > > +#define EMC_BURST_REFRESH_NUM 0x74
> > > +#define EMC_PDEX2WR 0x78
> > > +#define EMC_PDEX2RD 0x7c
> > > +#define EMC_PCHG2PDEN 0x80
> > > +#define EMC_ACT2PDEN 0x84
> > > +#define EMC_AR2PDEN 0x88
> > > +#define EMC_RW2PDEN 0x8c
> > > +#define EMC_TXSR 0x90
> > > +#define EMC_TCKE 0x94
> > > +#define EMC_TFAW 0x98
> > > +#define EMC_TRPAB 0x9c
> > > +#define EMC_TCLKSTABLE 0xa0
> > > +#define EMC_TCLKSTOP 0xa4
> > > +#define EMC_TREFBW 0xa8
> > > +#define EMC_QUSE_EXTRA 0xac
> > > +#define EMC_ODT_WRITE 0xb0
> > > +#define EMC_ODT_READ 0xb4
> > > +#define EMC_WEXT 0xb8
> > > +#define EMC_CTT 0xbc
> > > +#define EMC_RFC_SLR 0xc0
> > > +#define EMC_MRS_WAIT_CNT2 0xc4
> > > +
> > > +#define EMC_MRS_WAIT_CNT 0xc8
> > > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT 0
> > > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK \
> > > + (0x3FF << EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT)
> > > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT 16
> > > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_MASK \
> > > + (0x3FF << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > > +
> > > +#define EMC_MRS 0xcc
> > > +#define EMC_MODE_SET_DLL_RESET BIT(8)
> > > +#define EMC_MODE_SET_LONG_CNT BIT(26)
> > > +#define EMC_EMRS 0xd0
> > > +#define EMC_REF 0xd4
> > > +#define EMC_PRE 0xd8
> > > +
> > > +#define EMC_SELF_REF 0xe0
> > > +#define EMC_SELF_REF_CMD_ENABLED BIT(0)
> > > +#define EMC_SELF_REF_DEV_SEL_SHIFT 30
> > > +
> > > +#define EMC_MRW 0xe8
> > > +
> > > +#define EMC_MRR 0xec
> > > +#define EMC_MRR_MA_SHIFT 16
> > > +#define LPDDR2_MR4_TEMP_SHIFT 0
> > > +
> > > +#define EMC_XM2DQSPADCTRL3 0xf8
> > > +#define EMC_FBIO_SPARE 0x100
> > > +
> > > +#define EMC_FBIO_CFG5 0x104
> > > +#define EMC_FBIO_CFG5_DRAM_TYPE_MASK 0x3
> > > +#define EMC_FBIO_CFG5_DRAM_TYPE_SHIFT 0
> >
> > Inconsistent to indent here and not elsewhere. My preference is not to indent.
> >
> > > +
> > > +#define EMC_FBIO_CFG6 0x114
> > > +#define EMC_EMRS2 0x12c
> > > +#define EMC_MRW2 0x134
> > > +#define EMC_MRW4 0x13c
> > > +#define EMC_EINPUT 0x14c
> > > +#define EMC_EINPUT_DURATION 0x150
> > > +#define EMC_PUTERM_EXTRA 0x154
> > > +#define EMC_TCKESR 0x158
> > > +#define EMC_TPD 0x15c
> > > +
> > > +#define EMC_AUTO_CAL_CONFIG 0x2a4
> > > +#define EMC_AUTO_CAL_CONFIG_AUTO_CAL_START BIT(31)
> > > +#define EMC_AUTO_CAL_INTERVAL 0x2a8
> > > +#define EMC_AUTO_CAL_STATUS 0x2ac
> > > +#define EMC_AUTO_CAL_STATUS_ACTIVE BIT(31)
> > > +#define EMC_STATUS 0x2b4
> > > +#define EMC_STATUS_TIMING_UPDATE_STALLED BIT(23)
> > > +
> > > +#define EMC_CFG_2 0x2b8
> > > +#define EMC_CLKCHANGE_REQ_ENABLE BIT(0)
> > > +#define EMC_CLKCHANGE_PD_ENABLE BIT(1)
> > > +#define EMC_CLKCHANGE_SR_ENABLE BIT(2)
> >
> > Better to prefix with EMC_CFG_2
> >
> > > +
> > > +#define EMC_CFG_DIG_DLL 0x2bc
> > > +#define EMC_CFG_DIG_DLL_PERIOD 0x2c0
> > > +#define EMC_RDV_MASK 0x2cc
> > > +#define EMC_WDV_MASK 0x2d0
> > > +#define EMC_CTT_DURATION 0x2d8
> > > +#define EMC_CTT_TERM_CTRL 0x2dc
> > > +#define EMC_ZCAL_INTERVAL 0x2e0
> > > +#define EMC_ZCAL_WAIT_CNT 0x2e4
> > > +
> > > +#define EMC_ZQ_CAL 0x2ec
> > > +#define EMC_ZQ_CAL_CMD BIT(0)
> > > +#define EMC_ZQ_CAL_LONG BIT(4)
> > > +#define EMC_ZQ_CAL_LONG_CMD_DEV0 \
> > > + (DRAM_DEV_SEL_0 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > > +#define EMC_ZQ_CAL_LONG_CMD_DEV1 \
> > > + (DRAM_DEV_SEL_1 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > > +
> > > +#define EMC_XM2CMDPADCTRL 0x2f0
> > > +#define EMC_XM2DQSPADCTRL 0x2f8
> > > +#define EMC_XM2DQSPADCTRL2 0x2fc
> > > +#define EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE BIT(0)
> > > +#define EMC_XM2DQSPADCTRL2_VREF_ENABLE BIT(5)
> > > +#define EMC_XM2DQPADCTRL 0x300
> > > +#define EMC_XM2DQPADCTRL2 0x304
> > > +#define EMC_XM2CLKPADCTRL 0x308
> > > +#define EMC_XM2COMPPADCTRL 0x30c
> > > +#define EMC_XM2VTTGENPADCTRL 0x310
> > > +#define EMC_XM2VTTGENPADCTRL2 0x314
> > > +#define EMC_XM2QUSEPADCTRL 0x318
> > > +#define EMC_XM2DQSPADCTRL4 0x320
> > > +#define EMC_DLL_XFORM_DQS0 0x328
> > > +#define EMC_DLL_XFORM_DQS1 0x32c
> > > +#define EMC_DLL_XFORM_DQS2 0x330
> > > +#define EMC_DLL_XFORM_DQS3 0x334
> > > +#define EMC_DLL_XFORM_DQS4 0x338
> > > +#define EMC_DLL_XFORM_DQS5 0x33c
> > > +#define EMC_DLL_XFORM_DQS6 0x340
> > > +#define EMC_DLL_XFORM_DQS7 0x344
> > > +#define EMC_DLL_XFORM_QUSE0 0x348
> > > +#define EMC_DLL_XFORM_QUSE1 0x34c
> > > +#define EMC_DLL_XFORM_QUSE2 0x350
> > > +#define EMC_DLL_XFORM_QUSE3 0x354
> > > +#define EMC_DLL_XFORM_QUSE4 0x358
> > > +#define EMC_DLL_XFORM_QUSE5 0x35c
> > > +#define EMC_DLL_XFORM_QUSE6 0x360
> > > +#define EMC_DLL_XFORM_QUSE7 0x364
> > > +#define EMC_DLL_XFORM_DQ0 0x368
> > > +#define EMC_DLL_XFORM_DQ1 0x36c
> > > +#define EMC_DLL_XFORM_DQ2 0x370
> > > +#define EMC_DLL_XFORM_DQ3 0x374
> > > +#define EMC_DLI_TRIM_TXDQS0 0x3a8
> > > +#define EMC_DLI_TRIM_TXDQS1 0x3ac
> > > +#define EMC_DLI_TRIM_TXDQS2 0x3b0
> > > +#define EMC_DLI_TRIM_TXDQS3 0x3b4
> > > +#define EMC_DLI_TRIM_TXDQS4 0x3b8
> > > +#define EMC_DLI_TRIM_TXDQS5 0x3bc
> > > +#define EMC_DLI_TRIM_TXDQS6 0x3c0
> > > +#define EMC_DLI_TRIM_TXDQS7 0x3c4
> > > +#define EMC_STALL_THEN_EXE_AFTER_CLKCHANGE 0x3cc
> > > +#define EMC_SEL_DPD_CTRL 0x3d8
> > > +#define EMC_SEL_DPD_CTRL_DATA_SEL_DPD BIT(8)
> > > +#define EMC_SEL_DPD_CTRL_ODT_SEL_DPD BIT(5)
> > > +#define EMC_SEL_DPD_CTRL_RESET_SEL_DPD BIT(4)
> > > +#define EMC_SEL_DPD_CTRL_CA_SEL_DPD BIT(3)
> > > +#define EMC_SEL_DPD_CTRL_CLK_SEL_DPD BIT(2)
> > > +#define EMC_SEL_DPD_CTRL_DDR3_MASK \
> > > + ((0xf << 2) | BIT(8))
> > > +#define EMC_SEL_DPD_CTRL_MASK \
> > > + ((0x3 << 2) | BIT(5) | BIT(8))
> > > +#define EMC_PRE_REFRESH_REQ_CNT 0x3dc
> > > +#define EMC_DYN_SELF_REF_CONTROL 0x3e0
> > > +#define EMC_TXSRDLL 0x3e4
> > > +#define EMC_CCFIFO_ADDR 0x3e8
> > > +#define EMC_CCFIFO_DATA 0x3ec
> > > +#define EMC_CCFIFO_STATUS 0x3f0
> > > +#define EMC_CDB_CNTL_1 0x3f4
> > > +#define EMC_CDB_CNTL_2 0x3f8
> > > +#define EMC_XM2CLKPADCTRL2 0x3fc
> > > +#define EMC_AUTO_CAL_CONFIG2 0x458
> > > +#define EMC_AUTO_CAL_CONFIG3 0x45c
> > > +#define EMC_IBDLY 0x468
> > > +#define EMC_DLL_XFORM_ADDR0 0x46c
> > > +#define EMC_DLL_XFORM_ADDR1 0x470
> > > +#define EMC_DLL_XFORM_ADDR2 0x474
> > > +#define EMC_DSR_VTTGEN_DRV 0x47c
> > > +#define EMC_TXDSRVTTGEN 0x480
> > > +#define EMC_XM2CMDPADCTRL4 0x484
> > > +
> > > +#define DRAM_DEV_SEL_ALL 0
> > > +#define DRAM_DEV_SEL_0 BIT(31)
> > > +#define DRAM_DEV_SEL_1 BIT(30)
> > > +
> > > +#define EMC_CFG_POWER_FEATURES_MASK \
> > > + (EMC_CFG_DYN_SREF | EMC_CFG_DRAM_ACPD | EMC_CFG_DRAM_CLKSTOP_SR | \
> > > + EMC_CFG_DRAM_CLKSTOP_PD | EMC_CFG_DSR_VTTGEN_DRV_EN)
> > > +#define EMC_REFCTRL_DEV_SEL(n) ((((n) > 1) ? 0 : 2) << EMC_REFCTRL_DEV_SEL_SHIFT)
> > > +#define EMC_DRAM_DEV_SEL(n) (((n) > 1) ? DRAM_DEV_SEL_ALL : DRAM_DEV_SEL_0)
> > > +
> > > +/* Maximum amount of time in us. to wait for changes to become effective */
> > > +#define EMC_STATUS_UPDATE_TIMEOUT 1000
> > > +
> > > +enum emc_dram_type {
> > > + DRAM_TYPE_DDR3,
> > > + DRAM_TYPE_DDR1,
> > > + DRAM_TYPE_LPDDR2,
> > > + DRAM_TYPE_DDR2
> > > +};
> > > +
> > > +enum emc_dll_change {
> > > + DLL_CHANGE_NONE,
> > > + DLL_CHANGE_ON,
> > > + DLL_CHANGE_OFF
> > > +};
> > > +
> > > +static const unsigned long emc_burst_regs[] = {
> > > + EMC_RC,
> > > + EMC_RFC,
> > > + EMC_RAS,
> > > + EMC_RP,
> > > + EMC_R2W,
> > > + EMC_W2R,
> > > + EMC_R2P,
> > > + EMC_W2P,
> > > + EMC_RD_RCD,
> > > + EMC_WR_RCD,
> > > + EMC_RRD,
> > > + EMC_REXT,
> > > + EMC_WEXT,
> > > + EMC_WDV,
> > > + EMC_WDV_MASK,
> > > + EMC_QUSE,
> > > + EMC_IBDLY,
> > > + EMC_EINPUT,
> > > + EMC_EINPUT_DURATION,
> > > + EMC_PUTERM_EXTRA,
> > > + EMC_CDB_CNTL_1,
> > > + EMC_CDB_CNTL_2,
> > > + EMC_QRST,
> > > + EMC_QSAFE,
> > > + EMC_RDV,
> > > + EMC_RDV_MASK,
> > > + EMC_REFRESH,
> > > + EMC_BURST_REFRESH_NUM,
> > > + EMC_PRE_REFRESH_REQ_CNT,
> > > + EMC_PDEX2WR,
> > > + EMC_PDEX2RD,
> > > + EMC_PCHG2PDEN,
> > > + EMC_ACT2PDEN,
> > > + EMC_AR2PDEN,
> > > + EMC_RW2PDEN,
> > > + EMC_TXSR,
> > > + EMC_TXSRDLL,
> > > + EMC_TCKE,
> > > + EMC_TCKESR,
> > > + EMC_TPD,
> > > + EMC_TFAW,
> > > + EMC_TRPAB,
> > > + EMC_TCLKSTABLE,
> > > + EMC_TCLKSTOP,
> > > + EMC_TREFBW,
> > > + EMC_QUSE_EXTRA,
> > > + EMC_FBIO_CFG6,
> > > + EMC_ODT_WRITE,
> > > + EMC_ODT_READ,
> > > + EMC_FBIO_CFG5,
> > > + EMC_CFG_DIG_DLL,
> > > + EMC_CFG_DIG_DLL_PERIOD,
> > > + EMC_DLL_XFORM_DQS0,
> > > + EMC_DLL_XFORM_DQS1,
> > > + EMC_DLL_XFORM_DQS2,
> > > + EMC_DLL_XFORM_DQS3,
> > > + EMC_DLL_XFORM_DQS4,
> > > + EMC_DLL_XFORM_DQS5,
> > > + EMC_DLL_XFORM_DQS6,
> > > + EMC_DLL_XFORM_DQS7,
> > > + EMC_DLL_XFORM_QUSE0,
> > > + EMC_DLL_XFORM_QUSE1,
> > > + EMC_DLL_XFORM_QUSE2,
> > > + EMC_DLL_XFORM_QUSE3,
> > > + EMC_DLL_XFORM_QUSE4,
> > > + EMC_DLL_XFORM_QUSE5,
> > > + EMC_DLL_XFORM_QUSE6,
> > > + EMC_DLL_XFORM_QUSE7,
> > > + EMC_DLI_TRIM_TXDQS0,
> > > + EMC_DLI_TRIM_TXDQS1,
> > > + EMC_DLI_TRIM_TXDQS2,
> > > + EMC_DLI_TRIM_TXDQS3,
> > > + EMC_DLI_TRIM_TXDQS4,
> > > + EMC_DLI_TRIM_TXDQS5,
> > > + EMC_DLI_TRIM_TXDQS6,
> > > + EMC_DLI_TRIM_TXDQS7,
> > > + EMC_DLL_XFORM_DQ0,
> > > + EMC_DLL_XFORM_DQ1,
> > > + EMC_DLL_XFORM_DQ2,
> > > + EMC_DLL_XFORM_DQ3,
> > > + EMC_XM2CMDPADCTRL,
> > > + EMC_XM2CMDPADCTRL4,
> > > + EMC_XM2DQPADCTRL2,
> > > + EMC_XM2CLKPADCTRL,
> > > + EMC_XM2COMPPADCTRL,
> > > + EMC_XM2VTTGENPADCTRL,
> > > + EMC_XM2VTTGENPADCTRL2,
> > > + EMC_XM2DQSPADCTRL3,
> > > + EMC_XM2DQSPADCTRL4,
> > > + EMC_DSR_VTTGEN_DRV,
> > > + EMC_TXDSRVTTGEN,
> > > + EMC_FBIO_SPARE,
> > > + EMC_ZCAL_WAIT_CNT,
> > > + EMC_MRS_WAIT_CNT2,
> > > + EMC_CTT,
> > > + EMC_CTT_DURATION,
> > > + EMC_DYN_SELF_REF_CONTROL,
> > > +};
> >
> > How was this list determined? It doesn't seem to match the trees I can find, or the list in the TRM (which is also different from the downstream source code).
> >
>
> Hm, IIRC, I used Tegra114 3.4 kernel sources, specifically
> tegratab/macallan memory board files as my base and then tried to
> align them closer to list used by Tegra124 (not identical obviously
> since lists have different lengths). This list contains burst and
> trimmer registers with some of them excluded as a dedicated entries in
> emc_timing structure below (yet again - similar to Tegra124). If you
> have any ideas how to group registers better I would be happy to hear.
That sounds fine by me if we're programming all registers the downstream sequence is programming (except for ones not related to the DRAM configuration like the latency allowance stuff that's better done otherwise). I was just wondering.
>
> > > +
> > > +struct emc_timing {
> > > + unsigned long rate;
> > > +
> > > + u32 emc_burst_data[ARRAY_SIZE(emc_burst_regs)];
> > > +
> > > + u32 emc_auto_cal_config;
> > > + u32 emc_auto_cal_config2;
> > > + u32 emc_auto_cal_config3;
> > > + u32 emc_auto_cal_interval;
> > > + u32 emc_cfg;
> > > + u32 emc_ctt_term_ctrl;
> > > + u32 emc_mode_1;
> > > + u32 emc_mode_2;
> > > + u32 emc_mode_4;
> > > + u32 emc_mode_reset;
> > > + u32 emc_mrs_wait_cnt;
> > > + u32 emc_sel_dpd_ctrl;
> > > + u32 emc_xm2dqspadctrl2;
> > > + u32 emc_zcal_cnt_long;
> > > + u32 emc_zcal_interval;
> > > +};
> > > +
> > > +enum emc_rate_request_type {
> > > + EMC_RATE_DEBUG,
> > > + EMC_RATE_ICC,
> > > + EMC_RATE_TYPE_MAX,
> > > +};
> > > +
> > > +struct emc_rate_request {
> > > + unsigned long min_rate;
> > > + unsigned long max_rate;
> > > +};
> > > +
> > > +struct tegra_emc {
> > > + struct device *dev;
> > > +
> > > + struct tegra_mc *mc;
> > > +
> > > + void __iomem *regs;
> > > +
> > > + unsigned int irq;
> > > +
> > > + struct clk *clk;
> >
> > Nit: I don't think all the empty lines are needed.
> >
> > > +
> > > + enum emc_dram_type dram_type;
> > > + unsigned int dram_num;
> > > +
> > > + struct emc_timing last_timing;
> > > + struct emc_timing *timings;
> > > + unsigned int num_timings;
> > > +
> > > + struct {
> > > + struct dentry *root;
> > > + unsigned long min_rate;
> > > + unsigned long max_rate;
> > > + } debugfs;
> > > +
> > > + struct icc_provider provider;
> > > +
> > > + /*
> > > + * There are multiple sources in the EMC driver which could request
> > > + * a min/max clock rate, these rates are contained in this array.
> > > + */
> > > + struct emc_rate_request requested_rate[EMC_RATE_TYPE_MAX];
> > > +
> > > + /* protect shared rate-change code path */
> > > + struct mutex rate_lock;
> > > +};
> > > +
> > > +static irqreturn_t tegra_emc_isr(int irq, void *data)
> > > +{
> > > + struct tegra_emc *emc = data;
> > > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > > + u32 status;
> > > +
> > > + status = readl_relaxed(emc->regs + EMC_INTSTATUS) & intmask;
> > > + if (!status)
> > > + return IRQ_NONE;
> > > +
> > > + /* notify about HW problem */
> > > + if (status & EMC_REFRESH_OVERFLOW_INT)
> > > + dev_err_ratelimited(emc->dev,
> > > + "refresh request overflow timeout\n");
> > > +
> > > + /* clear interrupts */
> > > + writel_relaxed(status, emc->regs + EMC_INTSTATUS);
> > > +
> > > + return IRQ_HANDLED;
> > > +}
> > > +
> > > +/* Timing change sequence functions */
> > > +
> > > +static void emc_ccfifo_writel(struct tegra_emc *emc, u32 value,
> > > + unsigned long offset)
> > > +{
> > > + writel(value, emc->regs + EMC_CCFIFO_DATA);
> > > + writel(offset, emc->regs + EMC_CCFIFO_ADDR);
> > > +}
> > > +
> > > +static void emc_seq_update_timing(struct tegra_emc *emc)
> > > +{
> > > + unsigned int i;
> > > + u32 value;
> > > +
> > > + writel(1, emc->regs + EMC_TIMING_CONTROL);
> > > +
> > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > + value = readl(emc->regs + EMC_STATUS);
> > > + if ((value & EMC_STATUS_TIMING_UPDATE_STALLED) == 0)
> > > + return;
> > > + udelay(1);
> > > + }
> >
> > This can be replaced with readl_poll_timeout_atomic
> >
> > > +
> > > + dev_err(emc->dev, "timing update timed out\n");
> > > +}
> > > +
> > > +static void emc_seq_disable_auto_cal(struct tegra_emc *emc)
> > > +{
> > > + unsigned int i;
> > > + u32 value;
> > > +
> > > + writel(0, emc->regs + EMC_AUTO_CAL_INTERVAL);
> > > +
> > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > + value = readl(emc->regs + EMC_AUTO_CAL_STATUS);
> > > + if ((value & EMC_AUTO_CAL_STATUS_ACTIVE) == 0)
> > > + return;
> > > + udelay(1);
> > > + }
> >
> > Likewise
> >
> > > +
> > > + dev_err(emc->dev, "auto cal disable timed out\n");
> > > +}
> > > +
> > > +static void emc_seq_wait_clkchange(struct tegra_emc *emc)
> > > +{
> > > + unsigned int i;
> > > + u32 value;
> > > +
> > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > + value = readl(emc->regs + EMC_INTSTATUS);
> > > + if (value & EMC_INTSTATUS_CLKCHANGE_COMPLETE)
> > > + return;
> > > + udelay(1);
> > > + }
> >
> > Likewise
> >
> > > +
> > > + dev_err(emc->dev, "clock change timed out\n");
> > > +}
> > > +
> > > +static struct emc_timing *tegra_emc_find_timing(struct tegra_emc *emc,
> > > + unsigned long rate)
> > > +{
> > > + struct emc_timing *timing = NULL;
> > > + unsigned int i;
> > > +
> > > + for (i = 0; i < emc->num_timings; i++) {
> > > + if (emc->timings[i].rate == rate) {
> > > + timing = &emc->timings[i];
> > > + break;
> > > + }
> > > + }
> > > +
> > > + if (!timing) {
> > > + dev_err(emc->dev, "no timing for rate %lu\n", rate);
> > > + return NULL;
> > > + }
> > > +
> > > + return timing;
> > > +}
> > > +
> > > +static int tegra_emc_prepare_timing_change(struct tegra_emc *emc,
> > > + unsigned long rate)
> > > +{
> > > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > > + struct emc_timing *last = &emc->last_timing;
> > > + enum emc_dll_change dll_change;
> > > + unsigned int pre_wait = 0;
> > > + u32 val, mask;
> > > + bool update = false;
> > > + unsigned int i;
> > > +
> > > + if (!timing)
> > > + return -ENOENT;
> > > +
> > > + if ((last->emc_mode_1 & 0x1) == (timing->emc_mode_1 & 0x1))
> > > + dll_change = DLL_CHANGE_NONE;
> > > + else if (timing->emc_mode_1 & 0x1)
> >
> > This looks incorrect. DLL is enabled if bit 0 is off. Now, I'm guessing that comes from the other drivers, originally from tegra124-emc.c, which was written by.. me :) I can send a patch for the other chips.
> >
>
> Noted
>
> > > + dll_change = DLL_CHANGE_ON;
> > > + else
> > > + dll_change = DLL_CHANGE_OFF;
> > > +
> > > + /* Clear CLKCHANGE_COMPLETE interrupts */
> > > + writel(EMC_INTSTATUS_CLKCHANGE_COMPLETE, emc->regs + EMC_INTSTATUS);
> > > +
> > > + /* Disable dynamic self-refresh */
> > > + val = readl(emc->regs + EMC_CFG);
> > > + if (val & EMC_CFG_PWR_MASK) {
> >
> > This doesn't strictly match downstream Tegra114 EMC code or the TRM -- it is the later sequence version for Tegra124. However, my hunch is that the Tegra124 sequence would be compatible and probably more reliable as it would have received more testing. So it's probably not a bad idea to use it.
> >
> > There are other places in the sequence that have changed between versions, but I don't think we need to change them. If issues are seen in the future, we can check again.
> >
>
> It does not strictly match, yes, but overall logic is preserved. I
> have tested these on my Tegra114 devices and I did not observe any
> notable issues.
>
Sounds good.
> > > + val &= ~EMC_CFG_POWER_FEATURES_MASK;
> > > + writel(val, emc->regs + EMC_CFG);
> > > +
> > > + pre_wait = 5;
> > > + }
> > > +
> > > + /* Disable SEL_DPD_CTRL for clock change */
> > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > + mask = EMC_SEL_DPD_CTRL_DDR3_MASK;
> > > + else
> > > + mask = EMC_SEL_DPD_CTRL_MASK;
> > > +
> > > + val = readl(emc->regs + EMC_SEL_DPD_CTRL);
> > > + if (val & mask) {
> > > + val &= ~mask;
> > > + writel(val, emc->regs + EMC_SEL_DPD_CTRL);
> > > + }
> > > +
> > > + /* Prepare DQ/DQS for clock change */
> > > + val = readl(emc->regs + EMC_XM2DQSPADCTRL2);
> > > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_VREF_ENABLE &&
> > > + !(val & EMC_XM2DQSPADCTRL2_VREF_ENABLE)) {
> > > + val |= EMC_XM2DQSPADCTRL2_VREF_ENABLE;
> > > + update = true;
> > > + }
> > > +
> > > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE &&
> > > + !(val & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE)) {
> > > + val |= EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE;
> > > + update = true;
> > > + }
> > > +
> > > + if (update) {
> > > + writel(val, emc->regs + EMC_XM2DQSPADCTRL2);
> > > + if (pre_wait < 30)
> > > + pre_wait = 30;
> > > + }
> > > +
> > > + /* Wait to settle */
> > > + if (pre_wait) {
> > > + emc_seq_update_timing(emc);
> > > + udelay(pre_wait);
> > > + }
> > > +
> > > + /* Program CTT_TERM control */
> > > + if (last->emc_ctt_term_ctrl != timing->emc_ctt_term_ctrl) {
> > > + emc_seq_disable_auto_cal(emc);
> > > + writel(timing->emc_ctt_term_ctrl,
> > > + emc->regs + EMC_CTT_TERM_CTRL);
> > > + emc_seq_update_timing(emc);
> > > + }
> > > +
> > > + /* Program burst shadow registers */
> > > + for (i = 0; i < ARRAY_SIZE(timing->emc_burst_data); ++i)
> > > + writel(timing->emc_burst_data[i],
> > > + emc->regs + emc_burst_regs[i]);
> > > +
> > > + writel(timing->emc_xm2dqspadctrl2, emc->regs + EMC_XM2DQSPADCTRL2);
> > > + writel(timing->emc_zcal_interval, emc->regs + EMC_ZCAL_INTERVAL);
> > > +
> > > + tegra_mc_write_emem_configuration(emc->mc, timing->rate);
> > > +
> > > + val = timing->emc_cfg & ~EMC_CFG_POWER_FEATURES_MASK;
> > > + emc_ccfifo_writel(emc, val, EMC_CFG);
> > > +
> > > + /* Program AUTO_CAL_CONFIG */
> > > + if (timing->emc_auto_cal_config2 != last->emc_auto_cal_config2)
> > > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config2,
> > > + EMC_AUTO_CAL_CONFIG2);
> > > +
> > > + if (timing->emc_auto_cal_config3 != last->emc_auto_cal_config3)
> > > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config3,
> > > + EMC_AUTO_CAL_CONFIG3);
> > > +
> > > + if (timing->emc_auto_cal_config != last->emc_auto_cal_config) {
> > > + val = timing->emc_auto_cal_config;
> > > + val &= EMC_AUTO_CAL_CONFIG_AUTO_CAL_START;
> > > + emc_ccfifo_writel(emc, val, EMC_AUTO_CAL_CONFIG);
> > > + }
> > > +
> > > + /* DDR3: predict MRS long wait count */
> > > + if (emc->dram_type == DRAM_TYPE_DDR3 &&
> > > + dll_change == DLL_CHANGE_ON) {
> > > + u32 cnt = 512;
> > > +
> > > + if (timing->emc_zcal_interval != 0 &&
> > > + last->emc_zcal_interval == 0)
> > > + cnt -= emc->dram_num * 256;
> > > +
> > > + val = (timing->emc_mrs_wait_cnt
> > > + & EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK)
> > > + >> EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT;
> > > + if (cnt < val)
> > > + cnt = val;
> > > +
> > > + val = timing->emc_mrs_wait_cnt
> > > + & ~EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > > + val |= (cnt << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > > + & EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > > +
> > > + writel(val, emc->regs + EMC_MRS_WAIT_CNT);
> > > + }
> > > +
> > > + /* DDR3: Turn off DLL and enter self-refresh */
> > > + if (emc->dram_type == DRAM_TYPE_DDR3 && dll_change == DLL_CHANGE_OFF)
> > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > > +
> > > + /* Disable refresh controller */
> > > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num),
> > > + EMC_REFCTRL);
> > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num) |
> > > + EMC_SELF_REF_CMD_ENABLED,
> > > + EMC_SELF_REF);
> > > +
> > > + /* Flow control marker */
> > > + emc_ccfifo_writel(emc, 1, EMC_STALL_THEN_EXE_AFTER_CLKCHANGE);
> > > +
> > > + /* DDR3: Exit self-refresh */
> > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num),
> > > + EMC_SELF_REF);
> > > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num) |
> > > + EMC_REFCTRL_ENABLE,
> > > + EMC_REFCTRL);
> > > +
> > > + /* Set DRAM mode registers */
> > > + if (emc->dram_type == DRAM_TYPE_DDR3) {
> > > + if (timing->emc_mode_1 != last->emc_mode_1)
> > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > > + if (timing->emc_mode_2 != last->emc_mode_2)
> > > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_EMRS2);
> > > +
> > > + if (timing->emc_mode_reset != last->emc_mode_reset ||
> > > + dll_change == DLL_CHANGE_ON) {
> > > + val = timing->emc_mode_reset;
> > > + if (dll_change == DLL_CHANGE_ON) {
> > > + val |= EMC_MODE_SET_DLL_RESET;
> > > + val |= EMC_MODE_SET_LONG_CNT;
> > > + } else {
> > > + val &= ~EMC_MODE_SET_DLL_RESET;
> > > + }
> > > + emc_ccfifo_writel(emc, val, EMC_MRS);
> > > + }
> > > + } else {
> > > + if (timing->emc_mode_2 != last->emc_mode_2)
> > > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_MRW2);
> > > + if (timing->emc_mode_1 != last->emc_mode_1)
> > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_MRW);
> > > + if (timing->emc_mode_4 != last->emc_mode_4)
> > > + emc_ccfifo_writel(emc, timing->emc_mode_4, EMC_MRW4);
> > > + }
> > > +
> > > + /* Issue ZCAL command if turning ZCAL on */
> > > + if (timing->emc_zcal_interval != 0 && last->emc_zcal_interval == 0) {
> > > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV0, EMC_ZQ_CAL);
> > > + if (emc->dram_num > 1)
> > > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV1,
> > > + EMC_ZQ_CAL);
> > > + }
> > > +
> > > + /* Write to RO register to remove stall after change */
> > > + emc_ccfifo_writel(emc, 0, EMC_CCFIFO_STATUS);
> > > +
> > > + /* Disable AUTO_CAL for clock change */
> > > + emc_seq_disable_auto_cal(emc);
> > > +
> > > + /* Read register to wait until programming has settled */
> > > + mc_readl(emc->mc, MC_EMEM_ADR_CFG);
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static void tegra_emc_complete_timing_change(struct tegra_emc *emc,
> > > + unsigned long rate)
> > > +{
> > > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > > + struct emc_timing *last = &emc->last_timing;
> > > +
> > > + if (!timing)
> > > + return;
> > > +
> > > + /* Wait until the state machine has settled */
> > > + emc_seq_wait_clkchange(emc);
> > > +
> > > + /* Restore AUTO_CAL */
> > > + if (timing->emc_ctt_term_ctrl != last->emc_ctt_term_ctrl)
> > > + writel(timing->emc_auto_cal_interval,
> > > + emc->regs + EMC_AUTO_CAL_INTERVAL);
> > > +
> > > + /* Restore dynamic self-refresh */
> > > + if (timing->emc_cfg & EMC_CFG_PWR_MASK)
> > > + writel(timing->emc_cfg, emc->regs + EMC_CFG);
> > > +
> > > + /* Set ZCAL wait count */
> > > + writel(timing->emc_zcal_cnt_long, emc->regs + EMC_ZCAL_WAIT_CNT);
> > > +
> > > + /* Wait for timing to settle */
> > > + udelay(2);
> > > +
> > > + /* Reprogram SEL_DPD_CTRL */
> > > + writel(timing->emc_sel_dpd_ctrl, emc->regs + EMC_SEL_DPD_CTRL);
> > > + emc_seq_update_timing(emc);
> > > +
> > > + emc->last_timing = *timing;
> > > +}
> > > +
> > > +/* Initialization and deinitialization */
> > > +
> > > +static void emc_read_current_timing(struct tegra_emc *emc,
> > > + struct emc_timing *timing)
> > > +{
> > > + unsigned int i;
> > > +
> > > + for (i = 0; i < ARRAY_SIZE(emc_burst_regs); ++i)
> > > + timing->emc_burst_data[i] =
> > > + readl(emc->regs + emc_burst_regs[i]);
> > > +
> > > + timing->emc_cfg = readl(emc->regs + EMC_CFG);
> > > +
> > > + timing->emc_auto_cal_interval = 0;
> > > + timing->emc_zcal_cnt_long = 0;
> > > + timing->emc_mode_1 = 0;
> > > + timing->emc_mode_2 = 0;
> > > + timing->emc_mode_4 = 0;
> > > + timing->emc_mode_reset = 0;
> >
> > Hmm. I wonder why these aren't being read. It seems like it would be a good idea, since the some of these are checked for last_timing in the sequence.
> >
>
> This stems from Tegra124 emc driver, so maybe it has some sense. In
> any case, adding readl is not an issue whatsoever.
>
Looks like they are set to zero in the downstream code as well, which still doesn't make much sense, but it does seem to work. So leaving at zero should be fine.
> > > +}
> > > +
> > > +static int emc_init(struct tegra_emc *emc)
> > > +{
> > > + u32 emc_cfg, emc_dbg;
> > > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > > + const char *dram_type_str;
> > > +
> > > + emc->dram_type = readl(emc->regs + EMC_FBIO_CFG5);
> > > +
> > > + emc->dram_type &= EMC_FBIO_CFG5_DRAM_TYPE_MASK;
> > > + emc->dram_type >>= EMC_FBIO_CFG5_DRAM_TYPE_SHIFT;
> > > +
> > > + emc->dram_num = tegra_mc_get_emem_device_count(emc->mc);
> > > +
> > > + emc_cfg = readl_relaxed(emc->regs + EMC_CFG_2);
> > > +
> > > + /* enable EMC and CAR to handshake on PLL divider/source changes */
> > > + emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> > > +
> > > + /* configure clock change mode accordingly to DRAM type */
> > > + switch (emc->dram_type) {
> > > + case DRAM_TYPE_LPDDR2:
> > > + emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> > > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > > + break;
> > > +
> > > + default:
> > > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > > + emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> > > + break;
> > > + }
> >
> > This doesn't match the source trees I have (either Tegra114 or Tegra124). Those don't touch EMC_CLKCHANGE_SR_ENABLE. TRM seems to be contradictory about this. It says to leave it at reset value of DISABLED, but then later says that the reset value is ENABLED. I would err on the side of the code. In any case, I think this would be cleaner to write as an if statement
> >
> > emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> >
> > if (emc->dram_type == DRAM_TYPE_LPDDR2)
> > emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> > else
> > emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> >
>
> Noted. Yes, TRM in Software programming sequence on the Tegra 4 clock
> change sequence states Keep these register fields in reset values:
> CLKCHANGE_REQ_ENABLE = ENABLED
> CLKCHANGE_SR_ENABLE = DISABLED
>
> Hence I have added emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE
I think it might be worth checking what the reset value actually is (by reading the register after boot). The register's section in the TRM has a different name for the field (REF_AFTER_SREF) and it says the reset value should be ENABLED, not DISABLED. The EMC_CFG_2 register is part of burst regs for Tegra124, so I checked some EMC tables and it seems the bit is always set for those tables; and for Tegra114 the code never changes the bit from reset values. So I think the programming sequence section could be wrong (perhaps the register was changed after it was written but it was never updated).
>
> > > +
> > > + writel_relaxed(emc_cfg, emc->regs + EMC_CFG_2);
> > > +
> > > + /* initialize interrupt */
> > > + writel_relaxed(intmask, emc->regs + EMC_INTMASK);
> > > + writel_relaxed(0xffffffff, emc->regs + EMC_INTSTATUS);
> > > +
> > > + /* ensure that unwanted debug features are disabled */
> > > + emc_dbg = readl_relaxed(emc->regs + EMC_DBG);
> > > + emc_dbg |= EMC_DBG_CFG_PRIORITY;
> > > + emc_dbg &= ~EMC_DBG_READ_MUX_ASSEMBLY;
> > > + emc_dbg &= ~EMC_DBG_WRITE_MUX_ACTIVE;
> > > + emc_dbg &= ~EMC_DBG_FORCE_UPDATE;
> > > + writel_relaxed(emc_dbg, emc->regs + EMC_DBG);
> > > +
> > > + switch (emc->dram_type) {
> > > + case DRAM_TYPE_DDR1:
> > > + dram_type_str = "DDR1";
> > > + break;
> > > + case DRAM_TYPE_LPDDR2:
> > > + dram_type_str = "LPDDR2";
> > > + break;
> > > + case DRAM_TYPE_DDR2:
> > > + dram_type_str = "DDR2";
> > > + break;
> > > + case DRAM_TYPE_DDR3:
> > > + dram_type_str = "DDR3";
> > > + break;
> > > + }
> > > +
> > > + dev_info_once(emc->dev, "%u %s %s attached\n", emc->dram_num,
> > > + dram_type_str, emc->dram_num == 2 ? "devices" : "device");
> > > +
> > > + emc_read_current_timing(emc, &emc->last_timing);
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static int load_one_timing_from_dt(struct tegra_emc *emc,
> > > + struct emc_timing *timing,
> > > + struct device_node *node)
> > > +{
> > > + u32 value;
> > > + int err;
> > > +
> > > + err = of_property_read_u32(node, "clock-frequency", &value);
> > > + if (err) {
> > > + dev_err(emc->dev, "timing %pOFn: failed to read rate: %d\n",
> > > + node, err);
> > > + return err;
> > > + }
> > > +
> > > + timing->rate = value;
> > > +
> > > + err = of_property_read_u32_array(node, "nvidia,emc-configuration",
> > > + timing->emc_burst_data,
> > > + ARRAY_SIZE(timing->emc_burst_data));
> > > + if (err) {
> > > + dev_err(emc->dev,
> > > + "timing %pOFn: failed to read emc burst data: %d\n",
> > > + node, err);
> > > + return err;
> > > + }
> > > +
> > > +#define EMC_READ_PROP(prop, dtprop) { \
> > > + err = of_property_read_u32(node, dtprop, &timing->prop); \
> > > + if (err) { \
> > > + dev_err(emc->dev, "timing %pOFn: failed to read " #prop ": %d\n", \
> > > + node, err); \
> > > + return err; \
> > > + } \
> > > +}
> > > +
> > > + EMC_READ_PROP(emc_auto_cal_config, "nvidia,emc-auto-cal-config")
> > > + EMC_READ_PROP(emc_auto_cal_config2, "nvidia,emc-auto-cal-config2")
> > > + EMC_READ_PROP(emc_auto_cal_config3, "nvidia,emc-auto-cal-config3")
> > > + EMC_READ_PROP(emc_auto_cal_interval, "nvidia,emc-auto-cal-interval")
> > > + EMC_READ_PROP(emc_cfg, "nvidia,emc-cfg")
> > > + EMC_READ_PROP(emc_ctt_term_ctrl, "nvidia,emc-ctt-term-ctrl")
> > > + EMC_READ_PROP(emc_mode_1, "nvidia,emc-mode-1")
> > > + EMC_READ_PROP(emc_mode_2, "nvidia,emc-mode-2")
> > > + EMC_READ_PROP(emc_mode_4, "nvidia,emc-mode-4")
> > > + EMC_READ_PROP(emc_mode_reset, "nvidia,emc-mode-reset")
> > > + EMC_READ_PROP(emc_mrs_wait_cnt, "nvidia,emc-mrs-wait-cnt")
> > > + EMC_READ_PROP(emc_sel_dpd_ctrl, "nvidia,emc-sel-dpd-ctrl")
> > > + EMC_READ_PROP(emc_xm2dqspadctrl2, "nvidia,emc-xm2dqspadctrl2")
> > > + EMC_READ_PROP(emc_zcal_cnt_long, "nvidia,emc-zcal-cnt-long")
> > > + EMC_READ_PROP(emc_zcal_interval, "nvidia,emc-zcal-interval")
> > > +
> > > +#undef EMC_READ_PROP
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static int cmp_timings(const void *_a, const void *_b)
> > > +{
> > > + const struct emc_timing *a = _a;
> > > + const struct emc_timing *b = _b;
> > > +
> > > + if (a->rate < b->rate)
> > > + return -1;
> > > + else if (a->rate == b->rate)
> > > + return 0;
> > > + else
> > > + return 1;
> > > +}
> > > +
> > > +static int tegra_emc_load_timings_from_dt(struct tegra_emc *emc,
> > > + struct device_node *node)
> > > +{
> > > + int child_count = of_get_child_count(node);
> > > + struct device_node *child;
> > > + struct emc_timing *timing;
> > > + unsigned int i = 0;
> > > + int err;
> > > +
> > > + emc->timings = devm_kcalloc(emc->dev, child_count, sizeof(*timing),
> > > + GFP_KERNEL);
> > > + if (!emc->timings)
> > > + return -ENOMEM;
> > > +
> > > + emc->num_timings = child_count;
> > > +
> > > + for_each_child_of_node(node, child) {
> > > + timing = &emc->timings[i++];
> > > +
> > > + err = load_one_timing_from_dt(emc, timing, child);
> > > + if (err) {
> > > + of_node_put(child);
> > > + return err;
> > > + }
> > > + }
> > > +
> > > + sort(emc->timings, emc->num_timings, sizeof(*timing), cmp_timings,
> > > + NULL);
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static struct device_node *
> > > +tegra_emc_find_node_by_ram_code(struct device_node *node, u32 ram_code)
> > > +{
> > > + struct device_node *np;
> > > + int err;
> > > +
> > > + for_each_child_of_node(node, np) {
> > > + u32 value;
> > > +
> > > + err = of_property_read_u32(np, "nvidia,ram-code", &value);
> > > + if (err || value != ram_code)
> > > + continue;
> > > +
> > > + return np;
> > > + }
> > > +
> > > + return NULL;
> > > +}
> > > +
> > > +static void tegra_emc_rate_requests_init(struct tegra_emc *emc)
> > > +{
> > > + unsigned int i;
> > > +
> > > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++) {
> > > + emc->requested_rate[i].min_rate = 0;
> > > + emc->requested_rate[i].max_rate = ULONG_MAX;
> > > + }
> > > +}
> > > +
> > > +static int emc_request_rate(struct tegra_emc *emc,
> > > + unsigned long new_min_rate,
> > > + unsigned long new_max_rate,
> > > + enum emc_rate_request_type type)
> > > +{
> > > + struct emc_rate_request *req = emc->requested_rate;
> > > + unsigned long min_rate = 0, max_rate = ULONG_MAX;
> > > + unsigned int i;
> > > + int err;
> > > +
> > > + /* select minimum and maximum rates among the requested rates */
> > > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++, req++) {
> > > + if (i == type) {
> > > + min_rate = max(new_min_rate, min_rate);
> > > + max_rate = min(new_max_rate, max_rate);
> > > + } else {
> > > + min_rate = max(req->min_rate, min_rate);
> > > + max_rate = min(req->max_rate, max_rate);
> > > + }
> > > + }
> > > +
> > > + if (min_rate > max_rate) {
> > > + dev_err_ratelimited(emc->dev, "%s: type %u: out of range: %lu %lu\n",
> > > + __func__, type, min_rate, max_rate);
> > > + return -ERANGE;
> > > + }
> > > +
> > > + /*
> > > + * EMC rate-changes should go via OPP API because it manages voltage
> > > + * changes.
> > > + */
> > > + err = dev_pm_opp_set_rate(emc->dev, min_rate);
> > > + if (err)
> > > + return err;
> > > +
> > > + emc->requested_rate[type].min_rate = new_min_rate;
> > > + emc->requested_rate[type].max_rate = new_max_rate;
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static int emc_set_min_rate(struct tegra_emc *emc, unsigned long rate,
> > > + enum emc_rate_request_type type)
> > > +{
> > > + struct emc_rate_request *req = &emc->requested_rate[type];
> > > + int ret;
> > > +
> > > + mutex_lock(&emc->rate_lock);
> > > + ret = emc_request_rate(emc, rate, req->max_rate, type);
> > > + mutex_unlock(&emc->rate_lock);
> > > +
> > > + return ret;
> > > +}
> > > +
> > > +static int emc_set_max_rate(struct tegra_emc *emc, unsigned long rate,
> > > + enum emc_rate_request_type type)
> > > +{
> > > + struct emc_rate_request *req = &emc->requested_rate[type];
> > > + int ret;
> > > +
> > > + mutex_lock(&emc->rate_lock);
> > > + ret = emc_request_rate(emc, req->min_rate, rate, type);
> > > + mutex_unlock(&emc->rate_lock);
> > > +
> > > + return ret;
> > > +}
> > > +
> > > +/*
> > > + * debugfs interface
> > > + *
> > > + * The memory controller driver exposes some files in debugfs that can be used
> > > + * to control the EMC frequency. The top-level directory can be found here:
> > > + *
> > > + * /sys/kernel/debug/emc
> > > + *
> > > + * It contains the following files:
> > > + *
> > > + * - available_rates: This file contains a list of valid, space-separated
> > > + * EMC frequencies.
> > > + *
> > > + * - min_rate: Writing a value to this file sets the given frequency as the
> > > + * floor of the permitted range. If this is higher than the currently
> > > + * configured EMC frequency, this will cause the frequency to be
> > > + * increased so that it stays within the valid range.
> > > + *
> > > + * - max_rate: Similarly to the min_rate file, writing a value to this file
> > > + * sets the given frequency as the ceiling of the permitted range. If
> > > + * the value is lower than the currently configured EMC frequency, this
> > > + * will cause the frequency to be decreased so that it stays within the
> > > + * valid range.
> > > + */
> > > +
> > > +static bool tegra_emc_validate_rate(struct tegra_emc *emc, unsigned long rate)
> > > +{
> > > + unsigned int i;
> > > +
> > > + for (i = 0; i < emc->num_timings; i++)
> > > + if (rate == emc->timings[i].rate)
> > > + return true;
> > > +
> > > + return false;
> > > +}
> > > +
> > > +static int tegra_emc_debug_available_rates_show(struct seq_file *s,
> > > + void *data)
> > > +{
> > > + struct tegra_emc *emc = s->private;
> > > + const char *prefix = "";
> > > + unsigned int i;
> > > +
> > > + for (i = 0; i < emc->num_timings; i++) {
> > > + seq_printf(s, "%s%lu", prefix, emc->timings[i].rate);
> > > + prefix = " ";
> > > + }
> > > +
> > > + seq_puts(s, "\n");
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +DEFINE_SHOW_ATTRIBUTE(tegra_emc_debug_available_rates);
> > > +
> > > +static int tegra_emc_debug_min_rate_get(void *data, u64 *rate)
> > > +{
> > > + struct tegra_emc *emc = data;
> > > +
> > > + *rate = emc->debugfs.min_rate;
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static int tegra_emc_debug_min_rate_set(void *data, u64 rate)
> > > +{
> > > + struct tegra_emc *emc = data;
> > > + int err;
> > > +
> > > + if (!tegra_emc_validate_rate(emc, rate))
> > > + return -EINVAL;
> > > +
> > > + err = emc_set_min_rate(emc, rate, EMC_RATE_DEBUG);
> > > + if (err < 0)
> > > + return err;
> > > +
> > > + emc->debugfs.min_rate = rate;
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_min_rate_fops,
> > > + tegra_emc_debug_min_rate_get,
> > > + tegra_emc_debug_min_rate_set, "%llu\n");
> > > +
> > > +static int tegra_emc_debug_max_rate_get(void *data, u64 *rate)
> > > +{
> > > + struct tegra_emc *emc = data;
> > > +
> > > + *rate = emc->debugfs.max_rate;
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static int tegra_emc_debug_max_rate_set(void *data, u64 rate)
> > > +{
> > > + struct tegra_emc *emc = data;
> > > + int err;
> > > +
> > > + if (!tegra_emc_validate_rate(emc, rate))
> > > + return -EINVAL;
> > > +
> > > + err = emc_set_max_rate(emc, rate, EMC_RATE_DEBUG);
> > > + if (err < 0)
> > > + return err;
> > > +
> > > + emc->debugfs.max_rate = rate;
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_max_rate_fops,
> > > + tegra_emc_debug_max_rate_get,
> > > + tegra_emc_debug_max_rate_set, "%llu\n");
> > > +
> > > +static void emc_debugfs_init(struct device *dev, struct tegra_emc *emc)
> > > +{
> > > + unsigned int i;
> > > + int err;
> > > +
> > > + emc->debugfs.min_rate = ULONG_MAX;
> > > + emc->debugfs.max_rate = 0;
> > > +
> > > + for (i = 0; i < emc->num_timings; i++) {
> > > + if (emc->timings[i].rate < emc->debugfs.min_rate)
> > > + emc->debugfs.min_rate = emc->timings[i].rate;
> > > +
> > > + if (emc->timings[i].rate > emc->debugfs.max_rate)
> > > + emc->debugfs.max_rate = emc->timings[i].rate;
> > > + }
> > > +
> > > + if (!emc->num_timings) {
> > > + emc->debugfs.min_rate = clk_get_rate(emc->clk);
> > > + emc->debugfs.max_rate = emc->debugfs.min_rate;
> > > + }
> > > +
> > > + err = clk_set_rate_range(emc->clk, emc->debugfs.min_rate,
> > > + emc->debugfs.max_rate);
> > > + if (err < 0) {
> > > + dev_err(dev, "failed to set rate range [%lu-%lu] for %pC\n",
> > > + emc->debugfs.min_rate, emc->debugfs.max_rate,
> > > + emc->clk);
> > > + return;
> > > + }
> > > +
> > > + emc->debugfs.root = debugfs_create_dir("emc", NULL);
> > > +
> > > + debugfs_create_file("available_rates", 0444, emc->debugfs.root, emc,
> > > + &tegra_emc_debug_available_rates_fops);
> > > + debugfs_create_file("min_rate", 0644, emc->debugfs.root,
> > > + emc, &tegra_emc_debug_min_rate_fops);
> > > + debugfs_create_file("max_rate", 0644, emc->debugfs.root,
> > > + emc, &tegra_emc_debug_max_rate_fops);
> > > +}
> > > +
> > > +static inline struct tegra_emc *
> > > +to_tegra_emc_provider(struct icc_provider *provider)
> > > +{
> > > + return container_of(provider, struct tegra_emc, provider);
> > > +}
> > > +
> > > +static struct icc_node_data *
> > > +emc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
> > > +{
> > > + struct icc_provider *provider = data;
> > > + struct icc_node_data *ndata;
> > > + struct icc_node *node;
> > > +
> > > + /* External Memory is the only possible ICC route */
> > > + list_for_each_entry(node, &provider->nodes, node_list) {
> > > + if (node->id != TEGRA_ICC_EMEM)
> > > + continue;
> > > +
> > > + ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
> > > + if (!ndata)
> > > + return ERR_PTR(-ENOMEM);
> > > +
> > > + /*
> > > + * SRC and DST nodes should have matching TAG in order to have
> > > + * it set by default for a requested path.
> > > + */
> > > + ndata->tag = TEGRA_MC_ICC_TAG_ISO;
> > > + ndata->node = node;
> > > +
> > > + return ndata;
> > > + }
> > > +
> > > + return ERR_PTR(-EPROBE_DEFER);
> > > +}
> > > +
> > > +static int emc_icc_set(struct icc_node *src, struct icc_node *dst)
> > > +{
> > > + struct tegra_emc *emc = to_tegra_emc_provider(dst->provider);
> > > + unsigned long long peak_bw = icc_units_to_bps(dst->peak_bw);
> > > + unsigned long long avg_bw = icc_units_to_bps(dst->avg_bw);
> > > + unsigned long long rate = max(avg_bw, peak_bw);
> > > + unsigned int dram_data_bus_width_bytes = 4;
> > > + const unsigned int ddr = 2;
> > > + int err;
> > > +
> > > + /*
> > > + * Tegra114 EMC runs on a clock rate of SDRAM bus. This means that
> > > + * EMC clock rate is twice smaller than the peak data rate because
> > > + * data is sampled on both EMC clock edges.
> > > + */
> > > + do_div(rate, ddr * dram_data_bus_width_bytes);
> > > + rate = min_t(u64, rate, U32_MAX);
> > > +
> > > + err = emc_set_min_rate(emc, rate, EMC_RATE_ICC);
> > > + if (err)
> > > + return err;
> > > +
> > > + return 0;
> > > +}
> > > +
> > > +static int tegra_emc_interconnect_init(struct tegra_emc *emc)
> > > +{
> > > + const struct tegra_mc_soc *soc = emc->mc->soc;
> > > + struct icc_node *node;
> > > + int err;
> > > +
> > > + emc->provider.dev = emc->dev;
> > > + emc->provider.set = emc_icc_set;
> > > + emc->provider.data = &emc->provider;
> > > + emc->provider.aggregate = soc->icc_ops->aggregate;
> > > + emc->provider.xlate_extended = emc_of_icc_xlate_extended;
> > > +
> > > + icc_provider_init(&emc->provider);
> > > +
> > > + /* create External Memory Controller node */
> > > + node = icc_node_create(TEGRA_ICC_EMC);
> > > + if (IS_ERR(node)) {
> > > + err = PTR_ERR(node);
> > > + goto err_msg;
> > > + }
> > > +
> > > + node->name = "External Memory Controller";
> > > + icc_node_add(node, &emc->provider);
> > > +
> > > + /* link External Memory Controller to External Memory (DRAM) */
> > > + err = icc_link_create(node, TEGRA_ICC_EMEM);
> > > + if (err)
> > > + goto remove_nodes;
> > > +
> > > + /* create External Memory node */
> > > + node = icc_node_create(TEGRA_ICC_EMEM);
> > > + if (IS_ERR(node)) {
> > > + err = PTR_ERR(node);
> > > + goto remove_nodes;
> > > + }
> > > +
> > > + node->name = "External Memory (DRAM)";
> > > + icc_node_add(node, &emc->provider);
> > > +
> > > + err = icc_provider_register(&emc->provider);
> > > + if (err)
> > > + goto remove_nodes;
> > > +
> > > + return 0;
> > > +
> > > +remove_nodes:
> > > + icc_nodes_remove(&emc->provider);
> > > +err_msg:
> > > + dev_err(emc->dev, "failed to initialize ICC: %d\n", err);
> > > +
> > > + return err;
> > > +}
> > > +
> > > +static int tegra_emc_opp_table_init(struct tegra_emc *emc)
>
> In v4 I will switch to devm_tegra_core_dev_init_opp_table used in
> tegra30 emc with required adjustments to it if you don't mind.
Sounds good.
>
> > > +{
> > > + u32 hw_version = BIT(tegra_sku_info.soc_speedo_id);
> > > + int opp_token, err;
> > > +
> > > + err = dev_pm_opp_set_supported_hw(emc->dev, &hw_version, 1);
> > > + if (err < 0) {
> > > + dev_err(emc->dev, "failed to set OPP supported HW: %d\n", err);
> > > + return err;
> > > + }
> > > + opp_token = err;
> > > +
> > > + err = dev_pm_opp_of_add_table(emc->dev);
> > > + if (err) {
> > > + if (err == -ENODEV)
> > > + dev_err(emc->dev, "OPP table not found, please update your device tree\n");
> > > + else
> > > + dev_err(emc->dev, "failed to add OPP table: %d\n", err);
> > > +
> > > + goto put_hw_table;
> > > + }
> > > +
> > > + dev_info_once(emc->dev, "OPP HW ver. 0x%x, current clock rate %lu MHz\n",
> > > + hw_version, clk_get_rate(emc->clk) / 1000000);
> > > +
> > > + /* first dummy rate-set initializes voltage state */
> > > + err = dev_pm_opp_set_rate(emc->dev, clk_get_rate(emc->clk));
> > > + if (err) {
> > > + dev_err(emc->dev, "failed to initialize OPP clock: %d\n", err);
> > > + goto remove_table;
> > > + }
> > > +
> > > + return 0;
> > > +
> > > +remove_table:
> > > + dev_pm_opp_of_remove_table(emc->dev);
> > > +put_hw_table:
> > > + dev_pm_opp_put_supported_hw(opp_token);
> > > +
> > > + return err;
> > > +}
> > > +
> > > +static void devm_tegra_emc_unset_callback(void *data)
> > > +{
> > > + tegra124_clk_set_emc_callbacks(NULL, NULL);
> > > +}
> > > +
> > > +static int tegra_emc_probe(struct platform_device *pdev)
> > > +{
> > > + struct device_node *np;
> > > + struct tegra_emc *emc;
> > > + u32 ram_code;
> > > + int err;
> > > +
> > > + emc = devm_kzalloc(&pdev->dev, sizeof(*emc), GFP_KERNEL);
> > > + if (!emc)
> > > + return -ENOMEM;
> > > +
> > > + mutex_init(&emc->rate_lock);
> > > + emc->dev = &pdev->dev;
> > > +
> > > + emc->regs = devm_platform_ioremap_resource(pdev, 0);
> > > + if (IS_ERR(emc->regs))
> > > + return PTR_ERR(emc->regs);
> > > +
> > > + emc->mc = devm_tegra_memory_controller_get(&pdev->dev);
> > > + if (IS_ERR(emc->mc))
> > > + return PTR_ERR(emc->mc);
> > > +
> > > + ram_code = tegra_read_ram_code();
> > > +
> > > + np = tegra_emc_find_node_by_ram_code(pdev->dev.of_node, ram_code);
> > > + if (np) {
> > > + err = tegra_emc_load_timings_from_dt(emc, np);
> > > + of_node_put(np);
> > > + if (err)
> > > + return err;
> > > + } else {
> > > + dev_info_once(&pdev->dev,
> > > + "no memory timings for RAM code %u found in DT\n",
> > > + ram_code);
> > > + }
> > > +
> > > + err = emc_init(emc);
> > > + if (err) {
> > > + dev_err(&pdev->dev, "EMC initialization failed: %d\n", err);
> > > + return err;
> > > + }
> > > +
> > > + platform_set_drvdata(pdev, emc);
> > > +
> > > + tegra124_clk_set_emc_callbacks(tegra_emc_prepare_timing_change,
> > > + tegra_emc_complete_timing_change);
> > > +
> > > + err = devm_add_action_or_reset(&pdev->dev, devm_tegra_emc_unset_callback,
> > > + NULL);
> > > + if (err)
> > > + return err;
> > > +
> > > + err = platform_get_irq(pdev, 0);
> > > + if (err < 0)
> > > + return err;
> > > +
> > > + emc->irq = err;
> > > +
> > > + err = devm_request_irq(&pdev->dev, emc->irq, tegra_emc_isr, 0,
> > > + dev_name(&pdev->dev), emc);
> > > + if (err) {
> > > + dev_err(&pdev->dev, "failed to request irq: %d\n", err);
> > > + return err;
> > > + }
> > > +
> > > + emc->clk = devm_clk_get(&pdev->dev, "emc");
> > > + if (IS_ERR(emc->clk)) {
> > > + err = PTR_ERR(emc->clk);
> > > + dev_err(&pdev->dev, "failed to get EMC clock: %d\n", err);
> > > + return err;
> > > + }
> > > +
> > > + err = tegra_emc_opp_table_init(emc);
> > > + if (err)
> > > + return err;
> > > +
> > > + tegra_emc_rate_requests_init(emc);
> > > +
> > > + if (IS_ENABLED(CONFIG_DEBUG_FS))
> > > + emc_debugfs_init(&pdev->dev, emc);
> > > +
> > > + tegra_emc_interconnect_init(emc);
> > > +
> > > + /*
> > > + * Don't allow the kernel module to be unloaded. Unloading adds some
> > > + * extra complexity which doesn't really worth the effort in a case of
> > > + * this driver.
> > > + */
> > > + try_module_get(THIS_MODULE);
> > > +
> > > + return 0;
> > > +};
> > > +
> > > +static const struct of_device_id tegra_emc_of_match[] = {
> > > + { .compatible = "nvidia,tegra114-emc" },
> > > + {}
> > > +};
> > > +MODULE_DEVICE_TABLE(of, tegra_emc_of_match);
> > > +
> > > +static struct platform_driver tegra_emc_driver = {
> > > + .probe = tegra_emc_probe,
> > > + .driver = {
> > > + .name = "tegra114-emc",
> > > + .of_match_table = tegra_emc_of_match,
> > > + .suppress_bind_attrs = true,
> > > + .sync_state = icc_sync_state,
> > > + },
> > > +};
> > > +module_platform_driver(tegra_emc_driver);
> > > +
> > > +MODULE_AUTHOR("Svyatoslav Ryhel <clamor95@gmail.com>");
> > > +MODULE_DESCRIPTION("NVIDIA Tegra114 EMC driver");
> > > +MODULE_LICENSE("GPL");
> > >
> >
> >
> >
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver
2025-11-21 4:03 ` Mikko Perttunen
@ 2025-11-21 8:54 ` Svyatoslav Ryhel
2025-11-25 3:29 ` Mikko Perttunen
0 siblings, 1 reply; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-11-21 8:54 UTC (permalink / raw)
To: Mikko Perttunen
Cc: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
пт, 21 лист. 2025 р. о 06:04 Mikko Perttunen <mperttunen@nvidia.com> пише:
>
> On Tuesday, November 18, 2025 5:05 PM Svyatoslav Ryhel wrote:
> > вт, 18 лист. 2025 р. о 09:08 Mikko Perttunen <mperttunen@nvidia.com> пише:
> > >
> > > On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> > > > Introduce driver for the External Memory Controller (EMC) found in Tegra114
> > > > SoC. It controls the external DRAM on the board. The purpose of this
> > > > driver is to program memory timing for external memory on the EMC clock
> > > > rate change.
> > > >
> > > > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > > > ---
> > > > drivers/memory/tegra/Kconfig | 12 +
> > > > drivers/memory/tegra/Makefile | 1 +
> > > > drivers/memory/tegra/tegra114-emc.c | 1487 +++++++++++++++++++++++++++
> > > > 3 files changed, 1500 insertions(+)
> > > > create mode 100644 drivers/memory/tegra/tegra114-emc.c
> > > >
> > > > diff --git a/drivers/memory/tegra/Kconfig b/drivers/memory/tegra/Kconfig
> > > > index fc5a27791826..11e7cc357d39 100644
> > > > --- a/drivers/memory/tegra/Kconfig
> > > > +++ b/drivers/memory/tegra/Kconfig
> > > > @@ -35,6 +35,18 @@ config TEGRA30_EMC
> > > > This driver is required to change memory timings / clock rate for
> > > > external memory.
> > > >
> > > > +config TEGRA114_EMC
> > > > + tristate "NVIDIA Tegra114 External Memory Controller driver"
> > > > + default y
> > > > + depends on ARCH_TEGRA_114_SOC || COMPILE_TEST
> > > > + select TEGRA124_CLK_EMC if ARCH_TEGRA
> > > > + select PM_OPP
> > > > + help
> > > > + This driver is for the External Memory Controller (EMC) found on
> > > > + Tegra114 chips. The EMC controls the external DRAM on the board.
> > > > + This driver is required to change memory timings / clock rate for
> > > > + external memory.
> > > > +
> > > > config TEGRA124_EMC
> > > > tristate "NVIDIA Tegra124 External Memory Controller driver"
> > > > default ARCH_TEGRA_124_SOC
> > > > diff --git a/drivers/memory/tegra/Makefile b/drivers/memory/tegra/Makefile
> > > > index 0750847dac3c..d36be28efc4a 100644
> > > > --- a/drivers/memory/tegra/Makefile
> > > > +++ b/drivers/memory/tegra/Makefile
> > > > @@ -15,6 +15,7 @@ obj-$(CONFIG_TEGRA_MC) += tegra-mc.o
> > > >
> > > > obj-$(CONFIG_TEGRA20_EMC) += tegra20-emc.o
> > > > obj-$(CONFIG_TEGRA30_EMC) += tegra30-emc.o
> > > > +obj-$(CONFIG_TEGRA114_EMC) += tegra114-emc.o
> > > > obj-$(CONFIG_TEGRA124_EMC) += tegra124-emc.o
> > > > obj-$(CONFIG_TEGRA210_EMC_TABLE) += tegra210-emc-table.o
> > > > obj-$(CONFIG_TEGRA210_EMC) += tegra210-emc.o
> > > > diff --git a/drivers/memory/tegra/tegra114-emc.c b/drivers/memory/tegra/tegra114-emc.c
> > > > new file mode 100644
> > > > index 000000000000..b986b5509f41
> > > > --- /dev/null
> > > > +++ b/drivers/memory/tegra/tegra114-emc.c
> > > > @@ -0,0 +1,1487 @@
> > > > +// SPDX-License-Identifier: GPL-2.0-only
> > > > +/*
> > > > + * Tegra114 External Memory Controller driver
> > > > + *
> > > > + * Based on downstream driver from NVIDIA and tegra124-emc.c
> > > > + * Copyright (C) 2011-2014 NVIDIA Corporation
> > > > + *
> > > > + * Copyright (C) 2024 Svyatoslav Ryhel <clamor95@gmail.com>
> > > > + */
> > > > +
> > > > +#include <linux/clk-provider.h>
> > > > +#include <linux/clk.h>
> > > > +#include <linux/clkdev.h>
> > > > +#include <linux/clk/tegra.h>
> > > > +#include <linux/debugfs.h>
> > > > +#include <linux/delay.h>
> > > > +#include <linux/interconnect-provider.h>
> > > > +#include <linux/interrupt.h>
> > > > +#include <linux/io.h>
> > > > +#include <linux/module.h>
> > > > +#include <linux/mutex.h>
> > > > +#include <linux/of_address.h>
> > > > +#include <linux/of_platform.h>
> > > > +#include <linux/platform_device.h>
> > > > +#include <linux/pm_opp.h>
> > > > +#include <linux/sort.h>
> > > > +#include <linux/string.h>
> > > > +
> > > > +#include <soc/tegra/fuse.h>
> > > > +#include <soc/tegra/mc.h>
> > > > +
> > > > +#include "mc.h"
> > > > +
> > > > +#define EMC_INTSTATUS 0x0
> > > > +#define EMC_REFRESH_OVERFLOW_INT BIT(3)
> > > > +#define EMC_INTSTATUS_CLKCHANGE_COMPLETE BIT(4)
> > >
> > > This naming is inconsistent. I'd prefer using EMC_INTSTATUS_REFRESH_OVERFLOW and EMC_INTSTATUS_CLKCHANGE_COMPLETE.
> > >
> > > > +
> > > > +#define EMC_INTMASK 0x4
> > > > +
> > > > +#define EMC_DBG 0x8
> > > > +#define EMC_DBG_READ_MUX_ASSEMBLY BIT(0)
> > > > +#define EMC_DBG_WRITE_MUX_ACTIVE BIT(1)
> > > > +#define EMC_DBG_FORCE_UPDATE BIT(2)
> > > > +#define EMC_DBG_CFG_PRIORITY BIT(24)
> > > > +
> > > > +#define EMC_CFG 0xc
> > > > +#define EMC_CFG_DRAM_CLKSTOP_PD BIT(31)
> > > > +#define EMC_CFG_DRAM_CLKSTOP_SR BIT(30)
> > > > +#define EMC_CFG_DRAM_ACPD BIT(29)
> > > > +#define EMC_CFG_DYN_SREF BIT(28)
> > > > +#define EMC_CFG_PWR_MASK ((0xF << 28) | BIT(18))
> > > > +#define EMC_CFG_DSR_VTTGEN_DRV_EN BIT(18)
> > >
> > > Ordering from first to last register would be more consistent.
> > >
> > > > +
> > > > +#define EMC_ADR_CFG 0x10
> > > > +#define EMC_ADR_CFG_EMEM_NUMDEV BIT(0)
> > > > +
> > > > +#define EMC_REFCTRL 0x20
> > > > +#define EMC_REFCTRL_DEV_SEL_SHIFT 0
> > > > +#define EMC_REFCTRL_ENABLE BIT(31)
> > > > +
> > > > +#define EMC_TIMING_CONTROL 0x28
> > > > +#define EMC_RC 0x2c
> > > > +#define EMC_RFC 0x30
> > > > +#define EMC_RAS 0x34
> > > > +#define EMC_RP 0x38
> > > > +#define EMC_R2W 0x3c
> > > > +#define EMC_W2R 0x40
> > > > +#define EMC_R2P 0x44
> > > > +#define EMC_W2P 0x48
> > > > +#define EMC_RD_RCD 0x4c
> > > > +#define EMC_WR_RCD 0x50
> > > > +#define EMC_RRD 0x54
> > > > +#define EMC_REXT 0x58
> > > > +#define EMC_WDV 0x5c
> > > > +#define EMC_QUSE 0x60
> > > > +#define EMC_QRST 0x64
> > > > +#define EMC_QSAFE 0x68
> > > > +#define EMC_RDV 0x6c
> > > > +#define EMC_REFRESH 0x70
> > > > +#define EMC_BURST_REFRESH_NUM 0x74
> > > > +#define EMC_PDEX2WR 0x78
> > > > +#define EMC_PDEX2RD 0x7c
> > > > +#define EMC_PCHG2PDEN 0x80
> > > > +#define EMC_ACT2PDEN 0x84
> > > > +#define EMC_AR2PDEN 0x88
> > > > +#define EMC_RW2PDEN 0x8c
> > > > +#define EMC_TXSR 0x90
> > > > +#define EMC_TCKE 0x94
> > > > +#define EMC_TFAW 0x98
> > > > +#define EMC_TRPAB 0x9c
> > > > +#define EMC_TCLKSTABLE 0xa0
> > > > +#define EMC_TCLKSTOP 0xa4
> > > > +#define EMC_TREFBW 0xa8
> > > > +#define EMC_QUSE_EXTRA 0xac
> > > > +#define EMC_ODT_WRITE 0xb0
> > > > +#define EMC_ODT_READ 0xb4
> > > > +#define EMC_WEXT 0xb8
> > > > +#define EMC_CTT 0xbc
> > > > +#define EMC_RFC_SLR 0xc0
> > > > +#define EMC_MRS_WAIT_CNT2 0xc4
> > > > +
> > > > +#define EMC_MRS_WAIT_CNT 0xc8
> > > > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT 0
> > > > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK \
> > > > + (0x3FF << EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT)
> > > > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT 16
> > > > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_MASK \
> > > > + (0x3FF << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > > > +
> > > > +#define EMC_MRS 0xcc
> > > > +#define EMC_MODE_SET_DLL_RESET BIT(8)
> > > > +#define EMC_MODE_SET_LONG_CNT BIT(26)
> > > > +#define EMC_EMRS 0xd0
> > > > +#define EMC_REF 0xd4
> > > > +#define EMC_PRE 0xd8
> > > > +
> > > > +#define EMC_SELF_REF 0xe0
> > > > +#define EMC_SELF_REF_CMD_ENABLED BIT(0)
> > > > +#define EMC_SELF_REF_DEV_SEL_SHIFT 30
> > > > +
> > > > +#define EMC_MRW 0xe8
> > > > +
> > > > +#define EMC_MRR 0xec
> > > > +#define EMC_MRR_MA_SHIFT 16
> > > > +#define LPDDR2_MR4_TEMP_SHIFT 0
> > > > +
> > > > +#define EMC_XM2DQSPADCTRL3 0xf8
> > > > +#define EMC_FBIO_SPARE 0x100
> > > > +
> > > > +#define EMC_FBIO_CFG5 0x104
> > > > +#define EMC_FBIO_CFG5_DRAM_TYPE_MASK 0x3
> > > > +#define EMC_FBIO_CFG5_DRAM_TYPE_SHIFT 0
> > >
> > > Inconsistent to indent here and not elsewhere. My preference is not to indent.
> > >
> > > > +
> > > > +#define EMC_FBIO_CFG6 0x114
> > > > +#define EMC_EMRS2 0x12c
> > > > +#define EMC_MRW2 0x134
> > > > +#define EMC_MRW4 0x13c
> > > > +#define EMC_EINPUT 0x14c
> > > > +#define EMC_EINPUT_DURATION 0x150
> > > > +#define EMC_PUTERM_EXTRA 0x154
> > > > +#define EMC_TCKESR 0x158
> > > > +#define EMC_TPD 0x15c
> > > > +
> > > > +#define EMC_AUTO_CAL_CONFIG 0x2a4
> > > > +#define EMC_AUTO_CAL_CONFIG_AUTO_CAL_START BIT(31)
> > > > +#define EMC_AUTO_CAL_INTERVAL 0x2a8
> > > > +#define EMC_AUTO_CAL_STATUS 0x2ac
> > > > +#define EMC_AUTO_CAL_STATUS_ACTIVE BIT(31)
> > > > +#define EMC_STATUS 0x2b4
> > > > +#define EMC_STATUS_TIMING_UPDATE_STALLED BIT(23)
> > > > +
> > > > +#define EMC_CFG_2 0x2b8
> > > > +#define EMC_CLKCHANGE_REQ_ENABLE BIT(0)
> > > > +#define EMC_CLKCHANGE_PD_ENABLE BIT(1)
> > > > +#define EMC_CLKCHANGE_SR_ENABLE BIT(2)
> > >
> > > Better to prefix with EMC_CFG_2
> > >
> > > > +
> > > > +#define EMC_CFG_DIG_DLL 0x2bc
> > > > +#define EMC_CFG_DIG_DLL_PERIOD 0x2c0
> > > > +#define EMC_RDV_MASK 0x2cc
> > > > +#define EMC_WDV_MASK 0x2d0
> > > > +#define EMC_CTT_DURATION 0x2d8
> > > > +#define EMC_CTT_TERM_CTRL 0x2dc
> > > > +#define EMC_ZCAL_INTERVAL 0x2e0
> > > > +#define EMC_ZCAL_WAIT_CNT 0x2e4
> > > > +
> > > > +#define EMC_ZQ_CAL 0x2ec
> > > > +#define EMC_ZQ_CAL_CMD BIT(0)
> > > > +#define EMC_ZQ_CAL_LONG BIT(4)
> > > > +#define EMC_ZQ_CAL_LONG_CMD_DEV0 \
> > > > + (DRAM_DEV_SEL_0 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > > > +#define EMC_ZQ_CAL_LONG_CMD_DEV1 \
> > > > + (DRAM_DEV_SEL_1 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > > > +
> > > > +#define EMC_XM2CMDPADCTRL 0x2f0
> > > > +#define EMC_XM2DQSPADCTRL 0x2f8
> > > > +#define EMC_XM2DQSPADCTRL2 0x2fc
> > > > +#define EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE BIT(0)
> > > > +#define EMC_XM2DQSPADCTRL2_VREF_ENABLE BIT(5)
> > > > +#define EMC_XM2DQPADCTRL 0x300
> > > > +#define EMC_XM2DQPADCTRL2 0x304
> > > > +#define EMC_XM2CLKPADCTRL 0x308
> > > > +#define EMC_XM2COMPPADCTRL 0x30c
> > > > +#define EMC_XM2VTTGENPADCTRL 0x310
> > > > +#define EMC_XM2VTTGENPADCTRL2 0x314
> > > > +#define EMC_XM2QUSEPADCTRL 0x318
> > > > +#define EMC_XM2DQSPADCTRL4 0x320
> > > > +#define EMC_DLL_XFORM_DQS0 0x328
> > > > +#define EMC_DLL_XFORM_DQS1 0x32c
> > > > +#define EMC_DLL_XFORM_DQS2 0x330
> > > > +#define EMC_DLL_XFORM_DQS3 0x334
> > > > +#define EMC_DLL_XFORM_DQS4 0x338
> > > > +#define EMC_DLL_XFORM_DQS5 0x33c
> > > > +#define EMC_DLL_XFORM_DQS6 0x340
> > > > +#define EMC_DLL_XFORM_DQS7 0x344
> > > > +#define EMC_DLL_XFORM_QUSE0 0x348
> > > > +#define EMC_DLL_XFORM_QUSE1 0x34c
> > > > +#define EMC_DLL_XFORM_QUSE2 0x350
> > > > +#define EMC_DLL_XFORM_QUSE3 0x354
> > > > +#define EMC_DLL_XFORM_QUSE4 0x358
> > > > +#define EMC_DLL_XFORM_QUSE5 0x35c
> > > > +#define EMC_DLL_XFORM_QUSE6 0x360
> > > > +#define EMC_DLL_XFORM_QUSE7 0x364
> > > > +#define EMC_DLL_XFORM_DQ0 0x368
> > > > +#define EMC_DLL_XFORM_DQ1 0x36c
> > > > +#define EMC_DLL_XFORM_DQ2 0x370
> > > > +#define EMC_DLL_XFORM_DQ3 0x374
> > > > +#define EMC_DLI_TRIM_TXDQS0 0x3a8
> > > > +#define EMC_DLI_TRIM_TXDQS1 0x3ac
> > > > +#define EMC_DLI_TRIM_TXDQS2 0x3b0
> > > > +#define EMC_DLI_TRIM_TXDQS3 0x3b4
> > > > +#define EMC_DLI_TRIM_TXDQS4 0x3b8
> > > > +#define EMC_DLI_TRIM_TXDQS5 0x3bc
> > > > +#define EMC_DLI_TRIM_TXDQS6 0x3c0
> > > > +#define EMC_DLI_TRIM_TXDQS7 0x3c4
> > > > +#define EMC_STALL_THEN_EXE_AFTER_CLKCHANGE 0x3cc
> > > > +#define EMC_SEL_DPD_CTRL 0x3d8
> > > > +#define EMC_SEL_DPD_CTRL_DATA_SEL_DPD BIT(8)
> > > > +#define EMC_SEL_DPD_CTRL_ODT_SEL_DPD BIT(5)
> > > > +#define EMC_SEL_DPD_CTRL_RESET_SEL_DPD BIT(4)
> > > > +#define EMC_SEL_DPD_CTRL_CA_SEL_DPD BIT(3)
> > > > +#define EMC_SEL_DPD_CTRL_CLK_SEL_DPD BIT(2)
> > > > +#define EMC_SEL_DPD_CTRL_DDR3_MASK \
> > > > + ((0xf << 2) | BIT(8))
> > > > +#define EMC_SEL_DPD_CTRL_MASK \
> > > > + ((0x3 << 2) | BIT(5) | BIT(8))
> > > > +#define EMC_PRE_REFRESH_REQ_CNT 0x3dc
> > > > +#define EMC_DYN_SELF_REF_CONTROL 0x3e0
> > > > +#define EMC_TXSRDLL 0x3e4
> > > > +#define EMC_CCFIFO_ADDR 0x3e8
> > > > +#define EMC_CCFIFO_DATA 0x3ec
> > > > +#define EMC_CCFIFO_STATUS 0x3f0
> > > > +#define EMC_CDB_CNTL_1 0x3f4
> > > > +#define EMC_CDB_CNTL_2 0x3f8
> > > > +#define EMC_XM2CLKPADCTRL2 0x3fc
> > > > +#define EMC_AUTO_CAL_CONFIG2 0x458
> > > > +#define EMC_AUTO_CAL_CONFIG3 0x45c
> > > > +#define EMC_IBDLY 0x468
> > > > +#define EMC_DLL_XFORM_ADDR0 0x46c
> > > > +#define EMC_DLL_XFORM_ADDR1 0x470
> > > > +#define EMC_DLL_XFORM_ADDR2 0x474
> > > > +#define EMC_DSR_VTTGEN_DRV 0x47c
> > > > +#define EMC_TXDSRVTTGEN 0x480
> > > > +#define EMC_XM2CMDPADCTRL4 0x484
> > > > +
> > > > +#define DRAM_DEV_SEL_ALL 0
> > > > +#define DRAM_DEV_SEL_0 BIT(31)
> > > > +#define DRAM_DEV_SEL_1 BIT(30)
> > > > +
> > > > +#define EMC_CFG_POWER_FEATURES_MASK \
> > > > + (EMC_CFG_DYN_SREF | EMC_CFG_DRAM_ACPD | EMC_CFG_DRAM_CLKSTOP_SR | \
> > > > + EMC_CFG_DRAM_CLKSTOP_PD | EMC_CFG_DSR_VTTGEN_DRV_EN)
> > > > +#define EMC_REFCTRL_DEV_SEL(n) ((((n) > 1) ? 0 : 2) << EMC_REFCTRL_DEV_SEL_SHIFT)
> > > > +#define EMC_DRAM_DEV_SEL(n) (((n) > 1) ? DRAM_DEV_SEL_ALL : DRAM_DEV_SEL_0)
> > > > +
> > > > +/* Maximum amount of time in us. to wait for changes to become effective */
> > > > +#define EMC_STATUS_UPDATE_TIMEOUT 1000
> > > > +
> > > > +enum emc_dram_type {
> > > > + DRAM_TYPE_DDR3,
> > > > + DRAM_TYPE_DDR1,
> > > > + DRAM_TYPE_LPDDR2,
> > > > + DRAM_TYPE_DDR2
> > > > +};
> > > > +
> > > > +enum emc_dll_change {
> > > > + DLL_CHANGE_NONE,
> > > > + DLL_CHANGE_ON,
> > > > + DLL_CHANGE_OFF
> > > > +};
> > > > +
> > > > +static const unsigned long emc_burst_regs[] = {
> > > > + EMC_RC,
> > > > + EMC_RFC,
> > > > + EMC_RAS,
> > > > + EMC_RP,
> > > > + EMC_R2W,
> > > > + EMC_W2R,
> > > > + EMC_R2P,
> > > > + EMC_W2P,
> > > > + EMC_RD_RCD,
> > > > + EMC_WR_RCD,
> > > > + EMC_RRD,
> > > > + EMC_REXT,
> > > > + EMC_WEXT,
> > > > + EMC_WDV,
> > > > + EMC_WDV_MASK,
> > > > + EMC_QUSE,
> > > > + EMC_IBDLY,
> > > > + EMC_EINPUT,
> > > > + EMC_EINPUT_DURATION,
> > > > + EMC_PUTERM_EXTRA,
> > > > + EMC_CDB_CNTL_1,
> > > > + EMC_CDB_CNTL_2,
> > > > + EMC_QRST,
> > > > + EMC_QSAFE,
> > > > + EMC_RDV,
> > > > + EMC_RDV_MASK,
> > > > + EMC_REFRESH,
> > > > + EMC_BURST_REFRESH_NUM,
> > > > + EMC_PRE_REFRESH_REQ_CNT,
> > > > + EMC_PDEX2WR,
> > > > + EMC_PDEX2RD,
> > > > + EMC_PCHG2PDEN,
> > > > + EMC_ACT2PDEN,
> > > > + EMC_AR2PDEN,
> > > > + EMC_RW2PDEN,
> > > > + EMC_TXSR,
> > > > + EMC_TXSRDLL,
> > > > + EMC_TCKE,
> > > > + EMC_TCKESR,
> > > > + EMC_TPD,
> > > > + EMC_TFAW,
> > > > + EMC_TRPAB,
> > > > + EMC_TCLKSTABLE,
> > > > + EMC_TCLKSTOP,
> > > > + EMC_TREFBW,
> > > > + EMC_QUSE_EXTRA,
> > > > + EMC_FBIO_CFG6,
> > > > + EMC_ODT_WRITE,
> > > > + EMC_ODT_READ,
> > > > + EMC_FBIO_CFG5,
> > > > + EMC_CFG_DIG_DLL,
> > > > + EMC_CFG_DIG_DLL_PERIOD,
> > > > + EMC_DLL_XFORM_DQS0,
> > > > + EMC_DLL_XFORM_DQS1,
> > > > + EMC_DLL_XFORM_DQS2,
> > > > + EMC_DLL_XFORM_DQS3,
> > > > + EMC_DLL_XFORM_DQS4,
> > > > + EMC_DLL_XFORM_DQS5,
> > > > + EMC_DLL_XFORM_DQS6,
> > > > + EMC_DLL_XFORM_DQS7,
> > > > + EMC_DLL_XFORM_QUSE0,
> > > > + EMC_DLL_XFORM_QUSE1,
> > > > + EMC_DLL_XFORM_QUSE2,
> > > > + EMC_DLL_XFORM_QUSE3,
> > > > + EMC_DLL_XFORM_QUSE4,
> > > > + EMC_DLL_XFORM_QUSE5,
> > > > + EMC_DLL_XFORM_QUSE6,
> > > > + EMC_DLL_XFORM_QUSE7,
> > > > + EMC_DLI_TRIM_TXDQS0,
> > > > + EMC_DLI_TRIM_TXDQS1,
> > > > + EMC_DLI_TRIM_TXDQS2,
> > > > + EMC_DLI_TRIM_TXDQS3,
> > > > + EMC_DLI_TRIM_TXDQS4,
> > > > + EMC_DLI_TRIM_TXDQS5,
> > > > + EMC_DLI_TRIM_TXDQS6,
> > > > + EMC_DLI_TRIM_TXDQS7,
> > > > + EMC_DLL_XFORM_DQ0,
> > > > + EMC_DLL_XFORM_DQ1,
> > > > + EMC_DLL_XFORM_DQ2,
> > > > + EMC_DLL_XFORM_DQ3,
> > > > + EMC_XM2CMDPADCTRL,
> > > > + EMC_XM2CMDPADCTRL4,
> > > > + EMC_XM2DQPADCTRL2,
> > > > + EMC_XM2CLKPADCTRL,
> > > > + EMC_XM2COMPPADCTRL,
> > > > + EMC_XM2VTTGENPADCTRL,
> > > > + EMC_XM2VTTGENPADCTRL2,
> > > > + EMC_XM2DQSPADCTRL3,
> > > > + EMC_XM2DQSPADCTRL4,
> > > > + EMC_DSR_VTTGEN_DRV,
> > > > + EMC_TXDSRVTTGEN,
> > > > + EMC_FBIO_SPARE,
> > > > + EMC_ZCAL_WAIT_CNT,
> > > > + EMC_MRS_WAIT_CNT2,
> > > > + EMC_CTT,
> > > > + EMC_CTT_DURATION,
> > > > + EMC_DYN_SELF_REF_CONTROL,
> > > > +};
> > >
> > > How was this list determined? It doesn't seem to match the trees I can find, or the list in the TRM (which is also different from the downstream source code).
> > >
> >
> > Hm, IIRC, I used Tegra114 3.4 kernel sources, specifically
> > tegratab/macallan memory board files as my base and then tried to
> > align them closer to list used by Tegra124 (not identical obviously
> > since lists have different lengths). This list contains burst and
> > trimmer registers with some of them excluded as a dedicated entries in
> > emc_timing structure below (yet again - similar to Tegra124). If you
> > have any ideas how to group registers better I would be happy to hear.
>
> That sounds fine by me if we're programming all registers the downstream sequence is programming (except for ones not related to the DRAM configuration like the latency allowance stuff that's better done otherwise). I was just wondering.
>
> >
> > > > +
> > > > +struct emc_timing {
> > > > + unsigned long rate;
> > > > +
> > > > + u32 emc_burst_data[ARRAY_SIZE(emc_burst_regs)];
> > > > +
> > > > + u32 emc_auto_cal_config;
> > > > + u32 emc_auto_cal_config2;
> > > > + u32 emc_auto_cal_config3;
> > > > + u32 emc_auto_cal_interval;
> > > > + u32 emc_cfg;
> > > > + u32 emc_ctt_term_ctrl;
> > > > + u32 emc_mode_1;
> > > > + u32 emc_mode_2;
> > > > + u32 emc_mode_4;
> > > > + u32 emc_mode_reset;
> > > > + u32 emc_mrs_wait_cnt;
> > > > + u32 emc_sel_dpd_ctrl;
> > > > + u32 emc_xm2dqspadctrl2;
> > > > + u32 emc_zcal_cnt_long;
> > > > + u32 emc_zcal_interval;
> > > > +};
> > > > +
> > > > +enum emc_rate_request_type {
> > > > + EMC_RATE_DEBUG,
> > > > + EMC_RATE_ICC,
> > > > + EMC_RATE_TYPE_MAX,
> > > > +};
> > > > +
> > > > +struct emc_rate_request {
> > > > + unsigned long min_rate;
> > > > + unsigned long max_rate;
> > > > +};
> > > > +
> > > > +struct tegra_emc {
> > > > + struct device *dev;
> > > > +
> > > > + struct tegra_mc *mc;
> > > > +
> > > > + void __iomem *regs;
> > > > +
> > > > + unsigned int irq;
> > > > +
> > > > + struct clk *clk;
> > >
> > > Nit: I don't think all the empty lines are needed.
> > >
> > > > +
> > > > + enum emc_dram_type dram_type;
> > > > + unsigned int dram_num;
> > > > +
> > > > + struct emc_timing last_timing;
> > > > + struct emc_timing *timings;
> > > > + unsigned int num_timings;
> > > > +
> > > > + struct {
> > > > + struct dentry *root;
> > > > + unsigned long min_rate;
> > > > + unsigned long max_rate;
> > > > + } debugfs;
> > > > +
> > > > + struct icc_provider provider;
> > > > +
> > > > + /*
> > > > + * There are multiple sources in the EMC driver which could request
> > > > + * a min/max clock rate, these rates are contained in this array.
> > > > + */
> > > > + struct emc_rate_request requested_rate[EMC_RATE_TYPE_MAX];
> > > > +
> > > > + /* protect shared rate-change code path */
> > > > + struct mutex rate_lock;
> > > > +};
> > > > +
> > > > +static irqreturn_t tegra_emc_isr(int irq, void *data)
> > > > +{
> > > > + struct tegra_emc *emc = data;
> > > > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > > > + u32 status;
> > > > +
> > > > + status = readl_relaxed(emc->regs + EMC_INTSTATUS) & intmask;
> > > > + if (!status)
> > > > + return IRQ_NONE;
> > > > +
> > > > + /* notify about HW problem */
> > > > + if (status & EMC_REFRESH_OVERFLOW_INT)
> > > > + dev_err_ratelimited(emc->dev,
> > > > + "refresh request overflow timeout\n");
> > > > +
> > > > + /* clear interrupts */
> > > > + writel_relaxed(status, emc->regs + EMC_INTSTATUS);
> > > > +
> > > > + return IRQ_HANDLED;
> > > > +}
> > > > +
> > > > +/* Timing change sequence functions */
> > > > +
> > > > +static void emc_ccfifo_writel(struct tegra_emc *emc, u32 value,
> > > > + unsigned long offset)
> > > > +{
> > > > + writel(value, emc->regs + EMC_CCFIFO_DATA);
> > > > + writel(offset, emc->regs + EMC_CCFIFO_ADDR);
> > > > +}
> > > > +
> > > > +static void emc_seq_update_timing(struct tegra_emc *emc)
> > > > +{
> > > > + unsigned int i;
> > > > + u32 value;
> > > > +
> > > > + writel(1, emc->regs + EMC_TIMING_CONTROL);
> > > > +
> > > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > > + value = readl(emc->regs + EMC_STATUS);
> > > > + if ((value & EMC_STATUS_TIMING_UPDATE_STALLED) == 0)
> > > > + return;
> > > > + udelay(1);
> > > > + }
> > >
> > > This can be replaced with readl_poll_timeout_atomic
> > >
> > > > +
> > > > + dev_err(emc->dev, "timing update timed out\n");
> > > > +}
> > > > +
> > > > +static void emc_seq_disable_auto_cal(struct tegra_emc *emc)
> > > > +{
> > > > + unsigned int i;
> > > > + u32 value;
> > > > +
> > > > + writel(0, emc->regs + EMC_AUTO_CAL_INTERVAL);
> > > > +
> > > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > > + value = readl(emc->regs + EMC_AUTO_CAL_STATUS);
> > > > + if ((value & EMC_AUTO_CAL_STATUS_ACTIVE) == 0)
> > > > + return;
> > > > + udelay(1);
> > > > + }
> > >
> > > Likewise
> > >
> > > > +
> > > > + dev_err(emc->dev, "auto cal disable timed out\n");
> > > > +}
> > > > +
> > > > +static void emc_seq_wait_clkchange(struct tegra_emc *emc)
> > > > +{
> > > > + unsigned int i;
> > > > + u32 value;
> > > > +
> > > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > > + value = readl(emc->regs + EMC_INTSTATUS);
> > > > + if (value & EMC_INTSTATUS_CLKCHANGE_COMPLETE)
> > > > + return;
> > > > + udelay(1);
> > > > + }
> > >
> > > Likewise
> > >
> > > > +
> > > > + dev_err(emc->dev, "clock change timed out\n");
> > > > +}
> > > > +
> > > > +static struct emc_timing *tegra_emc_find_timing(struct tegra_emc *emc,
> > > > + unsigned long rate)
> > > > +{
> > > > + struct emc_timing *timing = NULL;
> > > > + unsigned int i;
> > > > +
> > > > + for (i = 0; i < emc->num_timings; i++) {
> > > > + if (emc->timings[i].rate == rate) {
> > > > + timing = &emc->timings[i];
> > > > + break;
> > > > + }
> > > > + }
> > > > +
> > > > + if (!timing) {
> > > > + dev_err(emc->dev, "no timing for rate %lu\n", rate);
> > > > + return NULL;
> > > > + }
> > > > +
> > > > + return timing;
> > > > +}
> > > > +
> > > > +static int tegra_emc_prepare_timing_change(struct tegra_emc *emc,
> > > > + unsigned long rate)
> > > > +{
> > > > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > > > + struct emc_timing *last = &emc->last_timing;
> > > > + enum emc_dll_change dll_change;
> > > > + unsigned int pre_wait = 0;
> > > > + u32 val, mask;
> > > > + bool update = false;
> > > > + unsigned int i;
> > > > +
> > > > + if (!timing)
> > > > + return -ENOENT;
> > > > +
> > > > + if ((last->emc_mode_1 & 0x1) == (timing->emc_mode_1 & 0x1))
> > > > + dll_change = DLL_CHANGE_NONE;
> > > > + else if (timing->emc_mode_1 & 0x1)
> > >
> > > This looks incorrect. DLL is enabled if bit 0 is off. Now, I'm guessing that comes from the other drivers, originally from tegra124-emc.c, which was written by.. me :) I can send a patch for the other chips.
> > >
> >
> > Noted
> >
> > > > + dll_change = DLL_CHANGE_ON;
> > > > + else
> > > > + dll_change = DLL_CHANGE_OFF;
> > > > +
> > > > + /* Clear CLKCHANGE_COMPLETE interrupts */
> > > > + writel(EMC_INTSTATUS_CLKCHANGE_COMPLETE, emc->regs + EMC_INTSTATUS);
> > > > +
> > > > + /* Disable dynamic self-refresh */
> > > > + val = readl(emc->regs + EMC_CFG);
> > > > + if (val & EMC_CFG_PWR_MASK) {
> > >
> > > This doesn't strictly match downstream Tegra114 EMC code or the TRM -- it is the later sequence version for Tegra124. However, my hunch is that the Tegra124 sequence would be compatible and probably more reliable as it would have received more testing. So it's probably not a bad idea to use it.
> > >
> > > There are other places in the sequence that have changed between versions, but I don't think we need to change them. If issues are seen in the future, we can check again.
> > >
> >
> > It does not strictly match, yes, but overall logic is preserved. I
> > have tested these on my Tegra114 devices and I did not observe any
> > notable issues.
> >
>
> Sounds good.
>
> > > > + val &= ~EMC_CFG_POWER_FEATURES_MASK;
> > > > + writel(val, emc->regs + EMC_CFG);
> > > > +
> > > > + pre_wait = 5;
> > > > + }
> > > > +
> > > > + /* Disable SEL_DPD_CTRL for clock change */
> > > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > > + mask = EMC_SEL_DPD_CTRL_DDR3_MASK;
> > > > + else
> > > > + mask = EMC_SEL_DPD_CTRL_MASK;
> > > > +
> > > > + val = readl(emc->regs + EMC_SEL_DPD_CTRL);
> > > > + if (val & mask) {
> > > > + val &= ~mask;
> > > > + writel(val, emc->regs + EMC_SEL_DPD_CTRL);
> > > > + }
> > > > +
> > > > + /* Prepare DQ/DQS for clock change */
> > > > + val = readl(emc->regs + EMC_XM2DQSPADCTRL2);
> > > > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_VREF_ENABLE &&
> > > > + !(val & EMC_XM2DQSPADCTRL2_VREF_ENABLE)) {
> > > > + val |= EMC_XM2DQSPADCTRL2_VREF_ENABLE;
> > > > + update = true;
> > > > + }
> > > > +
> > > > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE &&
> > > > + !(val & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE)) {
> > > > + val |= EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE;
> > > > + update = true;
> > > > + }
> > > > +
> > > > + if (update) {
> > > > + writel(val, emc->regs + EMC_XM2DQSPADCTRL2);
> > > > + if (pre_wait < 30)
> > > > + pre_wait = 30;
> > > > + }
> > > > +
> > > > + /* Wait to settle */
> > > > + if (pre_wait) {
> > > > + emc_seq_update_timing(emc);
> > > > + udelay(pre_wait);
> > > > + }
> > > > +
> > > > + /* Program CTT_TERM control */
> > > > + if (last->emc_ctt_term_ctrl != timing->emc_ctt_term_ctrl) {
> > > > + emc_seq_disable_auto_cal(emc);
> > > > + writel(timing->emc_ctt_term_ctrl,
> > > > + emc->regs + EMC_CTT_TERM_CTRL);
> > > > + emc_seq_update_timing(emc);
> > > > + }
> > > > +
> > > > + /* Program burst shadow registers */
> > > > + for (i = 0; i < ARRAY_SIZE(timing->emc_burst_data); ++i)
> > > > + writel(timing->emc_burst_data[i],
> > > > + emc->regs + emc_burst_regs[i]);
> > > > +
> > > > + writel(timing->emc_xm2dqspadctrl2, emc->regs + EMC_XM2DQSPADCTRL2);
> > > > + writel(timing->emc_zcal_interval, emc->regs + EMC_ZCAL_INTERVAL);
> > > > +
> > > > + tegra_mc_write_emem_configuration(emc->mc, timing->rate);
> > > > +
> > > > + val = timing->emc_cfg & ~EMC_CFG_POWER_FEATURES_MASK;
> > > > + emc_ccfifo_writel(emc, val, EMC_CFG);
> > > > +
> > > > + /* Program AUTO_CAL_CONFIG */
> > > > + if (timing->emc_auto_cal_config2 != last->emc_auto_cal_config2)
> > > > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config2,
> > > > + EMC_AUTO_CAL_CONFIG2);
> > > > +
> > > > + if (timing->emc_auto_cal_config3 != last->emc_auto_cal_config3)
> > > > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config3,
> > > > + EMC_AUTO_CAL_CONFIG3);
> > > > +
> > > > + if (timing->emc_auto_cal_config != last->emc_auto_cal_config) {
> > > > + val = timing->emc_auto_cal_config;
> > > > + val &= EMC_AUTO_CAL_CONFIG_AUTO_CAL_START;
> > > > + emc_ccfifo_writel(emc, val, EMC_AUTO_CAL_CONFIG);
> > > > + }
> > > > +
> > > > + /* DDR3: predict MRS long wait count */
> > > > + if (emc->dram_type == DRAM_TYPE_DDR3 &&
> > > > + dll_change == DLL_CHANGE_ON) {
> > > > + u32 cnt = 512;
> > > > +
> > > > + if (timing->emc_zcal_interval != 0 &&
> > > > + last->emc_zcal_interval == 0)
> > > > + cnt -= emc->dram_num * 256;
> > > > +
> > > > + val = (timing->emc_mrs_wait_cnt
> > > > + & EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK)
> > > > + >> EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT;
> > > > + if (cnt < val)
> > > > + cnt = val;
> > > > +
> > > > + val = timing->emc_mrs_wait_cnt
> > > > + & ~EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > > > + val |= (cnt << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > > > + & EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > > > +
> > > > + writel(val, emc->regs + EMC_MRS_WAIT_CNT);
> > > > + }
> > > > +
> > > > + /* DDR3: Turn off DLL and enter self-refresh */
> > > > + if (emc->dram_type == DRAM_TYPE_DDR3 && dll_change == DLL_CHANGE_OFF)
> > > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > > > +
> > > > + /* Disable refresh controller */
> > > > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num),
> > > > + EMC_REFCTRL);
> > > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num) |
> > > > + EMC_SELF_REF_CMD_ENABLED,
> > > > + EMC_SELF_REF);
> > > > +
> > > > + /* Flow control marker */
> > > > + emc_ccfifo_writel(emc, 1, EMC_STALL_THEN_EXE_AFTER_CLKCHANGE);
> > > > +
> > > > + /* DDR3: Exit self-refresh */
> > > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num),
> > > > + EMC_SELF_REF);
> > > > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num) |
> > > > + EMC_REFCTRL_ENABLE,
> > > > + EMC_REFCTRL);
> > > > +
> > > > + /* Set DRAM mode registers */
> > > > + if (emc->dram_type == DRAM_TYPE_DDR3) {
> > > > + if (timing->emc_mode_1 != last->emc_mode_1)
> > > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > > > + if (timing->emc_mode_2 != last->emc_mode_2)
> > > > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_EMRS2);
> > > > +
> > > > + if (timing->emc_mode_reset != last->emc_mode_reset ||
> > > > + dll_change == DLL_CHANGE_ON) {
> > > > + val = timing->emc_mode_reset;
> > > > + if (dll_change == DLL_CHANGE_ON) {
> > > > + val |= EMC_MODE_SET_DLL_RESET;
> > > > + val |= EMC_MODE_SET_LONG_CNT;
> > > > + } else {
> > > > + val &= ~EMC_MODE_SET_DLL_RESET;
> > > > + }
> > > > + emc_ccfifo_writel(emc, val, EMC_MRS);
> > > > + }
> > > > + } else {
> > > > + if (timing->emc_mode_2 != last->emc_mode_2)
> > > > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_MRW2);
> > > > + if (timing->emc_mode_1 != last->emc_mode_1)
> > > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_MRW);
> > > > + if (timing->emc_mode_4 != last->emc_mode_4)
> > > > + emc_ccfifo_writel(emc, timing->emc_mode_4, EMC_MRW4);
> > > > + }
> > > > +
> > > > + /* Issue ZCAL command if turning ZCAL on */
> > > > + if (timing->emc_zcal_interval != 0 && last->emc_zcal_interval == 0) {
> > > > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV0, EMC_ZQ_CAL);
> > > > + if (emc->dram_num > 1)
> > > > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV1,
> > > > + EMC_ZQ_CAL);
> > > > + }
> > > > +
> > > > + /* Write to RO register to remove stall after change */
> > > > + emc_ccfifo_writel(emc, 0, EMC_CCFIFO_STATUS);
> > > > +
> > > > + /* Disable AUTO_CAL for clock change */
> > > > + emc_seq_disable_auto_cal(emc);
> > > > +
> > > > + /* Read register to wait until programming has settled */
> > > > + mc_readl(emc->mc, MC_EMEM_ADR_CFG);
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static void tegra_emc_complete_timing_change(struct tegra_emc *emc,
> > > > + unsigned long rate)
> > > > +{
> > > > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > > > + struct emc_timing *last = &emc->last_timing;
> > > > +
> > > > + if (!timing)
> > > > + return;
> > > > +
> > > > + /* Wait until the state machine has settled */
> > > > + emc_seq_wait_clkchange(emc);
> > > > +
> > > > + /* Restore AUTO_CAL */
> > > > + if (timing->emc_ctt_term_ctrl != last->emc_ctt_term_ctrl)
> > > > + writel(timing->emc_auto_cal_interval,
> > > > + emc->regs + EMC_AUTO_CAL_INTERVAL);
> > > > +
> > > > + /* Restore dynamic self-refresh */
> > > > + if (timing->emc_cfg & EMC_CFG_PWR_MASK)
> > > > + writel(timing->emc_cfg, emc->regs + EMC_CFG);
> > > > +
> > > > + /* Set ZCAL wait count */
> > > > + writel(timing->emc_zcal_cnt_long, emc->regs + EMC_ZCAL_WAIT_CNT);
> > > > +
> > > > + /* Wait for timing to settle */
> > > > + udelay(2);
> > > > +
> > > > + /* Reprogram SEL_DPD_CTRL */
> > > > + writel(timing->emc_sel_dpd_ctrl, emc->regs + EMC_SEL_DPD_CTRL);
> > > > + emc_seq_update_timing(emc);
> > > > +
> > > > + emc->last_timing = *timing;
> > > > +}
> > > > +
> > > > +/* Initialization and deinitialization */
> > > > +
> > > > +static void emc_read_current_timing(struct tegra_emc *emc,
> > > > + struct emc_timing *timing)
> > > > +{
> > > > + unsigned int i;
> > > > +
> > > > + for (i = 0; i < ARRAY_SIZE(emc_burst_regs); ++i)
> > > > + timing->emc_burst_data[i] =
> > > > + readl(emc->regs + emc_burst_regs[i]);
> > > > +
> > > > + timing->emc_cfg = readl(emc->regs + EMC_CFG);
> > > > +
> > > > + timing->emc_auto_cal_interval = 0;
> > > > + timing->emc_zcal_cnt_long = 0;
> > > > + timing->emc_mode_1 = 0;
> > > > + timing->emc_mode_2 = 0;
> > > > + timing->emc_mode_4 = 0;
> > > > + timing->emc_mode_reset = 0;
> > >
> > > Hmm. I wonder why these aren't being read. It seems like it would be a good idea, since the some of these are checked for last_timing in the sequence.
> > >
> >
> > This stems from Tegra124 emc driver, so maybe it has some sense. In
> > any case, adding readl is not an issue whatsoever.
> >
>
> Looks like they are set to zero in the downstream code as well, which still doesn't make much sense, but it does seem to work. So leaving at zero should be fine.
>
> > > > +}
> > > > +
> > > > +static int emc_init(struct tegra_emc *emc)
> > > > +{
> > > > + u32 emc_cfg, emc_dbg;
> > > > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > > > + const char *dram_type_str;
> > > > +
> > > > + emc->dram_type = readl(emc->regs + EMC_FBIO_CFG5);
> > > > +
> > > > + emc->dram_type &= EMC_FBIO_CFG5_DRAM_TYPE_MASK;
> > > > + emc->dram_type >>= EMC_FBIO_CFG5_DRAM_TYPE_SHIFT;
> > > > +
> > > > + emc->dram_num = tegra_mc_get_emem_device_count(emc->mc);
> > > > +
> > > > + emc_cfg = readl_relaxed(emc->regs + EMC_CFG_2);
> > > > +
> > > > + /* enable EMC and CAR to handshake on PLL divider/source changes */
> > > > + emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> > > > +
> > > > + /* configure clock change mode accordingly to DRAM type */
> > > > + switch (emc->dram_type) {
> > > > + case DRAM_TYPE_LPDDR2:
> > > > + emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> > > > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > > > + break;
> > > > +
> > > > + default:
> > > > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > > > + emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> > > > + break;
> > > > + }
> > >
> > > This doesn't match the source trees I have (either Tegra114 or Tegra124). Those don't touch EMC_CLKCHANGE_SR_ENABLE. TRM seems to be contradictory about this. It says to leave it at reset value of DISABLED, but then later says that the reset value is ENABLED. I would err on the side of the code. In any case, I think this would be cleaner to write as an if statement
> > >
> > > emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> > >
> > > if (emc->dram_type == DRAM_TYPE_LPDDR2)
> > > emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> > > else
> > > emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> > >
> >
> > Noted. Yes, TRM in Software programming sequence on the Tegra 4 clock
> > change sequence states Keep these register fields in reset values:
> > CLKCHANGE_REQ_ENABLE = ENABLED
> > CLKCHANGE_SR_ENABLE = DISABLED
> >
> > Hence I have added emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE
>
> I think it might be worth checking what the reset value actually is (by reading the register after boot). The register's section in the TRM has a different name for the field (REF_AFTER_SREF) and it says the reset value should be ENABLED, not DISABLED. The EMC_CFG_2 register is part of burst regs for Tegra124, so I checked some EMC tables and it seems the bit is always set for those tables; and for Tegra114 the code never changes the bit from reset values. So I think the programming sequence section could be wrong (perhaps the register was changed after it was written but it was never updated).
>
I have read 0x7001b000 + 0x2b8 which is EMCB + EMC_CFG_2
Both U-Boot coldboot and chainload result in this:
(bootloader) 7001b2b8: 000008c5
CLKCHANGE_REQ_ENABLE - ENABLED (Bit 0)
CLKCHANGE_PD_ENABLE - DISABLED (Bit 1)
REF_AFTER_SREF or CLKCHANGE_SR_ENABLE - ENABLED (Bit 2)
TRM description of EMC_CFG_2_0 register seems to match behavior after boot.
So what should I do with CLKCHANGE_SR_ENABLE?
> >
> > > > +
> > > > + writel_relaxed(emc_cfg, emc->regs + EMC_CFG_2);
> > > > +
> > > > + /* initialize interrupt */
> > > > + writel_relaxed(intmask, emc->regs + EMC_INTMASK);
> > > > + writel_relaxed(0xffffffff, emc->regs + EMC_INTSTATUS);
> > > > +
> > > > + /* ensure that unwanted debug features are disabled */
> > > > + emc_dbg = readl_relaxed(emc->regs + EMC_DBG);
> > > > + emc_dbg |= EMC_DBG_CFG_PRIORITY;
> > > > + emc_dbg &= ~EMC_DBG_READ_MUX_ASSEMBLY;
> > > > + emc_dbg &= ~EMC_DBG_WRITE_MUX_ACTIVE;
> > > > + emc_dbg &= ~EMC_DBG_FORCE_UPDATE;
> > > > + writel_relaxed(emc_dbg, emc->regs + EMC_DBG);
> > > > +
> > > > + switch (emc->dram_type) {
> > > > + case DRAM_TYPE_DDR1:
> > > > + dram_type_str = "DDR1";
> > > > + break;
> > > > + case DRAM_TYPE_LPDDR2:
> > > > + dram_type_str = "LPDDR2";
> > > > + break;
> > > > + case DRAM_TYPE_DDR2:
> > > > + dram_type_str = "DDR2";
> > > > + break;
> > > > + case DRAM_TYPE_DDR3:
> > > > + dram_type_str = "DDR3";
> > > > + break;
> > > > + }
> > > > +
> > > > + dev_info_once(emc->dev, "%u %s %s attached\n", emc->dram_num,
> > > > + dram_type_str, emc->dram_num == 2 ? "devices" : "device");
> > > > +
> > > > + emc_read_current_timing(emc, &emc->last_timing);
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static int load_one_timing_from_dt(struct tegra_emc *emc,
> > > > + struct emc_timing *timing,
> > > > + struct device_node *node)
> > > > +{
> > > > + u32 value;
> > > > + int err;
> > > > +
> > > > + err = of_property_read_u32(node, "clock-frequency", &value);
> > > > + if (err) {
> > > > + dev_err(emc->dev, "timing %pOFn: failed to read rate: %d\n",
> > > > + node, err);
> > > > + return err;
> > > > + }
> > > > +
> > > > + timing->rate = value;
> > > > +
> > > > + err = of_property_read_u32_array(node, "nvidia,emc-configuration",
> > > > + timing->emc_burst_data,
> > > > + ARRAY_SIZE(timing->emc_burst_data));
> > > > + if (err) {
> > > > + dev_err(emc->dev,
> > > > + "timing %pOFn: failed to read emc burst data: %d\n",
> > > > + node, err);
> > > > + return err;
> > > > + }
> > > > +
> > > > +#define EMC_READ_PROP(prop, dtprop) { \
> > > > + err = of_property_read_u32(node, dtprop, &timing->prop); \
> > > > + if (err) { \
> > > > + dev_err(emc->dev, "timing %pOFn: failed to read " #prop ": %d\n", \
> > > > + node, err); \
> > > > + return err; \
> > > > + } \
> > > > +}
> > > > +
> > > > + EMC_READ_PROP(emc_auto_cal_config, "nvidia,emc-auto-cal-config")
> > > > + EMC_READ_PROP(emc_auto_cal_config2, "nvidia,emc-auto-cal-config2")
> > > > + EMC_READ_PROP(emc_auto_cal_config3, "nvidia,emc-auto-cal-config3")
> > > > + EMC_READ_PROP(emc_auto_cal_interval, "nvidia,emc-auto-cal-interval")
> > > > + EMC_READ_PROP(emc_cfg, "nvidia,emc-cfg")
> > > > + EMC_READ_PROP(emc_ctt_term_ctrl, "nvidia,emc-ctt-term-ctrl")
> > > > + EMC_READ_PROP(emc_mode_1, "nvidia,emc-mode-1")
> > > > + EMC_READ_PROP(emc_mode_2, "nvidia,emc-mode-2")
> > > > + EMC_READ_PROP(emc_mode_4, "nvidia,emc-mode-4")
> > > > + EMC_READ_PROP(emc_mode_reset, "nvidia,emc-mode-reset")
> > > > + EMC_READ_PROP(emc_mrs_wait_cnt, "nvidia,emc-mrs-wait-cnt")
> > > > + EMC_READ_PROP(emc_sel_dpd_ctrl, "nvidia,emc-sel-dpd-ctrl")
> > > > + EMC_READ_PROP(emc_xm2dqspadctrl2, "nvidia,emc-xm2dqspadctrl2")
> > > > + EMC_READ_PROP(emc_zcal_cnt_long, "nvidia,emc-zcal-cnt-long")
> > > > + EMC_READ_PROP(emc_zcal_interval, "nvidia,emc-zcal-interval")
> > > > +
> > > > +#undef EMC_READ_PROP
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static int cmp_timings(const void *_a, const void *_b)
> > > > +{
> > > > + const struct emc_timing *a = _a;
> > > > + const struct emc_timing *b = _b;
> > > > +
> > > > + if (a->rate < b->rate)
> > > > + return -1;
> > > > + else if (a->rate == b->rate)
> > > > + return 0;
> > > > + else
> > > > + return 1;
> > > > +}
> > > > +
> > > > +static int tegra_emc_load_timings_from_dt(struct tegra_emc *emc,
> > > > + struct device_node *node)
> > > > +{
> > > > + int child_count = of_get_child_count(node);
> > > > + struct device_node *child;
> > > > + struct emc_timing *timing;
> > > > + unsigned int i = 0;
> > > > + int err;
> > > > +
> > > > + emc->timings = devm_kcalloc(emc->dev, child_count, sizeof(*timing),
> > > > + GFP_KERNEL);
> > > > + if (!emc->timings)
> > > > + return -ENOMEM;
> > > > +
> > > > + emc->num_timings = child_count;
> > > > +
> > > > + for_each_child_of_node(node, child) {
> > > > + timing = &emc->timings[i++];
> > > > +
> > > > + err = load_one_timing_from_dt(emc, timing, child);
> > > > + if (err) {
> > > > + of_node_put(child);
> > > > + return err;
> > > > + }
> > > > + }
> > > > +
> > > > + sort(emc->timings, emc->num_timings, sizeof(*timing), cmp_timings,
> > > > + NULL);
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static struct device_node *
> > > > +tegra_emc_find_node_by_ram_code(struct device_node *node, u32 ram_code)
> > > > +{
> > > > + struct device_node *np;
> > > > + int err;
> > > > +
> > > > + for_each_child_of_node(node, np) {
> > > > + u32 value;
> > > > +
> > > > + err = of_property_read_u32(np, "nvidia,ram-code", &value);
> > > > + if (err || value != ram_code)
> > > > + continue;
> > > > +
> > > > + return np;
> > > > + }
> > > > +
> > > > + return NULL;
> > > > +}
> > > > +
> > > > +static void tegra_emc_rate_requests_init(struct tegra_emc *emc)
> > > > +{
> > > > + unsigned int i;
> > > > +
> > > > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++) {
> > > > + emc->requested_rate[i].min_rate = 0;
> > > > + emc->requested_rate[i].max_rate = ULONG_MAX;
> > > > + }
> > > > +}
> > > > +
> > > > +static int emc_request_rate(struct tegra_emc *emc,
> > > > + unsigned long new_min_rate,
> > > > + unsigned long new_max_rate,
> > > > + enum emc_rate_request_type type)
> > > > +{
> > > > + struct emc_rate_request *req = emc->requested_rate;
> > > > + unsigned long min_rate = 0, max_rate = ULONG_MAX;
> > > > + unsigned int i;
> > > > + int err;
> > > > +
> > > > + /* select minimum and maximum rates among the requested rates */
> > > > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++, req++) {
> > > > + if (i == type) {
> > > > + min_rate = max(new_min_rate, min_rate);
> > > > + max_rate = min(new_max_rate, max_rate);
> > > > + } else {
> > > > + min_rate = max(req->min_rate, min_rate);
> > > > + max_rate = min(req->max_rate, max_rate);
> > > > + }
> > > > + }
> > > > +
> > > > + if (min_rate > max_rate) {
> > > > + dev_err_ratelimited(emc->dev, "%s: type %u: out of range: %lu %lu\n",
> > > > + __func__, type, min_rate, max_rate);
> > > > + return -ERANGE;
> > > > + }
> > > > +
> > > > + /*
> > > > + * EMC rate-changes should go via OPP API because it manages voltage
> > > > + * changes.
> > > > + */
> > > > + err = dev_pm_opp_set_rate(emc->dev, min_rate);
> > > > + if (err)
> > > > + return err;
> > > > +
> > > > + emc->requested_rate[type].min_rate = new_min_rate;
> > > > + emc->requested_rate[type].max_rate = new_max_rate;
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static int emc_set_min_rate(struct tegra_emc *emc, unsigned long rate,
> > > > + enum emc_rate_request_type type)
> > > > +{
> > > > + struct emc_rate_request *req = &emc->requested_rate[type];
> > > > + int ret;
> > > > +
> > > > + mutex_lock(&emc->rate_lock);
> > > > + ret = emc_request_rate(emc, rate, req->max_rate, type);
> > > > + mutex_unlock(&emc->rate_lock);
> > > > +
> > > > + return ret;
> > > > +}
> > > > +
> > > > +static int emc_set_max_rate(struct tegra_emc *emc, unsigned long rate,
> > > > + enum emc_rate_request_type type)
> > > > +{
> > > > + struct emc_rate_request *req = &emc->requested_rate[type];
> > > > + int ret;
> > > > +
> > > > + mutex_lock(&emc->rate_lock);
> > > > + ret = emc_request_rate(emc, req->min_rate, rate, type);
> > > > + mutex_unlock(&emc->rate_lock);
> > > > +
> > > > + return ret;
> > > > +}
> > > > +
> > > > +/*
> > > > + * debugfs interface
> > > > + *
> > > > + * The memory controller driver exposes some files in debugfs that can be used
> > > > + * to control the EMC frequency. The top-level directory can be found here:
> > > > + *
> > > > + * /sys/kernel/debug/emc
> > > > + *
> > > > + * It contains the following files:
> > > > + *
> > > > + * - available_rates: This file contains a list of valid, space-separated
> > > > + * EMC frequencies.
> > > > + *
> > > > + * - min_rate: Writing a value to this file sets the given frequency as the
> > > > + * floor of the permitted range. If this is higher than the currently
> > > > + * configured EMC frequency, this will cause the frequency to be
> > > > + * increased so that it stays within the valid range.
> > > > + *
> > > > + * - max_rate: Similarly to the min_rate file, writing a value to this file
> > > > + * sets the given frequency as the ceiling of the permitted range. If
> > > > + * the value is lower than the currently configured EMC frequency, this
> > > > + * will cause the frequency to be decreased so that it stays within the
> > > > + * valid range.
> > > > + */
> > > > +
> > > > +static bool tegra_emc_validate_rate(struct tegra_emc *emc, unsigned long rate)
> > > > +{
> > > > + unsigned int i;
> > > > +
> > > > + for (i = 0; i < emc->num_timings; i++)
> > > > + if (rate == emc->timings[i].rate)
> > > > + return true;
> > > > +
> > > > + return false;
> > > > +}
> > > > +
> > > > +static int tegra_emc_debug_available_rates_show(struct seq_file *s,
> > > > + void *data)
> > > > +{
> > > > + struct tegra_emc *emc = s->private;
> > > > + const char *prefix = "";
> > > > + unsigned int i;
> > > > +
> > > > + for (i = 0; i < emc->num_timings; i++) {
> > > > + seq_printf(s, "%s%lu", prefix, emc->timings[i].rate);
> > > > + prefix = " ";
> > > > + }
> > > > +
> > > > + seq_puts(s, "\n");
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +DEFINE_SHOW_ATTRIBUTE(tegra_emc_debug_available_rates);
> > > > +
> > > > +static int tegra_emc_debug_min_rate_get(void *data, u64 *rate)
> > > > +{
> > > > + struct tegra_emc *emc = data;
> > > > +
> > > > + *rate = emc->debugfs.min_rate;
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static int tegra_emc_debug_min_rate_set(void *data, u64 rate)
> > > > +{
> > > > + struct tegra_emc *emc = data;
> > > > + int err;
> > > > +
> > > > + if (!tegra_emc_validate_rate(emc, rate))
> > > > + return -EINVAL;
> > > > +
> > > > + err = emc_set_min_rate(emc, rate, EMC_RATE_DEBUG);
> > > > + if (err < 0)
> > > > + return err;
> > > > +
> > > > + emc->debugfs.min_rate = rate;
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_min_rate_fops,
> > > > + tegra_emc_debug_min_rate_get,
> > > > + tegra_emc_debug_min_rate_set, "%llu\n");
> > > > +
> > > > +static int tegra_emc_debug_max_rate_get(void *data, u64 *rate)
> > > > +{
> > > > + struct tegra_emc *emc = data;
> > > > +
> > > > + *rate = emc->debugfs.max_rate;
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static int tegra_emc_debug_max_rate_set(void *data, u64 rate)
> > > > +{
> > > > + struct tegra_emc *emc = data;
> > > > + int err;
> > > > +
> > > > + if (!tegra_emc_validate_rate(emc, rate))
> > > > + return -EINVAL;
> > > > +
> > > > + err = emc_set_max_rate(emc, rate, EMC_RATE_DEBUG);
> > > > + if (err < 0)
> > > > + return err;
> > > > +
> > > > + emc->debugfs.max_rate = rate;
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_max_rate_fops,
> > > > + tegra_emc_debug_max_rate_get,
> > > > + tegra_emc_debug_max_rate_set, "%llu\n");
> > > > +
> > > > +static void emc_debugfs_init(struct device *dev, struct tegra_emc *emc)
> > > > +{
> > > > + unsigned int i;
> > > > + int err;
> > > > +
> > > > + emc->debugfs.min_rate = ULONG_MAX;
> > > > + emc->debugfs.max_rate = 0;
> > > > +
> > > > + for (i = 0; i < emc->num_timings; i++) {
> > > > + if (emc->timings[i].rate < emc->debugfs.min_rate)
> > > > + emc->debugfs.min_rate = emc->timings[i].rate;
> > > > +
> > > > + if (emc->timings[i].rate > emc->debugfs.max_rate)
> > > > + emc->debugfs.max_rate = emc->timings[i].rate;
> > > > + }
> > > > +
> > > > + if (!emc->num_timings) {
> > > > + emc->debugfs.min_rate = clk_get_rate(emc->clk);
> > > > + emc->debugfs.max_rate = emc->debugfs.min_rate;
> > > > + }
> > > > +
> > > > + err = clk_set_rate_range(emc->clk, emc->debugfs.min_rate,
> > > > + emc->debugfs.max_rate);
> > > > + if (err < 0) {
> > > > + dev_err(dev, "failed to set rate range [%lu-%lu] for %pC\n",
> > > > + emc->debugfs.min_rate, emc->debugfs.max_rate,
> > > > + emc->clk);
> > > > + return;
> > > > + }
> > > > +
> > > > + emc->debugfs.root = debugfs_create_dir("emc", NULL);
> > > > +
> > > > + debugfs_create_file("available_rates", 0444, emc->debugfs.root, emc,
> > > > + &tegra_emc_debug_available_rates_fops);
> > > > + debugfs_create_file("min_rate", 0644, emc->debugfs.root,
> > > > + emc, &tegra_emc_debug_min_rate_fops);
> > > > + debugfs_create_file("max_rate", 0644, emc->debugfs.root,
> > > > + emc, &tegra_emc_debug_max_rate_fops);
> > > > +}
> > > > +
> > > > +static inline struct tegra_emc *
> > > > +to_tegra_emc_provider(struct icc_provider *provider)
> > > > +{
> > > > + return container_of(provider, struct tegra_emc, provider);
> > > > +}
> > > > +
> > > > +static struct icc_node_data *
> > > > +emc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
> > > > +{
> > > > + struct icc_provider *provider = data;
> > > > + struct icc_node_data *ndata;
> > > > + struct icc_node *node;
> > > > +
> > > > + /* External Memory is the only possible ICC route */
> > > > + list_for_each_entry(node, &provider->nodes, node_list) {
> > > > + if (node->id != TEGRA_ICC_EMEM)
> > > > + continue;
> > > > +
> > > > + ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
> > > > + if (!ndata)
> > > > + return ERR_PTR(-ENOMEM);
> > > > +
> > > > + /*
> > > > + * SRC and DST nodes should have matching TAG in order to have
> > > > + * it set by default for a requested path.
> > > > + */
> > > > + ndata->tag = TEGRA_MC_ICC_TAG_ISO;
> > > > + ndata->node = node;
> > > > +
> > > > + return ndata;
> > > > + }
> > > > +
> > > > + return ERR_PTR(-EPROBE_DEFER);
> > > > +}
> > > > +
> > > > +static int emc_icc_set(struct icc_node *src, struct icc_node *dst)
> > > > +{
> > > > + struct tegra_emc *emc = to_tegra_emc_provider(dst->provider);
> > > > + unsigned long long peak_bw = icc_units_to_bps(dst->peak_bw);
> > > > + unsigned long long avg_bw = icc_units_to_bps(dst->avg_bw);
> > > > + unsigned long long rate = max(avg_bw, peak_bw);
> > > > + unsigned int dram_data_bus_width_bytes = 4;
> > > > + const unsigned int ddr = 2;
> > > > + int err;
> > > > +
> > > > + /*
> > > > + * Tegra114 EMC runs on a clock rate of SDRAM bus. This means that
> > > > + * EMC clock rate is twice smaller than the peak data rate because
> > > > + * data is sampled on both EMC clock edges.
> > > > + */
> > > > + do_div(rate, ddr * dram_data_bus_width_bytes);
> > > > + rate = min_t(u64, rate, U32_MAX);
> > > > +
> > > > + err = emc_set_min_rate(emc, rate, EMC_RATE_ICC);
> > > > + if (err)
> > > > + return err;
> > > > +
> > > > + return 0;
> > > > +}
> > > > +
> > > > +static int tegra_emc_interconnect_init(struct tegra_emc *emc)
> > > > +{
> > > > + const struct tegra_mc_soc *soc = emc->mc->soc;
> > > > + struct icc_node *node;
> > > > + int err;
> > > > +
> > > > + emc->provider.dev = emc->dev;
> > > > + emc->provider.set = emc_icc_set;
> > > > + emc->provider.data = &emc->provider;
> > > > + emc->provider.aggregate = soc->icc_ops->aggregate;
> > > > + emc->provider.xlate_extended = emc_of_icc_xlate_extended;
> > > > +
> > > > + icc_provider_init(&emc->provider);
> > > > +
> > > > + /* create External Memory Controller node */
> > > > + node = icc_node_create(TEGRA_ICC_EMC);
> > > > + if (IS_ERR(node)) {
> > > > + err = PTR_ERR(node);
> > > > + goto err_msg;
> > > > + }
> > > > +
> > > > + node->name = "External Memory Controller";
> > > > + icc_node_add(node, &emc->provider);
> > > > +
> > > > + /* link External Memory Controller to External Memory (DRAM) */
> > > > + err = icc_link_create(node, TEGRA_ICC_EMEM);
> > > > + if (err)
> > > > + goto remove_nodes;
> > > > +
> > > > + /* create External Memory node */
> > > > + node = icc_node_create(TEGRA_ICC_EMEM);
> > > > + if (IS_ERR(node)) {
> > > > + err = PTR_ERR(node);
> > > > + goto remove_nodes;
> > > > + }
> > > > +
> > > > + node->name = "External Memory (DRAM)";
> > > > + icc_node_add(node, &emc->provider);
> > > > +
> > > > + err = icc_provider_register(&emc->provider);
> > > > + if (err)
> > > > + goto remove_nodes;
> > > > +
> > > > + return 0;
> > > > +
> > > > +remove_nodes:
> > > > + icc_nodes_remove(&emc->provider);
> > > > +err_msg:
> > > > + dev_err(emc->dev, "failed to initialize ICC: %d\n", err);
> > > > +
> > > > + return err;
> > > > +}
> > > > +
> > > > +static int tegra_emc_opp_table_init(struct tegra_emc *emc)
> >
> > In v4 I will switch to devm_tegra_core_dev_init_opp_table used in
> > tegra30 emc with required adjustments to it if you don't mind.
>
> Sounds good.
>
> >
> > > > +{
> > > > + u32 hw_version = BIT(tegra_sku_info.soc_speedo_id);
> > > > + int opp_token, err;
> > > > +
> > > > + err = dev_pm_opp_set_supported_hw(emc->dev, &hw_version, 1);
> > > > + if (err < 0) {
> > > > + dev_err(emc->dev, "failed to set OPP supported HW: %d\n", err);
> > > > + return err;
> > > > + }
> > > > + opp_token = err;
> > > > +
> > > > + err = dev_pm_opp_of_add_table(emc->dev);
> > > > + if (err) {
> > > > + if (err == -ENODEV)
> > > > + dev_err(emc->dev, "OPP table not found, please update your device tree\n");
> > > > + else
> > > > + dev_err(emc->dev, "failed to add OPP table: %d\n", err);
> > > > +
> > > > + goto put_hw_table;
> > > > + }
> > > > +
> > > > + dev_info_once(emc->dev, "OPP HW ver. 0x%x, current clock rate %lu MHz\n",
> > > > + hw_version, clk_get_rate(emc->clk) / 1000000);
> > > > +
> > > > + /* first dummy rate-set initializes voltage state */
> > > > + err = dev_pm_opp_set_rate(emc->dev, clk_get_rate(emc->clk));
> > > > + if (err) {
> > > > + dev_err(emc->dev, "failed to initialize OPP clock: %d\n", err);
> > > > + goto remove_table;
> > > > + }
> > > > +
> > > > + return 0;
> > > > +
> > > > +remove_table:
> > > > + dev_pm_opp_of_remove_table(emc->dev);
> > > > +put_hw_table:
> > > > + dev_pm_opp_put_supported_hw(opp_token);
> > > > +
> > > > + return err;
> > > > +}
> > > > +
> > > > +static void devm_tegra_emc_unset_callback(void *data)
> > > > +{
> > > > + tegra124_clk_set_emc_callbacks(NULL, NULL);
> > > > +}
> > > > +
> > > > +static int tegra_emc_probe(struct platform_device *pdev)
> > > > +{
> > > > + struct device_node *np;
> > > > + struct tegra_emc *emc;
> > > > + u32 ram_code;
> > > > + int err;
> > > > +
> > > > + emc = devm_kzalloc(&pdev->dev, sizeof(*emc), GFP_KERNEL);
> > > > + if (!emc)
> > > > + return -ENOMEM;
> > > > +
> > > > + mutex_init(&emc->rate_lock);
> > > > + emc->dev = &pdev->dev;
> > > > +
> > > > + emc->regs = devm_platform_ioremap_resource(pdev, 0);
> > > > + if (IS_ERR(emc->regs))
> > > > + return PTR_ERR(emc->regs);
> > > > +
> > > > + emc->mc = devm_tegra_memory_controller_get(&pdev->dev);
> > > > + if (IS_ERR(emc->mc))
> > > > + return PTR_ERR(emc->mc);
> > > > +
> > > > + ram_code = tegra_read_ram_code();
> > > > +
> > > > + np = tegra_emc_find_node_by_ram_code(pdev->dev.of_node, ram_code);
> > > > + if (np) {
> > > > + err = tegra_emc_load_timings_from_dt(emc, np);
> > > > + of_node_put(np);
> > > > + if (err)
> > > > + return err;
> > > > + } else {
> > > > + dev_info_once(&pdev->dev,
> > > > + "no memory timings for RAM code %u found in DT\n",
> > > > + ram_code);
> > > > + }
> > > > +
> > > > + err = emc_init(emc);
> > > > + if (err) {
> > > > + dev_err(&pdev->dev, "EMC initialization failed: %d\n", err);
> > > > + return err;
> > > > + }
> > > > +
> > > > + platform_set_drvdata(pdev, emc);
> > > > +
> > > > + tegra124_clk_set_emc_callbacks(tegra_emc_prepare_timing_change,
> > > > + tegra_emc_complete_timing_change);
> > > > +
> > > > + err = devm_add_action_or_reset(&pdev->dev, devm_tegra_emc_unset_callback,
> > > > + NULL);
> > > > + if (err)
> > > > + return err;
> > > > +
> > > > + err = platform_get_irq(pdev, 0);
> > > > + if (err < 0)
> > > > + return err;
> > > > +
> > > > + emc->irq = err;
> > > > +
> > > > + err = devm_request_irq(&pdev->dev, emc->irq, tegra_emc_isr, 0,
> > > > + dev_name(&pdev->dev), emc);
> > > > + if (err) {
> > > > + dev_err(&pdev->dev, "failed to request irq: %d\n", err);
> > > > + return err;
> > > > + }
> > > > +
> > > > + emc->clk = devm_clk_get(&pdev->dev, "emc");
> > > > + if (IS_ERR(emc->clk)) {
> > > > + err = PTR_ERR(emc->clk);
> > > > + dev_err(&pdev->dev, "failed to get EMC clock: %d\n", err);
> > > > + return err;
> > > > + }
> > > > +
> > > > + err = tegra_emc_opp_table_init(emc);
> > > > + if (err)
> > > > + return err;
> > > > +
> > > > + tegra_emc_rate_requests_init(emc);
> > > > +
> > > > + if (IS_ENABLED(CONFIG_DEBUG_FS))
> > > > + emc_debugfs_init(&pdev->dev, emc);
> > > > +
> > > > + tegra_emc_interconnect_init(emc);
> > > > +
> > > > + /*
> > > > + * Don't allow the kernel module to be unloaded. Unloading adds some
> > > > + * extra complexity which doesn't really worth the effort in a case of
> > > > + * this driver.
> > > > + */
> > > > + try_module_get(THIS_MODULE);
> > > > +
> > > > + return 0;
> > > > +};
> > > > +
> > > > +static const struct of_device_id tegra_emc_of_match[] = {
> > > > + { .compatible = "nvidia,tegra114-emc" },
> > > > + {}
> > > > +};
> > > > +MODULE_DEVICE_TABLE(of, tegra_emc_of_match);
> > > > +
> > > > +static struct platform_driver tegra_emc_driver = {
> > > > + .probe = tegra_emc_probe,
> > > > + .driver = {
> > > > + .name = "tegra114-emc",
> > > > + .of_match_table = tegra_emc_of_match,
> > > > + .suppress_bind_attrs = true,
> > > > + .sync_state = icc_sync_state,
> > > > + },
> > > > +};
> > > > +module_platform_driver(tegra_emc_driver);
> > > > +
> > > > +MODULE_AUTHOR("Svyatoslav Ryhel <clamor95@gmail.com>");
> > > > +MODULE_DESCRIPTION("NVIDIA Tegra114 EMC driver");
> > > > +MODULE_LICENSE("GPL");
> > > >
> > >
> > >
> > >
>
>
>
>
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver
2025-11-21 8:54 ` Svyatoslav Ryhel
@ 2025-11-25 3:29 ` Mikko Perttunen
0 siblings, 0 replies; 32+ messages in thread
From: Mikko Perttunen @ 2025-11-25 3:29 UTC (permalink / raw)
To: Svyatoslav Ryhel
Cc: Krzysztof Kozlowski, Rob Herring, Conor Dooley, Thierry Reding,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Michael Turquette, Stephen Boyd, Dmitry Osipenko, MyungJoo Ham,
Kyungmin Park, Chanwoo Choi, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
On Friday, November 21, 2025 5:54 PM Svyatoslav Ryhel wrote:
> пт, 21 лист. 2025 р. о 06:04 Mikko Perttunen <mperttunen@nvidia.com> пише:
> >
> > On Tuesday, November 18, 2025 5:05 PM Svyatoslav Ryhel wrote:
> > > вт, 18 лист. 2025 р. о 09:08 Mikko Perttunen <mperttunen@nvidia.com> пише:
> > > >
> > > > On Monday, September 15, 2025 5:01 PM Svyatoslav Ryhel wrote:
> > > > > Introduce driver for the External Memory Controller (EMC) found in Tegra114
> > > > > SoC. It controls the external DRAM on the board. The purpose of this
> > > > > driver is to program memory timing for external memory on the EMC clock
> > > > > rate change.
> > > > >
> > > > > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > > > > ---
> > > > > drivers/memory/tegra/Kconfig | 12 +
> > > > > drivers/memory/tegra/Makefile | 1 +
> > > > > drivers/memory/tegra/tegra114-emc.c | 1487 +++++++++++++++++++++++++++
> > > > > 3 files changed, 1500 insertions(+)
> > > > > create mode 100644 drivers/memory/tegra/tegra114-emc.c
> > > > >
> > > > > diff --git a/drivers/memory/tegra/Kconfig b/drivers/memory/tegra/Kconfig
> > > > > index fc5a27791826..11e7cc357d39 100644
> > > > > --- a/drivers/memory/tegra/Kconfig
> > > > > +++ b/drivers/memory/tegra/Kconfig
> > > > > @@ -35,6 +35,18 @@ config TEGRA30_EMC
> > > > > This driver is required to change memory timings / clock rate for
> > > > > external memory.
> > > > >
> > > > > +config TEGRA114_EMC
> > > > > + tristate "NVIDIA Tegra114 External Memory Controller driver"
> > > > > + default y
> > > > > + depends on ARCH_TEGRA_114_SOC || COMPILE_TEST
> > > > > + select TEGRA124_CLK_EMC if ARCH_TEGRA
> > > > > + select PM_OPP
> > > > > + help
> > > > > + This driver is for the External Memory Controller (EMC) found on
> > > > > + Tegra114 chips. The EMC controls the external DRAM on the board.
> > > > > + This driver is required to change memory timings / clock rate for
> > > > > + external memory.
> > > > > +
> > > > > config TEGRA124_EMC
> > > > > tristate "NVIDIA Tegra124 External Memory Controller driver"
> > > > > default ARCH_TEGRA_124_SOC
> > > > > diff --git a/drivers/memory/tegra/Makefile b/drivers/memory/tegra/Makefile
> > > > > index 0750847dac3c..d36be28efc4a 100644
> > > > > --- a/drivers/memory/tegra/Makefile
> > > > > +++ b/drivers/memory/tegra/Makefile
> > > > > @@ -15,6 +15,7 @@ obj-$(CONFIG_TEGRA_MC) += tegra-mc.o
> > > > >
> > > > > obj-$(CONFIG_TEGRA20_EMC) += tegra20-emc.o
> > > > > obj-$(CONFIG_TEGRA30_EMC) += tegra30-emc.o
> > > > > +obj-$(CONFIG_TEGRA114_EMC) += tegra114-emc.o
> > > > > obj-$(CONFIG_TEGRA124_EMC) += tegra124-emc.o
> > > > > obj-$(CONFIG_TEGRA210_EMC_TABLE) += tegra210-emc-table.o
> > > > > obj-$(CONFIG_TEGRA210_EMC) += tegra210-emc.o
> > > > > diff --git a/drivers/memory/tegra/tegra114-emc.c b/drivers/memory/tegra/tegra114-emc.c
> > > > > new file mode 100644
> > > > > index 000000000000..b986b5509f41
> > > > > --- /dev/null
> > > > > +++ b/drivers/memory/tegra/tegra114-emc.c
> > > > > @@ -0,0 +1,1487 @@
> > > > > +// SPDX-License-Identifier: GPL-2.0-only
> > > > > +/*
> > > > > + * Tegra114 External Memory Controller driver
> > > > > + *
> > > > > + * Based on downstream driver from NVIDIA and tegra124-emc.c
> > > > > + * Copyright (C) 2011-2014 NVIDIA Corporation
> > > > > + *
> > > > > + * Copyright (C) 2024 Svyatoslav Ryhel <clamor95@gmail.com>
> > > > > + */
> > > > > +
> > > > > +#include <linux/clk-provider.h>
> > > > > +#include <linux/clk.h>
> > > > > +#include <linux/clkdev.h>
> > > > > +#include <linux/clk/tegra.h>
> > > > > +#include <linux/debugfs.h>
> > > > > +#include <linux/delay.h>
> > > > > +#include <linux/interconnect-provider.h>
> > > > > +#include <linux/interrupt.h>
> > > > > +#include <linux/io.h>
> > > > > +#include <linux/module.h>
> > > > > +#include <linux/mutex.h>
> > > > > +#include <linux/of_address.h>
> > > > > +#include <linux/of_platform.h>
> > > > > +#include <linux/platform_device.h>
> > > > > +#include <linux/pm_opp.h>
> > > > > +#include <linux/sort.h>
> > > > > +#include <linux/string.h>
> > > > > +
> > > > > +#include <soc/tegra/fuse.h>
> > > > > +#include <soc/tegra/mc.h>
> > > > > +
> > > > > +#include "mc.h"
> > > > > +
> > > > > +#define EMC_INTSTATUS 0x0
> > > > > +#define EMC_REFRESH_OVERFLOW_INT BIT(3)
> > > > > +#define EMC_INTSTATUS_CLKCHANGE_COMPLETE BIT(4)
> > > >
> > > > This naming is inconsistent. I'd prefer using EMC_INTSTATUS_REFRESH_OVERFLOW and EMC_INTSTATUS_CLKCHANGE_COMPLETE.
> > > >
> > > > > +
> > > > > +#define EMC_INTMASK 0x4
> > > > > +
> > > > > +#define EMC_DBG 0x8
> > > > > +#define EMC_DBG_READ_MUX_ASSEMBLY BIT(0)
> > > > > +#define EMC_DBG_WRITE_MUX_ACTIVE BIT(1)
> > > > > +#define EMC_DBG_FORCE_UPDATE BIT(2)
> > > > > +#define EMC_DBG_CFG_PRIORITY BIT(24)
> > > > > +
> > > > > +#define EMC_CFG 0xc
> > > > > +#define EMC_CFG_DRAM_CLKSTOP_PD BIT(31)
> > > > > +#define EMC_CFG_DRAM_CLKSTOP_SR BIT(30)
> > > > > +#define EMC_CFG_DRAM_ACPD BIT(29)
> > > > > +#define EMC_CFG_DYN_SREF BIT(28)
> > > > > +#define EMC_CFG_PWR_MASK ((0xF << 28) | BIT(18))
> > > > > +#define EMC_CFG_DSR_VTTGEN_DRV_EN BIT(18)
> > > >
> > > > Ordering from first to last register would be more consistent.
> > > >
> > > > > +
> > > > > +#define EMC_ADR_CFG 0x10
> > > > > +#define EMC_ADR_CFG_EMEM_NUMDEV BIT(0)
> > > > > +
> > > > > +#define EMC_REFCTRL 0x20
> > > > > +#define EMC_REFCTRL_DEV_SEL_SHIFT 0
> > > > > +#define EMC_REFCTRL_ENABLE BIT(31)
> > > > > +
> > > > > +#define EMC_TIMING_CONTROL 0x28
> > > > > +#define EMC_RC 0x2c
> > > > > +#define EMC_RFC 0x30
> > > > > +#define EMC_RAS 0x34
> > > > > +#define EMC_RP 0x38
> > > > > +#define EMC_R2W 0x3c
> > > > > +#define EMC_W2R 0x40
> > > > > +#define EMC_R2P 0x44
> > > > > +#define EMC_W2P 0x48
> > > > > +#define EMC_RD_RCD 0x4c
> > > > > +#define EMC_WR_RCD 0x50
> > > > > +#define EMC_RRD 0x54
> > > > > +#define EMC_REXT 0x58
> > > > > +#define EMC_WDV 0x5c
> > > > > +#define EMC_QUSE 0x60
> > > > > +#define EMC_QRST 0x64
> > > > > +#define EMC_QSAFE 0x68
> > > > > +#define EMC_RDV 0x6c
> > > > > +#define EMC_REFRESH 0x70
> > > > > +#define EMC_BURST_REFRESH_NUM 0x74
> > > > > +#define EMC_PDEX2WR 0x78
> > > > > +#define EMC_PDEX2RD 0x7c
> > > > > +#define EMC_PCHG2PDEN 0x80
> > > > > +#define EMC_ACT2PDEN 0x84
> > > > > +#define EMC_AR2PDEN 0x88
> > > > > +#define EMC_RW2PDEN 0x8c
> > > > > +#define EMC_TXSR 0x90
> > > > > +#define EMC_TCKE 0x94
> > > > > +#define EMC_TFAW 0x98
> > > > > +#define EMC_TRPAB 0x9c
> > > > > +#define EMC_TCLKSTABLE 0xa0
> > > > > +#define EMC_TCLKSTOP 0xa4
> > > > > +#define EMC_TREFBW 0xa8
> > > > > +#define EMC_QUSE_EXTRA 0xac
> > > > > +#define EMC_ODT_WRITE 0xb0
> > > > > +#define EMC_ODT_READ 0xb4
> > > > > +#define EMC_WEXT 0xb8
> > > > > +#define EMC_CTT 0xbc
> > > > > +#define EMC_RFC_SLR 0xc0
> > > > > +#define EMC_MRS_WAIT_CNT2 0xc4
> > > > > +
> > > > > +#define EMC_MRS_WAIT_CNT 0xc8
> > > > > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT 0
> > > > > +#define EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK \
> > > > > + (0x3FF << EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT)
> > > > > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT 16
> > > > > +#define EMC_MRS_WAIT_CNT_LONG_WAIT_MASK \
> > > > > + (0x3FF << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > > > > +
> > > > > +#define EMC_MRS 0xcc
> > > > > +#define EMC_MODE_SET_DLL_RESET BIT(8)
> > > > > +#define EMC_MODE_SET_LONG_CNT BIT(26)
> > > > > +#define EMC_EMRS 0xd0
> > > > > +#define EMC_REF 0xd4
> > > > > +#define EMC_PRE 0xd8
> > > > > +
> > > > > +#define EMC_SELF_REF 0xe0
> > > > > +#define EMC_SELF_REF_CMD_ENABLED BIT(0)
> > > > > +#define EMC_SELF_REF_DEV_SEL_SHIFT 30
> > > > > +
> > > > > +#define EMC_MRW 0xe8
> > > > > +
> > > > > +#define EMC_MRR 0xec
> > > > > +#define EMC_MRR_MA_SHIFT 16
> > > > > +#define LPDDR2_MR4_TEMP_SHIFT 0
> > > > > +
> > > > > +#define EMC_XM2DQSPADCTRL3 0xf8
> > > > > +#define EMC_FBIO_SPARE 0x100
> > > > > +
> > > > > +#define EMC_FBIO_CFG5 0x104
> > > > > +#define EMC_FBIO_CFG5_DRAM_TYPE_MASK 0x3
> > > > > +#define EMC_FBIO_CFG5_DRAM_TYPE_SHIFT 0
> > > >
> > > > Inconsistent to indent here and not elsewhere. My preference is not to indent.
> > > >
> > > > > +
> > > > > +#define EMC_FBIO_CFG6 0x114
> > > > > +#define EMC_EMRS2 0x12c
> > > > > +#define EMC_MRW2 0x134
> > > > > +#define EMC_MRW4 0x13c
> > > > > +#define EMC_EINPUT 0x14c
> > > > > +#define EMC_EINPUT_DURATION 0x150
> > > > > +#define EMC_PUTERM_EXTRA 0x154
> > > > > +#define EMC_TCKESR 0x158
> > > > > +#define EMC_TPD 0x15c
> > > > > +
> > > > > +#define EMC_AUTO_CAL_CONFIG 0x2a4
> > > > > +#define EMC_AUTO_CAL_CONFIG_AUTO_CAL_START BIT(31)
> > > > > +#define EMC_AUTO_CAL_INTERVAL 0x2a8
> > > > > +#define EMC_AUTO_CAL_STATUS 0x2ac
> > > > > +#define EMC_AUTO_CAL_STATUS_ACTIVE BIT(31)
> > > > > +#define EMC_STATUS 0x2b4
> > > > > +#define EMC_STATUS_TIMING_UPDATE_STALLED BIT(23)
> > > > > +
> > > > > +#define EMC_CFG_2 0x2b8
> > > > > +#define EMC_CLKCHANGE_REQ_ENABLE BIT(0)
> > > > > +#define EMC_CLKCHANGE_PD_ENABLE BIT(1)
> > > > > +#define EMC_CLKCHANGE_SR_ENABLE BIT(2)
> > > >
> > > > Better to prefix with EMC_CFG_2
> > > >
> > > > > +
> > > > > +#define EMC_CFG_DIG_DLL 0x2bc
> > > > > +#define EMC_CFG_DIG_DLL_PERIOD 0x2c0
> > > > > +#define EMC_RDV_MASK 0x2cc
> > > > > +#define EMC_WDV_MASK 0x2d0
> > > > > +#define EMC_CTT_DURATION 0x2d8
> > > > > +#define EMC_CTT_TERM_CTRL 0x2dc
> > > > > +#define EMC_ZCAL_INTERVAL 0x2e0
> > > > > +#define EMC_ZCAL_WAIT_CNT 0x2e4
> > > > > +
> > > > > +#define EMC_ZQ_CAL 0x2ec
> > > > > +#define EMC_ZQ_CAL_CMD BIT(0)
> > > > > +#define EMC_ZQ_CAL_LONG BIT(4)
> > > > > +#define EMC_ZQ_CAL_LONG_CMD_DEV0 \
> > > > > + (DRAM_DEV_SEL_0 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > > > > +#define EMC_ZQ_CAL_LONG_CMD_DEV1 \
> > > > > + (DRAM_DEV_SEL_1 | EMC_ZQ_CAL_LONG | EMC_ZQ_CAL_CMD)
> > > > > +
> > > > > +#define EMC_XM2CMDPADCTRL 0x2f0
> > > > > +#define EMC_XM2DQSPADCTRL 0x2f8
> > > > > +#define EMC_XM2DQSPADCTRL2 0x2fc
> > > > > +#define EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE BIT(0)
> > > > > +#define EMC_XM2DQSPADCTRL2_VREF_ENABLE BIT(5)
> > > > > +#define EMC_XM2DQPADCTRL 0x300
> > > > > +#define EMC_XM2DQPADCTRL2 0x304
> > > > > +#define EMC_XM2CLKPADCTRL 0x308
> > > > > +#define EMC_XM2COMPPADCTRL 0x30c
> > > > > +#define EMC_XM2VTTGENPADCTRL 0x310
> > > > > +#define EMC_XM2VTTGENPADCTRL2 0x314
> > > > > +#define EMC_XM2QUSEPADCTRL 0x318
> > > > > +#define EMC_XM2DQSPADCTRL4 0x320
> > > > > +#define EMC_DLL_XFORM_DQS0 0x328
> > > > > +#define EMC_DLL_XFORM_DQS1 0x32c
> > > > > +#define EMC_DLL_XFORM_DQS2 0x330
> > > > > +#define EMC_DLL_XFORM_DQS3 0x334
> > > > > +#define EMC_DLL_XFORM_DQS4 0x338
> > > > > +#define EMC_DLL_XFORM_DQS5 0x33c
> > > > > +#define EMC_DLL_XFORM_DQS6 0x340
> > > > > +#define EMC_DLL_XFORM_DQS7 0x344
> > > > > +#define EMC_DLL_XFORM_QUSE0 0x348
> > > > > +#define EMC_DLL_XFORM_QUSE1 0x34c
> > > > > +#define EMC_DLL_XFORM_QUSE2 0x350
> > > > > +#define EMC_DLL_XFORM_QUSE3 0x354
> > > > > +#define EMC_DLL_XFORM_QUSE4 0x358
> > > > > +#define EMC_DLL_XFORM_QUSE5 0x35c
> > > > > +#define EMC_DLL_XFORM_QUSE6 0x360
> > > > > +#define EMC_DLL_XFORM_QUSE7 0x364
> > > > > +#define EMC_DLL_XFORM_DQ0 0x368
> > > > > +#define EMC_DLL_XFORM_DQ1 0x36c
> > > > > +#define EMC_DLL_XFORM_DQ2 0x370
> > > > > +#define EMC_DLL_XFORM_DQ3 0x374
> > > > > +#define EMC_DLI_TRIM_TXDQS0 0x3a8
> > > > > +#define EMC_DLI_TRIM_TXDQS1 0x3ac
> > > > > +#define EMC_DLI_TRIM_TXDQS2 0x3b0
> > > > > +#define EMC_DLI_TRIM_TXDQS3 0x3b4
> > > > > +#define EMC_DLI_TRIM_TXDQS4 0x3b8
> > > > > +#define EMC_DLI_TRIM_TXDQS5 0x3bc
> > > > > +#define EMC_DLI_TRIM_TXDQS6 0x3c0
> > > > > +#define EMC_DLI_TRIM_TXDQS7 0x3c4
> > > > > +#define EMC_STALL_THEN_EXE_AFTER_CLKCHANGE 0x3cc
> > > > > +#define EMC_SEL_DPD_CTRL 0x3d8
> > > > > +#define EMC_SEL_DPD_CTRL_DATA_SEL_DPD BIT(8)
> > > > > +#define EMC_SEL_DPD_CTRL_ODT_SEL_DPD BIT(5)
> > > > > +#define EMC_SEL_DPD_CTRL_RESET_SEL_DPD BIT(4)
> > > > > +#define EMC_SEL_DPD_CTRL_CA_SEL_DPD BIT(3)
> > > > > +#define EMC_SEL_DPD_CTRL_CLK_SEL_DPD BIT(2)
> > > > > +#define EMC_SEL_DPD_CTRL_DDR3_MASK \
> > > > > + ((0xf << 2) | BIT(8))
> > > > > +#define EMC_SEL_DPD_CTRL_MASK \
> > > > > + ((0x3 << 2) | BIT(5) | BIT(8))
> > > > > +#define EMC_PRE_REFRESH_REQ_CNT 0x3dc
> > > > > +#define EMC_DYN_SELF_REF_CONTROL 0x3e0
> > > > > +#define EMC_TXSRDLL 0x3e4
> > > > > +#define EMC_CCFIFO_ADDR 0x3e8
> > > > > +#define EMC_CCFIFO_DATA 0x3ec
> > > > > +#define EMC_CCFIFO_STATUS 0x3f0
> > > > > +#define EMC_CDB_CNTL_1 0x3f4
> > > > > +#define EMC_CDB_CNTL_2 0x3f8
> > > > > +#define EMC_XM2CLKPADCTRL2 0x3fc
> > > > > +#define EMC_AUTO_CAL_CONFIG2 0x458
> > > > > +#define EMC_AUTO_CAL_CONFIG3 0x45c
> > > > > +#define EMC_IBDLY 0x468
> > > > > +#define EMC_DLL_XFORM_ADDR0 0x46c
> > > > > +#define EMC_DLL_XFORM_ADDR1 0x470
> > > > > +#define EMC_DLL_XFORM_ADDR2 0x474
> > > > > +#define EMC_DSR_VTTGEN_DRV 0x47c
> > > > > +#define EMC_TXDSRVTTGEN 0x480
> > > > > +#define EMC_XM2CMDPADCTRL4 0x484
> > > > > +
> > > > > +#define DRAM_DEV_SEL_ALL 0
> > > > > +#define DRAM_DEV_SEL_0 BIT(31)
> > > > > +#define DRAM_DEV_SEL_1 BIT(30)
> > > > > +
> > > > > +#define EMC_CFG_POWER_FEATURES_MASK \
> > > > > + (EMC_CFG_DYN_SREF | EMC_CFG_DRAM_ACPD | EMC_CFG_DRAM_CLKSTOP_SR | \
> > > > > + EMC_CFG_DRAM_CLKSTOP_PD | EMC_CFG_DSR_VTTGEN_DRV_EN)
> > > > > +#define EMC_REFCTRL_DEV_SEL(n) ((((n) > 1) ? 0 : 2) << EMC_REFCTRL_DEV_SEL_SHIFT)
> > > > > +#define EMC_DRAM_DEV_SEL(n) (((n) > 1) ? DRAM_DEV_SEL_ALL : DRAM_DEV_SEL_0)
> > > > > +
> > > > > +/* Maximum amount of time in us. to wait for changes to become effective */
> > > > > +#define EMC_STATUS_UPDATE_TIMEOUT 1000
> > > > > +
> > > > > +enum emc_dram_type {
> > > > > + DRAM_TYPE_DDR3,
> > > > > + DRAM_TYPE_DDR1,
> > > > > + DRAM_TYPE_LPDDR2,
> > > > > + DRAM_TYPE_DDR2
> > > > > +};
> > > > > +
> > > > > +enum emc_dll_change {
> > > > > + DLL_CHANGE_NONE,
> > > > > + DLL_CHANGE_ON,
> > > > > + DLL_CHANGE_OFF
> > > > > +};
> > > > > +
> > > > > +static const unsigned long emc_burst_regs[] = {
> > > > > + EMC_RC,
> > > > > + EMC_RFC,
> > > > > + EMC_RAS,
> > > > > + EMC_RP,
> > > > > + EMC_R2W,
> > > > > + EMC_W2R,
> > > > > + EMC_R2P,
> > > > > + EMC_W2P,
> > > > > + EMC_RD_RCD,
> > > > > + EMC_WR_RCD,
> > > > > + EMC_RRD,
> > > > > + EMC_REXT,
> > > > > + EMC_WEXT,
> > > > > + EMC_WDV,
> > > > > + EMC_WDV_MASK,
> > > > > + EMC_QUSE,
> > > > > + EMC_IBDLY,
> > > > > + EMC_EINPUT,
> > > > > + EMC_EINPUT_DURATION,
> > > > > + EMC_PUTERM_EXTRA,
> > > > > + EMC_CDB_CNTL_1,
> > > > > + EMC_CDB_CNTL_2,
> > > > > + EMC_QRST,
> > > > > + EMC_QSAFE,
> > > > > + EMC_RDV,
> > > > > + EMC_RDV_MASK,
> > > > > + EMC_REFRESH,
> > > > > + EMC_BURST_REFRESH_NUM,
> > > > > + EMC_PRE_REFRESH_REQ_CNT,
> > > > > + EMC_PDEX2WR,
> > > > > + EMC_PDEX2RD,
> > > > > + EMC_PCHG2PDEN,
> > > > > + EMC_ACT2PDEN,
> > > > > + EMC_AR2PDEN,
> > > > > + EMC_RW2PDEN,
> > > > > + EMC_TXSR,
> > > > > + EMC_TXSRDLL,
> > > > > + EMC_TCKE,
> > > > > + EMC_TCKESR,
> > > > > + EMC_TPD,
> > > > > + EMC_TFAW,
> > > > > + EMC_TRPAB,
> > > > > + EMC_TCLKSTABLE,
> > > > > + EMC_TCLKSTOP,
> > > > > + EMC_TREFBW,
> > > > > + EMC_QUSE_EXTRA,
> > > > > + EMC_FBIO_CFG6,
> > > > > + EMC_ODT_WRITE,
> > > > > + EMC_ODT_READ,
> > > > > + EMC_FBIO_CFG5,
> > > > > + EMC_CFG_DIG_DLL,
> > > > > + EMC_CFG_DIG_DLL_PERIOD,
> > > > > + EMC_DLL_XFORM_DQS0,
> > > > > + EMC_DLL_XFORM_DQS1,
> > > > > + EMC_DLL_XFORM_DQS2,
> > > > > + EMC_DLL_XFORM_DQS3,
> > > > > + EMC_DLL_XFORM_DQS4,
> > > > > + EMC_DLL_XFORM_DQS5,
> > > > > + EMC_DLL_XFORM_DQS6,
> > > > > + EMC_DLL_XFORM_DQS7,
> > > > > + EMC_DLL_XFORM_QUSE0,
> > > > > + EMC_DLL_XFORM_QUSE1,
> > > > > + EMC_DLL_XFORM_QUSE2,
> > > > > + EMC_DLL_XFORM_QUSE3,
> > > > > + EMC_DLL_XFORM_QUSE4,
> > > > > + EMC_DLL_XFORM_QUSE5,
> > > > > + EMC_DLL_XFORM_QUSE6,
> > > > > + EMC_DLL_XFORM_QUSE7,
> > > > > + EMC_DLI_TRIM_TXDQS0,
> > > > > + EMC_DLI_TRIM_TXDQS1,
> > > > > + EMC_DLI_TRIM_TXDQS2,
> > > > > + EMC_DLI_TRIM_TXDQS3,
> > > > > + EMC_DLI_TRIM_TXDQS4,
> > > > > + EMC_DLI_TRIM_TXDQS5,
> > > > > + EMC_DLI_TRIM_TXDQS6,
> > > > > + EMC_DLI_TRIM_TXDQS7,
> > > > > + EMC_DLL_XFORM_DQ0,
> > > > > + EMC_DLL_XFORM_DQ1,
> > > > > + EMC_DLL_XFORM_DQ2,
> > > > > + EMC_DLL_XFORM_DQ3,
> > > > > + EMC_XM2CMDPADCTRL,
> > > > > + EMC_XM2CMDPADCTRL4,
> > > > > + EMC_XM2DQPADCTRL2,
> > > > > + EMC_XM2CLKPADCTRL,
> > > > > + EMC_XM2COMPPADCTRL,
> > > > > + EMC_XM2VTTGENPADCTRL,
> > > > > + EMC_XM2VTTGENPADCTRL2,
> > > > > + EMC_XM2DQSPADCTRL3,
> > > > > + EMC_XM2DQSPADCTRL4,
> > > > > + EMC_DSR_VTTGEN_DRV,
> > > > > + EMC_TXDSRVTTGEN,
> > > > > + EMC_FBIO_SPARE,
> > > > > + EMC_ZCAL_WAIT_CNT,
> > > > > + EMC_MRS_WAIT_CNT2,
> > > > > + EMC_CTT,
> > > > > + EMC_CTT_DURATION,
> > > > > + EMC_DYN_SELF_REF_CONTROL,
> > > > > +};
> > > >
> > > > How was this list determined? It doesn't seem to match the trees I can find, or the list in the TRM (which is also different from the downstream source code).
> > > >
> > >
> > > Hm, IIRC, I used Tegra114 3.4 kernel sources, specifically
> > > tegratab/macallan memory board files as my base and then tried to
> > > align them closer to list used by Tegra124 (not identical obviously
> > > since lists have different lengths). This list contains burst and
> > > trimmer registers with some of them excluded as a dedicated entries in
> > > emc_timing structure below (yet again - similar to Tegra124). If you
> > > have any ideas how to group registers better I would be happy to hear.
> >
> > That sounds fine by me if we're programming all registers the downstream sequence is programming (except for ones not related to the DRAM configuration like the latency allowance stuff that's better done otherwise). I was just wondering.
> >
> > >
> > > > > +
> > > > > +struct emc_timing {
> > > > > + unsigned long rate;
> > > > > +
> > > > > + u32 emc_burst_data[ARRAY_SIZE(emc_burst_regs)];
> > > > > +
> > > > > + u32 emc_auto_cal_config;
> > > > > + u32 emc_auto_cal_config2;
> > > > > + u32 emc_auto_cal_config3;
> > > > > + u32 emc_auto_cal_interval;
> > > > > + u32 emc_cfg;
> > > > > + u32 emc_ctt_term_ctrl;
> > > > > + u32 emc_mode_1;
> > > > > + u32 emc_mode_2;
> > > > > + u32 emc_mode_4;
> > > > > + u32 emc_mode_reset;
> > > > > + u32 emc_mrs_wait_cnt;
> > > > > + u32 emc_sel_dpd_ctrl;
> > > > > + u32 emc_xm2dqspadctrl2;
> > > > > + u32 emc_zcal_cnt_long;
> > > > > + u32 emc_zcal_interval;
> > > > > +};
> > > > > +
> > > > > +enum emc_rate_request_type {
> > > > > + EMC_RATE_DEBUG,
> > > > > + EMC_RATE_ICC,
> > > > > + EMC_RATE_TYPE_MAX,
> > > > > +};
> > > > > +
> > > > > +struct emc_rate_request {
> > > > > + unsigned long min_rate;
> > > > > + unsigned long max_rate;
> > > > > +};
> > > > > +
> > > > > +struct tegra_emc {
> > > > > + struct device *dev;
> > > > > +
> > > > > + struct tegra_mc *mc;
> > > > > +
> > > > > + void __iomem *regs;
> > > > > +
> > > > > + unsigned int irq;
> > > > > +
> > > > > + struct clk *clk;
> > > >
> > > > Nit: I don't think all the empty lines are needed.
> > > >
> > > > > +
> > > > > + enum emc_dram_type dram_type;
> > > > > + unsigned int dram_num;
> > > > > +
> > > > > + struct emc_timing last_timing;
> > > > > + struct emc_timing *timings;
> > > > > + unsigned int num_timings;
> > > > > +
> > > > > + struct {
> > > > > + struct dentry *root;
> > > > > + unsigned long min_rate;
> > > > > + unsigned long max_rate;
> > > > > + } debugfs;
> > > > > +
> > > > > + struct icc_provider provider;
> > > > > +
> > > > > + /*
> > > > > + * There are multiple sources in the EMC driver which could request
> > > > > + * a min/max clock rate, these rates are contained in this array.
> > > > > + */
> > > > > + struct emc_rate_request requested_rate[EMC_RATE_TYPE_MAX];
> > > > > +
> > > > > + /* protect shared rate-change code path */
> > > > > + struct mutex rate_lock;
> > > > > +};
> > > > > +
> > > > > +static irqreturn_t tegra_emc_isr(int irq, void *data)
> > > > > +{
> > > > > + struct tegra_emc *emc = data;
> > > > > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > > > > + u32 status;
> > > > > +
> > > > > + status = readl_relaxed(emc->regs + EMC_INTSTATUS) & intmask;
> > > > > + if (!status)
> > > > > + return IRQ_NONE;
> > > > > +
> > > > > + /* notify about HW problem */
> > > > > + if (status & EMC_REFRESH_OVERFLOW_INT)
> > > > > + dev_err_ratelimited(emc->dev,
> > > > > + "refresh request overflow timeout\n");
> > > > > +
> > > > > + /* clear interrupts */
> > > > > + writel_relaxed(status, emc->regs + EMC_INTSTATUS);
> > > > > +
> > > > > + return IRQ_HANDLED;
> > > > > +}
> > > > > +
> > > > > +/* Timing change sequence functions */
> > > > > +
> > > > > +static void emc_ccfifo_writel(struct tegra_emc *emc, u32 value,
> > > > > + unsigned long offset)
> > > > > +{
> > > > > + writel(value, emc->regs + EMC_CCFIFO_DATA);
> > > > > + writel(offset, emc->regs + EMC_CCFIFO_ADDR);
> > > > > +}
> > > > > +
> > > > > +static void emc_seq_update_timing(struct tegra_emc *emc)
> > > > > +{
> > > > > + unsigned int i;
> > > > > + u32 value;
> > > > > +
> > > > > + writel(1, emc->regs + EMC_TIMING_CONTROL);
> > > > > +
> > > > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > > > + value = readl(emc->regs + EMC_STATUS);
> > > > > + if ((value & EMC_STATUS_TIMING_UPDATE_STALLED) == 0)
> > > > > + return;
> > > > > + udelay(1);
> > > > > + }
> > > >
> > > > This can be replaced with readl_poll_timeout_atomic
> > > >
> > > > > +
> > > > > + dev_err(emc->dev, "timing update timed out\n");
> > > > > +}
> > > > > +
> > > > > +static void emc_seq_disable_auto_cal(struct tegra_emc *emc)
> > > > > +{
> > > > > + unsigned int i;
> > > > > + u32 value;
> > > > > +
> > > > > + writel(0, emc->regs + EMC_AUTO_CAL_INTERVAL);
> > > > > +
> > > > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > > > + value = readl(emc->regs + EMC_AUTO_CAL_STATUS);
> > > > > + if ((value & EMC_AUTO_CAL_STATUS_ACTIVE) == 0)
> > > > > + return;
> > > > > + udelay(1);
> > > > > + }
> > > >
> > > > Likewise
> > > >
> > > > > +
> > > > > + dev_err(emc->dev, "auto cal disable timed out\n");
> > > > > +}
> > > > > +
> > > > > +static void emc_seq_wait_clkchange(struct tegra_emc *emc)
> > > > > +{
> > > > > + unsigned int i;
> > > > > + u32 value;
> > > > > +
> > > > > + for (i = 0; i < EMC_STATUS_UPDATE_TIMEOUT; ++i) {
> > > > > + value = readl(emc->regs + EMC_INTSTATUS);
> > > > > + if (value & EMC_INTSTATUS_CLKCHANGE_COMPLETE)
> > > > > + return;
> > > > > + udelay(1);
> > > > > + }
> > > >
> > > > Likewise
> > > >
> > > > > +
> > > > > + dev_err(emc->dev, "clock change timed out\n");
> > > > > +}
> > > > > +
> > > > > +static struct emc_timing *tegra_emc_find_timing(struct tegra_emc *emc,
> > > > > + unsigned long rate)
> > > > > +{
> > > > > + struct emc_timing *timing = NULL;
> > > > > + unsigned int i;
> > > > > +
> > > > > + for (i = 0; i < emc->num_timings; i++) {
> > > > > + if (emc->timings[i].rate == rate) {
> > > > > + timing = &emc->timings[i];
> > > > > + break;
> > > > > + }
> > > > > + }
> > > > > +
> > > > > + if (!timing) {
> > > > > + dev_err(emc->dev, "no timing for rate %lu\n", rate);
> > > > > + return NULL;
> > > > > + }
> > > > > +
> > > > > + return timing;
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_prepare_timing_change(struct tegra_emc *emc,
> > > > > + unsigned long rate)
> > > > > +{
> > > > > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > > > > + struct emc_timing *last = &emc->last_timing;
> > > > > + enum emc_dll_change dll_change;
> > > > > + unsigned int pre_wait = 0;
> > > > > + u32 val, mask;
> > > > > + bool update = false;
> > > > > + unsigned int i;
> > > > > +
> > > > > + if (!timing)
> > > > > + return -ENOENT;
> > > > > +
> > > > > + if ((last->emc_mode_1 & 0x1) == (timing->emc_mode_1 & 0x1))
> > > > > + dll_change = DLL_CHANGE_NONE;
> > > > > + else if (timing->emc_mode_1 & 0x1)
> > > >
> > > > This looks incorrect. DLL is enabled if bit 0 is off. Now, I'm guessing that comes from the other drivers, originally from tegra124-emc.c, which was written by.. me :) I can send a patch for the other chips.
> > > >
> > >
> > > Noted
> > >
> > > > > + dll_change = DLL_CHANGE_ON;
> > > > > + else
> > > > > + dll_change = DLL_CHANGE_OFF;
> > > > > +
> > > > > + /* Clear CLKCHANGE_COMPLETE interrupts */
> > > > > + writel(EMC_INTSTATUS_CLKCHANGE_COMPLETE, emc->regs + EMC_INTSTATUS);
> > > > > +
> > > > > + /* Disable dynamic self-refresh */
> > > > > + val = readl(emc->regs + EMC_CFG);
> > > > > + if (val & EMC_CFG_PWR_MASK) {
> > > >
> > > > This doesn't strictly match downstream Tegra114 EMC code or the TRM -- it is the later sequence version for Tegra124. However, my hunch is that the Tegra124 sequence would be compatible and probably more reliable as it would have received more testing. So it's probably not a bad idea to use it.
> > > >
> > > > There are other places in the sequence that have changed between versions, but I don't think we need to change them. If issues are seen in the future, we can check again.
> > > >
> > >
> > > It does not strictly match, yes, but overall logic is preserved. I
> > > have tested these on my Tegra114 devices and I did not observe any
> > > notable issues.
> > >
> >
> > Sounds good.
> >
> > > > > + val &= ~EMC_CFG_POWER_FEATURES_MASK;
> > > > > + writel(val, emc->regs + EMC_CFG);
> > > > > +
> > > > > + pre_wait = 5;
> > > > > + }
> > > > > +
> > > > > + /* Disable SEL_DPD_CTRL for clock change */
> > > > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > > > + mask = EMC_SEL_DPD_CTRL_DDR3_MASK;
> > > > > + else
> > > > > + mask = EMC_SEL_DPD_CTRL_MASK;
> > > > > +
> > > > > + val = readl(emc->regs + EMC_SEL_DPD_CTRL);
> > > > > + if (val & mask) {
> > > > > + val &= ~mask;
> > > > > + writel(val, emc->regs + EMC_SEL_DPD_CTRL);
> > > > > + }
> > > > > +
> > > > > + /* Prepare DQ/DQS for clock change */
> > > > > + val = readl(emc->regs + EMC_XM2DQSPADCTRL2);
> > > > > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_VREF_ENABLE &&
> > > > > + !(val & EMC_XM2DQSPADCTRL2_VREF_ENABLE)) {
> > > > > + val |= EMC_XM2DQSPADCTRL2_VREF_ENABLE;
> > > > > + update = true;
> > > > > + }
> > > > > +
> > > > > + if (timing->emc_xm2dqspadctrl2 & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE &&
> > > > > + !(val & EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE)) {
> > > > > + val |= EMC_XM2DQSPADCTRL2_RX_FT_REC_ENABLE;
> > > > > + update = true;
> > > > > + }
> > > > > +
> > > > > + if (update) {
> > > > > + writel(val, emc->regs + EMC_XM2DQSPADCTRL2);
> > > > > + if (pre_wait < 30)
> > > > > + pre_wait = 30;
> > > > > + }
> > > > > +
> > > > > + /* Wait to settle */
> > > > > + if (pre_wait) {
> > > > > + emc_seq_update_timing(emc);
> > > > > + udelay(pre_wait);
> > > > > + }
> > > > > +
> > > > > + /* Program CTT_TERM control */
> > > > > + if (last->emc_ctt_term_ctrl != timing->emc_ctt_term_ctrl) {
> > > > > + emc_seq_disable_auto_cal(emc);
> > > > > + writel(timing->emc_ctt_term_ctrl,
> > > > > + emc->regs + EMC_CTT_TERM_CTRL);
> > > > > + emc_seq_update_timing(emc);
> > > > > + }
> > > > > +
> > > > > + /* Program burst shadow registers */
> > > > > + for (i = 0; i < ARRAY_SIZE(timing->emc_burst_data); ++i)
> > > > > + writel(timing->emc_burst_data[i],
> > > > > + emc->regs + emc_burst_regs[i]);
> > > > > +
> > > > > + writel(timing->emc_xm2dqspadctrl2, emc->regs + EMC_XM2DQSPADCTRL2);
> > > > > + writel(timing->emc_zcal_interval, emc->regs + EMC_ZCAL_INTERVAL);
> > > > > +
> > > > > + tegra_mc_write_emem_configuration(emc->mc, timing->rate);
> > > > > +
> > > > > + val = timing->emc_cfg & ~EMC_CFG_POWER_FEATURES_MASK;
> > > > > + emc_ccfifo_writel(emc, val, EMC_CFG);
> > > > > +
> > > > > + /* Program AUTO_CAL_CONFIG */
> > > > > + if (timing->emc_auto_cal_config2 != last->emc_auto_cal_config2)
> > > > > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config2,
> > > > > + EMC_AUTO_CAL_CONFIG2);
> > > > > +
> > > > > + if (timing->emc_auto_cal_config3 != last->emc_auto_cal_config3)
> > > > > + emc_ccfifo_writel(emc, timing->emc_auto_cal_config3,
> > > > > + EMC_AUTO_CAL_CONFIG3);
> > > > > +
> > > > > + if (timing->emc_auto_cal_config != last->emc_auto_cal_config) {
> > > > > + val = timing->emc_auto_cal_config;
> > > > > + val &= EMC_AUTO_CAL_CONFIG_AUTO_CAL_START;
> > > > > + emc_ccfifo_writel(emc, val, EMC_AUTO_CAL_CONFIG);
> > > > > + }
> > > > > +
> > > > > + /* DDR3: predict MRS long wait count */
> > > > > + if (emc->dram_type == DRAM_TYPE_DDR3 &&
> > > > > + dll_change == DLL_CHANGE_ON) {
> > > > > + u32 cnt = 512;
> > > > > +
> > > > > + if (timing->emc_zcal_interval != 0 &&
> > > > > + last->emc_zcal_interval == 0)
> > > > > + cnt -= emc->dram_num * 256;
> > > > > +
> > > > > + val = (timing->emc_mrs_wait_cnt
> > > > > + & EMC_MRS_WAIT_CNT_SHORT_WAIT_MASK)
> > > > > + >> EMC_MRS_WAIT_CNT_SHORT_WAIT_SHIFT;
> > > > > + if (cnt < val)
> > > > > + cnt = val;
> > > > > +
> > > > > + val = timing->emc_mrs_wait_cnt
> > > > > + & ~EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > > > > + val |= (cnt << EMC_MRS_WAIT_CNT_LONG_WAIT_SHIFT)
> > > > > + & EMC_MRS_WAIT_CNT_LONG_WAIT_MASK;
> > > > > +
> > > > > + writel(val, emc->regs + EMC_MRS_WAIT_CNT);
> > > > > + }
> > > > > +
> > > > > + /* DDR3: Turn off DLL and enter self-refresh */
> > > > > + if (emc->dram_type == DRAM_TYPE_DDR3 && dll_change == DLL_CHANGE_OFF)
> > > > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > > > > +
> > > > > + /* Disable refresh controller */
> > > > > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num),
> > > > > + EMC_REFCTRL);
> > > > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > > > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num) |
> > > > > + EMC_SELF_REF_CMD_ENABLED,
> > > > > + EMC_SELF_REF);
> > > > > +
> > > > > + /* Flow control marker */
> > > > > + emc_ccfifo_writel(emc, 1, EMC_STALL_THEN_EXE_AFTER_CLKCHANGE);
> > > > > +
> > > > > + /* DDR3: Exit self-refresh */
> > > > > + if (emc->dram_type == DRAM_TYPE_DDR3)
> > > > > + emc_ccfifo_writel(emc, EMC_DRAM_DEV_SEL(emc->dram_num),
> > > > > + EMC_SELF_REF);
> > > > > + emc_ccfifo_writel(emc, EMC_REFCTRL_DEV_SEL(emc->dram_num) |
> > > > > + EMC_REFCTRL_ENABLE,
> > > > > + EMC_REFCTRL);
> > > > > +
> > > > > + /* Set DRAM mode registers */
> > > > > + if (emc->dram_type == DRAM_TYPE_DDR3) {
> > > > > + if (timing->emc_mode_1 != last->emc_mode_1)
> > > > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_EMRS);
> > > > > + if (timing->emc_mode_2 != last->emc_mode_2)
> > > > > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_EMRS2);
> > > > > +
> > > > > + if (timing->emc_mode_reset != last->emc_mode_reset ||
> > > > > + dll_change == DLL_CHANGE_ON) {
> > > > > + val = timing->emc_mode_reset;
> > > > > + if (dll_change == DLL_CHANGE_ON) {
> > > > > + val |= EMC_MODE_SET_DLL_RESET;
> > > > > + val |= EMC_MODE_SET_LONG_CNT;
> > > > > + } else {
> > > > > + val &= ~EMC_MODE_SET_DLL_RESET;
> > > > > + }
> > > > > + emc_ccfifo_writel(emc, val, EMC_MRS);
> > > > > + }
> > > > > + } else {
> > > > > + if (timing->emc_mode_2 != last->emc_mode_2)
> > > > > + emc_ccfifo_writel(emc, timing->emc_mode_2, EMC_MRW2);
> > > > > + if (timing->emc_mode_1 != last->emc_mode_1)
> > > > > + emc_ccfifo_writel(emc, timing->emc_mode_1, EMC_MRW);
> > > > > + if (timing->emc_mode_4 != last->emc_mode_4)
> > > > > + emc_ccfifo_writel(emc, timing->emc_mode_4, EMC_MRW4);
> > > > > + }
> > > > > +
> > > > > + /* Issue ZCAL command if turning ZCAL on */
> > > > > + if (timing->emc_zcal_interval != 0 && last->emc_zcal_interval == 0) {
> > > > > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV0, EMC_ZQ_CAL);
> > > > > + if (emc->dram_num > 1)
> > > > > + emc_ccfifo_writel(emc, EMC_ZQ_CAL_LONG_CMD_DEV1,
> > > > > + EMC_ZQ_CAL);
> > > > > + }
> > > > > +
> > > > > + /* Write to RO register to remove stall after change */
> > > > > + emc_ccfifo_writel(emc, 0, EMC_CCFIFO_STATUS);
> > > > > +
> > > > > + /* Disable AUTO_CAL for clock change */
> > > > > + emc_seq_disable_auto_cal(emc);
> > > > > +
> > > > > + /* Read register to wait until programming has settled */
> > > > > + mc_readl(emc->mc, MC_EMEM_ADR_CFG);
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static void tegra_emc_complete_timing_change(struct tegra_emc *emc,
> > > > > + unsigned long rate)
> > > > > +{
> > > > > + struct emc_timing *timing = tegra_emc_find_timing(emc, rate);
> > > > > + struct emc_timing *last = &emc->last_timing;
> > > > > +
> > > > > + if (!timing)
> > > > > + return;
> > > > > +
> > > > > + /* Wait until the state machine has settled */
> > > > > + emc_seq_wait_clkchange(emc);
> > > > > +
> > > > > + /* Restore AUTO_CAL */
> > > > > + if (timing->emc_ctt_term_ctrl != last->emc_ctt_term_ctrl)
> > > > > + writel(timing->emc_auto_cal_interval,
> > > > > + emc->regs + EMC_AUTO_CAL_INTERVAL);
> > > > > +
> > > > > + /* Restore dynamic self-refresh */
> > > > > + if (timing->emc_cfg & EMC_CFG_PWR_MASK)
> > > > > + writel(timing->emc_cfg, emc->regs + EMC_CFG);
> > > > > +
> > > > > + /* Set ZCAL wait count */
> > > > > + writel(timing->emc_zcal_cnt_long, emc->regs + EMC_ZCAL_WAIT_CNT);
> > > > > +
> > > > > + /* Wait for timing to settle */
> > > > > + udelay(2);
> > > > > +
> > > > > + /* Reprogram SEL_DPD_CTRL */
> > > > > + writel(timing->emc_sel_dpd_ctrl, emc->regs + EMC_SEL_DPD_CTRL);
> > > > > + emc_seq_update_timing(emc);
> > > > > +
> > > > > + emc->last_timing = *timing;
> > > > > +}
> > > > > +
> > > > > +/* Initialization and deinitialization */
> > > > > +
> > > > > +static void emc_read_current_timing(struct tegra_emc *emc,
> > > > > + struct emc_timing *timing)
> > > > > +{
> > > > > + unsigned int i;
> > > > > +
> > > > > + for (i = 0; i < ARRAY_SIZE(emc_burst_regs); ++i)
> > > > > + timing->emc_burst_data[i] =
> > > > > + readl(emc->regs + emc_burst_regs[i]);
> > > > > +
> > > > > + timing->emc_cfg = readl(emc->regs + EMC_CFG);
> > > > > +
> > > > > + timing->emc_auto_cal_interval = 0;
> > > > > + timing->emc_zcal_cnt_long = 0;
> > > > > + timing->emc_mode_1 = 0;
> > > > > + timing->emc_mode_2 = 0;
> > > > > + timing->emc_mode_4 = 0;
> > > > > + timing->emc_mode_reset = 0;
> > > >
> > > > Hmm. I wonder why these aren't being read. It seems like it would be a good idea, since the some of these are checked for last_timing in the sequence.
> > > >
> > >
> > > This stems from Tegra124 emc driver, so maybe it has some sense. In
> > > any case, adding readl is not an issue whatsoever.
> > >
> >
> > Looks like they are set to zero in the downstream code as well, which still doesn't make much sense, but it does seem to work. So leaving at zero should be fine.
> >
> > > > > +}
> > > > > +
> > > > > +static int emc_init(struct tegra_emc *emc)
> > > > > +{
> > > > > + u32 emc_cfg, emc_dbg;
> > > > > + u32 intmask = EMC_REFRESH_OVERFLOW_INT;
> > > > > + const char *dram_type_str;
> > > > > +
> > > > > + emc->dram_type = readl(emc->regs + EMC_FBIO_CFG5);
> > > > > +
> > > > > + emc->dram_type &= EMC_FBIO_CFG5_DRAM_TYPE_MASK;
> > > > > + emc->dram_type >>= EMC_FBIO_CFG5_DRAM_TYPE_SHIFT;
> > > > > +
> > > > > + emc->dram_num = tegra_mc_get_emem_device_count(emc->mc);
> > > > > +
> > > > > + emc_cfg = readl_relaxed(emc->regs + EMC_CFG_2);
> > > > > +
> > > > > + /* enable EMC and CAR to handshake on PLL divider/source changes */
> > > > > + emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> > > > > +
> > > > > + /* configure clock change mode accordingly to DRAM type */
> > > > > + switch (emc->dram_type) {
> > > > > + case DRAM_TYPE_LPDDR2:
> > > > > + emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> > > > > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > > > > + break;
> > > > > +
> > > > > + default:
> > > > > + emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE;
> > > > > + emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> > > > > + break;
> > > > > + }
> > > >
> > > > This doesn't match the source trees I have (either Tegra114 or Tegra124). Those don't touch EMC_CLKCHANGE_SR_ENABLE. TRM seems to be contradictory about this. It says to leave it at reset value of DISABLED, but then later says that the reset value is ENABLED. I would err on the side of the code. In any case, I think this would be cleaner to write as an if statement
> > > >
> > > > emc_cfg |= EMC_CLKCHANGE_REQ_ENABLE;
> > > >
> > > > if (emc->dram_type == DRAM_TYPE_LPDDR2)
> > > > emc_cfg |= EMC_CLKCHANGE_PD_ENABLE;
> > > > else
> > > > emc_cfg &= ~EMC_CLKCHANGE_PD_ENABLE;
> > > >
> > >
> > > Noted. Yes, TRM in Software programming sequence on the Tegra 4 clock
> > > change sequence states Keep these register fields in reset values:
> > > CLKCHANGE_REQ_ENABLE = ENABLED
> > > CLKCHANGE_SR_ENABLE = DISABLED
> > >
> > > Hence I have added emc_cfg &= ~EMC_CLKCHANGE_SR_ENABLE
> >
> > I think it might be worth checking what the reset value actually is (by reading the register after boot). The register's section in the TRM has a different name for the field (REF_AFTER_SREF) and it says the reset value should be ENABLED, not DISABLED. The EMC_CFG_2 register is part of burst regs for Tegra124, so I checked some EMC tables and it seems the bit is always set for those tables; and for Tegra114 the code never changes the bit from reset values. So I think the programming sequence section could be wrong (perhaps the register was changed after it was written but it was never updated).
> >
>
> I have read 0x7001b000 + 0x2b8 which is EMCB + EMC_CFG_2
>
> Both U-Boot coldboot and chainload result in this:
> (bootloader) 7001b2b8: 000008c5
>
> CLKCHANGE_REQ_ENABLE - ENABLED (Bit 0)
> CLKCHANGE_PD_ENABLE - DISABLED (Bit 1)
> REF_AFTER_SREF or CLKCHANGE_SR_ENABLE - ENABLED (Bit 2)
>
> TRM description of EMC_CFG_2_0 register seems to match behavior after boot.
>
> So what should I do with CLKCHANGE_SR_ENABLE?
Thanks for checking. In that case I think safest to go with the downstream code's behavior of not modifying the value of REF_AFTER_SREF / CLKCHANGE_SR_ENABLE. Perhaps put in a comment explaining the discrepancy in the TRM.
>
> > >
> > > > > +
> > > > > + writel_relaxed(emc_cfg, emc->regs + EMC_CFG_2);
> > > > > +
> > > > > + /* initialize interrupt */
> > > > > + writel_relaxed(intmask, emc->regs + EMC_INTMASK);
> > > > > + writel_relaxed(0xffffffff, emc->regs + EMC_INTSTATUS);
> > > > > +
> > > > > + /* ensure that unwanted debug features are disabled */
> > > > > + emc_dbg = readl_relaxed(emc->regs + EMC_DBG);
> > > > > + emc_dbg |= EMC_DBG_CFG_PRIORITY;
> > > > > + emc_dbg &= ~EMC_DBG_READ_MUX_ASSEMBLY;
> > > > > + emc_dbg &= ~EMC_DBG_WRITE_MUX_ACTIVE;
> > > > > + emc_dbg &= ~EMC_DBG_FORCE_UPDATE;
> > > > > + writel_relaxed(emc_dbg, emc->regs + EMC_DBG);
> > > > > +
> > > > > + switch (emc->dram_type) {
> > > > > + case DRAM_TYPE_DDR1:
> > > > > + dram_type_str = "DDR1";
> > > > > + break;
> > > > > + case DRAM_TYPE_LPDDR2:
> > > > > + dram_type_str = "LPDDR2";
> > > > > + break;
> > > > > + case DRAM_TYPE_DDR2:
> > > > > + dram_type_str = "DDR2";
> > > > > + break;
> > > > > + case DRAM_TYPE_DDR3:
> > > > > + dram_type_str = "DDR3";
> > > > > + break;
> > > > > + }
> > > > > +
> > > > > + dev_info_once(emc->dev, "%u %s %s attached\n", emc->dram_num,
> > > > > + dram_type_str, emc->dram_num == 2 ? "devices" : "device");
> > > > > +
> > > > > + emc_read_current_timing(emc, &emc->last_timing);
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static int load_one_timing_from_dt(struct tegra_emc *emc,
> > > > > + struct emc_timing *timing,
> > > > > + struct device_node *node)
> > > > > +{
> > > > > + u32 value;
> > > > > + int err;
> > > > > +
> > > > > + err = of_property_read_u32(node, "clock-frequency", &value);
> > > > > + if (err) {
> > > > > + dev_err(emc->dev, "timing %pOFn: failed to read rate: %d\n",
> > > > > + node, err);
> > > > > + return err;
> > > > > + }
> > > > > +
> > > > > + timing->rate = value;
> > > > > +
> > > > > + err = of_property_read_u32_array(node, "nvidia,emc-configuration",
> > > > > + timing->emc_burst_data,
> > > > > + ARRAY_SIZE(timing->emc_burst_data));
> > > > > + if (err) {
> > > > > + dev_err(emc->dev,
> > > > > + "timing %pOFn: failed to read emc burst data: %d\n",
> > > > > + node, err);
> > > > > + return err;
> > > > > + }
> > > > > +
> > > > > +#define EMC_READ_PROP(prop, dtprop) { \
> > > > > + err = of_property_read_u32(node, dtprop, &timing->prop); \
> > > > > + if (err) { \
> > > > > + dev_err(emc->dev, "timing %pOFn: failed to read " #prop ": %d\n", \
> > > > > + node, err); \
> > > > > + return err; \
> > > > > + } \
> > > > > +}
> > > > > +
> > > > > + EMC_READ_PROP(emc_auto_cal_config, "nvidia,emc-auto-cal-config")
> > > > > + EMC_READ_PROP(emc_auto_cal_config2, "nvidia,emc-auto-cal-config2")
> > > > > + EMC_READ_PROP(emc_auto_cal_config3, "nvidia,emc-auto-cal-config3")
> > > > > + EMC_READ_PROP(emc_auto_cal_interval, "nvidia,emc-auto-cal-interval")
> > > > > + EMC_READ_PROP(emc_cfg, "nvidia,emc-cfg")
> > > > > + EMC_READ_PROP(emc_ctt_term_ctrl, "nvidia,emc-ctt-term-ctrl")
> > > > > + EMC_READ_PROP(emc_mode_1, "nvidia,emc-mode-1")
> > > > > + EMC_READ_PROP(emc_mode_2, "nvidia,emc-mode-2")
> > > > > + EMC_READ_PROP(emc_mode_4, "nvidia,emc-mode-4")
> > > > > + EMC_READ_PROP(emc_mode_reset, "nvidia,emc-mode-reset")
> > > > > + EMC_READ_PROP(emc_mrs_wait_cnt, "nvidia,emc-mrs-wait-cnt")
> > > > > + EMC_READ_PROP(emc_sel_dpd_ctrl, "nvidia,emc-sel-dpd-ctrl")
> > > > > + EMC_READ_PROP(emc_xm2dqspadctrl2, "nvidia,emc-xm2dqspadctrl2")
> > > > > + EMC_READ_PROP(emc_zcal_cnt_long, "nvidia,emc-zcal-cnt-long")
> > > > > + EMC_READ_PROP(emc_zcal_interval, "nvidia,emc-zcal-interval")
> > > > > +
> > > > > +#undef EMC_READ_PROP
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static int cmp_timings(const void *_a, const void *_b)
> > > > > +{
> > > > > + const struct emc_timing *a = _a;
> > > > > + const struct emc_timing *b = _b;
> > > > > +
> > > > > + if (a->rate < b->rate)
> > > > > + return -1;
> > > > > + else if (a->rate == b->rate)
> > > > > + return 0;
> > > > > + else
> > > > > + return 1;
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_load_timings_from_dt(struct tegra_emc *emc,
> > > > > + struct device_node *node)
> > > > > +{
> > > > > + int child_count = of_get_child_count(node);
> > > > > + struct device_node *child;
> > > > > + struct emc_timing *timing;
> > > > > + unsigned int i = 0;
> > > > > + int err;
> > > > > +
> > > > > + emc->timings = devm_kcalloc(emc->dev, child_count, sizeof(*timing),
> > > > > + GFP_KERNEL);
> > > > > + if (!emc->timings)
> > > > > + return -ENOMEM;
> > > > > +
> > > > > + emc->num_timings = child_count;
> > > > > +
> > > > > + for_each_child_of_node(node, child) {
> > > > > + timing = &emc->timings[i++];
> > > > > +
> > > > > + err = load_one_timing_from_dt(emc, timing, child);
> > > > > + if (err) {
> > > > > + of_node_put(child);
> > > > > + return err;
> > > > > + }
> > > > > + }
> > > > > +
> > > > > + sort(emc->timings, emc->num_timings, sizeof(*timing), cmp_timings,
> > > > > + NULL);
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static struct device_node *
> > > > > +tegra_emc_find_node_by_ram_code(struct device_node *node, u32 ram_code)
> > > > > +{
> > > > > + struct device_node *np;
> > > > > + int err;
> > > > > +
> > > > > + for_each_child_of_node(node, np) {
> > > > > + u32 value;
> > > > > +
> > > > > + err = of_property_read_u32(np, "nvidia,ram-code", &value);
> > > > > + if (err || value != ram_code)
> > > > > + continue;
> > > > > +
> > > > > + return np;
> > > > > + }
> > > > > +
> > > > > + return NULL;
> > > > > +}
> > > > > +
> > > > > +static void tegra_emc_rate_requests_init(struct tegra_emc *emc)
> > > > > +{
> > > > > + unsigned int i;
> > > > > +
> > > > > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++) {
> > > > > + emc->requested_rate[i].min_rate = 0;
> > > > > + emc->requested_rate[i].max_rate = ULONG_MAX;
> > > > > + }
> > > > > +}
> > > > > +
> > > > > +static int emc_request_rate(struct tegra_emc *emc,
> > > > > + unsigned long new_min_rate,
> > > > > + unsigned long new_max_rate,
> > > > > + enum emc_rate_request_type type)
> > > > > +{
> > > > > + struct emc_rate_request *req = emc->requested_rate;
> > > > > + unsigned long min_rate = 0, max_rate = ULONG_MAX;
> > > > > + unsigned int i;
> > > > > + int err;
> > > > > +
> > > > > + /* select minimum and maximum rates among the requested rates */
> > > > > + for (i = 0; i < EMC_RATE_TYPE_MAX; i++, req++) {
> > > > > + if (i == type) {
> > > > > + min_rate = max(new_min_rate, min_rate);
> > > > > + max_rate = min(new_max_rate, max_rate);
> > > > > + } else {
> > > > > + min_rate = max(req->min_rate, min_rate);
> > > > > + max_rate = min(req->max_rate, max_rate);
> > > > > + }
> > > > > + }
> > > > > +
> > > > > + if (min_rate > max_rate) {
> > > > > + dev_err_ratelimited(emc->dev, "%s: type %u: out of range: %lu %lu\n",
> > > > > + __func__, type, min_rate, max_rate);
> > > > > + return -ERANGE;
> > > > > + }
> > > > > +
> > > > > + /*
> > > > > + * EMC rate-changes should go via OPP API because it manages voltage
> > > > > + * changes.
> > > > > + */
> > > > > + err = dev_pm_opp_set_rate(emc->dev, min_rate);
> > > > > + if (err)
> > > > > + return err;
> > > > > +
> > > > > + emc->requested_rate[type].min_rate = new_min_rate;
> > > > > + emc->requested_rate[type].max_rate = new_max_rate;
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static int emc_set_min_rate(struct tegra_emc *emc, unsigned long rate,
> > > > > + enum emc_rate_request_type type)
> > > > > +{
> > > > > + struct emc_rate_request *req = &emc->requested_rate[type];
> > > > > + int ret;
> > > > > +
> > > > > + mutex_lock(&emc->rate_lock);
> > > > > + ret = emc_request_rate(emc, rate, req->max_rate, type);
> > > > > + mutex_unlock(&emc->rate_lock);
> > > > > +
> > > > > + return ret;
> > > > > +}
> > > > > +
> > > > > +static int emc_set_max_rate(struct tegra_emc *emc, unsigned long rate,
> > > > > + enum emc_rate_request_type type)
> > > > > +{
> > > > > + struct emc_rate_request *req = &emc->requested_rate[type];
> > > > > + int ret;
> > > > > +
> > > > > + mutex_lock(&emc->rate_lock);
> > > > > + ret = emc_request_rate(emc, req->min_rate, rate, type);
> > > > > + mutex_unlock(&emc->rate_lock);
> > > > > +
> > > > > + return ret;
> > > > > +}
> > > > > +
> > > > > +/*
> > > > > + * debugfs interface
> > > > > + *
> > > > > + * The memory controller driver exposes some files in debugfs that can be used
> > > > > + * to control the EMC frequency. The top-level directory can be found here:
> > > > > + *
> > > > > + * /sys/kernel/debug/emc
> > > > > + *
> > > > > + * It contains the following files:
> > > > > + *
> > > > > + * - available_rates: This file contains a list of valid, space-separated
> > > > > + * EMC frequencies.
> > > > > + *
> > > > > + * - min_rate: Writing a value to this file sets the given frequency as the
> > > > > + * floor of the permitted range. If this is higher than the currently
> > > > > + * configured EMC frequency, this will cause the frequency to be
> > > > > + * increased so that it stays within the valid range.
> > > > > + *
> > > > > + * - max_rate: Similarly to the min_rate file, writing a value to this file
> > > > > + * sets the given frequency as the ceiling of the permitted range. If
> > > > > + * the value is lower than the currently configured EMC frequency, this
> > > > > + * will cause the frequency to be decreased so that it stays within the
> > > > > + * valid range.
> > > > > + */
> > > > > +
> > > > > +static bool tegra_emc_validate_rate(struct tegra_emc *emc, unsigned long rate)
> > > > > +{
> > > > > + unsigned int i;
> > > > > +
> > > > > + for (i = 0; i < emc->num_timings; i++)
> > > > > + if (rate == emc->timings[i].rate)
> > > > > + return true;
> > > > > +
> > > > > + return false;
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_debug_available_rates_show(struct seq_file *s,
> > > > > + void *data)
> > > > > +{
> > > > > + struct tegra_emc *emc = s->private;
> > > > > + const char *prefix = "";
> > > > > + unsigned int i;
> > > > > +
> > > > > + for (i = 0; i < emc->num_timings; i++) {
> > > > > + seq_printf(s, "%s%lu", prefix, emc->timings[i].rate);
> > > > > + prefix = " ";
> > > > > + }
> > > > > +
> > > > > + seq_puts(s, "\n");
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +DEFINE_SHOW_ATTRIBUTE(tegra_emc_debug_available_rates);
> > > > > +
> > > > > +static int tegra_emc_debug_min_rate_get(void *data, u64 *rate)
> > > > > +{
> > > > > + struct tegra_emc *emc = data;
> > > > > +
> > > > > + *rate = emc->debugfs.min_rate;
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_debug_min_rate_set(void *data, u64 rate)
> > > > > +{
> > > > > + struct tegra_emc *emc = data;
> > > > > + int err;
> > > > > +
> > > > > + if (!tegra_emc_validate_rate(emc, rate))
> > > > > + return -EINVAL;
> > > > > +
> > > > > + err = emc_set_min_rate(emc, rate, EMC_RATE_DEBUG);
> > > > > + if (err < 0)
> > > > > + return err;
> > > > > +
> > > > > + emc->debugfs.min_rate = rate;
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_min_rate_fops,
> > > > > + tegra_emc_debug_min_rate_get,
> > > > > + tegra_emc_debug_min_rate_set, "%llu\n");
> > > > > +
> > > > > +static int tegra_emc_debug_max_rate_get(void *data, u64 *rate)
> > > > > +{
> > > > > + struct tegra_emc *emc = data;
> > > > > +
> > > > > + *rate = emc->debugfs.max_rate;
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_debug_max_rate_set(void *data, u64 rate)
> > > > > +{
> > > > > + struct tegra_emc *emc = data;
> > > > > + int err;
> > > > > +
> > > > > + if (!tegra_emc_validate_rate(emc, rate))
> > > > > + return -EINVAL;
> > > > > +
> > > > > + err = emc_set_max_rate(emc, rate, EMC_RATE_DEBUG);
> > > > > + if (err < 0)
> > > > > + return err;
> > > > > +
> > > > > + emc->debugfs.max_rate = rate;
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +DEFINE_DEBUGFS_ATTRIBUTE(tegra_emc_debug_max_rate_fops,
> > > > > + tegra_emc_debug_max_rate_get,
> > > > > + tegra_emc_debug_max_rate_set, "%llu\n");
> > > > > +
> > > > > +static void emc_debugfs_init(struct device *dev, struct tegra_emc *emc)
> > > > > +{
> > > > > + unsigned int i;
> > > > > + int err;
> > > > > +
> > > > > + emc->debugfs.min_rate = ULONG_MAX;
> > > > > + emc->debugfs.max_rate = 0;
> > > > > +
> > > > > + for (i = 0; i < emc->num_timings; i++) {
> > > > > + if (emc->timings[i].rate < emc->debugfs.min_rate)
> > > > > + emc->debugfs.min_rate = emc->timings[i].rate;
> > > > > +
> > > > > + if (emc->timings[i].rate > emc->debugfs.max_rate)
> > > > > + emc->debugfs.max_rate = emc->timings[i].rate;
> > > > > + }
> > > > > +
> > > > > + if (!emc->num_timings) {
> > > > > + emc->debugfs.min_rate = clk_get_rate(emc->clk);
> > > > > + emc->debugfs.max_rate = emc->debugfs.min_rate;
> > > > > + }
> > > > > +
> > > > > + err = clk_set_rate_range(emc->clk, emc->debugfs.min_rate,
> > > > > + emc->debugfs.max_rate);
> > > > > + if (err < 0) {
> > > > > + dev_err(dev, "failed to set rate range [%lu-%lu] for %pC\n",
> > > > > + emc->debugfs.min_rate, emc->debugfs.max_rate,
> > > > > + emc->clk);
> > > > > + return;
> > > > > + }
> > > > > +
> > > > > + emc->debugfs.root = debugfs_create_dir("emc", NULL);
> > > > > +
> > > > > + debugfs_create_file("available_rates", 0444, emc->debugfs.root, emc,
> > > > > + &tegra_emc_debug_available_rates_fops);
> > > > > + debugfs_create_file("min_rate", 0644, emc->debugfs.root,
> > > > > + emc, &tegra_emc_debug_min_rate_fops);
> > > > > + debugfs_create_file("max_rate", 0644, emc->debugfs.root,
> > > > > + emc, &tegra_emc_debug_max_rate_fops);
> > > > > +}
> > > > > +
> > > > > +static inline struct tegra_emc *
> > > > > +to_tegra_emc_provider(struct icc_provider *provider)
> > > > > +{
> > > > > + return container_of(provider, struct tegra_emc, provider);
> > > > > +}
> > > > > +
> > > > > +static struct icc_node_data *
> > > > > +emc_of_icc_xlate_extended(const struct of_phandle_args *spec, void *data)
> > > > > +{
> > > > > + struct icc_provider *provider = data;
> > > > > + struct icc_node_data *ndata;
> > > > > + struct icc_node *node;
> > > > > +
> > > > > + /* External Memory is the only possible ICC route */
> > > > > + list_for_each_entry(node, &provider->nodes, node_list) {
> > > > > + if (node->id != TEGRA_ICC_EMEM)
> > > > > + continue;
> > > > > +
> > > > > + ndata = kzalloc(sizeof(*ndata), GFP_KERNEL);
> > > > > + if (!ndata)
> > > > > + return ERR_PTR(-ENOMEM);
> > > > > +
> > > > > + /*
> > > > > + * SRC and DST nodes should have matching TAG in order to have
> > > > > + * it set by default for a requested path.
> > > > > + */
> > > > > + ndata->tag = TEGRA_MC_ICC_TAG_ISO;
> > > > > + ndata->node = node;
> > > > > +
> > > > > + return ndata;
> > > > > + }
> > > > > +
> > > > > + return ERR_PTR(-EPROBE_DEFER);
> > > > > +}
> > > > > +
> > > > > +static int emc_icc_set(struct icc_node *src, struct icc_node *dst)
> > > > > +{
> > > > > + struct tegra_emc *emc = to_tegra_emc_provider(dst->provider);
> > > > > + unsigned long long peak_bw = icc_units_to_bps(dst->peak_bw);
> > > > > + unsigned long long avg_bw = icc_units_to_bps(dst->avg_bw);
> > > > > + unsigned long long rate = max(avg_bw, peak_bw);
> > > > > + unsigned int dram_data_bus_width_bytes = 4;
> > > > > + const unsigned int ddr = 2;
> > > > > + int err;
> > > > > +
> > > > > + /*
> > > > > + * Tegra114 EMC runs on a clock rate of SDRAM bus. This means that
> > > > > + * EMC clock rate is twice smaller than the peak data rate because
> > > > > + * data is sampled on both EMC clock edges.
> > > > > + */
> > > > > + do_div(rate, ddr * dram_data_bus_width_bytes);
> > > > > + rate = min_t(u64, rate, U32_MAX);
> > > > > +
> > > > > + err = emc_set_min_rate(emc, rate, EMC_RATE_ICC);
> > > > > + if (err)
> > > > > + return err;
> > > > > +
> > > > > + return 0;
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_interconnect_init(struct tegra_emc *emc)
> > > > > +{
> > > > > + const struct tegra_mc_soc *soc = emc->mc->soc;
> > > > > + struct icc_node *node;
> > > > > + int err;
> > > > > +
> > > > > + emc->provider.dev = emc->dev;
> > > > > + emc->provider.set = emc_icc_set;
> > > > > + emc->provider.data = &emc->provider;
> > > > > + emc->provider.aggregate = soc->icc_ops->aggregate;
> > > > > + emc->provider.xlate_extended = emc_of_icc_xlate_extended;
> > > > > +
> > > > > + icc_provider_init(&emc->provider);
> > > > > +
> > > > > + /* create External Memory Controller node */
> > > > > + node = icc_node_create(TEGRA_ICC_EMC);
> > > > > + if (IS_ERR(node)) {
> > > > > + err = PTR_ERR(node);
> > > > > + goto err_msg;
> > > > > + }
> > > > > +
> > > > > + node->name = "External Memory Controller";
> > > > > + icc_node_add(node, &emc->provider);
> > > > > +
> > > > > + /* link External Memory Controller to External Memory (DRAM) */
> > > > > + err = icc_link_create(node, TEGRA_ICC_EMEM);
> > > > > + if (err)
> > > > > + goto remove_nodes;
> > > > > +
> > > > > + /* create External Memory node */
> > > > > + node = icc_node_create(TEGRA_ICC_EMEM);
> > > > > + if (IS_ERR(node)) {
> > > > > + err = PTR_ERR(node);
> > > > > + goto remove_nodes;
> > > > > + }
> > > > > +
> > > > > + node->name = "External Memory (DRAM)";
> > > > > + icc_node_add(node, &emc->provider);
> > > > > +
> > > > > + err = icc_provider_register(&emc->provider);
> > > > > + if (err)
> > > > > + goto remove_nodes;
> > > > > +
> > > > > + return 0;
> > > > > +
> > > > > +remove_nodes:
> > > > > + icc_nodes_remove(&emc->provider);
> > > > > +err_msg:
> > > > > + dev_err(emc->dev, "failed to initialize ICC: %d\n", err);
> > > > > +
> > > > > + return err;
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_opp_table_init(struct tegra_emc *emc)
> > >
> > > In v4 I will switch to devm_tegra_core_dev_init_opp_table used in
> > > tegra30 emc with required adjustments to it if you don't mind.
> >
> > Sounds good.
> >
> > >
> > > > > +{
> > > > > + u32 hw_version = BIT(tegra_sku_info.soc_speedo_id);
> > > > > + int opp_token, err;
> > > > > +
> > > > > + err = dev_pm_opp_set_supported_hw(emc->dev, &hw_version, 1);
> > > > > + if (err < 0) {
> > > > > + dev_err(emc->dev, "failed to set OPP supported HW: %d\n", err);
> > > > > + return err;
> > > > > + }
> > > > > + opp_token = err;
> > > > > +
> > > > > + err = dev_pm_opp_of_add_table(emc->dev);
> > > > > + if (err) {
> > > > > + if (err == -ENODEV)
> > > > > + dev_err(emc->dev, "OPP table not found, please update your device tree\n");
> > > > > + else
> > > > > + dev_err(emc->dev, "failed to add OPP table: %d\n", err);
> > > > > +
> > > > > + goto put_hw_table;
> > > > > + }
> > > > > +
> > > > > + dev_info_once(emc->dev, "OPP HW ver. 0x%x, current clock rate %lu MHz\n",
> > > > > + hw_version, clk_get_rate(emc->clk) / 1000000);
> > > > > +
> > > > > + /* first dummy rate-set initializes voltage state */
> > > > > + err = dev_pm_opp_set_rate(emc->dev, clk_get_rate(emc->clk));
> > > > > + if (err) {
> > > > > + dev_err(emc->dev, "failed to initialize OPP clock: %d\n", err);
> > > > > + goto remove_table;
> > > > > + }
> > > > > +
> > > > > + return 0;
> > > > > +
> > > > > +remove_table:
> > > > > + dev_pm_opp_of_remove_table(emc->dev);
> > > > > +put_hw_table:
> > > > > + dev_pm_opp_put_supported_hw(opp_token);
> > > > > +
> > > > > + return err;
> > > > > +}
> > > > > +
> > > > > +static void devm_tegra_emc_unset_callback(void *data)
> > > > > +{
> > > > > + tegra124_clk_set_emc_callbacks(NULL, NULL);
> > > > > +}
> > > > > +
> > > > > +static int tegra_emc_probe(struct platform_device *pdev)
> > > > > +{
> > > > > + struct device_node *np;
> > > > > + struct tegra_emc *emc;
> > > > > + u32 ram_code;
> > > > > + int err;
> > > > > +
> > > > > + emc = devm_kzalloc(&pdev->dev, sizeof(*emc), GFP_KERNEL);
> > > > > + if (!emc)
> > > > > + return -ENOMEM;
> > > > > +
> > > > > + mutex_init(&emc->rate_lock);
> > > > > + emc->dev = &pdev->dev;
> > > > > +
> > > > > + emc->regs = devm_platform_ioremap_resource(pdev, 0);
> > > > > + if (IS_ERR(emc->regs))
> > > > > + return PTR_ERR(emc->regs);
> > > > > +
> > > > > + emc->mc = devm_tegra_memory_controller_get(&pdev->dev);
> > > > > + if (IS_ERR(emc->mc))
> > > > > + return PTR_ERR(emc->mc);
> > > > > +
> > > > > + ram_code = tegra_read_ram_code();
> > > > > +
> > > > > + np = tegra_emc_find_node_by_ram_code(pdev->dev.of_node, ram_code);
> > > > > + if (np) {
> > > > > + err = tegra_emc_load_timings_from_dt(emc, np);
> > > > > + of_node_put(np);
> > > > > + if (err)
> > > > > + return err;
> > > > > + } else {
> > > > > + dev_info_once(&pdev->dev,
> > > > > + "no memory timings for RAM code %u found in DT\n",
> > > > > + ram_code);
> > > > > + }
> > > > > +
> > > > > + err = emc_init(emc);
> > > > > + if (err) {
> > > > > + dev_err(&pdev->dev, "EMC initialization failed: %d\n", err);
> > > > > + return err;
> > > > > + }
> > > > > +
> > > > > + platform_set_drvdata(pdev, emc);
> > > > > +
> > > > > + tegra124_clk_set_emc_callbacks(tegra_emc_prepare_timing_change,
> > > > > + tegra_emc_complete_timing_change);
> > > > > +
> > > > > + err = devm_add_action_or_reset(&pdev->dev, devm_tegra_emc_unset_callback,
> > > > > + NULL);
> > > > > + if (err)
> > > > > + return err;
> > > > > +
> > > > > + err = platform_get_irq(pdev, 0);
> > > > > + if (err < 0)
> > > > > + return err;
> > > > > +
> > > > > + emc->irq = err;
> > > > > +
> > > > > + err = devm_request_irq(&pdev->dev, emc->irq, tegra_emc_isr, 0,
> > > > > + dev_name(&pdev->dev), emc);
> > > > > + if (err) {
> > > > > + dev_err(&pdev->dev, "failed to request irq: %d\n", err);
> > > > > + return err;
> > > > > + }
> > > > > +
> > > > > + emc->clk = devm_clk_get(&pdev->dev, "emc");
> > > > > + if (IS_ERR(emc->clk)) {
> > > > > + err = PTR_ERR(emc->clk);
> > > > > + dev_err(&pdev->dev, "failed to get EMC clock: %d\n", err);
> > > > > + return err;
> > > > > + }
> > > > > +
> > > > > + err = tegra_emc_opp_table_init(emc);
> > > > > + if (err)
> > > > > + return err;
> > > > > +
> > > > > + tegra_emc_rate_requests_init(emc);
> > > > > +
> > > > > + if (IS_ENABLED(CONFIG_DEBUG_FS))
> > > > > + emc_debugfs_init(&pdev->dev, emc);
> > > > > +
> > > > > + tegra_emc_interconnect_init(emc);
> > > > > +
> > > > > + /*
> > > > > + * Don't allow the kernel module to be unloaded. Unloading adds some
> > > > > + * extra complexity which doesn't really worth the effort in a case of
> > > > > + * this driver.
> > > > > + */
> > > > > + try_module_get(THIS_MODULE);
> > > > > +
> > > > > + return 0;
> > > > > +};
> > > > > +
> > > > > +static const struct of_device_id tegra_emc_of_match[] = {
> > > > > + { .compatible = "nvidia,tegra114-emc" },
> > > > > + {}
> > > > > +};
> > > > > +MODULE_DEVICE_TABLE(of, tegra_emc_of_match);
> > > > > +
> > > > > +static struct platform_driver tegra_emc_driver = {
> > > > > + .probe = tegra_emc_probe,
> > > > > + .driver = {
> > > > > + .name = "tegra114-emc",
> > > > > + .of_match_table = tegra_emc_of_match,
> > > > > + .suppress_bind_attrs = true,
> > > > > + .sync_state = icc_sync_state,
> > > > > + },
> > > > > +};
> > > > > +module_platform_driver(tegra_emc_driver);
> > > > > +
> > > > > +MODULE_AUTHOR("Svyatoslav Ryhel <clamor95@gmail.com>");
> > > > > +MODULE_DESCRIPTION("NVIDIA Tegra114 EMC driver");
> > > > > +MODULE_LICENSE("GPL");
> > > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114
2025-09-21 17:54 ` Stephen Boyd
2025-11-13 14:21 ` Svyatoslav Ryhel
@ 2025-11-25 10:21 ` Svyatoslav Ryhel
1 sibling, 0 replies; 32+ messages in thread
From: Svyatoslav Ryhel @ 2025-11-25 10:21 UTC (permalink / raw)
To: Stephen Boyd
Cc: Chanwoo Choi, Conor Dooley, Dmitry Osipenko, Jonathan Hunter,
Krzysztof Kozlowski, Kyungmin Park, Michael Turquette,
Mikko Perttunen, MyungJoo Ham, Prashant Gaikwad, Rob Herring,
Thierry Reding, Thierry Reding, linux-kernel, devicetree,
linux-tegra, linux-clk, linux-pm
нд, 21 вер. 2025 р. о 20:54 Stephen Boyd <sboyd@kernel.org> пише:
>
> Quoting Svyatoslav Ryhel (2025-09-15 01:01:52)
> > diff --git a/drivers/clk/tegra/clk-tegra114.c b/drivers/clk/tegra/clk-tegra114.c
> > index 8bde72aa5e68..6b3a140772c2 100644
> > --- a/drivers/clk/tegra/clk-tegra114.c
> > +++ b/drivers/clk/tegra/clk-tegra114.c
> > @@ -1321,6 +1309,28 @@ static int tegra114_reset_deassert(unsigned long id)
> > return 0;
> > }
> >
> > +#ifdef CONFIG_TEGRA124_CLK_EMC
> > +static struct clk *tegra114_clk_src_onecell_get(struct of_phandle_args *clkspec,
> > + void *data)
> > +{
> > + struct clk_hw *hw;
> > + struct clk *clk;
> > +
> > + clk = of_clk_src_onecell_get(clkspec, data);
> > + if (IS_ERR(clk))
> > + return clk;
> > +
> > + hw = __clk_get_hw(clk);
>
> Can you just use of_clk_hw_onecell_get() instead? Then we don't need to
> use __clk_get_hw(). Or is this whole function used to return a clk
> pointer to something that isn't the clk framework?
>
I have tried to switch __clk_get_hw to of_clk_hw_onecell_get but it
did not work, tegra124_clk_emc_driver_available fails and I get
EPROBE_DEFER cascade. I will keep __clk_get_hw like Tegra124 driver
does since of_clk_hw_onecell_get did not worked in this case.
> > +
> > + if (clkspec->args[0] == TEGRA114_CLK_EMC) {
> > + if (!tegra124_clk_emc_driver_available(hw))
> > + return ERR_PTR(-EPROBE_DEFER);
> > + }
> > +
> > + return clk;
^ permalink raw reply [flat|nested] 32+ messages in thread
* Re: [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller
2025-09-24 15:24 ` Rob Herring
@ 2025-12-01 14:18 ` Thierry Reding
0 siblings, 0 replies; 32+ messages in thread
From: Thierry Reding @ 2025-12-01 14:18 UTC (permalink / raw)
To: Rob Herring
Cc: Svyatoslav Ryhel, Krzysztof Kozlowski, Conor Dooley,
Thierry Reding, Jonathan Hunter, Prashant Gaikwad,
Mikko Perttunen, Michael Turquette, Stephen Boyd, Dmitry Osipenko,
MyungJoo Ham, Kyungmin Park, Chanwoo Choi, linux-kernel,
devicetree, linux-tegra, linux-clk, linux-pm
[-- Attachment #1: Type: text/plain, Size: 6261 bytes --]
On Wed, Sep 24, 2025 at 10:24:30AM -0500, Rob Herring wrote:
> On Mon, Sep 22, 2025 at 07:18:00PM +0300, Svyatoslav Ryhel wrote:
> > пн, 22 вер. 2025 р. о 19:00 Rob Herring <robh@kernel.org> пише:
> > >
> > > On Mon, Sep 15, 2025 at 11:01:49AM +0300, Svyatoslav Ryhel wrote:
> > > > Add Tegra114 support into existing Tegra124 MC schema with the most
> > > > notable difference in the amount of EMEM timings.
> > > >
> > > > Signed-off-by: Svyatoslav Ryhel <clamor95@gmail.com>
> > > > ---
> > > > .../nvidia,tegra124-mc.yaml | 97 ++++++++++++++-----
> > > > 1 file changed, 74 insertions(+), 23 deletions(-)
> > > >
> > > > diff --git a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > > > index 7b18b4d11e0a..9cc9360d3bd0 100644
> > > > --- a/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > > > +++ b/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra124-mc.yaml
> > > > @@ -19,7 +19,9 @@ description: |
> > > >
> > > > properties:
> > > > compatible:
> > > > - const: nvidia,tegra124-mc
> > > > + enum:
> > > > + - nvidia,tegra114-mc
> > > > + - nvidia,tegra124-mc
> > > >
> > > > reg:
> > > > maxItems: 1
> > > > @@ -64,29 +66,10 @@ patternProperties:
> > > >
> > > > nvidia,emem-configuration:
> > > > $ref: /schemas/types.yaml#/definitions/uint32-array
> > > > - description: |
> > > > + description:
> > > > Values to be written to the EMEM register block. See section
> > > > - "15.6.1 MC Registers" in the TRM.
> > > > - items:
> > > > - - description: MC_EMEM_ARB_CFG
> > > > - - description: MC_EMEM_ARB_OUTSTANDING_REQ
> > > > - - description: MC_EMEM_ARB_TIMING_RCD
> > > > - - description: MC_EMEM_ARB_TIMING_RP
> > > > - - description: MC_EMEM_ARB_TIMING_RC
> > > > - - description: MC_EMEM_ARB_TIMING_RAS
> > > > - - description: MC_EMEM_ARB_TIMING_FAW
> > > > - - description: MC_EMEM_ARB_TIMING_RRD
> > > > - - description: MC_EMEM_ARB_TIMING_RAP2PRE
> > > > - - description: MC_EMEM_ARB_TIMING_WAP2PRE
> > > > - - description: MC_EMEM_ARB_TIMING_R2R
> > > > - - description: MC_EMEM_ARB_TIMING_W2W
> > > > - - description: MC_EMEM_ARB_TIMING_R2W
> > > > - - description: MC_EMEM_ARB_TIMING_W2R
> > > > - - description: MC_EMEM_ARB_DA_TURNS
> > > > - - description: MC_EMEM_ARB_DA_COVERS
> > > > - - description: MC_EMEM_ARB_MISC0
> > > > - - description: MC_EMEM_ARB_MISC1
> > > > - - description: MC_EMEM_ARB_RING1_THROTTLE
> > > > + "20.11.1 MC Registers" in the Tegea114 TRM or
> > > > + "15.6.1 MC Registers" in the Tegra124 TRM.
> > > >
> > > > required:
> > > > - clock-frequency
> > > > @@ -109,6 +92,74 @@ required:
> > > > - "#iommu-cells"
> > > > - "#interconnect-cells"
> > > >
> > > > +allOf:
> > > > + - if:
> > > > + properties:
> > > > + compatible:
> > > > + contains:
> > > > + enum:
> > > > + - nvidia,tegra114-mc
> > > > + then:
> > > > + patternProperties:
> > > > + "^emc-timings-[0-9]+$":
> > > > + patternProperties:
> > > > + "^timing-[0-9]+$":
> > > > + properties:
> > > > + nvidia,emem-configuration:
> > > > + items:
> > > > + - description: MC_EMEM_ARB_CFG
> > > > + - description: MC_EMEM_ARB_OUTSTANDING_REQ
> > > > + - description: MC_EMEM_ARB_TIMING_RCD
> > > > + - description: MC_EMEM_ARB_TIMING_RP
> > > > + - description: MC_EMEM_ARB_TIMING_RC
> > > > + - description: MC_EMEM_ARB_TIMING_RAS
> > > > + - description: MC_EMEM_ARB_TIMING_FAW
> > > > + - description: MC_EMEM_ARB_TIMING_RRD
> > > > + - description: MC_EMEM_ARB_TIMING_RAP2PRE
> > > > + - description: MC_EMEM_ARB_TIMING_WAP2PRE
> > > > + - description: MC_EMEM_ARB_TIMING_R2R
> > > > + - description: MC_EMEM_ARB_TIMING_W2W
> > > > + - description: MC_EMEM_ARB_TIMING_R2W
> > > > + - description: MC_EMEM_ARB_TIMING_W2R
> > > > + - description: MC_EMEM_ARB_DA_TURNS
> > > > + - description: MC_EMEM_ARB_DA_COVERS
> > > > + - description: MC_EMEM_ARB_MISC0
> > > > + - description: MC_EMEM_ARB_RING1_THROTTLE
> > >
> > > Like I said before, I don't think it is worth enumerating the list of
> > > registers for every variant. If you want to define the length
> > > (minItems/maxItems), then that is fine.
> > >
> >
> > It worth because position of value matters when reading and list above
> > provides a reference to the order in which register values should be
> > grouped.
>
> The schema does nothing to validate that. The only thing that gets
> validated is the length. It is just an opaque blob of data. I'm sure you
> have to define the order in the driver as well. One place is enough.
Hi Rob,
Sorry for being so late on this, but I just noticed that v4 had dropped
these items descriptions and then saw that you had suggested this. I
have always found the explicit mention useful because it allows DT
writers to know what to put into the properties without having to look
up a specific implementation.
If the DT bindings don't specify the order, then how do we guarantee
that all implementations agree on the order? While it's true that no
validation is done via the schema, the schema is the only specification
that we have for this. Without it there is no reason for an
implementation to pick one order over another.
Thierry
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
^ permalink raw reply [flat|nested] 32+ messages in thread
end of thread, other threads:[~2025-12-01 14:18 UTC | newest]
Thread overview: 32+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-09-15 8:01 [PATCH v3 00/11] Tegra114: implement EMC support Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 01/11] devfreq: tegra30-devfreq: add support for Tegra114 Svyatoslav Ryhel
2025-11-11 8:55 ` Mikko Perttunen
2025-11-11 13:34 ` Svyatoslav Ryhel
2025-11-13 4:20 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 02/11] ARM: tegra: Add ACTMON node to Tegra114 device tree Svyatoslav Ryhel
2025-11-11 9:00 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 03/11] dt-bindings: memory: Document Tegra114 Memory Controller Svyatoslav Ryhel
2025-09-22 16:00 ` Rob Herring
2025-09-22 16:18 ` Svyatoslav Ryhel
2025-09-24 15:24 ` Rob Herring
2025-12-01 14:18 ` Thierry Reding
2025-09-15 8:01 ` [PATCH v3 04/11] memory: tegra: implement EMEM regs and ICC ops for Tegra114 Svyatoslav Ryhel
2025-11-13 4:36 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 05/11] dt-bindings: memory: Add Tegra114 memory client IDs Svyatoslav Ryhel
2025-11-13 4:47 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 06/11] clk: tegra: remove EMC to MC clock mux in Tegra114 Svyatoslav Ryhel
2025-09-21 17:54 ` Stephen Boyd
2025-11-13 14:21 ` Svyatoslav Ryhel
2025-11-25 10:21 ` Svyatoslav Ryhel
2025-11-13 5:05 ` Mikko Perttunen
2025-11-13 14:29 ` Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 07/11] dt-bindings: memory: Document Tegra114 External Memory Controller Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 08/11] memory: tegra: Add Tegra114 EMC driver Svyatoslav Ryhel
2025-11-18 7:08 ` Mikko Perttunen
2025-11-18 8:05 ` Svyatoslav Ryhel
2025-11-21 4:03 ` Mikko Perttunen
2025-11-21 8:54 ` Svyatoslav Ryhel
2025-11-25 3:29 ` Mikko Perttunen
2025-09-15 8:01 ` [PATCH v3 09/11] ARM: tegra: Add External Memory Controller node on Tegra114 Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 10/11] ARM: tegra: Add EMC OPP and ICC properties to Tegra114 EMC and ACTMON device-tree nodes Svyatoslav Ryhel
2025-09-15 8:01 ` [PATCH v3 11/11] ARM: tegra: add DC interconnections for Tegra114 Svyatoslav Ryhel
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).