From: Christoph Hellwig <hch@lst.de> To: iommu@lists.linux-foundation.org Cc: linux-mips@linux-mips.org, linux-ia64@vger.kernel.org, linux-sh@vger.kernel.org, sparclinux@vger.kernel.org, Guan Xuetao <gxt@mprc.pku.edu.cn>, linux-arch@vger.kernel.org, linux-s390@vger.kernel.org, linux-c6x-dev@linux-c6x.org, linux-hexagon@vger.kernel.org, x86@kernel.org, linux-snps-arc@lists.infradead.org, adi-buildroot-devel@lists.sourceforge.net, linux-m68k@lists.linux-m68k.org, patches@groups.riscv.org, linux-metag@vger.kernel.org, linux-arm-kernel@lists.infradead.org, Michal Simek <monstr@monstr.eu>, linux-parisc@vger.kernel.org, linux-cris-kernel@axis.com, linux-kernel@vger.kernel.org, linux-alpha@vger.kernel.org, linuxppc-dev@lists.ozlabs.org Subject: consolidate direct dma mapping and swiotlb support Date: Fri, 29 Dec 2017 09:18:04 +0100 [thread overview] Message-ID: <20171229081911.2802-1-hch@lst.de> (raw) Almost every architecture supports a direct dma mapping implementation, where no iommu is used and the device dma address is a 1:1 mapping to the physical address or has a simple linear offset. Currently the code for this implementation is most duplicated over the architectures, and the duplicated again in the swiotlb code, and then duplicated again for special cases like the x86 memory encryption DMA ops. This series takes the existing very simple dma-noop dma mapping implementation, enhances it with all the x86 features and quirks, and creates a common set of architecture hooks for it and the swiotlb code. It then switches a large number of architectures to this generic direct map implement and the new generic swiotlb dma_map ops. Note that for now this only handles architectures that do cache coherent DMA, but a similar consolidation for non-coherent architectures is in the work for later merge windows.
WARNING: multiple messages have this Message-ID (diff)
From: Christoph Hellwig <hch@lst.de> To: iommu@lists.linux-foundation.org Cc: linux-alpha@vger.kernel.org, linux-snps-arc@lists.infradead.org, linux-arm-kernel@lists.infradead.org, adi-buildroot-devel@lists.sourceforge.net, linux-c6x-dev@linux-c6x.org, linux-cris-kernel@axis.com, linux-hexagon@vger.kernel.org, linux-ia64@vger.kernel.org, linux-m68k@lists.linux-m68k.org, linux-metag@vger.kernel.org, Michal Simek <monstr@monstr.eu>, linux-mips@linux-mips.org, linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, patches@groups.riscv.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, sparclinux@vger.kernel.org, Guan Xuetao <gxt@mprc.pku.edu.cn>, x86@kernel.org, linux-arch@vger.kernel.org, linux-kernel@vger.kernel.org Subject: consolidate direct dma mapping and swiotlb support Date: Fri, 29 Dec 2017 09:18:04 +0100 [thread overview] Message-ID: <20171229081911.2802-1-hch@lst.de> (raw) Message-ID: <20171229081804.GqI5LJMsl2cz9U2o5yrDiEjFN4Ey5oU3_VZpwJgNjCM@z> (raw) Almost every architecture supports a direct dma mapping implementation, where no iommu is used and the device dma address is a 1:1 mapping to the physical address or has a simple linear offset. Currently the code for this implementation is most duplicated over the architectures, and the duplicated again in the swiotlb code, and then duplicated again for special cases like the x86 memory encryption DMA ops. This series takes the existing very simple dma-noop dma mapping implementation, enhances it with all the x86 features and quirks, and creates a common set of architecture hooks for it and the swiotlb code. It then switches a large number of architectures to this generic direct map implement and the new generic swiotlb dma_map ops. Note that for now this only handles architectures that do cache coherent DMA, but a similar consolidation for non-coherent architectures is in the work for later merge windows.
next reply other threads:[~2017-12-29 8:18 UTC|newest] Thread overview: 191+ messages / expand[flat|nested] mbox.gz Atom feed top 2017-12-29 8:18 Christoph Hellwig [this message] 2017-12-29 8:18 ` consolidate direct dma mapping and swiotlb support Christoph Hellwig [not found] ` <20171229081911.2802-1-hch-jcswGhMUV9g@public.gmane.org> 2017-12-29 8:18 ` [PATCH 01/67] x86: remove X86_PPRO_FENCE Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 02/67] alpha: mark jensen as broken Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 10:36 ` Geert Uytterhoeven 2018-01-02 10:36 ` Geert Uytterhoeven 2018-01-04 8:53 ` Christoph Hellwig 2018-01-04 8:53 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 04/67] arm64: don't override dma_max_pfn Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 05/67] dma-mapping: replace PCI_DMA_BUS_IS_PHYS with a flag in struct dma_map_ops Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 10:39 ` Geert Uytterhoeven 2018-01-02 10:39 ` Geert Uytterhoeven 2018-01-09 15:55 ` Jesper Nilsson 2018-01-09 15:55 ` Jesper Nilsson 2017-12-29 8:18 ` [PATCH 07/67] m32r: remove unused flush_write_buffers definition Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 08/67] powerpc: " Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 10/67] m32r: remove the unused dma_capable helper Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 12/67] s390: " Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 15/67] hexagon: use the generic " Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 16/67] powerpc: rename dma_direct_ to dma_nommu_ Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig [not found] ` <20171229081911.2802-17-hch-jcswGhMUV9g@public.gmane.org> 2018-01-02 9:45 ` Michael Ellerman 2018-01-02 9:45 ` Michael Ellerman 2018-01-02 10:22 ` Geert Uytterhoeven 2018-01-02 10:22 ` Geert Uytterhoeven 2018-01-03 6:24 ` Michael Ellerman 2018-01-03 6:24 ` Michael Ellerman [not found] ` <87h8s3cvel.fsf-W0DJWXSxmBNbyGPkN3NxC2scP1bn1w/D@public.gmane.org> 2018-01-03 7:49 ` Geert Uytterhoeven 2018-01-03 7:49 ` Geert Uytterhoeven 2018-01-03 8:19 ` Julian Calaby 2018-01-03 8:19 ` Julian Calaby [not found] ` <CAGRGNgV+DnZAAtiE5oe8rxp4=_JHJrtSQc8F5jrgN0rgYKfwjA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> 2018-01-04 8:48 ` Christoph Hellwig 2018-01-04 8:48 ` Christoph Hellwig 2018-01-04 8:49 ` Christoph Hellwig 2018-01-04 8:49 ` Christoph Hellwig 2018-01-09 15:38 ` Christoph Hellwig 2018-01-09 15:38 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 18/67] microblaze: remove dma_nommu_dma_supported Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 20/67] s390: move s390_pci_dma_ops to asm/pci_dma.h Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 21/67] dma-mapping: warn when there is no coherent_dma_mask Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 23/67] dma-mapping: add an arch_dma_supported hook Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 25/67] dma-direct: rename dma_noop to dma_direct Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 16:25 ` Vladimir Murzin 2018-01-02 16:25 ` Vladimir Murzin 2017-12-29 8:18 ` [PATCH 26/67] dma-direct: use phys_to_dma Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 16:26 ` Vladimir Murzin 2018-01-02 16:26 ` Vladimir Murzin 2017-12-29 8:18 ` [PATCH 27/67] dma-direct: add dma address sanity checks Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 14:12 ` Geert Uytterhoeven 2017-12-29 14:12 ` Geert Uytterhoeven 2018-01-04 8:52 ` Christoph Hellwig 2018-01-04 8:52 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 59/67] unicore32: use generic swiotlb_ops Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 66/67] swiotlb: remove swiotlb_{alloc,free}_coherent Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 03/67] dma-mapping: take dma_pfn_offset into account in dma_max_pfn Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 06/67] hexagon: remove unused flush_write_buffers definition Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig [not found] ` <20171229081911.2802-7-hch-jcswGhMUV9g@public.gmane.org> 2018-01-09 3:13 ` Richard Kuo 2018-01-09 3:13 ` Richard Kuo 2017-12-29 8:18 ` [PATCH 09/67] arc: remove CONFIG_ARC_PLAT_NEEDS_PHYS_TO_DMA Christoph Hellwig [not found] ` <20171229081911.2802-10-hch-jcswGhMUV9g@public.gmane.org> 2018-01-05 19:45 ` Vineet Gupta 2018-01-05 19:45 ` Vineet Gupta 2017-12-29 8:18 ` [PATCH 11/67] riscv: remove the unused dma_capable helper Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 13/67] dma-mapping: move swiotlb arch helpers to a new header Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 14/67] dma-mapping: move dma_mark_clean to dma-direct.h Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 17/67] microblaze: rename dma_direct to dma_microblaze Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 10:11 ` Julian Calaby 2017-12-29 10:11 ` Julian Calaby 2018-01-04 8:45 ` Christoph Hellwig 2018-01-04 8:45 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 19/67] microblaze: remove the dead !NOT_COHERENT_CACHE dma code Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 22/67] dma-mapping: clear harmful GFP_* flags in common code Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 10:38 ` Geert Uytterhoeven 2018-01-02 10:38 ` Geert Uytterhoeven 2018-01-09 15:54 ` Jesper Nilsson 2018-01-09 15:54 ` Jesper Nilsson 2017-12-29 8:18 ` [PATCH 24/67] dma-mapping: provide a generic asm/dma-mapping.h Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 28/67] dma-direct: add support for CMA allocation Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 29/67] dma-direct: use node local allocations for coherent memory Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 10:29 ` Geert Uytterhoeven 2018-01-02 10:29 ` Geert Uytterhoeven 2017-12-29 8:18 ` [PATCH 30/67] dma-direct: retry allocations using GFP_DMA for small masks Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 16:43 ` Vladimir Murzin 2018-01-02 16:43 ` Vladimir Murzin [not found] ` <f6139b03-0a4a-a9fe-4818-9b0bccf419e4-5wv7dgnIgG8@public.gmane.org> 2018-01-04 9:02 ` Christoph Hellwig 2018-01-04 9:02 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 31/67] dma-direct: make dma_direct_{alloc,free} available to other implementations Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-02 16:44 ` [PATCH 31/67] dma-direct: make dma_direct_{alloc, free} " Vladimir Murzin 2018-01-02 16:44 ` Vladimir Murzin 2017-12-29 8:18 ` [PATCH 32/67] dma-direct: add support for allocation from ZONE_DMA and ZONE_DMA32 Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 33/67] dma-direct: reject too small dma masks Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 34/67] cris: use dma-direct Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2018-01-09 15:53 ` Jesper Nilsson 2018-01-09 15:53 ` Jesper Nilsson 2017-12-29 8:18 ` [PATCH 35/67] h8300: " Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 36/67] x86: remove dma_alloc_coherent_mask Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 37/67] x86: use dma-direct Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 38/67] x86/amd_gart: clean up gart_alloc_coherent Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 39/67] iommu/amd_iommu: use dma_direct_* helpers for the direct mapping case Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 40/67] iommu/intel-iommu: " Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 41/67] x86: remove dma_alloc_coherent_gfp_flags Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 42/67] arm64: rename swiotlb_dma_ops Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 43/67] ia64: " Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 44/67] powerpc: " Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 45/67] swiotlb: rename swiotlb_free to swiotlb_exit Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 46/67] swiotlb: lift x86 swiotlb_dma_ops to common code Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 47/67] swiotlb: wire up ->dma_supported in swiotlb_dma_ops Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 48/67] swiotlb: rely on dev->coherent_dma_mask Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 49/67] swiotlb: refactor coherent buffer freeing Christoph Hellwig 2017-12-29 8:18 ` [PATCH 50/67] swiotlb: refactor coherent buffer allocation Christoph Hellwig 2017-12-29 8:18 ` [PATCH 51/67] set_memory.h: provide set_memory_{en,de}crypted stubs Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 52/67] dma-direct: handle the memory encryption bit in common code Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 53/67] swiotlb: remove swiotlb_set_mem_attributes Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 54/67] x86: remove sta2x11_dma_ops Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:18 ` [PATCH 55/67] ia64: replace ZONE_DMA with ZONE_DMA32 Christoph Hellwig 2017-12-29 8:18 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 56/67] ia64: use generic swiotlb_ops Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 57/67] ia64: clean up swiotlb support Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 58/67] ia64: remove an ifdef around the content of pci-dma.c Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 60/67] tile: replace ZONE_DMA with ZONE_DMA32 Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 61/67] tile: use generic swiotlb_ops Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 62/67] mips/netlogic: remove swiotlb support Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 63/67] mips: use swiotlb_{alloc,free} Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 64/67] arm64: replace ZONE_DMA with ZONE_DMA32 Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 65/67] arm64: use swiotlb_alloc and swiotlb_free Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 8:19 ` [PATCH 67/67] swiotlb: remove various exports Christoph Hellwig 2017-12-29 8:19 ` Christoph Hellwig 2017-12-29 10:52 ` consolidate direct dma mapping and swiotlb support Vladimir Murzin 2017-12-29 10:52 ` Vladimir Murzin [not found] ` <23fee3bb-61ce-1735-b264-3acc0109c858-5wv7dgnIgG8@public.gmane.org> 2017-12-30 10:56 ` Christoph Hellwig 2017-12-30 10:56 ` Christoph Hellwig
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20171229081911.2802-1-hch@lst.de \ --to=hch@lst.de \ --cc=adi-buildroot-devel@lists.sourceforge.net \ --cc=gxt@mprc.pku.edu.cn \ --cc=iommu@lists.linux-foundation.org \ --cc=linux-alpha@vger.kernel.org \ --cc=linux-arch@vger.kernel.org \ --cc=linux-arm-kernel@lists.infradead.org \ --cc=linux-c6x-dev@linux-c6x.org \ --cc=linux-cris-kernel@axis.com \ --cc=linux-hexagon@vger.kernel.org \ --cc=linux-ia64@vger.kernel.org \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-m68k@lists.linux-m68k.org \ --cc=linux-metag@vger.kernel.org \ --cc=linux-mips@linux-mips.org \ --cc=linux-parisc@vger.kernel.org \ --cc=linux-s390@vger.kernel.org \ --cc=linux-sh@vger.kernel.org \ --cc=linux-snps-arc@lists.infradead.org \ --cc=linuxppc-dev@lists.ozlabs.org \ --cc=monstr@monstr.eu \ --cc=patches@groups.riscv.org \ --cc=sparclinux@vger.kernel.org \ --cc=x86@kernel.org \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).