Changes in Makefile

db98b430 - squashfs: always build "file direct" version of page actor

Fri, 17 Jun 2022 08:38:11 +0000

squashfs: always build "file direct" version of page actorSquashfs_readahead uses the "file direct" version of the page actor, andso build it unconditionally.Link: https://lkml.kernel.org/r/20220617083810.337573-3-hsinyi@chromium.orgSigned-off-by: Phillip Lougher Signed-off-by: Hsin-Yi Wang Reported-by: kernel test robot Cc: Hou Tao Cc: Marek Szyprowski Cc: Matthew Wilcox Cc: Miao Xie Cc: Xiongwei Song Cc: Zhang Yi Cc: Zheng Liang Signed-off-by: Andrew Morton List of files: /linux-6.15/fs/squashfs/Makefile

b2441318 - License cleanup: add SPDX GPL-2.0 license identifier to files with no license

Wed, 01 Nov 2017 14:07:57 +0000

License cleanup: add SPDX GPL-2.0 license identifier to files with no licenseMany source files in the tree are missing licensing information, whichmakes it harder for compliance tools to determine the correct license.By default all files without license information are under the defaultlicense of the kernel, which is GPL version 2.Update the files which contain no license information with the 'GPL-2.0'SPDX license identifier. The SPDX identifier is a legally bindingshorthand, which can be used instead of the full boiler plate text.This patch is based on work done by Thomas Gleixner and Kate Stewart andPhilippe Ombredanne.How this work was done:Patches were generated and checked against linux-4.14-rc6 for a subset ofthe use cases: - file had no licensing information it it. - file was a */uapi/* one with no licensing information in it, - file was a */uapi/* one with existing licensing information,Further patches will be generated in subsequent months to fix up caseswhere non-standard license headers were used, and references to licensehad to be inferred by heuristics based on keywords.The analysis to determine which SPDX License Identifier to be applied toa file was done in a spreadsheet of side by side results from of theoutput of two independent scanners (ScanCode & Windriver) producing SPDXtag:value files created by Philippe Ombredanne. Philippe prepared thebase worksheet, and did an initial spot review of a few 1000 files.The 4.13 kernel was the starting point of the analysis with 60,537 filesassessed. Kate Stewart did a file by file comparison of the scannerresults in the spreadsheet to determine which SPDX license identifier(s)to be applied to the file. She confirmed any determination that was notimmediately clear with lawyers working with the Linux Foundation.Criteria used to select files for SPDX license identifier tagging was: - Files considered eligible had to be source code files. - Make and config files were included as candidates if they contained >5 lines of source - File already had some variant of a license header in it (even if <5 lines).All documentation files were explicitly excluded.The following heuristics were used to determine which SPDX licenseidentifiers to apply. - when both scanners couldn't find any license traces, file was considered to have no license information in it, and the top level COPYING file license applied. For non */uapi/* files that summary was: SPDX license identifier # files ---------------------------------------------------|------- GPL-2.0 11139 and resulted in the first patch in this series. If that file was a */uapi/* path one, it was "GPL-2.0 WITH Linux-syscall-note" otherwise it was "GPL-2.0". Results of that was: SPDX license identifier # files ---------------------------------------------------|------- GPL-2.0 WITH Linux-syscall-note 930 and resulted in the second patch in this series. - if a file had some form of licensing information in it, and was one of the */uapi/* ones, it was denoted with the Linux-syscall-note if any GPL family license was found in the file or had no licensing in it (per prior point). Results summary: SPDX license identifier # files ---------------------------------------------------|------ GPL-2.0 WITH Linux-syscall-note 270 GPL-2.0+ WITH Linux-syscall-note 169 ((GPL-2.0 WITH Linux-syscall-note) OR BSD-2-Clause) 21 ((GPL-2.0 WITH Linux-syscall-note) OR BSD-3-Clause) 17 LGPL-2.1+ WITH Linux-syscall-note 15 GPL-1.0+ WITH Linux-syscall-note 14 ((GPL-2.0+ WITH Linux-syscall-note) OR BSD-3-Clause) 5 LGPL-2.0+ WITH Linux-syscall-note 4 LGPL-2.1 WITH Linux-syscall-note 3 ((GPL-2.0 WITH Linux-syscall-note) OR MIT) 3 ((GPL-2.0 WITH Linux-syscall-note) AND MIT) 1 and that resulted in the third patch in this series. - when the two scanners agreed on the detected license(s), that became the concluded license(s). - when there was disagreement between the two scanners (one detected a license but the other didn't, or they both detected different licenses) a manual inspection of the file occurred. - In most cases a manual inspection of the information in the file resulted in a clear resolution of the license that should apply (and which scanner probably needed to revisit its heuristics). - When it was not immediately clear, the license identifier was confirmed with lawyers working with the Linux Foundation. - If there was any question as to the appropriate license identifier, the file was flagged for further research and to be revisited later in time.In total, over 70 hours of logged manual review was done on thespreadsheet to determine the SPDX license identifiers to apply to thesource files by Kate, Philippe, Thomas and, in some cases, confirmationby lawyers working with the Linux Foundation.Kate also obtained a third independent scan of the 4.13 code base fromFOSSology, and compared selected files where the other two scannersdisagreed against that SPDX file, to see if there was new insights. TheWindriver scanner is based on an older version of FOSSology in part, sothey are related.Thomas did random spot checks in about 500 files from the spreadsheetsfor the uapi headers and agreed with SPDX license identifier in thefiles he inspected. For the non-uapi files Thomas did random spot checksin about 15000 files.In initial set of patches against 4.14-rc6, 3 files were found to havecopy/paste license identifier errors, and have been fixed to reflect thecorrect identifier.Additionally Philippe spent 10 hours this week doing a detailed manualinspection and review of the 12,461 patched files from the initial patchversion early this week with: - a full scancode scan run, collecting the matched texts, detected license ids and scores - reviewing anything where there was a license detected (about 500+ files) to ensure that the applied SPDX license was correct - reviewing anything where there was no detection but the patch license was not GPL-2.0 WITH Linux-syscall-note to ensure that the applied SPDX license was correctThis produced a worksheet with 20 files needing minor correction. Thisworksheet was then exported into 3 different .csv files for thedifferent types of files to be modified.These .csv files were then reviewed by Greg. Thomas wrote a script toparse the csv files and add the proper SPDX tag to the file, in theformat that the file expected. This script was further refined by Gregbased on the output to detect more types of files automatically and todistinguish between header and source .c files (which need differentcomment types.) Finally Greg ran the script using the .csv files togenerate the patches.Reviewed-by: Kate Stewart Reviewed-by: Philippe Ombredanne Reviewed-by: Thomas Gleixner Signed-off-by: Greg Kroah-Hartman List of files: /linux-6.15/fs/squashfs/Makefile

87bf54bb - squashfs: Add zstd support

Thu, 10 Aug 2017 02:42:36 +0000

squashfs: Add zstd supportAdd zstd compression and decompression support to SquashFS. zstd is agreat fit for SquashFS because it can compress at ratios approaching xz,while decompressing twice as fast as zlib. For SquashFS in particular,it can decompress as fast as lzo and lz4. It also has the flexibilityto turn down the compression ratio for faster compression times.The compression benchmark is run on the file tree from the SquashFS archivefound in ubuntu-16.10-desktop-amd64.iso [1]. It uses `mksquashfs` with thedefault block size (128 KB) and and various compression algorithms/levels.xz and zstd are also benchmarked with 256 KB blocks. The decompressionbenchmark times how long it takes to `tar` the file tree into `/dev/null`.See the benchmark file in the upstream zstd source repository located under`contrib/linux-kernel/squashfs-benchmark.sh` [2] for details.I ran the benchmarks on a Ubuntu 14.04 VM with 2 cores and 4 GiB of RAM.The VM is running on a MacBook Pro with a 3.1 GHz Intel Core i7 processor,16 GB of RAM, and a SSD.| Method | Ratio | Compression MB/s | Decompression MB/s ||----------------|-------|------------------|--------------------|| gzip | 2.92 | 15 | 128 || lzo | 2.64 | 9.5 | 217 || lz4 | 2.12 | 94 | 218 || xz | 3.43 | 5.5 | 35 || xz 256 KB | 3.53 | 5.4 | 40 || zstd 1 | 2.71 | 96 | 210 || zstd 5 | 2.93 | 69 | 198 || zstd 10 | 3.01 | 41 | 225 || zstd 15 | 3.13 | 11.4 | 224 || zstd 16 256 KB | 3.24 | 8.1 | 210 |This patch was written by Sean Purcell , but I will betaking over the submission process.[1] http://releases.ubuntu.com/16.10/[2] https://github.com/facebook/zstd/blob/dev/contrib/linux-kernel/squashfs-benchmark.shzstd source repository: https://github.com/facebook/zstdSigned-off-by: Sean Purcell Signed-off-by: Nick Terrell Signed-off-by: Chris Mason Acked-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

62421645 - Squashfs: Add LZ4 compression configuration option

Thu, 27 Nov 2014 18:48:44 +0000

Squashfs: Add LZ4 compression configuration optionAdd the glue code, and also update the documentation.Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

0d455c12 - Squashfs: Directly decompress into the page cache for file data

Wed, 13 Nov 2013 02:04:19 +0000

Squashfs: Directly decompress into the page cache for file dataThis introduces an implementation of squashfs_readpage_block()that directly decompresses into the page cache.This uses the previously added page handler abstraction to pushdown the necessary kmap_atomic/kunmap_atomic operations on thepage cache buffers into the decompressors. This enablesdirect copying into the page cache without using the slowkmap/kunmap calls.The code detects when multiple threads are racing insquashfs_readpage() to decompress the same block, and avoidsthis regression by falling back to using an intermediatebuffer.This patch enhances the performance of Squashfs significantlywhen multiple processes are accessing the filesystem simultaneouslybecause it not only reduces memcopying, but it more importantlyeliminates the lock contention on the intermediate buffer.Using single-thread decompression. dd if=file1 of=/dev/null bs=4096 & dd if=file2 of=/dev/null bs=4096 & dd if=file3 of=/dev/null bs=4096 & dd if=file4 of=/dev/null bs=4096Before:629145600 bytes (629 MB) copied, 45.8046 s, 13.7 MB/sAfter:629145600 bytes (629 MB) copied, 9.29414 s, 67.7 MB/sSigned-off-by: Phillip Lougher Reviewed-by: Minchan Kim List of files: /linux-6.15/fs/squashfs/Makefile

5f55dbc0 - Squashfs: Restructure squashfs_readpage()

Thu, 31 Oct 2013 19:24:27 +0000

Squashfs: Restructure squashfs_readpage()Restructure squashfs_readpage() splitting it into separatefunctions for datablocks, fragments and sparse blocks.Move the memcpying (from squashfs cache entry) implementation ofsquashfs_readpage_block into file_cache.cThis allows different implementations to be supported.Signed-off-by: Phillip Lougher Reviewed-by: Minchan Kim List of files: /linux-6.15/fs/squashfs/Makefile

d208383d - Squashfs: add multi-threaded decompression using percpu variable

Mon, 18 Nov 2013 02:31:36 +0000

Squashfs: add multi-threaded decompression using percpu variableAdd a multi-threaded decompression implementation which usespercpu variables.Using percpu variables has advantages and disadvantages overimplementations which do not use percpu variables.Advantages: * the nature of percpu variables ensures decompression is load-balanced across the multiple cores. * simplicity.Disadvantages: it limits decompression to one thread per core.Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

cd59c2ec - squashfs: Enhance parallel I/O

Mon, 28 Oct 2013 05:26:30 +0000

squashfs: Enhance parallel I/ONow squashfs have used for only one stream buffer for decompressionso it hurts parallel read performance so this patch supportsmultiple decompressor to enhance performance parallel I/O.Four 1G file dd read on KVM machine which has 2 CPU and 4G memory.dd if=test/test1.dat of=/dev/null &dd if=test/test2.dat of=/dev/null &dd if=test/test3.dat of=/dev/null &dd if=test/test4.dat of=/dev/null &old : 1m39s -> new : 9s* From v1 * Change comp_strm with decomp_strm - Phillip * Change/add comments - PhillipSigned-off-by: Minchan Kim Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

9508c6b9 - Squashfs: Refactor decompressor interface and code

Wed, 13 Nov 2013 02:56:26 +0000

Squashfs: Refactor decompressor interface and codeThe decompressor interface and code was written fromthe point of view of single-threaded operation. In doingso it mixed a lot of single-threaded implementation specificaspects into the decompressor code and elsewhere which makes itdifficult to seamlessly support multiple different decompressorimplementations.This patch does the following:1. It removes compressor_options parsing from the decompressor init() function. This allows the decompressor init() function to be dynamically called to instantiate multiple decompressors, without the compressor options needing to be read and parsed each time.2. It moves threading and all sleeping operations out of the decompressors. In doing so, it makes the decompressors non-blocking wrappers which only deal with interfacing with the decompressor implementation.3. It splits decompressor.[ch] into decompressor generic functions in decompressor.[ch], and moves the single threaded decompressor implementation into decompressor_single.c.The result of this patch is Squashfs should now be able tosupport multiple decompressors by adding new decompressor_xxx.cfiles with specialised implementations of the functions indecompressor_single.cSigned-off-by: Phillip Lougher Reviewed-by: Minchan Kim List of files: /linux-6.15/fs/squashfs/Makefile

cc6d3497 - Squashfs: Make ZLIB compression support optional

Fri, 22 Jul 2011 02:01:28 +0000

Squashfs: Make ZLIB compression support optionalSquashfs now supports XZ and LZO compression in addition to ZLIB.As such it no longer makes sense to always include ZLIB support.In particular embedded systems may only use LZO or XZ compression, andthe ability to exclude ZLIB support will reduce kernel size.Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

7a43ae52 - Squashfs: Add XZ compression configuration option

Thu, 09 Dec 2010 02:08:31 +0000

Squashfs: Add XZ compression configuration optionSigned-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

79cb8ced - Squashfs: Add LZO compression support

Thu, 05 Aug 2010 01:29:59 +0000

Squashfs: Add LZO compression supportSigned-off-by: Chan Jeong Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

637d5c9a - Squashfs: Make XATTR config name consistent with other file systems

Mon, 31 May 2010 17:46:29 +0000

Squashfs: Make XATTR config name consistent with other file systemsReported-by: Geert Uytterhoeven Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

01e5b4e4 - squashfs: add xattr support configure option

Mon, 17 May 2010 18:39:02 +0000

squashfs: add xattr support configure optionSigned-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

f41d207c - squashfs: add support for xattr reading

Mon, 17 May 2010 02:17:04 +0000

squashfs: add support for xattr readingAdd support for listxattr and getxattr. Also add xattr definitions.Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

4b5397dc - squashfs: add xattr id support

Fri, 14 May 2010 19:48:47 +0000

squashfs: add xattr id supportThis patch adds support for mapping xattr ids (stored in inodes)into the on-disk location of the xattrs themselves.Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

4c0f0bb2 - Squashfs: add a decompressor framework

Tue, 06 Oct 2009 03:04:15 +0000

Squashfs: add a decompressor frameworkThis adds a decompressor framework which allows multiple compressionalgorithms to be cleanly supported.Also update zlib wrapper and other code to use the new framework.Signed-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

e6a6d379 - Squashfs: move zlib decompression wrapper code into a separate file

Tue, 22 Sep 2009 18:25:24 +0000

Squashfs: move zlib decompression wrapper code into a separate fileSigned-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

e5d28753 - Squashfs: cody tidying, remove commented out line in Makefile

Wed, 13 May 2009 02:25:20 +0000

Squashfs: cody tidying, remove commented out line in MakefileSigned-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile

fcef6fb6 - Squashfs: Makefiles

Mon, 05 Jan 2009 08:46:27 +0000

Squashfs: MakefilesSigned-off-by: Phillip Lougher List of files: /linux-6.15/fs/squashfs/Makefile