You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Eric Dumazet 163da958ba [PATCH] FS: speed up rw_verify_area() ... oprofile hunting showed a stall in rw_verify_area(), because of triple indirection and potential cache misses. (file->f_path.dentry->d_inode->i_flock) By moving initialization of 'struct inode' pointer before the pos/count sanity tests, we allow the compiler and processor to perform two loads by anticipation, reducing stall, without prefetch() hints. Even x86 arch has enough registers to not use temporary variables and not increase text size. I validated this patch running a bench and studied oprofile changes, and absolute perf of the test program. Results of my epoll_pipe_bench (source available on request) on a Pentium-M 1.6 GHz machine Before : # ./epoll_pipe_bench -l 30 -t 20 Avg: 436089 evts/sec read_count=8843037 write_count=8843040 21.218390 samples per call (best value out of 10 runs) After : # ./epoll_pipe_bench -l 30 -t 20 Avg: 470980 evts/sec read_count=9549871 write_count=9549894 21.216694 samples per call (best value out of 10 runs) oprofile CPU_CLK_UNHALTED events gave a reduction from 5.3401 % to 2.5851 % for the rw_verify_area() function. Signed-off-by: Eric Dumazet <dada1@cosmosbay.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		18 years ago
..
9p	[PATCH] remove invalidate_inode_pages()	18 years ago
adfs	[PATCH] adfs: fix filename handling	18 years ago
affs	[PATCH] affs: change uses of f_{dentry, vfsmnt} to use f_path	18 years ago
afs	[PATCH] rename struct namespace to struct mnt_namespace	18 years ago
autofs	[PATCH] autofs: change uses of f_{dentry, vfsmnt} to use f_path	18 years ago
autofs4	[PATCH] getting rid of all casts of k[cmz]alloc() calls	18 years ago
befs	[PATCH] getting rid of all casts of k[cmz]alloc() calls	18 years ago
bfs	[PATCH] update Tigran's email addresses	18 years ago
cifs	[CIFS] Minor cleanup	18 years ago
coda	[PATCH] seq_file conversion: coda	18 years ago
configfs	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
cramfs	[PATCH] struct path: convert cramfs	18 years ago
debugfs	DebugFS : file/directory removal fix	18 years ago
devpts	…
dlm	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
ecryptfs	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
efs	[PATCH] struct path: convert efs	18 years ago
exportfs	…
ext2	[PATCH] fix umask when noACL kernel meets extN tuned for ACLs	18 years ago
ext3	[PATCH] jbd layer function called instead of fs specific one	18 years ago
ext4	[PATCH] jbd layer function called instead of fs specific one	18 years ago
fat	[PATCH] fat: change uses of f_{dentry,vfsmnt} to use f_path	18 years ago
freevxfs	[PATCH] struct path: convert freevxfs	18 years ago
fuse	[PATCH] remove invalidate_inode_pages()	18 years ago
gfs2	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
hfs	[PATCH] extend the set of "__attribute__" shortcut macros	18 years ago
hfsplus	[PATCH] extend the set of "__attribute__" shortcut macros	18 years ago
hostfs	[PATCH] uml: fix mknod	18 years ago
hpfs	[PATCH] struct path: convert hpfs	18 years ago
hppfs	[PATCH] struct path: convert hppfs	18 years ago
hugetlbfs	[PATCH] hugetlb: preserve hugetlb pte dirty state	18 years ago
isofs	[PATCH] isofs: change uses of f_{dentry, vfsmnt} to use f_path	18 years ago
jbd	[PATCH] jbd: wait for already submitted t_sync_datalist buffer to complete	18 years ago
jbd2	[PATCH] jbd2: wait for already submitted t_sync_datalist buffer to complete	18 years ago
jffs	[PATCH] remove invalidate_inode_pages()	18 years ago
jffs2	Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6	18 years ago
jfs	JFS: Remove incorrect kgdb define	18 years ago
lockd	[PATCH] fs/lockd/clntlock.c: add missing newlines to dprintk's	18 years ago
minix	[PATCH] struct path: convert minix	18 years ago
msdos	[PATCH] fat: add fat_getattr()	18 years ago
ncpfs	[PATCH] ncpfs: ensure we free wdog_pid on parse_option or fill_inode failure	18 years ago
nfs	[PATCH] Remove warning: VFS is out of sync with lock manager	18 years ago
nfs_common	[PATCH] nfs_common endianness annotations	19 years ago
nfsd	[PATCH] endianness bug: ntohl() misspelled as >> 24 in fh_verify().	18 years ago
nls	[PATCH] fs: make nls_cp936.c handle some U00XY characters and U20AC correctly	18 years ago
ntfs	[PATCH] NTFS: rename incorrect check of NTFS_DEBUG with just DEBUG	18 years ago
ocfs2	[PATCH] ocfs2 heartbeat: clean up bio submission code	18 years ago
openpromfs	[PATCH] struct path: convert openpromfs	18 years ago
partitions	Merge master.kernel.org:/pub/scm/linux/kernel/git/davem/sparc-2.6	18 years ago
proc	[PATCH] ifdef ->rchar, ->wchar, ->syscr, ->syscw from task_struct	18 years ago
qnx4	[PATCH] struct path: convert qnx4	18 years ago
ramfs	[PATCH] convert ramfs to use __set_page_dirty_no_writeback	18 years ago
reiserfs	[PATCH] reiserfs: Use ARRAY_SIZE macro when appropriate	18 years ago
romfs	[PATCH] struct path: convert romfs	18 years ago
smbfs	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
sysfs	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
sysv	[PATCH] fs/sysv/: proper prototypes for 2 functions	18 years ago
udf	[PATCH] struct path: convert udf	18 years ago
ufs	[PATCH] ufs: restore back support of openstep	18 years ago
vfat	[PATCH] fat: add fat_getattr()	18 years ago
xfs	[PATCH] Make XFS use BH_Unwritten and BH_Delay correctly	18 years ago
Kconfig	[PATCH] Remove unused kernel config option ZISOFS_FS	18 years ago
Kconfig.binfmt	…
Makefile	[PATCH] fsstack: Introduce fsstack_copy_{attr,inode}_*	18 years ago
aio.c	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
attr.c	…
bad_inode.c	[PATCH] fix memory corruption from misinterpreted bad_inode_ops return values	18 years ago
binfmt_aout.c	[PATCH] VFS: change struct file to use struct path	18 years ago
binfmt_elf.c	[PATCH] core-dumping unreadable binaries via PT_INTERP	18 years ago
binfmt_elf_fdpic.c	[PATCH] Remove final references to deprecated "MAP_ANON" page protection flag	18 years ago
binfmt_em86.c	…
binfmt_flat.c	[PATCH] uclinux: correctly remap bin_fmtflat exe allocated mem regions	18 years ago
binfmt_misc.c	[PATCH] getting rid of all casts of k[cmz]alloc() calls	18 years ago
binfmt_script.c	…
binfmt_som.c	…
bio.c	[PATCH] optimize o_direct on block devices	18 years ago
block_dev.c	[PATCH] revert blockdev direct io back to 2.6.19 version	18 years ago
buffer.c	[PATCH] warning fix: unsigned->signed	18 years ago
char_dev.c	[PATCH] register_chrdev_region() don't hand out the LOCAL/EXPERIMENTAL majors	18 years ago
compat.c	[PATCH] fdtable: Make fdarray and fdsets equal in size	18 years ago
compat_ioctl.c	[PATCH] VFS: change struct file to use struct path	18 years ago
dcache.c	[PATCH] Fix d_path for lazy unmounts	18 years ago
dcookies.c	[PATCH] slab: remove kmem_cache_t	18 years ago
direct-io.c	[PATCH] dio: lock refcount operations	18 years ago
dnotify.c	[PATCH] VFS: change struct file to use struct path	18 years ago
dquot.c	[PATCH] remove sb->s_files and file_list_lock usage in dquot.c	18 years ago
drop_caches.c	[PATCH] remove invalidate_inode_pages()	18 years ago
eventpoll.c	[PATCH] VFS: change struct file to use struct path	18 years ago
exec.c	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
fcntl.c	[PATCH] fdtable: Make fdarray and fdsets equal in size	18 years ago
fifo.c	…
file.c	[PATCH] fdtable: Provide free_fdtable() wrapper	18 years ago
file_table.c	[PATCH] VFS: change struct file to use struct path	18 years ago
filesystems.c	…
fs-writeback.c	Write back inode data pages even when the inode itself is locked	18 years ago
generic_acl.c	…
inode.c	[PATCH] move remove_dquot_ref to dqout.c	18 years ago
inotify.c	[PATCH] severing fs.h, radix-tree.h -> sched.h	18 years ago
inotify_user.c	[PATCH] inotify: read return val fix	18 years ago
internal.h	…
ioctl.c	[PATCH] VFS: change struct file to use struct path	18 years ago
ioprio.c	[PATCH] block layer: ioprio_best function fix	19 years ago
libfs.c	[PATCH] VFS: change struct file to use struct path	18 years ago
locks.c	[PATCH] VFS: change struct file to use struct path	18 years ago
mbcache.c	[PATCH] slab: remove kmem_cache_t	18 years ago
mpage.c	…
namei.c	[PATCH] VFS: change struct file to use struct path	18 years ago
namespace.c	[PATCH] Transform kmem_cache_alloc()+memset(0) -> kmem_cache_zalloc().	18 years ago
nfsctl.c	…
no-block.c	…
open.c	[PATCH] fdtable: Make fdarray and fdsets equal in size	18 years ago
pipe.c	[PATCH] fix leaks on pipe(2) failure exits	18 years ago
pnode.c	[PATCH] rename struct namespace to struct mnt_namespace	18 years ago
pnode.h	[PATCH] rename struct namespace to struct mnt_namespace	18 years ago
posix_acl.c	…
quota.c	…
quota_v1.c	…
quota_v2.c	…
read_write.c	[PATCH] FS: speed up rw_verify_area()	18 years ago
read_write.h	…
readdir.c	[PATCH] VFS: change struct file to use struct path	18 years ago
select.c	[PATCH] fdtable: Make fdarray and fdsets equal in size	18 years ago
seq_file.c	[PATCH] VFS: change struct file to use struct path	18 years ago
splice.c	[PATCH] constify pipe_buf_operations	18 years ago
stack.c	[PATCH] fsstack: Remove inode copy	18 years ago
stat.c	[PATCH] VFS: change struct file to use struct path	18 years ago
super.c	[PATCH] Revert bd_mount_mutex back to a semaphore	18 years ago
sync.c	[PATCH] VFS: change struct file to use struct path	18 years ago
utimes.c	[PATCH] severing fs.h, radix-tree.h -> sched.h	18 years ago
xattr.c	[PATCH] VFS: change struct file to use struct path	18 years ago
xattr_acl.c	…