Re: efficient access to "rotational"; new fcntl?

From: Arjan van de Ven
Date: Sat Sep 19 2009 - 05:19:23 EST


On Sat, 19 Sep 2009 11:07:21 +0200
Jim Meyering <jim@xxxxxxxxxxxx> wrote:

> > btw have you given thought about using threads as part of rm -r[f] ?
> > (would make the unlinks of unrelated directories/files asynchronous)
>
> While it is certainly a nicely parallelizable process,
> rm usually runs so quickly that I doubt it'd be worthwhile.
> If you know in advance that parallelizing a particular recursive
> removal would give a significant benefit, it's probably best to do it
> via e.g., xargs --max-procs=N.

deleting large files has several seeks kind of cost (small files is
cheap). At least on ext3. I guess with btrfs being the future it's
indeed not worth doing in userspace.


> However, sort *would* benefit, and some UCLA students implemented that
> for a term project. Unfortunately, the project is stalled because the
> implementation was not efficient enough, and no one has found the
> time to improve it since.

parallel sort... call me skeptical. My gut feeling is that you'll get
killed by communication overhead.
(sort seems to be more communication than raw cpu use)



--
Arjan van de Ven Intel Open Source Technology Centre
For development, discussion and tips for power savings,
visit http://www.lesswatts.org
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/