DMARC-Filter: OpenDMARC Filter v1.4.2 delorie.com 538IkDNH2216150
Authentication-Results: delorie.com; dmarc=pass (p=none dis=none) header.from=cygwin.com
Authentication-Results: delorie.com; spf=pass smtp.mailfrom=cygwin.com
DKIM-Filter: OpenDKIM Filter v2.11.0 delorie.com 538IkDNH2216150
Authentication-Results: delorie.com;
	dkim=pass (1024-bit key, unprotected) header.d=cygwin.com header.i=@cygwin.com header.a=rsa-sha256 header.s=default header.b=Nc3B2tWV
X-Recipient: archive-cygwin AT delorie DOT com
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org E372D385AC35
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1744137971;
	bh=SEW47EZ7cI1L5ZiTN/YUodwjpAYOgFNKMI8jr3tRfrQ=;
	h=Date:Subject:To:References:In-Reply-To:List-Id:List-Unsubscribe:
	 List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:Cc:
	 From;
	b=Nc3B2tWVQRMJuMH4X6kEgbzmllTg0ki1ZLrSg4seQgZ3AjEMZylrh4vn4U9Ic+i1b
	 fwQCbx5YHKvLRvcLNAu9JR1StjFWGXt27tLS2coqTXvUjhjWNlVbZGaeBwc09mghi9
	 sTxJg6kdOVfwALwHUooksP6SMWW+wLOLqUGtqx/s=
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 0A7853857023
ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 0A7853857023
ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1744137948; cv=none;
 b=Nlb4UWcF6I2Cc1MZwsgcPorReZZY+/lKhLSTT0csjjzyvstW+QpjuiivtRgqpi54l5bK8IVVOqZ00DikFAX7/LKtzbmAmMox8U7e3D3nlkm6DE7DchCn8wWbxxWJ6ZiIrbKRbYwpQJMu4/4Q6h7DEH4jIwNmwnCUlXJBMyJ0dxQ=
ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key;
 t=1744137948; c=relaxed/simple;
 bh=z4sWNSmaDLayeVzyZKJk8deSvWIkZCEb5u+ujLpzk68=;
 h=Message-ID:Date:MIME-Version:From:Subject:To:DKIM-Signature;
 b=IH1LL1w1PWNc8HNG6a5FRp/gTUNgi2y7mWwI4sGZiB/5+rJPILJVIZMBVsw3rZVuWjjM+YSbWXIgaR+c/2OwI/FDHvrMsiU5PWss1mKp6TTRb/Dt7XEMRuMm7ksjTOIesuzNsOW+GNAQpNLANuGntx6YhV5D1e21N/NhLqLmPEY=
ARC-Authentication-Results: i=1; server2.sourceware.org
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 0A7853857023
Message-ID: <41fc4806-f26d-46e5-af71-d9d6d18e64c4@SystematicSW.ab.ca>
Date: Tue, 8 Apr 2025 12:45:45 -0600
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: Tuning ls, ls -l, find ., find . -ls performance for very large
 dirs (60000+ files/dir)
To: cygwin AT cygwin DOT com
References: <CAN0SSYywSV5cbJhUFa7TYrSWuqZS-OBpKkJ=8vrcxXxHx2v70A AT mail DOT gmail DOT com>
Content-Language: en-CA
Organization: Systematic Software
In-Reply-To: <CAN0SSYywSV5cbJhUFa7TYrSWuqZS-OBpKkJ=8vrcxXxHx2v70A@mail.gmail.com>
X-Stat-Signature: k3yyn91yr9k31etwfrmgtpum68gsxwwq
X-Rspamd-Server: rspamout04
X-Rspamd-Queue-Id: 2312C6000D
X-Session-Marker: 427269616E2E496E676C69734053797374656D6174696353572E61622E6361
X-Session-ID: U2FsdGVkX18PxY/Pa5PaRh6XcjYkpubNnqNe78/U2wA=
X-HE-Tag: 1744137946-875317
X-HE-Meta: U2FsdGVkX1+lXLnwg6lK93YvsRjYi2mRE0FOhlT6pRvxr7lvt+9msQ6cdzY7fx4NdQIR82yGuhdkoDXluE0BI04HkggUGPevLBqusDoy5+zgbNzcuiD+/f/X9m7+5cP9SRgoRCCEzKk/54At886U81ZNMyJ29DjRtAoFss3XGKRslgBxUHoE8YlaCO+1MgWc5mAuvDvNN1E4ZD8eOr5OyqwkmgIy7Znh3zwWjx7MIFb+KA/ORVM4hEvPUaAlJkJr05Ikc3PKCET5JJrWGcSyr+hSXpl4F9Ut0A6hGPJmeWAeEH2NxxnO+ruWyZyItYAWvcFBe8XiIfGge1mapCR9rxH1Je4g3fY8
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.30
Precedence: list
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Unsubscribe: <https://cygwin.com/mailman/options/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=unsubscribe>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: Brian Inglis via Cygwin <cygwin AT cygwin DOT com>
Reply-To: cygwin AT cygwin DOT com
Cc: Brian Inglis <Brian DOT Inglis AT SystematicSW DOT ab DOT ca>
Content-Type: text/plain; charset="utf-8"; Format="flowed"
Errors-To: cygwin-bounces~archive-cygwin=delorie DOT com AT cygwin DOT com
Sender: "Cygwin" <cygwin-bounces~archive-cygwin=delorie DOT com AT cygwin DOT com>
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from base64 to 8bit by delorie.com id 538IkDNH2216150

On 2025-04-08 12:05, Mark Liam Brown via Cygwin wrote:
> Greetings!
> 
> Are there tuning variables to improve ls, ls -l, find ., find . -ls
> performance for very large dirs?
> 
> If we have a SMB dir with 60000+ entries a simple ls -l can take MANY
> minutes (22+mins), while cmd.exe dir just floods the terminal with
> results immediately.

AFAIK Cygwin stat(3) is slow because of the Windows calls it has to make and 
alternate suffixes also have to be tried multiplying the time.

-- 
Take care. Thanks, Brian Inglis              Calgary, Alberta, Canada

La perfection est atteinte                   Perfection is achieved
non pas lorsqu'il n'y a plus rien à ajouter  not when there is no more to add
mais lorsqu'il n'y a plus rien à retrancher  but when there is no more to cut
                                 -- Antoine de Saint-Exupéry

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple