www.delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2025/07/17/10:15:01

DMARC-Filter: OpenDMARC Filter v1.4.2 delorie.com 56HEEx8n968094
Authentication-Results: delorie.com; dmarc=pass (p=none dis=none) header.from=cygwin.com
Authentication-Results: delorie.com; spf=pass smtp.mailfrom=cygwin.com
DKIM-Filter: OpenDKIM Filter v2.11.0 delorie.com 56HEEx8n968094
Authentication-Results: delorie.com;
dkim=pass (1024-bit key, unprotected) header.d=cygwin.com header.i=@cygwin.com header.a=rsa-sha256 header.s=default header.b=E7ExZbgB
X-Recipient: archive-cygwin AT delorie DOT com
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org B4E80385DC3D
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
s=default; t=1752761697;
bh=l6KGAJ6KqXPP/VcpjUNa9y3yrhjaw6mEhoch/nmhbk4=;
h=Date:To:Subject:In-Reply-To:References:List-Id:List-Unsubscribe:
List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:
From;
b=E7ExZbgB7lR2klUJTNTa9S40AQ/qm+Iw4QzsqvatxpOdn+vJmUNTwFoEzVlgRAvip
MU91Pom1UKr0v4wh28VSQG2Za4ZsM/LnSZ/HeouB+qlfSP/BWYzkOc1eupUf2CyUV4
FlbCr2xwi2LeVwH6x7/mk8yj4VF8b7d9Pk3UiKLg=
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 339C6385E45D
ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 339C6385E45D
ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1752761665; cv=none;
b=ddxwX9Fw9LStX3+SwbK4zY8j4xrwgX27gnp++Z4wO6uq2nHPy9WrVjl/Gr9Z+RBnStvglzw5oNO6P7dCyRzTaCwOHQ+vHnWF90pcfk2xWhNTB9IOfzSMqcKyJl8GJRp+OBo52+dSmKiiNKpQaTXHMDFvUe/0ohgd4sY8PIJ1mm8=
ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key;
t=1752761665; c=relaxed/simple;
bh=sD9eRW44rwCL6lkDTWU6HY3flYA7X2HMAuH8wjTttE8=;
h=Date:From:To:Subject:Message-Id:Mime-Version:DKIM-Signature;
b=YEP7cDBqfBXWsVWXuhnx2ywgCuKpGe7p6MpTd3wCEmzpmTEqMX+pJfGPCZBbzz+p2lVnBJDQYCTHA76UtCHotAVEUw744KXMJMLgsEDvyacDJIAgSGss9BGQqG8GwrIR07moDQz6bBELYfL+6MG0fZPBgCIfoSUL+SY3cqI8tM4=
ARC-Authentication-Results: i=1; server2.sourceware.org
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 339C6385E45D
Date: Thu, 17 Jul 2025 23:14:21 +0900
To: cygwin AT cygwin DOT com
Subject: Re: Calling system() in multi-threads.
Message-Id: <20250717231421.56b54f7e96266311101d4c08@nifty.ne.jp>
In-Reply-To: <aHfHCqD2xZcdyu7u@calimero.vinschen.de>
References: <20250617215411 DOT ebf69d1c18b55191a1b76c01 AT nifty DOT ne DOT jp>
<eb7786ee-dc7a-4689-9d17-b842e581d7c7 AT maxrnd DOT com>
<20250618203127 DOT 71ac180de11230a9a6055185 AT nifty DOT ne DOT jp>
<20250716235236 DOT 96055ec145d9a0528b50c357 AT nifty DOT ne DOT jp>
<aHfHCqD2xZcdyu7u AT calimero DOT vinschen DOT de>
X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.30; i686-pc-mingw32)
Mime-Version: 1.0
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.30
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Unsubscribe: <https://cygwin.com/mailman/options/cygwin>,
<mailto:cygwin-request AT cygwin DOT com?subject=unsubscribe>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: Takashi Yano via Cygwin <cygwin AT cygwin DOT com>
Reply-To: Takashi Yano <takashi DOT yano AT nifty DOT ne DOT jp>
Errors-To: cygwin-bounces~archive-cygwin=delorie DOT com AT cygwin DOT com
Sender: "Cygwin" <cygwin-bounces~archive-cygwin=delorie DOT com AT cygwin DOT com>

This is a multi-part message in MIME format.

--Multipart=_Thu__17_Jul_2025_23_14_21_+0900_1I_X.ijhGxrqNu+D
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit

Hi Corinna,

On Wed, 16 Jul 2025 17:36:42 +0200
Corinna Vinschen wrote:
> On Jul 16 23:52, Takashi Yano via Cygwin wrote:
> > Hi Corinna,
> > 
> > On Wed, 18 Jun 2025 20:31:27 +0900
> > Takashi Yano wrote:
> > > On Tue, 17 Jun 2025 15:42:26 -0700
> > > Mark Geisert wrote:
> > > > Hi Takashi,
> > > > 
> > > > On 6/17/2025 5:54 AM, Takashi Yano via Cygwin wrote:
> > > > > Hi,
> > > > > 
> > > > > If system() is called in parallel in threads, system()
> > > > > fails with exit code 127.
> > > > > 
> > > > > Just compile pthread_system.c attached and run.
> > > > > 
> > > > > I believe system() is multi-thread safe so the STC
> > > > > should work.
> > > > 
> > > > I regret to inform that system() is not currently MT-safe.  I discovered 
> > > > this a few years ago when porting YAFU (Yet Another Factoring Utility).
> > > > 
> > > > I ended up supplying a wrapper that serialized the system() call itself 
> > > > but allowed multiple wrappers (and thus child processes) to be running 
> > > > at the same time.  I never got around to supplying a fix for Cygwin. 
> > > > I've attached the code.
> > > > HTH somehow,
> > > 
> > > Thanks for the information. I guess the cause is that accessing
> > > child_info_spawn NO_COPY ch_spawn;
> > > in spwan.cc conflicts with other threads. I wonder ch_spawn should
> > > be thread-specific. Or should be guarded by lock.
> > 
> > Do you have any idea?
> 
> Locking would be super-simple.
> 
> But theoretically it should be possible to use a local child_info_spawn
> variable at this point.  The ch_spawn child_info_spawn instance is not
> copied to the child anyway, so that should be safe.  The same goes for
> posix_spawn() then, btw.
> 
> I checked the sources and I don't see any dependency to ch_spawn
> from a spawning process, in contrast to an exec'ing process.  That
> doesn't mean there is none, just that I didn't find any.

Thanks!
As a starting point, I tried tntroducing locking. It almost works
as expected, however, sometimes my STC in my first report is hangs
if N is large e.g. 100. The patch is as attached.

What am I missing?

-- 
Takashi Yano <takashi DOT yano AT nifty DOT ne DOT jp>

--Multipart=_Thu__17_Jul_2025_23_14_21_+0900_1I_X.ijhGxrqNu+D
Content-Type: text/plain;
 name="Add-lock-to-ch_spawn.patch"
Content-Disposition: attachment;
 filename="Add-lock-to-ch_spawn.patch"
Content-Transfer-Encoding: base64

ZGlmZiAtLWdpdCBhL3dpbnN1cC9jeWd3aW4vc3Bhd24uY2MgYi93aW5zdXAvY3lnd2luL3NwYXdu
LmNjDQppbmRleCBjYjU4YjZlZWQuLjdlNWQ2NmVlNyAxMDA2NDQNCi0tLSBhL3dpbnN1cC9jeWd3
aW4vc3Bhd24uY2MNCisrKyBiL3dpbnN1cC9jeWd3aW4vc3Bhd24uY2MNCkBAIC0yNzMsNiArMjcz
LDcgQEAgc3RydWN0IHN5c3RlbV9jYWxsX2hhbmRsZQ0KIH07DQogDQogY2hpbGRfaW5mb19zcGF3
biBOT19DT1BZIGNoX3NwYXduOw0KK3N0YXRpYyBOT19DT1BZIFNSV0xPQ0sgY2hfc3Bhd25fbG9j
ayA9IFNSV0xPQ0tfSU5JVDsNCiANCiBleHRlcm4gIkMiIHZvaWQgX19wb3NpeF9zcGF3bl9zZW1f
cmVsZWFzZSAodm9pZCAqc2VtLCBpbnQgZXJyb3IpOw0KIA0KQEAgLTMzMyw2ICszMzQsNyBAQCBj
aGlsZF9pbmZvX3NwYXduOjp3b3JrZXIgKGNvbnN0IGNoYXIgKnByb2dfYXJnLCBjb25zdCBjaGFy
ICpjb25zdCAqYXJndiwNCiANCiAgIF9fdHJ5DQogICAgIHsNCisgICAgICBBY3F1aXJlU1JXTG9j
a0V4Y2x1c2l2ZSAoJmNoX3NwYXduX2xvY2spOw0KICAgICAgIGNoaWxkX2luZm9fdHlwZXMgY2h0
eXBlOw0KICAgICAgIGlmIChtb2RlID09IF9QX09WRVJMQVkpDQogCWNodHlwZSA9IF9DSF9FWEVD
Ow0KQEAgLTg0NSw2ICs4NDcsOSBAQCBjaGlsZF9pbmZvX3NwYXduOjp3b3JrZXIgKGNvbnN0IGNo
YXIgKnByb2dfYXJnLCBjb25zdCBjaGFyICpjb25zdCAqYXJndiwNCiAJICAgd2FpdCBmb3IgaXQg
dG8gZXhpdCBpbiBtYXliZV9zZXRfZXhpdF9jb2RlX2Zyb21fd2luZG93cygpLiAqLw0KIAlzeW5j
ZWQgPSBpc2N5Z3dpbiAoKSA/IHN5bmMgKHBpLmR3UHJvY2Vzc0lkLCBwaS5oUHJvY2VzcywgSU5G
SU5JVEUpIDogdHJ1ZTsNCiANCisgICAgICBwaWRfdCBjaF9waWQgPSBjeWdwaWQ7DQorICAgICAg
dGhpcy0+Y2xlYW51cCAoKTsNCisgICAgICBSZWxlYXNlU1JXTG9ja0V4Y2x1c2l2ZSAoJmNoX3Nw
YXduX2xvY2spOw0KICAgICAgIHN3aXRjaCAobW9kZSkNCiAJew0KIAljYXNlIF9QX09WRVJMQVk6
DQpAQCAtODkxLDcgKzg5Niw3IEBAIGNoaWxkX2luZm9fc3Bhd246OndvcmtlciAoY29uc3QgY2hh
ciAqcHJvZ19hcmcsIGNvbnN0IGNoYXIgKmNvbnN0ICphcmd2LA0KIAljYXNlIF9QX1dBSVQ6DQog
CWNhc2UgX1BfU1lTVEVNOg0KIAkgIHN5c3RlbV9jYWxsLmFybSAoKTsNCi0JICBpZiAod2FpdHBp
ZCAoY3lncGlkLCAmcmVzLCAwKSAhPSBjeWdwaWQpDQorCSAgaWYgKHdhaXRwaWQgKGNoX3BpZCwg
JnJlcywgMCkgIT0gY2hfcGlkKQ0KIAkgICAgcmVzID0gLTE7DQogCSAgdGVybV9zcGF3bl93b3Jr
ZXIuY2xlYW51cCAoKTsNCiAJICBicmVhazsNCkBAIC05MDEsNyArOTA2LDcgQEAgY2hpbGRfaW5m
b19zcGF3bjo6d29ya2VyIChjb25zdCBjaGFyICpwcm9nX2FyZywgY29uc3QgY2hhciAqY29uc3Qg
KmFyZ3YsDQogCWNhc2UgX1BfTk9XQUlUOg0KIAljYXNlIF9QX05PV0FJVE86DQogCWNhc2UgX1Bf
VkZPUks6DQotCSAgcmVzID0gY3lncGlkOw0KKwkgIHJlcyA9IGNoX3BpZDsNCiAJICBicmVhazsN
CiAJZGVmYXVsdDoNCiAJICBicmVhazsNCkBAIC05MDksNiArOTE0LDggQEAgY2hpbGRfaW5mb19z
cGF3bjo6d29ya2VyIChjb25zdCBjaGFyICpwcm9nX2FyZywgY29uc3QgY2hhciAqY29uc3QgKmFy
Z3YsDQogICAgIH0NCiAgIF9fZXhjZXB0IChOT19FUlJPUikNCiAgICAgew0KKyAgICAgIHRoaXMt
PmNsZWFudXAgKCk7DQorICAgICAgUmVsZWFzZVNSV0xvY2tFeGNsdXNpdmUgKCZjaF9zcGF3bl9s
b2NrKTsNCiAgICAgICBpZiAoZ2V0X2Vycm5vICgpID09IEVOT01FTSkNCiAJc2V0X2Vycm5vIChF
MkJJRyk7DQogICAgICAgZWxzZQ0KQEAgLTkxNyw3ICs5MjQsNiBAQCBjaGlsZF9pbmZvX3NwYXdu
Ojp3b3JrZXIgKGNvbnN0IGNoYXIgKnByb2dfYXJnLCBjb25zdCBjaGFyICpjb25zdCAqYXJndiwN
CiAgICAgfQ0KICAgX19lbmR0cnkNCiAgIHRlcm1fc3Bhd25fd29ya2VyLmNsb3NlX2hhbmRsZV9z
ZXQgKCk7DQotICB0aGlzLT5jbGVhbnVwICgpOw0KICAgaWYgKGVudmJsb2NrKQ0KICAgICBmcmVl
IChlbnZibG9jayk7DQogDQo=

--Multipart=_Thu__17_Jul_2025_23_14_21_+0900_1I_X.ijhGxrqNu+D
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline


-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

--Multipart=_Thu__17_Jul_2025_23_14_21_+0900_1I_X.ijhGxrqNu+D--

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019