X-Authentication-Warning: delorie.com: mail set sender to geda-user-bounces using -f
Date: Tue, 5 Jan 2016 14:16:12 -0500
Message-Id: <201601051916.u05JGCHG025251@envy.delorie.com>
From: DJ Delorie <dj AT delorie DOT com>
To: geda-user AT delorie DOT com
CC: geda-user AT delorie DOT com
In-reply-to:
	<CAJXU7q81_G+1ndudoWKBTnbJwEkMhpD42e2b5FoF7gJ8WwwozQ AT mail DOT gmail DOT com>
	(geda-user AT delorie DOT com)
Subject: Re: [geda-user] A fileformat library
References: <1512221837 DOT AA25291 AT ivan DOT Harhan DOT ORG>
	<CAJXU7q_qxdvJaejF-VcY=u7VHZ-zrfrc+Z7-qSwfFyPdy-umxw AT mail DOT gmail DOT com>
	<B02363CD-469D-493A-AC15-1D5DC7836982 AT noqsi DOT com>
	<20151222232230 DOT 12633 DOT qmail AT stuge DOT se>
	<0F6F1D0F-4F07-48EA-90FE-836EAD4E2354 AT noqsi DOT com>
	<CAM2RGhTficnys3a4xs=UBFvk8aPwpzYWUADFLP_pUQ+R1iKs0g AT mail DOT gmail DOT com>
	<0FCF3774-F93C-4BFF-BB61-636F75DCCACB AT noqsi DOT com>
	<CAC4O8c_UAiFE-vGfoE2tXppHLhaa0dSYz9o_rkdCBo7_SRRtxw AT mail DOT gmail DOT com>
	<FFBE7623-E240-4798-96B0-2BECF56C8E29 AT noqsi DOT com>
	<CAC4O8c980g1gj15=5njstC_BT-WYDgKQx9BRycdFKA8OvgtiOg AT mail DOT gmail DOT com>
	<B54C0E1F-1986-4C79-9F70-7F1919B8B26D AT noqsi DOT com>
	<CAC4O8c9bxJP1eMG4yz3YwKkQJRmsDGmLQ0aMd5pJRyu0WpdCtQ AT mail DOT gmail DOT com>
	<C1CFCCEE-C64A-4E49-AA64-446C061656D6 AT noqsi DOT com>
	<CAC4O8c-zt8B=joDd+ws77D2jt6aZf3MWfR_dAvpzGcNuBrTURQ AT mail DOT gmail DOT com>
	<alpine DOT DEB DOT 2 DOT 11 DOT 1601030040320 DOT 2176 AT newt>
	<D9825C8C-B6FD-4C7F-A8D5-B8AF06253B72 AT noqsi DOT com>
	<CAC4O8c_R5xWLmzj_cz0g0mPWNs6mR4efjXKGBoup8YO6nwnPTA AT mail DOT gmail DOT com>
	<A942261D-7C25-4F2D-9CB1-FFC60FA1C160 AT noqsi DOT com>
	<CAC4O8c8zk8=Py1yX6fVqF+35SYe39Li=y4jZ8bCeZ1Ev8WccAg AT mail DOT gmail DOT com>
	<20160105182120 DOT 3237F809D79B AT turkos DOT aspodata DOT se>
	<201601051829 DOT u05IT7TI021027 AT envy DOT delorie DOT com> <CAJXU7q81_G+1ndudoWKBTnbJwEkMhpD42e2b5FoF7gJ8WwwozQ AT mail DOT gmail DOT com>
Reply-To: geda-user AT delorie DOT com


Actually, the big win was tokenizing strings - parsing variable-length
data and allocating temporary buffers was a killer.  The binary format
included storing the size of arrays and strings before the data so
that everything could be pre-allocated and read in chunks, and
tokenizing strings really sped up reading the name portion of
name=value pairs, since they were repeated so many times.