<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Fred 2.0</title>
	<atom:link href="http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2" rel="self" type="application/rss+xml" />
	<link>http://www.ibiblio.org/fred2.0/wordpress</link>
	<description>Cosmos, Taxis, and the Future of Bibiliographic Control</description>
	<lastBuildDate>Mon, 29 Nov 2010 20:04:48 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.1</generator>
		<item>
		<title>MADS/RDF &#8211; Some brief comments</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=254</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=254#comments</comments>
		<pubDate>Mon, 29 Nov 2010 20:04:48 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Future of Bibliographic Control]]></category>
		<category><![CDATA[LCSH]]></category>
		<category><![CDATA[MADS]]></category>
		<category><![CDATA[Metadata]]></category>
		<category><![CDATA[SKOS]]></category>
		<category><![CDATA[Semantics]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=254</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=MADS%2FRDF+%26%238211%3B+Some+brief+comments&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Future+of+Bibliographic+Control&amp;rft.subject=LCSH&amp;rft.subject=MADS&amp;rft.subject=Metadata&amp;rft.subject=SKOS&amp;rft.subject=Semantics&amp;rft.source=Fred+2.0&amp;rft.date=2010-11-29&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=254&amp;rft.language=English"></span>
Jeff Beall reposts some of the discussion on the  MODS mailing list on the recently published draft of MADS/RDF.  Beall wonders if the proposal, and the initial comments indicate that the entire semantic web effort is doomed. This may be an over-reaction. I spent some time working on a formal analysis of the semantics of [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=MADS%2FRDF+%26%238211%3B+Some+brief+comments&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Future+of+Bibliographic+Control&amp;rft.subject=LCSH&amp;rft.subject=MADS&amp;rft.subject=Metadata&amp;rft.subject=SKOS&amp;rft.subject=Semantics&amp;rft.source=Fred+2.0&amp;rft.date=2010-11-29&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=254&amp;rft.language=English"></span>
<p>Jeff Beall <a href="http://metadata.posterous.com/lcs-madsrdf-ontology-and-the-future-of-the-se">reposts</a> some of the discussion on the  <a href="http://listserv.loc.gov/listarch/mods.html">MODS mailing list</a> on the recently published draft of <a href="http://www.loc.gov/standards/mads/rdf/">MADS/RDF</a>.  Beall wonders if the proposal, and the initial comments indicate that the entire semantic web effort is doomed. This may be an over-reaction.</p>
<p>I spent some time working on a formal analysis of the semantics of  pre-combined<a href="#note1">[1]</a>/subdivided subject headings, and how they could be added in a downwards compatible way to SKOS. I had hoped to discuss the topic at the DC VOCAMP held at The Library  immediately after ISWC 2009, but there was no-one at the camp who was interested in library vocabularies, I let the matter drop<a href="#note2">[2]</a>.</p>
<p>Since support for pre-combined headings are one of the  major design goals of  <a href="http://www.loc.gov/standards/mads/rdf/">MADS/RDF</a>, I have been looking quite closely at the initial  draft.  I am not yet ready to publish detailed results, but I wanted to take this chance to make a few quick notes on the initial draft.</p>
<h3>Minor Issue</h3>
<p>There is a quick change that could make it easier for others to evaluate the proposed ontology.  Currently, the URI/IRI of the ontology is &#8220;http://id.loc.gov/ontologies/mads/2010/11&#8243;.  At the moment does not resolve as a URL.  Also, the name is slightly different from current usual practice.  Ontology URIs are typically of the form &#8230;/&lt;Year&gt;/&lt;Month&gt;/&lt;Name&gt;; the MADS IRI is in the form &#8230;/&lt;Name&gt;/&lt;Year&gt;/&lt;Month&gt;. This encourages some common tools, such as Protege, to abbreviate the ontology name as &#8220;11&#8243;.</p>
<h3>Major issues</h3>
<ol>
<li>The SKOS mappings <strong>are</strong> imported as part of the reference ontology; however due to problems in naming, this may not show up correctly.  It might be better to include the axioms in the mapping file directly in the main ontology.</li>
<li>The SKOS mappings are incomplete; it is possible that concentrating  on narrowing the differences between SKOS and<a href="http://www.niso.org/kst/reports/standards/kfile_download?id%3Austring%3Aiso-8859-1=Z39-19-2005.pdf&amp;pt=RkGKiXzW643YeUaYUqZ1BFwDhIG4-24RJbcZBWg8uE4vWdpZsJDs4RjLz0t90_d5_ymGsj_IKVaGZww13HuDlYn5U74YdfA-3TffjxYQ25QrtR8PONuJLqxvo-l0NIr5"> Standard(NISO Z39.19)</a>/Library KOS semantics would give an end result that should be more useful for use by The Library.</li>
<li>The current draft was created without support from an ontologist or owl expert. There are several problems in the modeling that result from this lack of resourcing.  For example, there are several places where a constraint or restriction is given in a comment that could readily have been represented in OWL, and many properties are not fully or properly specified.  There is a big difference between the ontology design and schema design, and without support resources, it is easy to fall in to some common anti-patterns.</li>
<li>The current draft was created without ready access to Subject Matter Experts (SMEs) in the Cataloging COI.  As a result, the ontology may not adequately represent the problem domain, and may make it harder to extend so as  to support LC rules and policy on subject heading formation. When modeling any complex area, regular interaction with relevant SMEs is essential throughout the process, both for knowledge elicitation and model validation.  Early, regular review of the ongoing work  by <a href="http://www.loc.gov/standards/mods/editorial-committee.html">MODS/MADS Editorial Committee</a> may be helpful.</li>
<li>The current draft does not define the semantics of pre-combined headings; there are different possible interpretations,  but none are discussed, and some inferences appear to be common across all readings.</li>
<li>Given known  data errors in the syndetic structure of LCSH (see e.g. <a href="http://www.ibiblio.org/ses/poster.pdf">LCSH is to Thesaurus as Doorbell is to Mammal</a>), it may better to devote resources to correcting these issues before deepening the semantics of exposed Linked Data.  This would make the LC vocabularies more reuseable in the web of data, as recommended in the Deanna Marcum&#8217;s  &#8221;<a href="http://www.loc.gov/bibliographic-future/news/LCWGResponse-Marcum-Final-061008.pdf">Response to: On the record: Report of the Library of Congress Working Group On The Future of Bibliographic Control</a>&#8220;.</li>
</ol>
<h3><span style="font-size: small;"><span style="font-weight: normal;"><span style="font-size: medium;"><span><strong><br />
</strong></span></span></span></span></h3>
<hr />[1] Following Soergel, I prefer this term to &#8220;Pre-coordinated&#8221;</p>
<p id="note2">[2] I also worked on relating the to the implied ontologies inferable from Knowledge Organization Systems that used sub-types of BT relationship (BTG, etc) that are part of the international standards, and which <a href="http://www.w3.org/2001/sw/Europe/reports/thes/1.0/guide/20040504/#3.9">were originally included in SKOS</a>, but which were <a href="http://www.w3.org/2004/02/skos/extensions/spec/2004-10-18.html">moved to an extension</a> , then finally dropped and relegated to <a href="http://www.w3.org/TR/skos-primer/#secskosspecialization">examples</a> in the published recommendation.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=254</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>If you&#8217;re thinking of attending Digital Humanities 2010</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=222</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=222#comments</comments>
		<pubDate>Tue, 09 Mar 2010 00:46:05 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Kings]]></category>
		<category><![CDATA[linguistics]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=222</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=If+you%26%238217%3Bre+thinking+of+attending+Digital+Humanities+2010&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Kings&amp;rft.subject=linguistics&amp;rft.source=Fred+2.0&amp;rft.date=2010-03-08&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=222&amp;rft.language=English"></span>
Now that registration is open, you may be thinking about attending this year&#8217;s ADHO Digital Humanities Conference, DH2010, which will be hosted at King&#8217;s College London by the Centre for Computing in the Humanities and the Centre for e-Research, with the support of the School of Arts and Humanities, Information Services and Systems, and the [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=If+you%26%238217%3Bre+thinking+of+attending+Digital+Humanities+2010&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Kings&amp;rft.subject=linguistics&amp;rft.source=Fred+2.0&amp;rft.date=2010-03-08&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=222&amp;rft.language=English"></span>
<p>Now that registration is open, you may be thinking about attending this year&#8217;s <a href="http://www.digitalhumanities.org/">ADHO</a> Digital Humanities Conference, <a href="http://dh2010.cch.kcl.ac.uk/home.html">DH2010</a>, which will be</p>
<blockquote><p>hosted at King&#8217;s College London by the Centre for Computing in the Humanities and the Centre for e-Research, with the support of the School of Arts and Humanities, Information Services and Systems, and the Principal, Professor Rick Trainor.</p></blockquote>
<p>Before you decide to register, you might wish to consider whether King&#8217;s can really afford to be hosting an event of this size, especially  in the light of the <a href="http://sites.google.com/site/kclgllcmeltdown/">savage cuts  that King&#8217;s College has felt forced to make this year</a> . Faculty cuts include <a href="http://http://gist.github.com/288062">Shalom Lappin</a>! It&#8217;s like MIT laying of TimBL.</p>
<p>You might feel it better for King&#8217;s  for you to focus your attention and submissions on other venues, and to bypass DH2010.</p>
<p>If you do, be sure to drop an email to  <a href="mailto:principal@kcl.ac.uk">Professor Trainor </a>explaining your decision.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=222</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Translation party breaks the conspiracy</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=186</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=186#comments</comments>
		<pubDate>Wed, 24 Feb 2010 12:56:40 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Emperors etc.]]></category>
		<category><![CDATA[Future of Bibliographic Control]]></category>
		<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[catalogers -- Wit and Humor]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=186</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Translation+party+breaks+the+conspiracy&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Emperors+etc.&amp;rft.subject=Future+of+Bibliographic+Control&amp;rft.subject=Uncategorized&amp;rft.subject=catalogers+--+Wit+and+Humor&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-24&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=186&amp;rft.language=English"></span>
Translation party uses the Google Translate API to  turn Machine Assisted Translation abuse into a one-click spectator sport. They automagically translate an phrase from English to Japanese and back again until they reach an equilibrium, or decide that they&#8217;ve tried enough (sometimes they give up prematurely, but you can only beat a dead horse for [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Translation+party+breaks+the+conspiracy&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Emperors+etc.&amp;rft.subject=Future+of+Bibliographic+Control&amp;rft.subject=Uncategorized&amp;rft.subject=catalogers+--+Wit+and+Humor&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-24&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=186&amp;rft.language=English"></span>
<p><a href="http://translationparty.com">Translation party</a> uses the Google Translate API to  turn Machine Assisted Translation abuse into a one-click spectator sport.</p>
<p>They automagically translate an phrase from English to Japanese and back again until they reach an equilibrium, or decide that they&#8217;ve tried enough (sometimes they give up prematurely, but you can only beat a dead horse for so long (or as they would say &#8220;<a href="http://translationparty.com/#6666049">Only between the wild-goose chase</a>&#8220;.</p>
<p>Sometimes, however,   <a href="http://translationparty.com/#6665807">Translaton party</a> discovers makes some remarkable discoveries.</p>
<h2 class="wp-table-reloaded-table-name">In Gibbero Veritas</h2>

<table id="wp-table-reloaded-id-2-no-1" class="wp-table-reloaded wp-table-reloaded-id-2">
<tbody>
	<tr class="row-1 odd">
		<td class="column-1">A non profit corporation from dublin</td><td class="column-2">In English<br />
</td>
	</tr>
	<tr class="row-2 even">
		<td class="column-1">ダブリンから非営利法人</td><td class="column-2">into Japanese</td>
	</tr>
	<tr class="row-3 odd">
		<td class="column-1">Non-profit from Dublin</td><td class="column-2">back into English</td>
	</tr>
	<tr class="row-4 even">
		<td class="column-1">禁煙ダブリンから利益を得る</td><td class="column-2">back into Japanese</td>
	</tr>
	<tr class="row-5 odd">
		<td class="column-1">Non profit from Dublin</td><td class="column-2">back into English</td>
	</tr>
	<tr class="row-6 even">
		<td class="column-1">ダブリンから非営利</td><td class="column-2">back into Japanese</td>
	</tr>
	<tr class="row-7 odd">
		<td class="column-1">Profit from Dublin</td><td class="column-2">back into English</td>
	</tr>
	<tr class="row-8 even">
		<td class="column-1">ダブリンからの利益</td><td class="column-2">back into Japanese</td>
	</tr>
	<tr class="row-9 odd">
		<td class="column-1">Profit from Dublin</td><td class="column-2">And we have a winner</td>
	</tr>
</tbody>
</table>

]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=186</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Who said the World&#8217;s Fair?  Genitive identity disorder?</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=182</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=182#comments</comments>
		<pubDate>Mon, 15 Feb 2010 14:01:58 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[ARC]]></category>
		<category><![CDATA[Archival Research Catalog]]></category>
		<category><![CDATA[NARA]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=182</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Who+said+the+World%26%238217%3Bs+Fair%3F++Genitive+identity+disorder%3F&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Uncategorized&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-15&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=182&amp;rft.language=English"></span>
Damned Yankees allRecords/ArchivalDescriptions/48/Item_95313.xml: &#60;display-name&#62;New York World's Fair (1964-1965)&#60;/display-name&#62; Good ol’ Boys allRecords/ArchivalDescriptions/68/FileUnit_763881.xml: &#60;title&#62;Cleveland-Harrison (1885-1893): South Carolina – World’s Fair&#60;/title&#62;]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Who+said+the+World%26%238217%3Bs+Fair%3F++Genitive+identity+disorder%3F&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Uncategorized&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-15&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=182&amp;rft.language=English"></span>
<h3>Damned Yankees</h3>
<p>allRecords/ArchivalDescriptions/48/Item_95313.xml:</p>
<blockquote>
<pre>&lt;display-name&gt;New York World<span style="color: #ff0000;">'</span>s Fair (1964-1965)&lt;/display-name&gt;</pre>
</blockquote>
<h3>Good ol’ Boys</h3>
<p>allRecords/ArchivalDescriptions/68/FileUnit_763881.xml:</p>
<blockquote>
<pre>&lt;title&gt;Cleveland-Harrison (1885-1893): South Carolina – World<span style="color: #ff0000;">’</span>s Fair&lt;/title&gt;</pre>
</blockquote>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=182</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>More ARC Character issues</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=178</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=178#comments</comments>
		<pubDate>Mon, 15 Feb 2010 04:00:20 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[ARC]]></category>
		<category><![CDATA[Archival Research Catalog]]></category>
		<category><![CDATA[NARA]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=178</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=More+ARC+Character+issues&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Uncategorized&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-14&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=178&amp;rft.language=English"></span>
Whilst checking up on some of the character set fixes, I&#8217;ve noticed that there seem to be some inconsistencies in the use of right quotes, apostrophes, and accute accents, which may lead to problems down the road when doing searches, or performing name authority work. Here are some examples that may make things clearer. Use [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=More+ARC+Character+issues&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Uncategorized&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-14&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=178&amp;rft.language=English"></span>
<p>Whilst checking up on some of the character set fixes, I&#8217;ve noticed that there seem to be some inconsistencies in the use of right quotes, apostrophes, and accute accents, which may lead to problems down the road when doing searches, or performing name authority work.</p>
<p>Here are some examples that may make things clearer.</p>
<h3>Use of a right single quote as an accute accent.</h3>
<p>In  allRecords/ArchivalDescriptions/68/FileUnit_744305.xml we find the following title:</p>
<blockquote>
<pre>&lt;title&gt;Navarro, Jose’ Antonio&lt;/title&gt;</pre>
</blockquote>
<p>There are several ways to represent é in UNICODE; composed, decompsed, or as an e followed by a non-combining accent  (U+00B4); none of these approaches will match this title string.</p>
<p>One correct form is:</p>
<blockquote>
<pre>&lt;title&gt;Navarro, José Antonio&lt;/title&gt;</pre>
</blockquote>
<p>(see e.g. <a href="http://www.tamu.edu/ccbn/dewitt/Navarro.htm">http://www.tamu.edu/ccbn/dewitt/Navarro.htm</a>)</p>
<h3>Some accute accents are encoded correctly</h3>
<p>For example, in allRecords/ArchivalDescriptions/1/Item_197118.xml we find:</p>
<blockquote>
<pre>&lt;display-name&gt;Québec (Québec province, Canada, North and Central America) inhabited place&lt;/display-name&gt;
</pre>
</blockquote>
<h3>Vive Jay Sherman! Vive Québec</h3>
<p><object classid="clsid:d27cdb6e-ae6d-11cf-96b8-444553540000" width="445" height="364" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=6,0,40,0"><param name="allowFullScreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="src" value="http://www.youtube.com/v/UCox6p5HejY&amp;hl=en_US&amp;fs=1&amp;rel=0&amp;border=1" /><param name="allowfullscreen" value="true" /><embed type="application/x-shockwave-flash" width="445" height="364" src="http://www.youtube.com/v/UCox6p5HejY&amp;hl=en_US&amp;fs=1&amp;rel=0&amp;border=1" allowscriptaccess="always" allowfullscreen="true"></embed></object></p>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=178</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Australia confirms no sweat-of-the-brow copyright in facts.</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=172</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=172#comments</comments>
		<pubDate>Mon, 15 Feb 2010 00:00:23 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Future of Bibliographic Control]]></category>
		<category><![CDATA[compilation copyright]]></category>
		<category><![CDATA[feist]]></category>
		<category><![CDATA[public domain]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=172</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Australia+confirms+no+sweat-of-the-brow+copyright+in+facts.&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Future+of+Bibliographic+Control&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-14&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=172&amp;rft.language=English"></span>
In a case most similar to the landmark US case of Feist vs. Rural Telecommunications,  the Federal Court of Australia  has ruled in the case of Telstra Corporation Limited v Phone Directories Company Pty Ltd that mere sweat-of-the-brow does not reach the minimum level  of creativity required to create copyright in compilations of facts. As [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Australia+confirms+no+sweat-of-the-brow+copyright+in+facts.&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Future+of+Bibliographic+Control&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-14&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=172&amp;rft.language=English"></span>
<p>In a case most similar to the landmark US case of <a href="http://www.law.cornell.edu/copyright/cases/499_US_340.htm">Feist vs. Rural Telecommunications</a>,  the Federal Court of Australia  has ruled in the case of <a href="http://www.austlii.edu.au/au/cases/cth/FCA/2010/44.html">Telstra Corporation Limited v Phone Directories Company Pty Ltd</a> that mere sweat-of-the-brow does not reach the minimum level  of creativity required to create copyright in compilations of facts. As with Feist in the United States, OCLC&#8217;s copyright claims on the Worldcat database  would not seem to survive  in Australia under this decision.</p>
<h3>Commercial value not relevant in deciding whether copyright exists</h3>
<blockquote><p>(20)(8) &#8230; Copyright is not given to reward work distinct from the production of a particular form of expression:  <em>IceTV </em><a title="View Case" href="http://www.austlii.edu.au/au/cases/cth/HCA/2009/14.html">[2009] HCA 14</a>;  <a title="View LawCiteRecord" href="http://www.austlii.edu.au/cgi-bin/LawCite?cit=254%20ALR%20386">254 ALR 386</a> at  <a href="http://www.austlii.edu.au/au/cases/cth/HCA/2009/14.html#para28">[28]</a> and [31].  Accordingly, it is “unhelpful to refer to the ‘commercial value’ of the information, because that directs attention to the information itself rather than to the particular form of expression”:  <em>IceTV </em><a title="View Case" href="http://www.austlii.edu.au/au/cases/cth/HCA/2009/14.html">[2009] HCA 14</a>;  <a title="View LawCiteRecord" href="http://www.austlii.edu.au/cgi-bin/LawCite?cit=254%20ALR%20386">254 ALR 386</a> at  <a href="http://www.austlii.edu.au/au/cases/cth/HCA/2009/14.html#para31">[31]</a> and [166].</p></blockquote>
<h3>Application of rules, no matter how skillfully is not enough to obtain copyright</h3>
<p>Section (C) (6) seems especially applicable to some mistaken claims of copyright in bibliographic records;  as in <a href="http://www.coolcopyright.com/cases/fulltext/batlinsnydertext.htm">Batlin v. Snyder</a>, &lt;&lt;the requirement of originality [cannot]  be satisfied simply by the demonstration of &#8220;physical skill&#8221; or &#8220;special training&#8221;&gt;&gt;</p>
<blockquote><p>(162) As the evidence shows, the person or persons who utilise the Rules and who, therefore, are submitted by the Applicants to be authors of the Works, do not exercise either “independent intellectual effort” or “sufficient effort of a literary nature” to be considered an author within the meaning of the <a href="http://www.austlii.edu.au/au/legis/cth/consol_act/ca1968133/">Copyright Act</a>.</p></blockquote>
<blockquote><p>
(163) First, it is the Rules that prescribe the particular form of expression of the Works, not any individual person alone or in collaboration with others.  The Rules control the content of each Work.  The various computer systems generate and control the choice of the content on the basis of the Rules and are responsible for ensuring the vast majority of their valid application.  In some circumstances the Rules expressly prohibit certain content.</p></blockquote>
<blockquote><p>
(164) Secondly, even where there is any level of human “discretion”, it must be exercised <em>in accordance</em> with the Rules.  There is no independent effort, let alone such effort being intellectual.  There is no effort, let alone sufficient effort, of a literary nature.  I reject the Applicants’ contention that there is judgment or discretion used in selecting the material for inclusion.  The Rules prescribe, presume and prohibit the actions of the contributors.  What choice there is, is the choice given by the Rules, not by any person or persons.</p></blockquote>
<blockquote><p>
(165)Thirdly, even if the judgment or discretion of the kind asserted by the Applicants was “independent intellectual effort”, it is not relevant intellectual effort.  I reject the Applicants’ contention that the relevant intellectual effort involved is in understanding and applying the Rules.  The “independent intellectual effort” required must be directed to the creation of the Work: <em>IceTV</em> <a title="View Case" href="http://www.austlii.edu.au/au/cases/cth/HCA/2009/14.html">[2009] HCA 14</a>;  <a title="View LawCiteRecord" href="http://www.austlii.edu.au/cgi-bin/LawCite?cit=254%20ALR%20386">254 ALR 386</a> at  <a href="http://www.austlii.edu.au/au/cases/cth/HCA/2009/14.html#para33">[33]</a>.  Such skill and judgment, on the facts, is not directed to the creation of each Work but to the application of the Rules.  Moreover, the “work” undertaken by many of the Sensis workers, is work directed (at least in part) to the maintenance and operation of the Genesis Computer System and associated computer systems (including the Genesis database) which is accessed or used for a multitude of applications.</p></blockquote>
<blockquote><p>
(166) Finally, even if it mattered, there is insufficient evidence about who created the Rules themselves.  The Rules alone cannot be said to be an author for the purposes of the <a href="http://www.austlii.edu.au/au/legis/cth/consol_act/ca1968133/">Copyright Act</a>.</p></blockquote>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=172</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>ARC Data Set With Fixed Character Encodings</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=127</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=127#comments</comments>
		<pubDate>Sat, 13 Feb 2010 19:32:31 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Metadata]]></category>
		<category><![CDATA[ARC]]></category>
		<category><![CDATA[Archival Research Catalog]]></category>
		<category><![CDATA[NARA]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=127</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=ARC+Data+Set+With+Fixed+Character+Encodings&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Metadata&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-13&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=127&amp;rft.language=English"></span>
I&#8217;m happy to announce the availability of the new  Tyler Hansbrough Special Edition of the NARA Archival Research Catalog. This special edition has fixes for the  character set encoding problems noted below. These problems were being caused by problems in the  UTF-8 encoding of   various single and double quotes, and en- and em- dashes, resulting [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=ARC+Data+Set+With+Fixed+Character+Encodings&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Metadata&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-13&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=127&amp;rft.language=English"></span>
<p>I&#8217;m happy to announce the availability of the new  <em>Tyler Hansbrough</em><em> Special Edition</em> of the NARA Archival Research Catalog. This special edition has fixes for the  character set encoding problems noted below. These problems were being caused by problems in the  UTF-8 encoding of   various single and double quotes, and en- and em- dashes, resulting in unparsable XML documents.</p>
<h2>Downloading the modified data sets</h2>
<p><a href="http://www.ibiblio.org/fred2.0/NARA/02-12-2010-Tyler-Hansborough-Release/">The  Tyler Hansbrough special edition can be downloaded from the Fred 2.0 repository on iBiblio.</a></p>
<h3>Affected characters</h3>
<p>The following characters were affected &#8211; the counts given are for the number of times each character occurred, and not the number of documents each character occurred in.</p>

<table id="wp-table-reloaded-id-1-no-1" class="wp-table-reloaded wp-table-reloaded-id-1">
<thead>
	<tr class="row-1 odd">
		<th class="column-1">Unicode Name</th><th class="column-2">Glyph</th><th class="column-3">Bad Code</th><th class="column-4">Fixed</th><th class="column-5">Count</th>
	</tr>
</thead>
<tbody>
	<tr class="row-2 even">
		<td class="column-1">EN-DASH	</td><td class="column-2">–</td><td class="column-3">U+0013	</td><td class="column-4">U+2013	</td><td class="column-5">86</td>
	</tr>
	<tr class="row-3 odd">
		<td class="column-1">LEFT SINGLE QUOTATION MARK	</td><td class="column-2">‘</td><td class="column-3">U+0018	</td><td class="column-4">U+2018</td><td class="column-5">4</td>
	</tr>
	<tr class="row-4 even">
		<td class="column-1">RIGHT SINGLE QUOTATION MARK	</td><td class="column-2">’	</td><td class="column-3">U+0019	</td><td class="column-4">U+2019</td><td class="column-5">712</td>
	</tr>
	<tr class="row-5 odd">
		<td class="column-1">LEFT DOUBLE QUOTATION MARK	</td><td class="column-2">“</td><td class="column-3">U+001C	</td><td class="column-4">U+201C</td><td class="column-5">280</td>
	</tr>
	<tr class="row-6 even">
		<td class="column-1">RIGHT DOUBLE QUOTATION MARK	</td><td class="column-2">”</td><td class="column-3">U+001D</td><td class="column-4">U+201D</td><td class="column-5">316</td>
	</tr>
</tbody>
</table>

<h3><strong>A</strong>ffected documents</h3>
<p>533 documents were affected.</p>
<p>A detailed list of which documents were affected, and which characters were replaced is available <a href="http://www.ibiblio.org/fred2.0/NARA/02-12-2010-Tyler-Hansborough-Release/detailed-changes.txt">here</a>.<br />
<span id="more-127"></span></p>
<h2>Technical details</h2>
<p>Here&#8217;s what was going on:</p>
<h3>Before</h3>
<p style="padding-left: 60px;">&lt;title&gt;651.343 &#8211; Adult Education, 1939 &#8211; Worker<span style="color: #ff0000;">s</span> Education, 1939&lt;/title&gt;</p>
<p>If we look at the actual bytes in the file, we see that there&#8217;s a strange character after the &#8220;s&#8221; in &#8220;Workers&#8221;.</p>
<pre style="font: normal normal normal 12px/18px Consolas, Monaco, 'Courier New', Courier, monospace; padding-left: 60px;">0000060    72  6b  65  72  <span style="color: #ff0000;">73</span>  <span style="color: #ff0000;">19</span>  20  45  64  75  63  61  74  69  6f  6e
           r   k   e   r   <span style="color: #ff0000;">s</span>  <span style="color: #ff0000;">031</span>      E   d   u   c   a   t   i   o   n</pre>
<p>The hexadecimal value of this byte is <span style="color: #ff0000;">19</span>; in UTF-8 and ASCII  this is a  control character used to mark the end of a paper tape.   This is not a valid XML character (<a href="http://www.w3.org/TR/REC-xml/">XML Recommendation § 2.2</a>), which means that XML parsers won&#8217;t accept records with these characters in them.</p>
<h3>After</h3>
<p style="padding-left: 60px;">&lt;title&gt;651.343 &#8211; Adult Education, 1939 &#8211; Worker<span style="color: #ff0000;">s’</span> Education, 1939&lt;/title&gt;</p>
<p>Now we can see the saxon genitive.</p>
<pre style="font: normal normal normal 12px/18px Consolas, Monaco, 'Courier New', Courier, monospace; padding-left: 60px;">0000200    6b  65  72  <span style="color: #ff0000;">73  e2  80  99</span>  20  45  64  75  63  61  74  69  6f
           k   e   r   <span style="color: #ff0000;">s   ’   **  ** </span>     E   d   u   c   a   t   i   o</pre>
<p>The correct character  code for Right Single Quotation Mark  &#8211; <span style="font-family: 'Lucida Grande', 'Times New Roman', 'Bitstream Charter', Times, serif; line-height: normal; font-size: 13px;">’<span style="font-family: Georgia, 'Times New Roman', 'Bitstream Charter', Times, serif; font-size: 13px; line-height: 19px;"> &#8211;  in UNICODE is U+2019. The UTF-8 representation of this character is  three bytes long &#8211; <span style="color: #ff0000;">e2 80 99</span>.</span></span></p>
<p style="padding-left: 30px;">For more information on the joy of quotes, see the Wikipedia entry on <a href="http://en.wikipedia.org/wiki/Quotation_mark_glyphs">Quotation mark glyphs</a>.</p>
<p style="text-align: center;"><em>«The Wonderful Thing About Standards Is There Are So Many To Choose From» &#8211; Adm. Hopper.</em></p>
<div style="text-align: center;"><em><br />
</em></div>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=127</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>ARC Notes &#8211; Character set conversion issues</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=123</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=123#comments</comments>
		<pubDate>Thu, 11 Feb 2010 01:10:31 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Metadata]]></category>
		<category><![CDATA[ARC]]></category>
		<category><![CDATA[Archival Research Catalog]]></category>
		<category><![CDATA[NARA]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=123</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=ARC+Notes+%26%238211%3B+Character+set+conversion+issues&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Metadata&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-10&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=123&amp;rft.language=English"></span>
There are a number of problems in the ARC data files that are caused by truncation of 16 bit unicode punctuation to 8-bits. There may be other undetected truncation errors where the truncated value is a legitimate UTF character, but this seems unlikely. I have written code to work around this problem; it&#8217;s a fairly [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=ARC+Notes+%26%238211%3B+Character+set+conversion+issues&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Metadata&amp;rft.source=Fred+2.0&amp;rft.date=2010-02-10&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=123&amp;rft.language=English"></span>
<p>There are a number of problems in the ARC data files that are caused by  truncation of 16 bit unicode punctuation to 8-bits.  There may be other undetected  truncation errors where the truncated value is a legitimate UTF character, but this seems unlikely.</p>
<p>I have written  code to work around this problem; it&#8217;s a fairly simple fix.</p>
<p> There are also about a dozen  records that are ill-formed- the contain <error> tags generated by an Oracle xml sql engine.    </p>
<p>Scary thought for the day:<br />
   Imagine if Oracle made an ILS</p>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=123</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Code4lib 2010 Asheville &#8211;  Event Schedule</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=116</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=116#comments</comments>
		<pubDate>Sun, 31 Jan 2010 22:18:39 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=116</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Code4lib+2010+Asheville+%26%238211%3B++Event+Schedule&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Uncategorized&amp;rft.source=Fred+2.0&amp;rft.date=2010-01-31&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=116&amp;rft.language=English"></span>
]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=Code4lib+2010+Asheville+%26%238211%3B++Event+Schedule&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Uncategorized&amp;rft.source=Fred+2.0&amp;rft.date=2010-01-31&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=116&amp;rft.language=English"></span>
<p><iframe src="https://www.google.com/calendar/embed?mode=AGENDA&amp;height=200&amp;wkst=1&amp;bgcolor=%23FFFFFF&amp;src=at1rvb5mgat3blhcng0vakugdk%40group.calendar.google.com&amp;color=%23AB8B00&amp;ctz=America%2FNew_York" style=" border-width:0 " width="800" height="200" frameborder="0" scrolling="no"></iframe></p>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=116</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>NARA Archival Research Catalog &#8211; Compressed for Your Dowloading Pleasure</title>
		<link>http://www.ibiblio.org/fred2.0/wordpress/?p=109</link>
		<comments>http://www.ibiblio.org/fred2.0/wordpress/?p=109#comments</comments>
		<pubDate>Fri, 29 Jan 2010 19:32:31 +0000</pubDate>
		<dc:creator>ses</dc:creator>
				<category><![CDATA[Metadata]]></category>
		<category><![CDATA[ARC]]></category>
		<category><![CDATA[Archival Research Catalog]]></category>
		<category><![CDATA[NARA]]></category>

		<guid isPermaLink="false">http://www.ibiblio.org/fred2.0/wordpress/?p=109</guid>
		<description><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=NARA+Archival+Research+Catalog+%26%238211%3B+Compressed+for+Your+Dowloading+Pleasure&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Metadata&amp;rft.source=Fred+2.0&amp;rft.date=2010-01-29&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=109&amp;rft.language=English"></span>
NARA has released the bulk contents of it&#8217;s Archival Research Catalog on data.gov, in ARC XML format. Unfortunately, when I say bulk contents, I mean bulk contents; the current distribution contains nearly 20GB of raw data; the Organizational authority file adds another 1.7GB. Since XML was deliberately designed for redundancy, XML encoded data sets are [...]]]></description>
			<content:encoded><![CDATA[	
	<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rfr_id=info%3Asid%2Focoins.info%3Agenerator&amp;rft.title=NARA+Archival+Research+Catalog+%26%238211%3B+Compressed+for+Your+Dowloading+Pleasure&amp;rft.aulast=Spero&amp;rft.aufirst=Simon&amp;rft.subject=Metadata&amp;rft.source=Fred+2.0&amp;rft.date=2010-01-29&amp;rft.type=blogPost&amp;rft.format=text&amp;rft.identifier=http://www.ibiblio.org/fred2.0/wordpress/?p=109&amp;rft.language=English"></span>
<p>NARA has released the bulk contents of it&#8217;s <a href="http://www.data.gov/details/1357">Archival Research Catalog</a> on <a href="http://www.data.gov/details/1357">data.gov</a>, in ARC XML format.</p>
<p>Unfortunately, when I say bulk contents, I mean <strong>bulk</strong> contents; the current distribution contains nearly 20GB of raw data; the <a href="http://www.data.gov/details/1358">Organizational authority file</a> adds another 1.7GB.</p>
<p>Since XML was deliberately designed for redundancy, XML encoded data sets are usually rather compressible. These data are no exception; bzip2 on the ARC data set achieves compression rations  between 40:1 and 50:1.   The 7-zip format does even better, but is not considered archival.</p>
<p>The real credit for this work belongs to the good people at NARA and their contributing agencies (and viewers like you). Don&#8217;t forget to visit the original pages on data.gov to give comments and feedback on this data, and don&#8217;t forget to show off all the cool UIs you build on top of this.</p>
<p>Mark Matienzo, (now a Yalie as of  Monday),  Richard Urban,  GSLIS, University of Illinois,and Simon Spero, SILS, University of North Carolina have prepared a compressed distribution of these data sets, allowing much more efficient access to the data.</p>
<p>This distribution is available from iBiblio at this location; <a href="http://www.ibiblio.org/fred2.0/NARA/">http://www.ibiblio.org/fred2.0/NARA/</a></p>
<p>One interesting datum that emerged during the compression process is that the compressed size of Part1 is nearly twice as large as most of the other Parts, despite having the same raw size.  There are several possible explanations for this:</p>
<ul>
<li>H1: The records in Part1 are more complete than in other files.</li>
<li>H2: Part1 describes record series from less related agencies than other files.</li>
<li>H3: Part1 contains records with less compressible data (image types, numeric data, etc).</li>
<li>H4: Part1 contains more, smaller, record series than other files.</li>
</ul>
<p>If  only had a time machine, I could do a poster and go to the iConference.  Alas, all I have is the scarf and the Jelly babies, and I&#8217;ve eaten the Jelly babies.</p>
<p>This release is dedicated to the memory of Prof. Brian Vickery (1918-2009), <a href="http://www.iskouk.org/">whose passing was announced on Thursday the 28th</a>.</p>
<p style="text-align: center;">Higgledy-Piggledy<br />
Brian C. Vickery<br />
Ranganathoricly<br />
Classified Life</p>
<p style="text-align: center;">Polyhierarchically<br />
Never too snarkaly<br />
Faceted artfully<br />
Helped refind science</p>
<p>&#8212;&#8211;</p>
<p>See the Readme file for a bit more details.</p>
<p><span id="more-109"></span></p>
<pre>THESE DATA SETS ARE NOT AUTHORITATIVE.

This replica is being provided to allow compressed versions of the data set
to be access to the NARA Archival Research Catalog data set. Once compressed
versions of the data sets are available, it may go away without due process.

For more information see the ARC home page at http://www.archives.gov/research/arc/

The original data can be found on the data.gov web site at the locations given
below.  The data.gov site will carry updated copies, and can be used to rate
and submit comments. 

This directory contains compressed versions of the Archival Research Catalog
(ARC) data set made available by NARA at
http://www.data.gov/details/1357 .

When complete, the dataset will contain ten files, named
ArchivalDescriptionsPart1.tar.bz2
...
ArchivalDescriptionsPart10.tar.bz2

This directory also contains a compressed version of the Organization Authority File made available by NARA at  http://www.data.gov/details/1358 

This file  identifies the names and administrative histories of Federal
and non-Federal organizations used as access points in the archival
descriptions.

This data-set is stored in a single file, ARCWebExport15Dec2009_Org.tar.bz2 .

DATE OF PREPARATION.

The data sets were retrieved on or about the 28th January 2010.
The source reports a last updated date of 15-Dec-2009.

TECHNICAL NOTES

This replica is being provided to allow compressed versions of the data set
to be accessed.  The uncompressed data is between 40-50 times larger than the
compressed versions. Be careful when working with this dataset on shared file
systems.  

The tar files contain a very large number of small files.  Be careful when
working with this dataset on hierarchical file systems.

CREDIT
The datasets were collected and prepared by the NARA and the contributing
agencies, to whom all real credit belongs.

This  replica was prepared by Simon Spero, SILS, University of
North Carolina, Mark Matienzo, University Libraries, Yale University,
and Richard Urban, GSLIS, University of Illinois. Affiliation is listed for
identification purposes only. 

This replica is hosted by iBiblio, and is transmitted using Z39.48 compliant
acid free electrons.</pre>
<p><!--more--></p>
]]></content:encoded>
			<wfw:commentRss>http://www.ibiblio.org/fred2.0/wordpress/?feed=rss2&amp;p=109</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
