There are a number of problems in the ARC data files that are caused by truncation of 16 bit unicode punctuation to 8-bits. There may be other undetected truncation errors where the truncated value is a legitimate UTF character, but this seems unlikely.

I have written code to work around this problem; it’s a fairly simple fix.

There are also about a dozen records that are ill-formed- the contain tags generated by an Oracle xml sql engine.

Scary thought for the day:
Imagine if Oracle made an ILS

Leave a Reply