I've to import a feed that uses semicolon as delimiter and unluckily its data is very bad. For instance a record contains an html encoded content
54166;PERFILISTATION SONNINO;Agip Eni;Stradale;PERFILISTATION SONNINO;VIA S.S. 699 "DELL'ABBAZIA DI FOSSANOVA" KM 9+850 SNC 04010, SONNINO (LT) snc 04010;SONNINO;LT;41.40569808543889;13.203876614570618
The single field VIA S.S. 699 "DELL'ABBAZIA DI FOSSANOVA" KM 9+850 SNC 04010, SONNINO (LT) snc 04010;SONNINO contains an HTML encoded quote ' and that semicolon causes the parser to consider the field up to that semicolon, screwing the rest of the record
How should I hande that case? I'd like to have a way to "pre parse" a raw row in order to HTML Decode the row before the parser kicks in but I can't find a way to do so, is it possible?