Re: unable to import csv-Data
- To: mathgroup at smc.vnet.net
- Subject: [mg119069] Re: unable to import csv-Data
- From: "E. Martin-Serrano" <eMartinSerrano at telefonica.net>
- Date: Sat, 21 May 2011 06:46:17 -0400 (EDT)
Right now I am importing CSV (Excel) files as it follows in Mathematica V8.01. Windows7. (* import data form ECB European Central Bank currency files *) NotebookDirectory[]; ratesfile = ToFileName[NotebookDirectory[], "eurofxref-hist.csv"]; Print["rates file name - > ", ratesfile]; cdata = Import[ratesfile, "Data"]; The file "eurofxref-hist.csv" can be found at http://www.ecb.int/stats/exchange/eurofxref/html/index.en.html Where you can download a zipped CSV file. After unzipped the file "eurofxref-hist.csv" can be imported easily as above. Regards. -----Mensaje original----- De: Andre Koppel [mailto:akoppel at akso.de] Enviado el: viernes, 20 de mayo de 2011 13:19 Para: mathgroup at smc.vnet.net Asunto: [mg119056] Re: unable to import csv-Data Hi Hans, I have tried your Import-Parameters. With my complete dataset it didn't work. The result was a strange mix of cells. Currently I am reading the file completely doing the convertion manually by using resgular expressions. Even if the csv-import would work, it's horribly slow (more than 1000 Seconds with you Import-Parameters). It would be nice, if there would exist a csv-Import-Function where there could be given a list that describes the contens of the columns. In such case Import should run much more faster producing better results. Thank you for your suggestion. Andre Am 19.05.2011 15:46, schrieb Hans Michel: > Andre: > The following does work > > Import["D:\\akk\\test.csv", "Table", {"FieldSeparators" -> ";", > "CharacterEncoding" -> "ASCII", "HeaderLines" -> 1, > "EmptyField" -> "", "RepeatedSeparators" -> False, > "DateStringFormat" -> {"Year", "-", "Month", "-", "Day"}}] > > See the Options for "Table" import > > ref/format/Table > > Hans > > -----Original Message----- > From: Andre Koppel [mailto:akoppel at akso.de] > Sent: Wednesday, May 18, 2011 6:18 AM > To: mathgroup at smc.vnet.net > Subject: [mg118980] unable to import csv-Data > > Hello to all, > > I am trying to import some data from a csv-file. But I am absolutely > unable to get any usefull result. > I have tried several options to do formating during input, but in > every case Mathematica 8 puts several csv-columns into one > result-column. > Because the csv-data contains germany encoding, I have tried several > conversion options, but nothing helps. > Here is a snapshot of the csv-data (one headline two datalines): > --------------------- cut here ------------------------ > ID;KONTO_NR;KONTO_BEZ;BELEG_DAT;BELEG_NR;GKTO_NR;GKTO_BEZ;BU_TEXT;SOLL > ;HABEN > ;Buchsaldo;WAEHRUNG;Faelligkeit;Anfangsbestand;Ausgeblendet;Changed;In > soBase > User;BuJahr > 1;;;;;;;;7807477,41;6986382,79;,00;;;False;False;2010-11-01 > 10:24:09.997;KDLB\Conrad; > 2;D_60004;Jeske, Norbert 23966 Hof > Triwalk;2008-01-01;;S_09008;Vortrag;EB-Werte durch AIS TaxAudit > berechnet und erstellt;387,37;,00;387,37;EUR;;True;True;2010-11-01 > 10:24:09.997;KDLB\Conrad; > --------------------- cut here ------------------------ I have tried > the following import-command (and several versions of it), but did not > get useful import-result: > imp = Import["test.csv", "Table", "FieldSeparators" -> ";", > "DateStringFormat" -> { "Year", "-", "Month", "-", "Day"}, > "CharacterEncoding" -> "ASCII", "HeaderLines" -> 1] ; > > For me it looks like the CSV-Importer is unable to detect NULL-Values > (;;)?!? > > By the way reading the data into excel, writing a resulting xls-file > and importing the xls-file into mathematica works out of the box, but > I can't go this way because there are more than 200000 datalines, and > Excel did not support such a great amount and Mathematica was unable > to import Excel-2010-Formated xlsx-Data (ods didn't works also because > of the great amount of data). > > Any help would be highly appreciated > Kind regards > Andre > -- Andre Koppel Software GmbH Prinz-Handjery-Str. 38 14167 Berlin Tel.: (+4930) 810 09 190 Fax: (+4930) 326 01 046 www.invep.de www.akso.de Eingetragen beim Amtsgericht Berlin Charlottenburg HRB92600 GeschE4ftsf=FChrer Andre Koppel