[Jprogramming] large csv

Björn Helgason gosinn at gmail.com
Sun Feb 24 21:56:13 HKT 2008


You can use indexed read

1!:11 'abc.x';1000 20
f=: 1!:21 <'abc.x'
1!:11 f,1000 20

file:///C:/Program%20Files/j602/help/dictionary/dx001.htm

You can also use utilities in files

   open'files'
     load'files'

2008/2/24, Jack Andrews <effbiae at gmail.com>:
>
> hi,
>
> i've got many data. how can i deal with a readcsv call that consumes
> all available memory?
> how can i use j to analyse more data than comfortably fits?
> i guess i can partition the data in different ways.
> i could also use another language to parse the csv, row-by-row, and
> invert the table.
>
> ta, jack
> ----------------------------------------------------------------------
> For information about J forums see http://www.jsoftware.com/forums.htm
>



-- 
Björn Helgason, Verkfræðingur
Fugl&Fiskur ehf, Þerneyjarsund 23, Box 127
801 Grímsnes ,t-póst: gosinn at gmail.com
Skype: gosiminn, gsm: +3546985532
Landslags og skrúðgarðagerð, gröfuþjónusta
http://groups.google.com/group/J-Programming


Tæknikunnátta höndlar hið flókna, sköpunargáfa er meistari einfaldleikans

góður kennari getur stigið á tær án þess að glansinn fari af skónum
          /|_      .-----------------------------------.
         ,'  .\  /  | Með léttri lund verður        |
     ,--'    _,'   | Dagurinn í dag                     |
    /       /       | Enn betri en gærdagurinn  |
   (   -.  |        `-----------------------------------'
   |     ) |        (\_ _/)
  (`-.  '--.)       (='.'=)
   `. )----'        (")_(")


More information about the Programming mailing list