[Jprogramming] large csv
Björn Helgason
gosinn at gmail.com
Sun Feb 24 21:56:13 HKT 2008
You can use indexed read
1!:11 'abc.x';1000 20
f=: 1!:21 <'abc.x'
1!:11 f,1000 20
file:///C:/Program%20Files/j602/help/dictionary/dx001.htm
You can also use utilities in files
open'files'
load'files'
2008/2/24, Jack Andrews <effbiae at gmail.com>:
>
> hi,
>
> i've got many data. how can i deal with a readcsv call that consumes
> all available memory?
> how can i use j to analyse more data than comfortably fits?
> i guess i can partition the data in different ways.
> i could also use another language to parse the csv, row-by-row, and
> invert the table.
>
> ta, jack
> ----------------------------------------------------------------------
> For information about J forums see http://www.jsoftware.com/forums.htm
>
--
Björn Helgason, Verkfræðingur
Fugl&Fiskur ehf, Þerneyjarsund 23, Box 127
801 Grímsnes ,t-póst: gosinn at gmail.com
Skype: gosiminn, gsm: +3546985532
Landslags og skrúðgarðagerð, gröfuþjónusta
http://groups.google.com/group/J-Programming
Tæknikunnátta höndlar hið flókna, sköpunargáfa er meistari einfaldleikans
góður kennari getur stigið á tær án þess að glansinn fari af skónum
/|_ .-----------------------------------.
,' .\ / | Með léttri lund verður |
,--' _,' | Dagurinn í dag |
/ / | Enn betri en gærdagurinn |
( -. | `-----------------------------------'
| ) | (\_ _/)
(`-. '--.) (='.'=)
`. )----' (")_(")
More information about the Programming
mailing list