fwf2csv: Fast conversion of a fwf file into a csv one

In descr: Descriptive Statistics

Fast conversion of a fwf file into a csv one

Description

Convert fixed width formated file into a tab separated one.

Usage

fwf2csv(fwffile, csvfile, names, begin, end,
        verbose = getOption("verbose"))

Arguments

fwffile	The fixed width format file.
csvfile	The csv file to be created. The fields will be separated by tab characters and there will be no quotes around strings.
names	A character vector with column names.
begin	A numeric vector with the begin offset of values in the fixed width format file.
end	A numeric vector with the end offset of values in the fixed width format file.
verbose	Logical: if TRUE a message about the number of saved lines is printed.

Details

The return value is NULL, but cvsfile is created if the function is successful. The file is a text table with fields separated by tabular characters without quotes around the strings.

This function is useful if you have a very big fixed width formated file to read and read.fwf would be too slow. The function that does the real job is very fast because it is written in C, and the use of RAM is minimum.

Value

NULL.

Author(s)

Jakson A. Aquino [e-mail]

See Also

For an efficient way of reading a csv file, see the function ‘⁠fread()⁠’ from data.table package.

Examples

txt_file <- tempfile()
csv_file <- tempfile()

# Column:     12345678901234567
writeLines(c("CE  1  11M43 2000",
             "CE  1  12F40 1800",
             "CE  1  13F 9    0",
             "CE  1  13M 6    0",
             "CE  2  21F36 1200",
             "CE  2  23M 6    0",
             "BA  1  11M33 2100",
             "BA  1  12F34 2300",
             "BA  1  13M10    0",
             "BA  1  13F 7    0",
             "BA  2  21F26 3600",
             "BA  2  22M27 3200",
             "BA  2  23F 2    0"),
           con = txt_file)

tab <- rbind(c("state",   1,  2),
             c("municp",  3,  5),
             c("house",   6,  8),
             c("cond",    9,  9),
             c("sex",    10, 10),
             c("age",    11, 12),
             c("income", 13, 17))

fwf2csv(txt_file, csv_file,
        names = tab[, 1],
        begin = as.numeric(tab[, 2]),
        end = as.numeric(tab[, 3]))
d <- read.table(csv_file, header = TRUE,
                 sep = "\t", quote = "")
d$cond <- factor(d$cond, levels = c(1, 2, 3),
                 labels = c("Reference", "Spouse", "Child"))
d$sex <- factor(d$sex)
d

descr documentation built on Nov. 28, 2023, 1:10 a.m.