R is a great tool, but processing large text files with data is cumbersome.
chunked
helps you to process large text files with dplyr while loading
only a part of the data in memory. It builds on the execellent R package LaF
Processing commands are writing in dplyr syntax, and chunked
(using LaF
)
will take care that chunk by chunk is processed, taking far less memory
than otherwise. chunked
is useful for selecting columns, mutating columns
and filtering rows. It can be used in data pre-processing.