Package: Streamer 1.53.0
Martin Morgan
Streamer: Enabling stream processing of large files
Large data files can be difficult to work with in R, where data generally resides in memory. This package encourages a style of programming where data is 'streamed' from disk into R via a `producer' and through a series of `consumers' that, typically reduce the original data to a manageable size. The package provides useful Producer and Consumer stream components for operations such as data input, sampling, indexing, and transformation; see package?Streamer for details.
Authors:
Streamer_1.53.0.tar.gz
Streamer_1.53.0.zip(r-4.5)Streamer_1.53.0.zip(r-4.4)Streamer_1.53.0.zip(r-4.3)
Streamer_1.53.0.tgz(r-4.4-x86_64)Streamer_1.53.0.tgz(r-4.4-arm64)Streamer_1.53.0.tgz(r-4.3-x86_64)Streamer_1.53.0.tgz(r-4.3-arm64)
Streamer_1.53.0.tar.gz(r-4.5-noble)Streamer_1.53.0.tar.gz(r-4.4-noble)
Streamer_1.53.0.tgz(r-4.4-emscripten)Streamer_1.53.0.tgz(r-4.3-emscripten)
Streamer.pdf |Streamer.html✨
Streamer/json (API)
| # Install 'Streamer' in R: |
| install.packages('Streamer', repos = c('https://bioc.r-universe.dev', 'https://cloud.r-project.org')) |
On BioConductor:Streamer-1.53.0(bioc 3.21)Streamer-1.52.0(bioc 3.20)
This package does not link to any Github/Gitlab/R-forge repository. No issue tracker or development information is available.
Last updated 2 months agofrom:6658a0566b. Checks:OK: 1 NOTE: 8. Indexed: yes.
| Target | Result | Date |
|---|---|---|
| Doc / Vignettes | OK | Dec 19 2024 |
| R-4.5-win-x86_64 | NOTE | Dec 19 2024 |
| R-4.5-linux-x86_64 | NOTE | Dec 19 2024 |
| R-4.4-win-x86_64 | NOTE | Dec 19 2024 |
| R-4.4-mac-x86_64 | NOTE | Dec 19 2024 |
| R-4.4-mac-aarch64 | NOTE | Dec 19 2024 |
| R-4.3-win-x86_64 | NOTE | Dec 19 2024 |
| R-4.3-mac-x86_64 | NOTE | Dec 19 2024 |
| R-4.3-mac-aarch64 | NOTE | Dec 19 2024 |
Exports:close.ConnectionProducerDAGParamDAGTeamDownsampleFunctionConsumerFunctionProducerlapplyMulticoreParamplot.DAGParamplot.DAGTeamRawInputrawParserFactoryrawReaderFactoryRawToCharReadLinesProducerReadTableProducerReducerregisterresetRevsapplyScanProducerSeqstatusStreamTeamyield
Dependencies:BHBiocGenericsgenericsgraphRBGL
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Package to enable stream (iterative) processing of large data | Streamer-package Streamer Streamer-class |
| Producer classes to read file connections | close.ConnectionProducer ConnectionProducer ConnectionProducer-class ConnectionProducer-classes ReadLinesProducer ReadLinesProducer-class ReadTableProducer ReadTableProducer-class ScanProducer ScanProducer-class |
| Class defining methods for all consumers | Consumer Consumer-class show,Consumer-method |
| Consumer classes for directed acyclic graph evaluation | DAGParam DAGParam,data.frame-method DAGParam,graphNEL-method DAGParam,matrix-method DAGParam,missing-method DAGParam-class DAGTeam DAGTeam-class plot.DAGParam plot.DAGTeam |
| Consumer class to down-sample data | Downsample Downsample-class |
| Classes for user-defined Producers and Consumers | Function* FunctionConsumer FunctionConsumer-class FunctionProducer FunctionProducer-class FunctionProducerConsumer-classes |
| Classes to configure parallel evaluation | MulticoreParam MulticoreParam-class ParallelParam ParallelParam-class ParallelRegister-class register |
| Class defining methods for all Producers | lapply,Producer-method Producer Producer-class sapply,Producer-method |
| Class "RawInput" | RawInput RawInput-class rawParserFactory rawReaderFactory |
| Consumer class to combine successive records | Reducer Reducer-class |
| Function to reset a Stream, Producer, or Consumer | reset reset,Streamer-method reset-methods |
| Producer class to generate (numeric) sequences | Seq Seq-class |
| Function to report current status of a stream | status status,Streamer-method status-methods |
| Class to represent a Producer and zero or more Consumers | lapply,Stream-method length,Stream-method sapply,Stream-method Stream Stream,Consumer-method Stream,Producer-method Stream-class Stream-methods [[,Stream,numeric-method |
| Consumer classes for parallel evaluation | MulticoreTeam-class Team Team,missing-method Team,MulticoreParam-method Team-class |
| Consumer classes with simple functionality, e.g., RawToChar, Rev | RawToChar RawToChar-class Rev Rev-class Utility Utility-class Utility-classes |
| Function to yield one task from a Stream or Producer | yield yield,Streamer-method yield-methods |
