Big Data Preprocessing Architecture


[Up] [Top]

Documentation for package ‘bdpar’ version 3.0.1

Help Pages

%>|% bdpar customized forward-pipe operator
AbbreviationPipe Class to find and/or replace the abbreviations on the data field of an Instance
Bdpar Class to manage the preprocess of the files throughout the flow of pipes
bdpar.log Write messages to the log at a given priority level using the custom bdpar log
bdpar.Options Object to handle the keys/attributes/options common to all pipeline flow
bdparData Example of the content of the files to be preprocessed.
Connections Class to manage the connections with Twitter and YouTube
ContractionPipe Class to find and/or replace the contractions on the data field of a Instance
DefaultPipeline Class implementing a default pipelining process.
DynamicPipeline Class implementing a dynamic pipelining process
ExtractorEml Class to handle email files with eml extension
ExtractorFactory Class to handle the creation of Instance types
ExtractorSms Class to handle SMS files with tsms extension
ExtractorTwtid Class to handle tweets files with twtid extension
ExtractorYtbid Class to handle comments of YouTube files with ytbid extension
File2Pipe Class to obtain the source field of an Instance
FindEmojiPipe Class to find and/or replace the emoji on the data field of an Instance
FindEmoticonPipe Class to find and/or remove the emoticons on the data field of an Instance
FindHashtagPipe Class to find and/or remove the hashtags on the data field of an Instance
FindUrlPipe Class to find and/or remove the URLs on the data field of an Instance
FindUserNamePipe Class to find and/or remove the users on the data field of an Instance
GenericPipe Abstract super class that handles the management of the Pipes
GenericPipeline Abstract super class implementing the pipelining process
GuessDatePipe Class to obtain the date field of an Instance
GuessLanguagePipe Class to guess the language of an Instance
Instance Abstract super class that handles the management of the Instances
InterjectionPipe Class to find and/or remove the interjections on the data field of an Instance
MeasureLengthPipe Class to obtain the length of the data field of an Instance
operator-pipe bdpar customized forward-pipe operator
ResourceHandler Class that handles different types of resources
runPipeline Initiates the pipelining process
SlangPipe Class to find and/or replace the slangs on the data field of an Instance
StopWordPipe Class to find and/or remove the stop words on the data field of an Instance
StoreFileExtPipe Class to get the file's extension field of an Instance
TargetAssigningPipe Class to get the target field of the Instance
TeeCSVPipe Class to handle a CSV with the properties field of the preprocessed Instance
ToLowerCasePipe Class to convert the data field of an Instance to lower case