Package org.cdlib.mrt.tools.loader

Class BatchLoader

java.lang.Object

org.cdlib.mrt.utility.ListProcessorBase

org.cdlib.mrt.utility.ListProcessorSimple

org.cdlib.mrt.tools.loader.BatchLoader

All Implemented Interfaces:

ListProcessor

public class BatchLoader
extends ListProcessorSimple
implements ListProcessor

Run a Storage load test

Author:

dloy

Field Summary

Fields

Modifier and Type	Field	Description
protected String	checksumType
protected URL	componentURLBase
static boolean	DEBUG
protected File	extractBaseDirectory
protected Vector<LoaderInfo>	extractDirectories
protected URL	ingestBase
static final String	LS
protected String	MESSAGE
protected String	NAME
protected File	outputBatchFile
protected URL	outputManifestBaseURL
protected File	outputManifestDirectoryBase
protected URL	outputManifestURL
protected File	processList
protected String	profile
static boolean	SENDINGEST

Fields inherited from class org.cdlib.mrt.utility.ListProcessorSimple

m_clientProperties

Fields inherited from class org.cdlib.mrt.utility.ListProcessorBase

logger, m_framework, m_status, PROCESSCNT, PROCESSTIME, TOTALBYTES, TOTALTIME

Constructor Summary

Constructors

Constructor	Description
BatchLoader(TFrame framework)

Method Summary

Modifier and Type	Method	Description
protected String	dumpStatus(String header, Properties statusProp)
void	end()	Process on EnrichmentList item
protected Properties	getDummyIngestStatus()
protected Properties	getIngestStatus(org.apache.http.HttpResponse response)
String	getName()	Name of EnrichmentList
protected void	initialize(TFrame fw)
protected void	initializeBatchLoader()
protected void	log(String msg)
static void	main(String[] args)	Main method
void	process(String line, Properties processProp)	Process an incoming line which contains 1) ark 2) sequence number Use the ark for issuing an addVersion to a storage service
protected Properties	sendIngest(URL ingestURL, String profile, File manifestFile)	Send constructed request to ingest
protected org.apache.http.HttpResponse	sendIngestMultipart(String ingestID, URL url, File ingestPackage, String profileIn, String type)	Send ingest request

Methods inherited from class org.cdlib.mrt.utility.ListProcessorSimple

getClientProperties, getIntProp, processList

Methods inherited from class org.cdlib.mrt.utility.ListProcessorBase

getFileProperties, log, requiredProp

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

NAME

protected String NAME

MESSAGE

protected String MESSAGE

LS

public static final String LS

DEBUG

public static boolean DEBUG

SENDINGEST

public static boolean SENDINGEST

checksumType

protected String checksumType

processList

protected File processList

extractBaseDirectory

protected File extractBaseDirectory

outputManifestDirectoryBase

protected File outputManifestDirectoryBase

outputManifestBaseURL

protected URL outputManifestBaseURL

componentURLBase

protected URL componentURLBase

outputManifestURL

protected URL outputManifestURL

outputBatchFile

protected File outputBatchFile

extractDirectories

protected Vector<LoaderInfo> extractDirectories

profile

protected String profile

ingestBase

protected URL ingestBase

Constructor Details

BatchLoader

public BatchLoader(TFrame framework)
            throws TException

Throws:

TException

Method Details

main

public static void main(String[] args)

Main method

initialize

protected void initialize(TFrame fw)
                   throws TException

Overrides:

initialize in class ListProcessorSimple

Throws:

TException

initializeBatchLoader

protected void initializeBatchLoader()
                              throws TException

Throws:

TException

getName

public String getName()

Name of EnrichmentList

Specified by:

getName in interface ListProcessor

Overrides:

getName in class ListProcessorSimple

Returns:

name to be applied for identifying process properties

process

public void process(String line,
 Properties processProp)
             throws TException

 Process an incoming line which contains
 1) ark
 2) sequence number
 Use the ark for issuing an addVersion to a storage service
 

Specified by:

process in interface ListProcessor

Overrides:

process in class ListProcessorSimple

Parameters:

line - line containing ark and sequence number

processProp - runtime properties

Throws:

TException - process exception

log

protected void log(String msg)

end

public void end()
         throws TException

Description copied from class: ListProcessorSimple

Process on EnrichmentList item

Overrides:

end in class ListProcessorSimple

Throws:

TException

sendIngest

protected Properties sendIngest(URL ingestURL,
 String profile,
 File manifestFile)
                         throws TException

Send constructed request to ingest

Parameters:

ingestURL - batch ingest service

profile - process profile

manifestInfo - batch manifest information

Returns:

Feeder service state

Throws:

TException - process exception

sendIngestMultipart

protected org.apache.http.HttpResponse sendIngestMultipart(String ingestID,
 URL url,
 File ingestPackage,
 String profileIn,
 String type)
                                                    throws TException

Send ingest request

Parameters:

ingestID -

url - URL of ingest service

ingestPackage - batch file

profileIn - ingest profile

type - type of ingest request

Returns:

http client response

Throws:

TException - process exceptions

getIngestStatus

protected Properties getIngestStatus(org.apache.http.HttpResponse response)
                              throws TException

Throws:

TException

getDummyIngestStatus

protected Properties getDummyIngestStatus()
                                   throws TException

Throws:

TException

dumpStatus

protected String dumpStatus(String header,
 Properties statusProp)