adls.append.core: The Core Append API.

In Microsoft/AzureSMR: Manage and Interact with Azure Resources

Description

The Core Append API.

Usage

adls.append.core(azureActiveContext, adlFileOutputStream = NULL,
  azureDataLakeAccount, relativePath, bufferSize, contents, contentSize = -1L,
  leaseId = NULL, sessionId = NULL, syncFlag = NULL,
  offsetToAppendTo = -1, verbose = FALSE)

Arguments

azureActiveContext	A container used for caching variables used by AzureSMR, created by createAzureContext()
adlFileOutputStream	The adlFileOutputStream object to operate with.
azureDataLakeAccount	Name of the Azure Data Lake account.
relativePath	Relative path of a file.
bufferSize	Size of the buffer to be used.
contents	raw contents to be written to the file.
contentSize	size of contents to be written to the file.
leaseId	a String containing the lease ID (generated by client). Can be null.
sessionId	a String containing the session ID (generated by client). Can be null.
syncFlag	Use DATA when writing more bytes to same file path. Most performant operation. Use METADATA when metadata for the file also needs to be updated especially file length retrieved from adls.file.info or adls.ls API call. Has an overhead of updating metadata operation. Use CLOSE when no more data is expected to be written in this path. Adl backend would update metadata, close the stream handle and release the lease on the path if valid leaseId is passed. Expensive operation and should be used only when last bytes are written.
offsetToAppendTo	offset at which to append to to file. To let the server choose offset, pass -1.
verbose	Print tracing information (default FALSE).

Details

Exceptions - IOException

Value

response object

References

https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-data-operations-rest-api#upload-data

See Also

https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Append_to_a_File

https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Buffer_Size

https://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FileSystem.html#append-org.apache.hadoop.fs.Path-int-org.apache.hadoop.util.Progressable-

Other Azure Data Lake Store functions: adls.append.direct, adls.append, adls.concat, adls.create, adls.delete, adls.file.info, adls.fileinputstream.available, adls.fileinputstream.close, adls.fileinputstream.create, adls.fileinputstream.getpos, adls.fileinputstream.length, adls.fileinputstream.readfromservice, adls.fileinputstream.readfully, adls.fileinputstream.read, adls.fileinputstream.seek, adls.fileinputstream.skip, adls.fileoutputstream.close, adls.fileoutputstream.create, adls.fileoutputstream.flush, adls.fileoutputstream.write, adls.ls, adls.mkdir, adls.read.core, adls.read.direct, adls.read, adls.rename, createAdlExponentialBackoffRetryPolicy, createAdlNonIdempotentRetryPolicy, createAdlRetryPolicy, shouldRetry.adlExponentialBackoffRetryPolicy, shouldRetry.adlNonIdempotentRetryPolicy, shouldRetry

Microsoft/AzureSMR documentation built on July 7, 2019, 11:25 p.m.