Package | Description |
---|---|
parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
In a map reduce job:
|
parquet.hadoop.mapred |
Modifier and Type | Method and Description |
---|---|
List<Footer> |
ParquetInputFormat.getFooters(org.apache.hadoop.conf.Configuration configuration,
List<org.apache.hadoop.fs.FileStatus> statuses)
the footers for the files
|
List<Footer> |
ParquetInputFormat.getFooters(org.apache.hadoop.mapreduce.JobContext jobContext) |
static List<Footer> |
ParquetFileReader.readAllFootersInParallel(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus fileStatus) |
static List<Footer> |
ParquetFileReader.readAllFootersInParallel(org.apache.hadoop.conf.Configuration configuration,
List<org.apache.hadoop.fs.FileStatus> partFiles) |
static List<Footer> |
ParquetFileReader.readAllFootersInParallelUsingSummaryFiles(org.apache.hadoop.conf.Configuration configuration,
List<org.apache.hadoop.fs.FileStatus> partFiles)
for files provided, check if there's a summary file.
|
static List<Footer> |
ParquetFileReader.readFooters(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus pathStatus) |
static List<Footer> |
ParquetFileReader.readFooters(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path file) |
static List<Footer> |
ParquetFileReader.readSummaryFile(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus summaryStatus) |
Modifier and Type | Method and Description |
---|---|
List<ParquetInputSplit> |
ParquetInputFormat.getSplits(org.apache.hadoop.conf.Configuration configuration,
List<Footer> footers) |
static void |
ParquetFileWriter.writeMetadataFile(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path outputPath,
List<Footer> footers)
writes a _metadata file
|
Modifier and Type | Method and Description |
---|---|
List<Footer> |
DeprecatedParquetInputFormat.getFooters(org.apache.hadoop.mapred.JobConf job) |
Copyright © 2015. All rights reserved.