Apache Drill 1.6.0 Release Notes

Release date: March 16, 2016

Today, we’re happy to announce the availability of Drill 1.6.0. You can download it here.

This release provides inbound impersonation, additional custom window frames, and the following bug fixes and improvements:

Sub-task

  • [DRILL-3488] - Allow Java 1.8
  • [DRILL-4261] - add support for RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING
  • [DRILL-4262] - add support for ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
  • [DRILL-4263] - add support for RANGE BETWEEN CURRENT ROW AND CURRENT ROW
  • [DRILL-4331] - TestFlattenPlanning.testFlattenPlanningAvoidUnnecessaryProject fail in Java 8
  • [DRILL-4332] - tests in TestFrameworkTest fail in Java 8
  • [DRILL-4334] - tests in TestMongoFilterPushDown fail in Java 8
  • [DRILL-4465] - Refactor Parsing and Planning to canonicalize planning and parsing

Bug

  • [DRILL-3547] - IndexOutOfBoundsException on directory with ~20 subdirectories
  • [DRILL-3581] - Google Guava version is so old it causes incompatibilities with other libs
  • [DRILL-3688] - Drill should honor "skip.header.line.count" and "skip.footer.line.count" attributes of Hive table
  • [DRILL-4225] - TestDateFunctions#testToChar fails when the locale is non-English
  • [DRILL-4279] - Improve performance for skipAll query against Text/JSON/Parquet table
  • [DRILL-4287] - Do lazy reading of parquet metadata cache file
  • [DRILL-4323] - Hive Native Reader : A simple count(*) throws Incoming batch has an empty schema error
  • [DRILL-4339] - Avro Reader can not read records - Regression
  • [DRILL-4354] - Remove sessions in anonymous (user auth disabled) mode in WebUI server
  • [DRILL-4375] - Fix the maven release profile, broken by jdbc jar size enforcer added in DRILL-4291
  • [DRILL-4384] - Query profile is missing important information on WebUi
  • [DRILL-4387] - Improve execution side when it handles skipAll query
  • [DRILL-4392] - CTAS with partition writes an internal field into generated parquet files
  • [DRILL-4410] - ListVector causes OversizedAllocationException
  • [DRILL-4434] - Remove (or deprecate) GroupScan.enforceWidth and use GroupScan.getMinParallelization
  • [DRILL-4441] - IN operator does not work with Avro reader
  • [DRILL-4443] - MIN/MAX on VARCHAR throw a NullPointerException
  • [DRILL-4449] - Wrong results when using metadata cache with specific set of queries
  • [DRILL-4457] - Difference in results returned by window function over BIGINT data
  • [DRILL-4467] - Invalid projection created using PrelUtil.getColumns
  • [DRILL-4474] - Inconsistent behavior while using COUNT in select (Apache drill 1.2.0)
  • [DRILL-4482] - Avro no longer selects data correctly from a sub-structure
  • [DRILL-4483] - Fix text plan issue in query profiles
  • [DRILL-4486] - Expression serializer incorrectly serializes escaped characters

Improvement

  • [DRILL-4260] - Adding support for some custom window frames
  • [DRILL-4297] - Provide a new interface to send custom messages
  • [DRILL-4313] - C++ client - Improve method of drillbit selection from cluster
  • [DRILL-4327] - Fix rawtypes warning emitted by compiler
  • [DRILL-4359] - EndpointAffinity missing equals method
  • [DRILL-4361] - Allow for FileSystemPlugin subclasses to override FormatCreator
  • [DRILL-4363] - Apply row count based pruning for parquet table in LIMIT n query
  • [DRILL-4383] - Allow passign custom configuration options to a file system through the storage plugin config
  • [DRILL-4423] - TestCsvHeader#testEmptyFinalColumn is causing the unit test framework to print 10K rows in Stdout

New Feature

  • [DRILL-2517] - Apply Partition pruning before reading files during planning
  • [DRILL-4314] - Unit Test Framework Enhancement: Schema check for zero-row query
  • [DRILL-4485] - MapR profile - use MapR 5.1.0

Task

  • [DRILL-4295] - Obsolete protobuf generated files under protocol/