Skip to content

3.1.2 Release Note #57263

@morrySnow

Description

@morrySnow

New Features

Storage and Compression

  • Configurable table compression type — allows selecting specific compression algorithms per table.
    #56276
  • Adaptive compaction write caching — dynamically tunes write caching during base compaction rowset flush.
    #56278

Cloud and Object Storage

  • Cloud mode query freshness control — adds user-defined tolerance between data latency and consistency.
    #56390
  • Object storage endpoint validation relaxed — enables private or custom storage endpoints.
    #56641

Datalake

  • OSS support for Datalake VPC Endpoints (dlf/datalake-vpc).
    #56476
  • AWS Glue Catalog now supports accessing S3 via IAM AssumeRole.
    #57036
  • S3 Client updated to use CustomAwsCredentialsProviderChain for improved credential management.
    #56943

Functional Enhancements

  • Java UDF now supports IP type.
    #56346
  • BE REST API adds RunningTasks output for monitoring.
    #56781
  • Transaction monitoring adds BRPC write-amplification metrics.
    #56832

Optimizations

Query Execution and Planner

  • COUNT(*) optimization — automatically selects the smallest column to reduce scan load.
    #56483
  • Compaction skips empty rowsets to improve throughput.
    #56768
  • Warmup statistics add “skipped rowset” metric for better visibility.
    #56373

Storage Layer

  • Variant column cache added for sparse columns to speed up reads.
    #56730
  • Segment footer is now cached in Index Page Cache to reduce latency.
    #56459
  • Recycler supports parallel cleanup tasks to increase throughput.
    #56573

Datalake

  • Paimon Time Travel improved and schema mismatch fixed.
    #56338
  • Iceberg scan error messages refined and nested namespaces supported.
    #56370, #57035
  • Legacy DLF catalog properties removed.
    #56196, #56505
  • JSON Load now defaults to row-by-row parsing mode for line-based data.
    #56736

Bug Fixes

Datalake

  • Fixed Iceberg system table classloader error.
    #56220
  • Fixed Iceberg partition table failure when no partition values exist.
    #57043
  • Fixed S3A catalog not using IAM AssumeRole profile properly.
    #56250
  • Disabled Hadoop FileSystem cache for multi-config object storage catalogs.
    #57153

Query Execution and SQL Engine

  • Fixed COUNT pushdown logic error.
    #56482
  • Fixed UNION local shuffle behavior bug.
    #56556
  • Fixed crash in IN predicate for OLAP storage types.
    #56834
  • Fixed timestampdiff computation error for datetimev1.
    #56893
  • Fixed crash caused by explode() function.
    #57002

Storage and Load

  • Fixed S3 Load check failure when no source file exists.
    #56376
  • Fixed FileCache cleanup crash.
    #56584
  • Fixed delete bitmap not cleared in MOW compression.
    #56785
  • Fixed Outfile bz2 compression failure for small files.
    #57041

Cloud and Recycler Mechanism

  • Fixed Warmup skipping multi-segment rowsets.
    #56680
  • Fixed CloudTablet Warmup coredump on reference capture.
    #56627
  • Fixed Recycler null pointer crash in cleanup task.
    #56773
  • Fixed uncaught partition boundary error in Cloud mode.
    #56968

System and Miscellaneous

  • Fixed incorrect Prometheus metric format in FE.
    #57082
  • Fixed auto-increment value incorrect after FE restart.
    #57118
  • Fixed SHOW CREATE VIEW missing column definitions.
    #57045
  • Fixed HDFS Reader crash when sampling Profile data.
    #56950

Contributors

@0AyanamiRei @924060929 @CalvinKirs @Gabriel39 @JNSimba @MoanasDaddyXu @Mryange @swjtu-zhanglei @TangSiyang2001 @Yukang-Lian @amorynan @bobhan1 @csun5285 @dataroaring @deardeng @eldenmoon @englefly @freemandealer @gavinchou @hubgeter @jacktengg @kaijchen @koarz @liaoxin01 @luwei16 @morningman @morrySnow @mrhhsg @mymeiyi @seawinde @shuke987 @sollhui @starocean999 @suxiaogang223 @wyxxxcat @xy720 @yujun777 @zclllyybb @zddr @zgxme @zy-kkk @zzzxl1993

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions