Releases: TileDB-Inc/TileDB
Releases · TileDB-Inc/TileDB
TileDB 2.15.3
TileDB v2.15.2
TileDB v2.15.1
TileDB v2.15.1 Release Notes
New features
- Introduce "vfs.s3.no_sign_request" to allow unsigned s3 API calls, useful for anonymous s3 bucket access. #3953
Improvements
Deprecations
Defects removed
- Fix support for empty strings for Dictionary and RLE encodings #3938
- Sparse global order reader: fix read progress update for duplicates. #3937
- Sparse unordered w/ dups: fix error on double var size overflow. #3963
- Dense reader: fix copies for schema evolution. #3970
- Sparse unordered w/ dups: overflow fix shouldn't include empty tile. #3985
API changes
C++ API
- Add a
Group
constructor that accepts a Config in the C++ API. #4011
TileDB 2.11.4
TileDB v2.11.4 Release Notes
Packaging Notes
- The linux release packages are now build with manylinux2014 (previously manylinux2010).
Defects removed
- Sparse global order reader: fixing incomplete reason for rest queries. #3620
- Sparse global order reader: fix tile cleanup when ending an iteration. #3674
- Sparse unordered w/ dups: fix error on double var size overflow. #3963
- Sparse unordered w/ dups: overflow fix shouldn't include empty tile. #3985
- Add missing query_type in array_open capnp #3616
TileDB 2.14.2
TileDB v2.14.2 Release Notes
Improvements
- RLE and dictionary filter only enabled for UTF8 since format version 17. #3868
- Fragment consolidation: using correct buffer weights. #3877
- Sparse global order reader: fix read progress update for duplicates. #3937
- Sparse unordered w/ dups: fix error on double var size overflow. #3963
Bug fixes
TileDB 2.15.0-rc2
TileDB v2.15.0 Release Notes
Disk Format
- Add FloatScaleFilter to format spec (documentation only; filter released in 2.11.0) #3494
Breaking C API changes
- Remove deprecated
Query
methods. #3841 - Remove deprecated API functions about buffers #3733
- Remove deprecated C API
tiledb_fragment_info_load_with_key
#3740 - Remove extra experimental set buffer methods #3761
- Remove C API functions
tiledb_array_open_at
and variations. #3755 - Remove C API functions
tiledb_array_consolidate_metadata
andtiledb_array_consolidate_metadata_with_key
#3742 - Remove deprecated C API function
tiledb_coords
. #3743 - Remove bitsort filter (feature-flagged filter). #3852
Breaking behavior
- An error is now raised when setting a subarray on a query that is already initialized. #3668
- An error is now raised when setting a subarray on a write to a sparse array. #3668
New features
- Partial attribute writes into a single fragment. #3714
- Query condition support for TIME types #3784
- Enable dimension labels for the C API (provisional) #3824
- Add dimension label C++ API (provisional) #3839
Improvements
- Add creation of ArrayDirectory on open to stats #3769
- Return underlying errors in Win::remove_dir #3866
- Removes tile-aligned restriction for remote global order writes by caching tile overflow data from submissions. #3762
- Implement S3 buffering support for remote global order writes #3609
- Add support for dimension labels on an encrypted array #3774
- Refactor relevant fragments into a separate class. #3738
- Implement duration instrument for measuring times in stats. #3746
- Move attribute order check to writer base #3748
- Fragment consolidator: use average cell size for buffer allocation. #3756
- Show URL in logger trace before results are returned #3745
- Refactor tiledb_set_subarray call in test/support/src/helpers.cc #3776
- Move array open methods from StorageManager to Array #3790
- Split Tile class into different classes for read and write. #3796
- Update ArrayDirectory to use ContextResources #3800
- Use
EncryptionType::NO_ENCRYPTION
instead of casting the C enum. #3545 - Tile metadata generator: fix buffer overflow on string comparison. #3821
- Ordered writer: process next tile batch while waiting on write. #3797
- Query v3: Reduce array open operations on Cloud #3626
- Read tiles: get rid of extra VFS allocation. #3848
- Clean-up
QueryBuffer
and move it away from statuses. #3840 - Storage manager: remove passthrough read/write functions. #3853
- Fix partial attribute write test. #3862
- Query v2: Add array directory and fragment meta ser/deser behind config flag #3845
- Ordered dimension label reader: handle empty array. #3869
- Fix comments in nullable attributes example. #3870
- RLE and dictionary filter only enabled for UTF8 since format version 17. #3868
- Move more resources into ContextResources #3807
- Better errors for failed dimension label queries. #3872
- Dense reader: process smaller units of work. #3856
- Use different config variable for enabling open v2 and query v3 #3879
- Fragment consolidation: using correct buffer weights. #3877
- Show expected and actual version numbers in the error message #3855
- Fix shallow test-only bug in unit_rtree.cc #3830
- Fix stack buffer overflow bug in unit-curl.cc #3832
- Fix stack use after free bug in unit_thread_pool #3831
Defects removed
- Fail if fragment info objects are accessed before loading them. #3846
- Let ConsolidationPlan::dump() produce valid JSON #3751
- Fix exceptions thrown during array schema validation for WebP filter. #3752
- Modify GlobalStats::reset() to support compensation for registered stats being effectively leaked. #3723
- Avoid pwrite bug on macOS Ventura 13.0 on Apple M1 #3799
- Fix ASAN-detected UAF in sparse global order reader #3822
- Improve WebP validation, fixes SC-24766, SC-24759 #3819
- Deregister a remote array from the Consistency multimap before reopening. #3859
- Fix buffer size error in deserializing query #3851
- Fix segfault in unit_consistency #3880
- Avoid segfault in unit_array #3883
- VFS CAPIHandle class #3523
API changes
C API
- Deprecate tiledb_query_submit_async #3802
- Deprecate
tiledb_fragment_info_get_name
. #3791 - Deprecate
tiledb_query_submit_async
. #3802 - Add
tiledb_array_delete_fragments_list
API #3798 - Add
tiledb_string_handle_t
so that C API functions can output strings with independent lifespans. #3792 - Add
tiledb_dimension_label_handle_t
andtiledb_dimension_label_t
handles to C-API #3820 - Add
tiledb_subarray_has_label_ranges
andtiledb_subarray_get_label_name
. #3858 - Add
tiledb_fragment_info_get_fragment_name_v2
. #3842 - Add function to access the dimension label attribute name. #3867
- Change query set buffer methods to set label buffers in experimental builds #3761
C++ API
- Move deprecated constructors into new array_deprecated.h file, manipulating them to use the new TemporalPolicy and EncryptionAlgorithm classes. #3854
- Add function to access the dimension label attribute name. #3867
- Add experimental
set_data_buffer
API that handles dimension labels #3882
Build system changes
Experimental features
- Set of three exploratory but fully consistent schedulers for TileDB task graph library. #3683
- Version 0.1 of specification task graph. #3754
Full Changelog:
TileDB v2.15.0
TileDB v2.15.0 Release Notes
Packaging Notes
- The TileDB homebrew package will be archived after TileDB 2.15. Please use the release binaries instead.
Disk Format
- Add FloatScaleFilter to format spec (documentation only; filter released in 2.11.0) #3494
Breaking C API changes
- Remove deprecated
Query
methods. #3841 - Remove deprecated API functions about buffers #3733
- Remove deprecated C API
tiledb_fragment_info_load_with_key
#3740 - Remove extra experimental set buffer methods #3761
- Remove C API functions
tiledb_array_open_at
and variations. #3755 - Remove C API functions
tiledb_array_consolidate_metadata
andtiledb_array_consolidate_metadata_with_key
#3742 - Remove deprecated C API function
tiledb_coords
. #3743 - Remove bitsort filter (feature-flagged filter). #3852
Breaking behavior
- An error is now raised when setting a subarray on a query that is already initialized. #3668
- An error is now raised when setting a subarray on a write to a sparse array. #3668
New features
- Partial attribute writes into a single fragment. #3714
- Query condition support for TIME types #3784
- Enable dimension labels for the C API (provisional) #3824
- Add dimension label C++ API (provisional) #3839
Improvements
- Add creation of ArrayDirectory on open to stats #3769
- Return underlying errors in Win::remove_dir #3866
- Removes tile-aligned restriction for remote global order writes by caching tile overflow data from submissions. #3762
- Implement S3 buffering support for remote global order writes #3609
- Add support for dimension labels on an encrypted array #3774
- Refactor relevant fragments into a separate class. #3738
- Implement duration instrument for measuring times in stats. #3746
- Move attribute order check to writer base #3748
- Fragment consolidator: use average cell size for buffer allocation. #3756
- Show URL in logger trace before results are returned #3745
- Refactor tiledb_set_subarray call in test/support/src/helpers.cc #3776
- Move array open methods from StorageManager to Array #3790
- Split Tile class into different classes for read and write. #3796
- Update ArrayDirectory to use ContextResources #3800
- Use
EncryptionType::NO_ENCRYPTION
instead of casting the C enum. #3545 - Tile metadata generator: fix buffer overflow on string comparison. #3821
- Ordered writer: process next tile batch while waiting on write. #3797
- Query v3: Reduce array open operations on Cloud #3626
- Read tiles: get rid of extra VFS allocation. #3848
- Clean-up
QueryBuffer
and move it away from statuses. #3840 - Storage manager: remove passthrough read/write functions. #3853
- Fix partial attribute write test. #3862
- Query v2: Add array directory and fragment meta ser/deser behind config flag #3845
- Ordered dimension label reader: handle empty array. #3869
- Fix comments in nullable attributes example. #3870
- RLE and dictionary filter only enabled for UTF8 since format version 17. #3868
- Move more resources into ContextResources #3807
- Better errors for failed dimension label queries. #3872
- Dense reader: process smaller units of work. #3856
- Use different config variable for enabling open v2 and query v3 #3879
- Fragment consolidation: using correct buffer weights. #3877
- Show expected and actual version numbers in the error message #3855
- Fix shallow test-only bug in unit_rtree.cc #3830
- Fix stack buffer overflow bug in unit-curl.cc #3832
- Fix stack use after free bug in unit_thread_pool #3831
Defects removed
- Support in place update of group members. #3928
- Fail if fragment info objects are accessed before loading them. #3846
- Let ConsolidationPlan::dump() produce valid JSON #3751
- Fix exceptions thrown during array schema validation for WebP filter. #3752
- Modify GlobalStats::reset() to support compensation for registered stats being effectively leaked. #3723
- Avoid pwrite bug on macOS Ventura 13.0 on Apple M1 #3799
- Fix ASAN-detected UAF in sparse global order reader #3822
- Improve WebP validation, fixes SC-24766, SC-24759 #3819
- Deregister a remote array from the Consistency multimap before reopening. #3859
- Fix buffer size error in deserializing query #3851
- Fix segfault in unit_consistency #3880
- Avoid segfault in unit_array #3883
- VFS CAPIHandle class #3523
API changes
C API
- Deprecate tiledb_query_submit_async #3802
- Deprecate
tiledb_fragment_info_get_name
. #3791 - Deprecate
tiledb_query_submit_async
. #3802 - Add
tiledb_array_delete_fragments_list
API #3798 - Add
tiledb_string_handle_t
so that C API functions can output strings with independent lifespans. #3792 - Add
tiledb_dimension_label_handle_t
andtiledb_dimension_label_t
handles to C-API #3820 - Add
tiledb_subarray_has_label_ranges
andtiledb_subarray_get_label_name
. #3858 - Add
tiledb_fragment_info_get_fragment_name_v2
. #3842 - Add function to access the dimension label attribute name. #3867
- Change query set buffer methods to set label buffers in experimental builds #3761
C++ API
- Move deprecated constructors into new array_deprecated.h file, manipulating them to use the new TemporalPolicy and EncryptionAlgorithm classes. #3854
- Add function to access the dimension label attribute name. #3867
- Add experimental
set_data_buffer
API that handles dimension labels #3882
Build system changes
Experimental features
- Set of three exploratory but fully consistent schedulers for TileDB task graph library. #3683
- Version 0.1 of specification task graph. #3754
Full Changelog:
TileDB 2.15.0-rc1
TileDB v2.15.0 Release Notes
Disk Format
- Add FloatScaleFilter to format spec (documentation only; filter released in 2.11.0) #3494
Breaking C API changes
- Remove deprecated
Query
methods. #3841 - Remove deprecated API functions about buffers #3733
- Remove deprecated C API
tiledb_fragment_info_load_with_key
#3740 - Remove extra experimental set buffer methods #3761
- Remove C API functions
tiledb_array_open_at
and variations. #3755 - Remove C API functions
tiledb_array_consolidate_metadata
andtiledb_array_consolidate_metadata_with_key
#3742 - Remove deprecated C API function
tiledb_coords
. #3743 - Remove bitsort filter (feature-flagged filter). #3852
Breaking behavior
- An error is now raised when setting a subarray on a query that is already initialized. #3668
- An error is now raised when setting a subarray on a write to a sparse array. #3668
New features
- Partial attribute writes into a single fragment. #3714
- Query condition support for TIME types #3784
- Enable dimension labels for the C API (provisional) #3824
- Add dimension label C++ API (provisional) #3839
Improvements
- Add creation of ArrayDirectory on open to stats #3769
- Return underlying errors in Win::remove_dir #3866
- Removes tile-aligned restriction for remote global order writes by caching tile overflow data from submissions. #3762
- Implement S3 buffering support for remote global order writes #3609
- Add support for dimension labels on an encrypted array #3774
- Refactor relevant fragments into a separate class. #3738
- Implement duration instrument for measuring times in stats. #3746
- Move attribute order check to writer base #3748
- Fragment consolidator: use average cell size for buffer allocation. #3756
- Show URL in logger trace before results are returned #3745
- Refactor tiledb_set_subarray call in test/support/src/helpers.cc #3776
- Move array open methods from StorageManager to Array #3790
- Split Tile class into different classes for read and write. #3796
- Update ArrayDirectory to use ContextResources #3800
- Use
EncryptionType::NO_ENCRYPTION
instead of casting the C enum. #3545 - Tile metadata generator: fix buffer overflow on string comparison. #3821
- Ordered writer: process next tile batch while waiting on write. #3797
- Query v3: Reduce array open operations on Cloud #3626
- Read tiles: get rid of extra VFS allocation. #3848
- Clean-up
QueryBuffer
and move it away from statuses. #3840 - Storage manager: remove passthrough read/write functions. #3853
- Fix partial attribute write test. #3862
- Query v2: Add array directory and fragment meta ser/deser behind config flag #3845
- Ordered dimension label reader: handle empty array. #3869
- Fix comments in nullable attributes example. #3870
- RLE and dictionary filter only enabled for UTF8 since format version 17. #3868
- Move more resources into ContextResources #3807
- Better errors for failed dimension label queries. #3872
- Dense reader: process smaller units of work. #3856
- Use different config variable for enabling open v2 and query v3 #3879
- Fragment consolidation: using correct buffer weights. #3877
- Show expected and actual version numbers in the error message #3855
- Fix shallow test-only bug in unit_rtree.cc #3830
- Fix stack buffer overflow bug in unit-curl.cc #3832
- Fix stack use after free bug in unit_thread_pool #3831
Defects removed
- Fail if fragment info objects are accessed before loading them. #3846
- Let ConsolidationPlan::dump() produce valid JSON #3751
- Fix exceptions thrown during array schema validation for WebP filter. #3752
- Modify GlobalStats::reset() to support compensation for registered stats being effectively leaked. #3723
- Avoid pwrite bug on macOS Ventura 13.0 on Apple M1 #3799
- Fix ASAN-detected UAF in sparse global order reader #3822
- Improve WebP validation, fixes SC-24766, SC-24759 #3819
- Deregister a remote array from the Consistency multimap before reopening. #3859
- Fix buffer size error in deserializing query #3851
- Fix segfault in unit_consistency #3880
- Avoid segfault in unit_array #3883
- VFS CAPIHandle class #3523
API changes
C API
- Deprecate tiledb_query_submit_async #3802
- Deprecate
tiledb_fragment_info_get_name
. #3791 - Deprecate
tiledb_query_submit_async
. #3802 - Add
tiledb_array_delete_fragments_list
API #3798 - Add
tiledb_string_handle_t
so that C API functions can output strings with independent lifespans. #3792 - Add
tiledb_dimension_label_handle_t
andtiledb_dimension_label_t
handles to C-API #3820 - Add
tiledb_subarray_has_label_ranges
andtiledb_subarray_get_label_name
. #3858 - Add
tiledb_fragment_info_get_fragment_name_v2
. #3842 - Add function to access the dimension label attribute name. #3867
- Change query set buffer methods to set label buffers in experimental builds #3761
C++ API
- Move deprecated constructors into new array_deprecated.h file, manipulating them to use the new TemporalPolicy and EncryptionAlgorithm classes. #3854
- Add function to access the dimension label attribute name. #3867
- Add experimental
set_data_buffer
API that handles dimension labels #3882
Build system changes
Experimental features
- Set of three exploratory but fully consistent schedulers for TileDB task graph library. #3683
- Version 0.1 of specification task graph. #3754
Full Changelog:
TileDB 2.15.0-rc0
TileDB v2.15.0 Release Notes
Disk Format
- Add FloatScaleFilter to format spec (documentation only; filter released in 2.11.0) #3494
Breaking C API changes
- Remove deprecated
Query
methods. #3841 - Remove deprecated API functions about buffers #3733
- Remove deprecated C API
tiledb_fragment_info_load_with_key
#3740 - Remove extra experimental set buffer methods #3761
- Remove C API functions
tiledb_array_open_at
and variations. #3755 - Remove C API functions
tiledb_array_consolidate_metadata
andtiledb_array_consolidate_metadata_with_key
#3742 - Remove deprecated C API function
tiledb_coords
. #3743 - Remove bitsort filter (feature-flagged filter). #3852
Breaking behavior
- An error is now raised when setting a subarray on a query that is already initialized. #3668
- An error is now raised when setting a subarray on a write to a sparse array. #3668
New features
- Partial attribute writes into a single fragment. #3714
- Query condition support for TIME types #3784
- Enable dimension labels for the C API (provisional) #3824
- Add dimension label C++ API (provisional) #3839
Improvements
- Add creation of ArrayDirectory on open to stats #3769
- Return underlying errors in Win::remove_dir #3866
- Removes tile-aligned restriction for remote global order writes by caching tile overflow data from submissions. #3762
- Implement S3 buffering support for remote global order writes #3609
- Add support for dimension labels on an encrypted array #3774
- Refactor relevant fragments into a separate class. #3738
- Implement duration instrument for measuring times in stats. #3746
- Move attribute order check to writer base #3748
- Fragment consolidator: use average cell size for buffer allocation. #3756
- Show URL in logger trace before results are returned #3745
- Refactor tiledb_set_subarray call in test/support/src/helpers.cc #3776
- Move array open methods from StorageManager to Array #3790
- Split Tile class into different classes for read and write. #3796
- Update ArrayDirectory to use ContextResources #3800
- Use
EncryptionType::NO_ENCRYPTION
instead of casting the C enum. #3545 - Tile metadata generator: fix buffer overflow on string comparison. #3821
- Ordered writer: process next tile batch while waiting on write. #3797
- Query v3: Reduce array open operations on Cloud #3626
- Read tiles: get rid of extra VFS allocation. #3848
- Clean-up
QueryBuffer
and move it away from statuses. #3840 - Storage manager: remove passthrough read/write functions. #3853
- Fix partial attribute write test. #3862
- Query v2: Add array directory and fragment meta ser/deser behind config flag #3845
- Ordered dimension label reader: handle empty array. #3869
- Fix comments in nullable attributes example. #3870
- RLE and dictionary filter only enabled for UTF8 since format version 17. #3868
- Move more resources into ContextResources #3807
- Better errors for failed dimension label queries. #3872
- Dense reader: process smaller units of work. #3856
- Use different config variable for enabling open v2 and query v3 #3879
- Fragment consolidation: using correct buffer weights. #3877
- Show expected and actual version numbers in the error message #3855
- Fix shallow test-only bug in unit_rtree.cc #3830
- Fix stack buffer overflow bug in unit-curl.cc #3832
- Fix stack use after free bug in unit_thread_pool #3831
Defects removed
- Fail if fragment info objects are accessed before loading them. #3846
- Let ConsolidationPlan::dump() produce valid JSON #3751
- Fix exceptions thrown during array schema validation for WebP filter. #3752
- Modify GlobalStats::reset() to support compensation for registered stats being effectively leaked. #3723
- Avoid pwrite bug on macOS Ventura 13.0 on Apple M1 #3799
- Fix ASAN-detected UAF in sparse global order reader #3822
- Improve WebP validation, fixes SC-24766, SC-24759 #3819
- Deregister a remote array from the Consistency multimap before reopening. #3859
- Fix buffer size error in deserializing query #3851
- Fix segfault in unit_consistency #3880
- Avoid segfault in unit_array #3883
- VFS CAPIHandle class #3523
API changes
C API
- Deprecate tiledb_query_submit_async #3802
- Deprecate
tiledb_fragment_info_get_name
. #3791 - Deprecate
tiledb_query_submit_async
. #3802 - Add
tiledb_array_delete_fragments_list
API #3798 - Add
tiledb_string_handle_t
so that C API functions can output strings with independent lifespans. #3792 - Add
tiledb_dimension_label_handle_t
andtiledb_dimension_label_t
handles to C-API #3820 - Add
tiledb_subarray_has_label_ranges
andtiledb_subarray_get_label_name
. #3858 - Add
tiledb_fragment_info_get_fragment_name_v2
. #3842 - Add function to access the dimension label attribute name. #3867
- Change query set buffer methods to set label buffers in experimental builds #3761
C++ API
- Move deprecated constructors into new array_deprecated.h file, manipulating them to use the new TemporalPolicy and EncryptionAlgorithm classes. #3854
- Add function to access the dimension label attribute name. #3867
- Add experimental
set_data_buffer
API that handles dimension labels #3882
Build system changes
Experimental features
- Set of three exploratory but fully consistent schedulers for TileDB task graph library. #3683
- Version 0.1 of specification task graph. #3754
Full Changelog:
TileDB 2.14.1
TileDB v2.14.1 Release Notes
Defects removed
- Tile metadata generator: fix buffer overflow on string comparison. #3821