You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Currently sort_and_finalize_staged_data the indexes in all segments to be sorted. Or an exception is thrown.
Traceback (most recent call last):
File "...\test.py", line 9, in <module>
lib.write("sym", df, staged=True)
File "...\arcticdb\version_store\library.py", line 461, in write
return self._nvs.write(
File "...\arcticdb\version_store\_store.py", line 583, in write
self.version_store.write_parallel(symbol, item, norm_meta, udm)
arcticdb_ext.exceptions.UnsortedDataException: E_UNSORTED_DATA When writing/appending staged data in parallel, input data must be sorted.
Describe the solution you'd like
Allow unordered indexes in staged segments and sort then when sort_and_finalize_staged_data is called.
The text was updated successfully, but these errors were encountered:
vasil-pashov
changed the title
sort_and_finalize does not work when the index is not sorted per segment. Should it?
Allow unordered indexes in staged area when sort_and_finalize_staged_data is used
Aug 1, 2024
Is your feature request related to a problem? Please describe.
Currently
sort_and_finalize_staged_data
the indexes in all segments to be sorted. Or an exception is thrown.Output:
Describe the solution you'd like
Allow unordered indexes in staged segments and sort then when
sort_and_finalize_staged_data
is called.The text was updated successfully, but these errors were encountered: