Changelog

Development

0.5.0

  • [Updated] Upgrade ska-sdp-config to 1.5.1 (MR37)

  • [Added] Use batches to add orphaned data, and seperate disk i/o tasks from DB tasks. (MR33)

0.4.0

  • [Updated] Use glob.glob to find all data directories in one go for processing orphaned data. (MR29)

  • [Updated] When allocatable space is determined, do not read size of directory from disk if allocation already contains final size. (MR29)

  • [Fixed] Generate orphaned data for more than one pb for a given eb if exists. (MR29)

  • [Updated] Create allocations for orphaned data. (MR31)

  • [Updated] Added functionality to update flow sizes of finished data products. (MR30)

  • [Fixed] Calculation of orphaned data value. (MR27)

  • [Fixed] etcd transaction failures in the buffer manager caused by exceeding the maximum number of operations per transaction (“too many operations in txn request”). (MR23, MR25)

  • [Fixed] Setting permissions on data product directories to work on any file system. (MR22)

  • [Updated] To create execution block along with processing block and flows for orphaned data products. (MR21)

  • [Updated] Update Available Quantity calculation. (MR24)

0.3.0

  • [Updated] Total storage capacity is configured via the SDP_BUFFERMANAGER_TOTAL_CAPACITY environment varialble, when set (MR19)

  • [Updated] Dependency status is checked to see if flow can be deleted (MR18)

  • [Added] Data Product Flow directories are now created for flows that are in PENDING state. (MR20)

0.2.0

  • [Updated] Upgraded ska-sdp-config to 1.3.0 (MR17)

  • [Updated] When removing data product directories, if path is not specified in flow, construct path using eb_id (MR16)

  • [Updated] Allow flow directory to be missing when deleting. (MR11)

  • [Updated] Upgraded ska-sdp-config to 1.2.0 (MR8)

  • [Updated] Update base images to ska-build-python 0.3.1 and ska-python 0.2.3 (MR4)

  • [Added] Add feature to move data products associated with data flows in DELETING to a recycle bin. (MR5)

  • [Added] Mark flow entries for deletion that have expired and are no longer referenced. (MR6, MR7)

0.1.0

  • [Changed] Buffer manager now works with capacity buffer storage, not performance buffer storage (MR3)

  • [Changed] Renamed PerformanceBufferStorageResource to CapacityBufferStorageResource (MR3)

  • [Added] Update main loop to alight with structure in ska-sdp-proccontrol. (MR2)

  • [Added] Included changelog in documentation. (MR2)

  • [Added] Created the PerformanceBufferStorageResource class to create and update resource entries in the configuration database. (MR2)