v23_0_0_rc1

Released at 2021-10-06 03:02

Added Product(s)

Removed Products(s)

cp_verify

cpputils

meas_extensions_gaap

meas_extensions_trailedSources

Ticket

Description

Last Merge

Product

DM-6056

Remove PTR and CONST_PTR macros

2021-08-30T18:17Z

afw, base, daf_persistence, ip_diffim, meas_algorithms, meas_astrom, meas_base, meas_deblender, meas_extensions_psfex, meas_modelfit, obs_subaru, shapelet

DM-11419

afwTable rows define offsets as int32, causing problems with very large (>2Gb) rows

2021-08-08T22:26Z

afw

DM-13089

Use new visitInfo parallactic angle calculations in jointcal

2021-09-29T23:58Z

jointcal

DM-13155

Fix typo in processEimage

2021-08-11T04:13Z

ip_diffim

DM-13365

Minimal on-disk caching Datastore

2021-09-08T00:29Z

daf_butler

DM-19392

Interval class and geom Python enhancements: Stage 1

2021-09-21T00:35Z

afw, geom, sphgeom

DM-22486

afwTable will seg-fault if you add a new record to a table with schema=None

2021-08-05T22:58Z

afw

DM-22534

Implement cpSkyTask

2021-09-22T22:49Z

cp_pipe, daf_butler

DM-24389

Implement amp-to-amp offset correction task

2021-09-01T04:38Z

ip_isr, obs_subaru

DM-24913

obs_decam README is confusing

2021-07-22T23:28Z

obs_decam

DM-25013

Unclear error messages in pipetask run

2021-09-15T01:37Z

ctrl_mpexec, daf_butler, pipe_base

DM-26214

Switch to using sourceTable and objectTable parquet files instead of the src FITS files

2021-08-02T17:26Z

faro

DM-27387

Implement scattering magnitudes for ApFakes

2021-08-04T19:11Z

ap_pipe, ap_verify, pipe_tasks

DM-27492

Improvements to pipetask execution options

2021-08-12T06:15Z

ctrl_mpexec, pipe_base

DM-28111

Include RUN name in QG dot diagrams for resolved DatasetRefs

2021-09-29T14:44Z

ctrl_mpexec

DM-28148

Make a gen 3 version of the colour colour plots in color_analysis

2021-09-22T01:42Z

obs_subaru, sdm_schemas

DM-28394

write write|transform|consolidateForcedSourceTable Tasks

2021-09-16T00:57Z

ap_association, obs_lsst, obs_subaru, pipe_tasks

DM-28653

Modify BPS to support execution butler

2021-07-29T04:05Z

ctrl_bps

DM-29310

Use CoaddPsfs from all warps in getTemplate task

2021-09-01T00:52Z

ip_diffim, meas_algorithms, pipe_tasks

DM-29346

Compute PSFlux chi squared metric

2021-07-26T22:14Z

ap_association, meas_base

DM-29511

Cleanup code on afw using clang-tidy

2021-09-13T23:25Z

afw

DM-29531

Update IsrCalib so it can serve as StorageClass for subclasses

2021-09-21T23:24Z

daf_butler, ip_isr

DM-29543

Gen3 refcat converter

2021-09-17T17:51Z

meas_algorithms

DM-29628

Better-handle alignment of source injection from FITS files

2021-10-03T06:01Z

pipe_tasks

DM-29756

BPS - Automatic retry with larger memory

2021-09-01T23:57Z

ctrl_bps

DM-29893

un-hardcode bps report output

2021-07-27T20:33Z

ctrl_bps

DM-29981

Migrate cp_pipe pipelines as defined in RFC-775

2021-07-22T19:52Z

cp_pipe, obs_lsst, obs_subaru

DM-30125

Add simple unit tests for image differencing

2021-08-23T18:45Z

ip_diffim

DM-30178

Please make daf_butler compatible with sqlalchemy 2

2021-08-31T18:53Z

daf_butler

DM-30202

Add “online” coaddition code to meas_algorithms and pipe_tasks

2021-08-04T15:26Z

meas_algorithms, pipe_tasks

DM-30245

Document cp_pipe

2021-08-11T21:21Z

cp_pipe

DM-30301

Switch Task to use python logging rather than lsst.log

2021-07-28T03:57Z

meas_base, obs_base, obs_test, pipe_base, pipe_tasks

DM-30349

Source count metrics include fake sources

2021-08-02T19:39Z

ap_verify, pipe_tasks

DM-30465

Implement decorrelation afterburner for maximum likelihood images

2021-09-25T18:10Z

ip_diffim, pipe_tasks

DM-30534

Test and Implement Default Parameters for Jointcal Outlier Rejection

2021-08-03T18:32Z

jointcal, obs_subaru

DM-30665

Add Source and Object schema_checks to ci_imsim

2021-09-20T23:13Z

sdm_schemas

DM-30683

Remove diaSourceAnalysis.py

2021-07-24T00:16Z

ip_diffim

DM-30777

Remove unused includes in afw

2021-09-23T22:33Z

afw, jointcal

DM-30787

Translate getting started tutorials to use gen3 and the new RC2 subset

2021-09-01T18:01Z

pipe_base

DM-30820

Investigate effect of reducing background fit Chebyshev polynomial order in DC2

2021-07-26T02:51Z

obs_lsst

DM-30905

Numpydoc conversion of meas_algorithms through utils.py

2021-08-04T20:53Z

meas_algorithms

DM-30977

Write pipeline task log output to butler

2021-07-26T22:43Z

ctrl_mpexec, daf_butler, pipe_base

DM-30992

dax_apdb’s uint64 is incompatible with pandas 1.3.0

2021-08-27T01:29Z

dax_apdb

DM-31026

Create Ephemeris Cache Precomputation Task for SSO attribution pipeline

2021-09-28T01:32Z

ap_association

DM-31033

Move DiaCalculation from a subtask of AssociationTask to a subtask of DiaPipe.

2021-07-26T19:17Z

ap_association

DM-31035

Reading an exposure may fail with certain metadata keys set

2021-10-04T14:14Z

afw

DM-31046

Write a Task for preparing diaSource cutouts for Zooniverse

2021-10-04T19:17Z

utils

DM-31079

Butler define-visits ignores collection

2021-08-13T05:06Z

obs_base

DM-31116

Deleting non-existant files from S3 ButlerURI triggers backoff

2021-08-11T04:47Z

daf_butler

DM-31131

lsst.verify outputs non-standard NaN in JSON

2021-09-17T17:22Z

verify

DM-31135

Add DM license preamble for each of the python files

2021-08-16T22:45Z

faro

DM-31136

Consistently adopt DM convention for class names involving Task, Config, and Connections

2021-08-05T14:55Z

faro

DM-31141

Add test decorators for cartesian product

2021-07-27T18:14Z

utils

DM-31146

Add cp_verify to lsst_distrib

2021-07-27T22:27Z

lsst_distrib

DM-31163

Add section to Object Table spec for flags taken from forced_src

2021-08-03T01:32Z

obs_subaru

DM-31174

str() method failure on lsst.ip.isr.Defects class

2021-07-22T22:25Z

ip_isr

DM-31180

ap_verify loses logs from pipeline

2021-07-26T22:38Z

ap_verify

DM-31188

Fix LoadReferenceCatalogTask so it doesn’t temporarily clobber its own config

2021-07-27T17:38Z

pipe_tasks

DM-31217

Add task to consolidate healsparse property maps

2021-09-29T03:44Z

obs_lsst, obs_subaru, pipe_tasks, skymap

DM-31220

API mismatch in Gen 2 ap_pipe

2021-07-27T22:02Z

ap_association, ap_pipe

DM-31228

Migrate obs packages to python logging where appropriate

2021-07-29T15:13Z

obs_cfht, obs_decam, obs_lsst, obs_subaru

DM-31233

Add PanDA packages to rubin-env

2021-08-12T22:44Z

lsst

DM-31235

LSST_CONDA_ENV_NAME cannot override newinstall.sh

2021-08-04T16:18Z

lsst

DM-31238

Remove phosimToRafts from obs_lsst

2021-07-29T19:54Z

obs_lsst, obs_lsst

DM-31240

Add support of Execution Butler into the PanDA plugin

2021-09-07T16:26Z

ctrl_bps

DM-31249

Fix ButlerURI.join confusion with schemeless URI

2021-07-31T04:12Z

daf_butler

DM-31251

Add execution butler example to pipelines_check

2021-08-02T17:28Z

daf_butler, pipe_base, pipelines_check

DM-31255

Fix log-to-butler failutres with –skip-existing

2021-07-30T02:25Z

ctrl_mpexec

DM-31262

Execution butler creation should not forward namespace value

2021-08-02T22:04Z

pipe_base

DM-31267

Jointcal failures in w_2021_30

2021-08-23T23:56Z

jointcal

DM-31272

Allow for curation of schema_index values “above” the Felis-file level

2021-09-29T23:19Z

sdm_schemas

DM-31275

w_2021_30 deblend or mergeDetections not playing nice with missing bands

2021-08-02T22:46Z

pipe_tasks

DM-31278

transformDiaSourceCatalog.py not expanding environment variables after weekly 29

2021-08-02T20:44Z

ap_association

DM-31282

Fetch only last-produced metric in chained collection in gen3_to_job

2021-09-02T23:50Z

verify

DM-31285

Enable meas_algorithms python API docs

2021-08-13T15:55Z

meas_algorithms

DM-31291

Documentation for CatalogMeasurementBase broken

2021-08-05T04:19Z

faro

DM-31294

Re-run faro on DC2 and re-dispatch with appropriate dates

2021-09-02T00:05Z

faro

DM-31295

Add timers for datastore activities and improve S3 performance

2021-08-04T20:00Z

daf_butler

DM-31301

Fix VignetteExposure name

2021-08-30T17:04Z

cp_pipe

DM-31303

conda needs –strict-channel-priority to get proper compilers

2021-08-04T15:45Z

lsst

DM-31306

Create single SAL script that produces biases, darks, and flats

2021-09-29T02:37Z

cp_pipe

DM-31313

Add htmIndex computation for DiaSources

2021-09-17T17:55Z

ap_association, pipe_tasks

DM-31324

Rearrange steps in DRP.yaml for more complete outputs and weave in diffm

2021-08-05T04:16Z

obs_lsst, obs_subaru

DM-31326

Run faro on gen3_RC2_subset and set it up in Jenkins

2021-09-09T20:07Z

faro

DM-31331

Add new log options to bps

2021-08-05T17:31Z

ctrl_bps

DM-31337

Allow skipping calibration collections in registry search methods

2021-08-07T14:12Z

daf_butler

DM-31344

Execution butler creation fails on s3

2021-08-10T22:56Z

daf_butler

DM-31355

Switch from the deprecated log.getName() to log.name

2021-08-11T03:40Z

ap_verify, meas_extensions_piff

DM-31359

MaskStreaks sending bad matrix to scipy.linalg.cho_factor

2021-08-19T13:59Z

pipe_tasks

DM-31360

w_2021_30 deblend still not playing nice with missing bands

2021-08-18T17:10Z

pipe_tasks

DM-31366

Add confirmation request to butler prune-collection

2021-09-02T18:02Z

daf_butler

DM-31367

Add butler register-dataset-type subcommand

2021-08-26T19:55Z

daf_butler

DM-31376

assembleCoadd can’t handle when selectVisit selects a visit with no Warp

2021-08-18T16:52Z

pipe_tasks

DM-31381

No connection called refDataset in CatalogMeasurementBaseConnections

2021-08-12T15:52Z

faro

DM-31382

Run faro in ci_hsc and ci_imsim

2021-08-24T21:35Z

faro

DM-31384

Add pipetask log option to add arbitrary MDC records

2021-08-12T22:46Z

ctrl_bps, ctrl_mpexec, daf_butler

DM-31389

Move new DiaObject creation out of AssociationTask

2021-09-16T19:47Z

ap_association

DM-31394

Overscan subtraction can create negative variance

2021-08-17T17:51Z

ip_isr

DM-31398

Error with execution butler on IDF’s DC2 repo

2021-08-14T14:26Z

daf_butler, pipe_base

DM-31412

Add config/imsim/charImage.py to obs_lsst

2021-08-17T13:11Z

obs_lsst

DM-31417

Add makeHpxWcs to afwGeom to make an HPX SkyWcs object.

2021-08-30T20:44Z

afw

DM-31419

ImageDifferenceTask no longer timed in AP

2021-08-18T23:50Z

ap_pipe, ap_verify

DM-31429

UNION ALL in subqueries is causing catastrophic database pessimizations

2021-08-17T22:21Z

daf_butler

DM-31434

Placeholder PSF WARN in charImage should be INFO

2021-08-18T04:06Z

pipe_tasks

DM-31442

Pass logName for undeblended plugins

2021-08-19T15:17Z

meas_base

DM-31443

Fix typo in quickFrameMeasurement task

2021-08-19T02:16Z

pipe_tasks

DM-31445

Ensure GAaP measurements are aperture corrected

2021-08-19T03:57Z

obs_lsst, obs_subaru

DM-31448

Allow gen2 butler lookups even when fields in the dataId are not in the registry

2021-09-12T15:56Z

daf_persistence

DM-31458

Prepare to merge Cassandra branch of dax_apdb

2021-10-06T02:19Z

ap_association, ap_pipe, dax_apdb, verify

DM-31462

Add random seed config to make fgcm density downsampling repeatable

2021-08-19T22:38Z

fgcmcal, obs_subaru

DM-31466

segfault when spatialOrder is zero in psfDetermination

2021-08-19T03:52Z

meas_extensions_psfex

DM-31472

Execution Butler merge failed with large workflows

2021-08-20T17:39Z

daf_butler

DM-31476

Clean up PanDA’s example bps yaml file

2021-09-30T05:44Z

ctrl_bps

DM-31489

Update StrayLightData to use FitsGenericFormatter with a deferred data set

2021-08-26T19:43Z

ip_isr, obs_subaru

DM-31505

Update fgcm to better handle survey edges and reference star outliers

2021-09-02T04:49Z

fgcmcal

DM-31507

Adjust stack objects to accommodate reference counting

2021-08-26T18:23Z

ctrl_mpexec, daf_butler, pex_config, pipe_base, pipe_tasks

DM-31520

Request butler collection-chain to take comma-separated list

2021-08-27T18:27Z

daf_butler, pipelines_check

DM-31528

Add more log messages to the measure task

2021-08-31T03:07Z

meas_base, meas_extensions_scarlet

DM-31530

Log outputs are being swallowed when running pipe_drivers scripts

2021-08-26T21:53Z

ctrl_pool

DM-31535

Deprecate PSF methods default position argument

2021-09-09T17:06Z

afw

DM-31540

Remove butlerQC.registry usage from fgcmcal

2021-08-26T22:30Z

fgcmcal

DM-31541

Change pipetaskInit job to not read full QuantumGraph

2021-09-09T03:47Z

ctrl_bps

DM-31542

Examine why disassembled composites take up much more space in datastore

2021-08-30T21:18Z

afw, daf_butler

DM-31545

Fix cp_pipe/defects debug error

2021-08-27T23:55Z

cp_pipe

DM-31548

patch_skypix_overlap table needs an additional index

2021-09-10T20:37Z

daf_butler

DM-31549

Fix clang compilation in lsst_distrib

2021-08-30T23:09Z

log

DM-31571

Gen3 isrTask could be made to take a default None camera object

2021-09-01T14:04Z

ip_isr

DM-31579

Fix permissions of butler log datasets

2021-09-07T17:02Z

ctrl_mpexec

DM-31580

Split “step5” into a per-tract step5 and a per-visit step6

2021-09-01T23:46Z

obs_lsst, obs_subaru

DM-31583

Add interfaces to dataset summary table data and use it to improve query generation

2021-09-22T14:44Z

daf_butler, pipe_base

DM-31591

Update developer guide on logging practices

2021-09-09T19:47Z

meas_base

DM-31596

Export DM-28920 calibrations for use at the summit

2021-09-14T19:08Z

daf_butler

DM-31601

Add tasks to forced phot diaObjects on calexps,diffim,coadds

2021-09-14T14:07Z

ap_association, meas_base, obs_lsst, obs_subaru, pipe_tasks

DM-31609

lsst.verify.Measurement needs a useful __repr__()

2021-09-10T17:00Z

verify

DM-31623

Support dataId rewriting on butler.put

2021-09-02T14:52Z

daf_butler

DM-31631

Forward job creation message on to dispatch_verify

2021-09-15T00:06Z

verify

DM-31659

Logging loses part of message in assembly.py

2021-09-04T04:21Z

obs_lsst

DM-31664

Fix clang compilation warnings

2021-09-09T19:27Z

jointcal, meas_extensions_psfex

DM-31676

Add genTemplate to obs_subaru/obs_lsst subsets for DC2/RC2 batch reruns

2021-09-08T16:11Z

obs_lsst, obs_subaru, pipe_tasks

DM-31691

pipetask doesn’t find dataset in execution butler from previous run.

2021-09-09T02:25Z

ctrl_mpexec

DM-31696

VERBOSE log-level in pipetask run sometimes issues DEBUG log messages

2021-09-09T04:25Z

daf_butler, ip_isr

DM-31700

Butler parquet formatter fails to load table with no indexes

2021-09-09T04:07Z

daf_butler

DM-31710

Optimize crosstalkSources lookup in IsrTask

2021-09-13T17:41Z

ip_isr

DM-31711

Problems pipetask –save-execution-butler w_2021_37

2021-09-14T01:17Z

ctrl_mpexec

DM-31721

Create cpputils package

2021-09-20T19:55Z

afw, ap_pipe, ap_verify, daf_base, geom, jointcal, meas_algorithms, meas_base, meas_modelfit, obs_cfht, obs_decam, obs_lsst, obs_subaru, utils

DM-31722

Move utility code out of pipe_base and daf_butler into utils package

2021-09-28T03:55Z

utils

DM-31760

Single amp reads for obs_lsst have the wrong geometry.

2021-09-15T21:02Z

obs_lsst

DM-31765

Make ForcedSourceOnDiaObjectsTable

2021-09-26T18:09Z

obs_lsst, obs_subaru, pipe_tasks

DM-31783

Register DECam N419 and N540 filters

2021-09-15T18:23Z

obs_decam

DM-31785

make butler transfer-datasets more efficient

2021-09-25T04:41Z

daf_butler

DM-31809

length of mask and means can disagree in BrighterFatterKernelSolveTask

2021-09-28T17:22Z

cp_pipe

DM-31825

Parquet Table clean up before DP0.2 Preliminary run.

2021-09-30T00:10Z

ap_association, fgcmcal, jointcal, meas_base, obs_lsst, obs_subaru, pipe_tasks, sdm_schemas

DM-31826

FileDatastore.transfer_from is replacing physical files with circular symlinks in the execution butler final job

2021-09-22T19:56Z

daf_butler

DM-31827

Stop providing fgcm photoCalib solutions when dubious

2021-09-24T03:57Z

fgcmcal

DM-31832

Change default LoadDiaCatalogs behavior to spatial loading of DiaSources.

2021-09-21T23:00Z

ap_association

DM-31841

The queue parameter submitted on per task level is not available in the GenericWorkflowJob

2021-09-23T01:24Z

ctrl_bps

DM-31846

Ongoing Jenkins issues

2021-09-21T22:49Z

faro

DM-31848

Add faro steps to DRP.yaml in obs_lsst/imsim

2021-09-30T00:57Z

obs_lsst

DM-31849

ForcedPhotCcdOnDataFrame outputs all NaNs

2021-09-29T14:55Z

meas_base, pipe_tasks

DM-31859

Add user-specified clustering to bps

2021-09-28T03:32Z

ctrl_bps

DM-31861

HSC DRP.yaml should not import from jointcal tests

2021-09-22T21:14Z

obs_subaru

DM-31869

Remove computeShape calls without argument in GAaP

2021-09-22T22:30Z

meas_base

DM-31887

Make execution butler default in ctrl_bps

2021-09-30T00:54Z

ctrl_bps

DM-31891

Fix cp_pipe documentation build error

2021-09-24T20:14Z

cp_pipe

DM-31900

Use per task cloud setting in PanDA plugin

2021-09-29T01:40Z

ctrl_bps

DM-31903

Add update kwargs/option to instrument registration

2021-09-24T19:13Z

obs_base, obs_base, obs_cfht, obs_decam, obs_lsst, obs_subaru

DM-31912

Add additional GAaP circular apertures for DP0.2

2021-09-30T00:49Z

obs_lsst, sdm_schemas

DM-31941

Log dataset does not overwrite on rerun with execution butler

2021-09-30T04:07Z

ctrl_mpexec, daf_butler

DM-31944

concurrency_limit split in htcondor submit file

2021-09-29T19:27Z

ctrl_bps

DM-31948

Fix regression in AP catalog metrics

2021-09-29T06:14Z

ip_diffim

DM-31956

mergeExecutionButler task hits database deadlock intermittently

2021-10-04T16:58Z

daf_butler

DM-31963

Use default compression for persisting parquet files

2021-10-01T00:09Z

daf_butler, pipe_tasks

DM-31970

Fix submission AttributeError in htcondor plugin when not using execution butler

2021-09-30T03:59Z

ctrl_bps

DM-32030

Fixup Jointcal after DM-31825

2021-10-05T20:27Z

jointcal