HEPCloud decisionengine_modules 2.0.4

Released on 2/28/2025

The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.

Fermilab users can access the RPMs also on the production HEPCloud yum repository.

---

Here are the GitHub-generated notes:

What's Changed

• Add CodeQL workflow for GitHub code scanning by @lgtm-com in #444
• Added CPU Metrics. by @Redjacket45 in #445
• Upgrading isort version to fix pre-config install error w/ poetry by @mambelli in #456
• Eliminate escaping of double quotation marks to conform with NEWT API's changed behavior by @namrathaurs in #461
• Disabling Python 3.6 and Fixing 3.9 Unit Tests in CI Workflow by @namrathaurs in #459
• Feature/vito pandas2 updates by @vitodb in #462
• Fixed Google dependency to work fine in Python 3.9 by @mambelli in #463
• Making CONTINUE_IF_NO_PROXY attribute configurable by @namrathaurs in #457
• Update tests by @vitodb in #465
• Adding DE modules EL9 CI container based on AlmaLinux9 by @vitodb in #472
• New Nersc Source Module using SuperFacilityApi by @hyunwoo18 in #468
• fix test_refresh_entry_token unit test by @vitodb in #474
• Adding Jenkinsfile for EL9 by @vitodb in #473
• Adding one line by @hyunwoo18 in #477
• Refactor DEConfigSource and configure_gwms_frontend by @BrunoCoimbra in #481
• Components of decisionengine dashboards by @skylerfoster67 in #482
• Change glideclient advertisement logic by @BrunoCoimbra in #484
• Fix a typo in glideids_to_advertise by @BrunoCoimbra in #485
• Fix configure_gwms_frontend tests by @BrunoCoimbra in #487
• Re-enable flak8 linter by @vitodb in #486
• Do not test external dependencies with flake8 by @vitodb in #492
• Added new metrics to job_q and source by @IlyaBaburashvili in #489
• Add dem_htcondor_cores_count and dem_htcondor_cores_histogram metrics to source.py by @IlyaBaburashvili in #493
• Added unit tests for dem_htcondor_slots_status_count, dem_htcondor_cores_count, dem_htcondor_memory_count. Fixed issues in source.py. by @IlyaBaburashvili in #498
• New Figure of Merit Metric by @skylerfoster67 in #496
• Two dashboards for cores, slots, and runtimes by @IlyaBaburashvili in #499
• In Jenkins pipeline config use podman instead of docker by @vitodb in #503
• add new method of determining token expiration instaed of relying on jwt.decode error code by @StevenCTimm in #502
• Refactor time_left in security module by @BrunoCoimbra in #507
• Migrating GCE Billing to BigQuery based Bill Calculations by @namrathaurs in #505
• DEConfigSource converts nested dicts to OrderedDicts by @BrunoCoimbra in #506
• Add retry functionality to NerscSFApi by @vitodb in #510
• Packaging with uv and pyproject.toml by @mambelli in #511
• Added codespell in pre-commit and fixed files to compliance by @mambelli in #512

New Contributors

• @lgtm-com made their first contribution in #444
• @namrathaurs made their first contribution in #461
• @skylerfoster67 made their first contribution in #482
• @IlyaBaburashvili made their first contribution in #489
• @StevenCTimm made their first contribution in #502

Full Changelog: 2.0.2...2.0.4

HEPCloud decisionengine_modules 2.0.2

Released on 9/23/2022

The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.

Fermilab users can access the RPMs also on the production HEPCloud yum repository.

---

Here are the GitHub-generated notes:

What's Changed

• Set CONTINUE_IF_NO_PROXY to False by @BrunoCoimbra in #427
• Set upper limit version for flake8. by @vitodb in #432
• No longer need to pin coverage version by @jcpunk in #433
• Fix de_client call by @vitodb in #436
• One monolithic factory-entries data product by @knoepfel in #429
• Docker container and test setup for EL8 by @vitodb in #430
• Added Idle Glideins and Max Glideins Metrics by @Redjacket45 in #431
• Update refresh_entry_token to use context managers by @BrunoCoimbra in #438
• Add initial Rigetti source by @jcpunk in #435
• update GWMS transforms by @vitodb in #440

New Contributors

• @Redjacket45 made their first contribution in #431

Full Changelog: 2.0.1...2.0.2

HEPCloud decisionengine_modules 1.7.4

Released on 9/23/2022

The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.

Fermilab users can access the RPMs also on the production HEPCloud yum repository.

---

Here are the GitHub-generated notes:

What's Changed

• Cherry-pick CONTINUE_IF_NO_PROXY changes from master by @BrunoCoimbra in #434
• Update refresh_entry_token to use context managers by @BrunoCoimbra in #437

Full Changelog: 1.7.3...1.7.4

HEPCloud decisionengine_modules 2.0.1

Released on 7/12/2022

The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.

Fermilab users can access the RPMs also on the production HEPCloud yum repository.

---

Here are the GitHub generated notes:

What's Changed

• Remove unnecessary testing classes by @knoepfel in #418
• Fix pyupgrade version for python 3.6 compatibility by @mambelli in #419
• Extend FE group classads publisher to allow configurable queries by @knoepfel in #417
• Fix pre-commit node version to 17.9.0 by @knoepfel in #420
• Enable token proxy hybrid GWMS configuration by @BrunoCoimbra in #421
• Handle empty requests datablock by @vitodb in #423
• Ensure setuptools is up-to-date in GitHub actions by @knoepfel in #426
• Cleanup tests by @knoepfel in #425

Full Changelog: 2.0.0...2.0.1

HEPCloud decisionengine_modules 1.7.3

Released on 7/12/2022

The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.

Fermilab users can access the RPMs also on the production HEPCloud yum repository.

---

Here are the GitHub generated notes:

What's Changed

• Enable token proxy hybrid GWMS configuration by @BrunoCoimbra in #422

Full Changelog: 1.7.2...1.7.3

HEPCloud decisionengine_modules 2.0.0

Released on 4/25/2022 (RC1 on 1/18/2022)

The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation, and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warning and more details.
Here are instructions to install and configure Decision Engine.

Fermilab users can access the RPMs also on the production HEPCloud yum repository.

---

Here are the GitHub generated notes:

What's Changed

• Update to latest setuptools_scm by @jcpunk in #365
• Run Linters in dedicated channel by @jcpunk in #364
• Take advantage of simplified logging by @knoepfel in #366
• Update pre-commit hooks via pre-commit autoupdate by @jcpunk in #371
• Homogenize parameter-naming for retries by @knoepfel in #372
• Simplify some code paths by @jcpunk in #368
• Support Graphite retries by @knoepfel in #373
• Start testing against python 3.10 by @jcpunk in #375
• Add AWSOccupancy AWSSpotPrice as Transforms and associated unit tests by @vitodb in #376
• Add jsonnetfmt hook by @jcpunk in #377
• Revert "Add jsonnetfmt hook" by @jcpunk in #378
• Remove modules that inherit from SourceProxy. by @vitodb in #379
• Ignoring E203, whitespace after ':', since black is adding the whitespaces by @mambelli in #380
• Set fail-fast to false to allow py3.6 tests to complete by @mambelli in #388
• Set Apache 2.0 license and added REUSE compliance by @mambelli in #389
• Change GlideinWMS module to read configuration from the DE framework by @BrunoCoimbra in #387
• Update pre-commit hook versions by @knoepfel in #395
• Update GlideinWMS dependencies by @BrunoCoimbra in #394
• Use pre-commit.ci rather than local actions by @jcpunk in #396
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #397
• Explicitly pass .coveragerc to pytest. by @jcpunk in #398
• Rename consumed product so that translation is not necessary by @knoepfel in #393
• Drop extra lines by @jcpunk in #399
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #401
• pin pytest version by @vitodb in #402
• Fix GlideClientGlobal create_invalidate_constraint by @BrunoCoimbra in #403
• Check DecisionEngineMonitorManifests for empty DFs by @BrunoCoimbra in #406
• Improve fe_group_classads test by @knoepfel in #409
• Modified pre-commit bot suggestions. by @mambelli in #412
• Add token authentication to the glideinwms module by @BrunoCoimbra in #411
• Catch exceptions when no VMs running in GCE by @mambelli in #413
• Update rpm-build workflow by @vitodb in #405
• Added changelog file for developers curated list of changes by @mambelli in #416

New Contributors

• @pre-commit-ci made their first contribution in #397

Full Changelog: 1.7.0...2.0.0

HEPCloud decisionengine_modules 1.7.1

Released on 1/25/2022 (RC1 on 1/7/2022)

The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation, and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warning and more details.
Here are instructions to install and configure Decision Engine.

Fermilab users can access the RPMs also on the production HEPCloud yum repository.

---

Here are the GitHub generated notes:

What's Changed

• Fixing issues reported by flake8 and by unit tests for 1.7 branch by @vitodb in #390
• Porting "Support retries for contacting Graphite." to 1.7 branch by @vitodb in #392
• porting "Homogenize parameter-naming" to 1.7 branch by @vitodb in #391

Full Changelog: 1.7.0...1.7.1