Update mlflow requirement from >=3.7 to >=3.14.0 by dependabot[bot] · Pull Request #969 · lincc-frameworks/hyrax

dependabot · 2026-07-01T03:11:50Z

Updates the requirements on mlflow to permit the latest version.

Release notes

v3.14.0

MLflow 3.14.0 includes several major features and improvements

Major New Features

🚀 One-command agent onboarding with mlflow agent setup: Install MLflow, set up tracing, and hand your favorite coding agent (Claude Code, OpenAI Codex, or OpenCode) the MLflow skills to instrument your app, all from a single command.

⚡ Durable, low-latency tracing for Claude Code: Roll out Claude Code tracing across a team with confidence: a write-ahead-log keeps it from slowing the agent, overwhelming the tracking server, or losing traces on a network blip or crash.

📝 Review Queues for traces: Assign traces to reviewers (or agents) and collect structured feedback and ground-truth annotations in the UI, written straight back onto the trace so they are immediately usable for evaluation.

🗂️ Revamped evaluation dataset UI: Browse, inspect, edit, and bulk-manage evaluation dataset records directly in the UI, with click-through to the source trace.

🧪 Pytest integration for regression testing: Write GenAI regression tests as plain pytest functions with the @mlflow.test marker, gate them in CI, and review test history and per-assertion judge results in the UI.

🎛️ LLM Playground: Iterate on prompts in the browser against your AI Gateway endpoints and Prompt Registry versions, with settings, tools, structured output, and template variables.

Breaking Changes

[Models] Change mlflow.sklearn serialization_format default from cloudpickle to skops (#23987, @copilot-swe-agent)

[Models] Change serialization_format default to "pt2" for mlflow.pytorch.log_model and mlflow.pytorch.save_model (#23988, @copilot-swe-agent)

[Models] Change serialization_format default to "skops" in mlflow.lightgbm log_model/save_model (#23986, @copilot-swe-agent)

Other Assorted Features & Improvements:

[Evaluation / UI] [3/3] Show regression-test results in the existing eval-run UI (#23985, @B-Step62)

[Prompts / UI] Add "Save prompt to registry" action to the Prompt Playground (#24021, @B-Step62)

[Prompts] Prompt Playground (#23273, @TomeHirata)

[Evaluation] [2/3] Add EvaluationResult.passed/.reason for @mlflow.test assertions (#23869, @B-Step62)

[UI] Review queues: list the affected queues in the delete-question confirmation (#24002, @kriscon-db)

[UI] Add shareable review queue URLs with a startReview deep link (#23941, @harupy)

[UI] Allow editing a completed review in place in focus mode (#23967, @kriscon-db)

[Tracing] Add x-mlflow-run-id support to OTLP trace ingestion (#23664, @sanatb187)

[Evaluation / Tracing] [1/3] Add @mlflow.test pytest marker and assertion framework (#23864, @B-Step62)

[UI] Improve review queue empty states with onboarding content (#23903, @B-Step62)

[UI] Add mlflow skills view/list CLI (#23907, @joshuawong-db)

[UI] Improve review queue list: flat layout, sortable columns, status filter (#23902, @B-Step62)

[Tracing] Add MLFLOW_WORKSPACE support to OSS auth provider (#23927, @Nehanth)

[Gateway] Add cached token pricing to Databricks model catalog (#23901, @TomeHirata)

[Evaluation] Add MLFLOW_GENAI_JUDGE_DEFAULT_MODEL environment variable (#23860, @B-Step62)

[Evaluation] Wire "Run judge(s)" submission in "Run Eval" in Evaluations Run page to POST /mlflow/genai/evaluate/invoke (#23781, @aaronteo-db)

[Evaluation] Add rule-based built-in scorers: RegexMatch, PIIDetection, ResponseLength (#22571, @debu-sinha)

[Tracing] Support Databricks backend in mlflow agent setup (#23783, @harupy)

[Evaluation] Add POST /mlflow/genai/evaluate/invoke handler & job for UI-triggered eval runs (#23779, @aaronteo-db)

[Tracing] [Claude Code] Support UC trace location via MLFLOW_TRACE_LOCATION (#23770, @B-Step62)

[Tracing] [Codex] Support UC trace location via MLFLOW_TRACE_LOCATION (#23771, @B-Step62)

[Evaluation / Tracking] [3/N] Label schemas: handlers + SDK + REST client (#23603, @kriscon-db)

[Tracing / Tracking] Add run_id support for trace APIs (#23629, @sanatb187)

[Evaluation / UI] Dataset v2 port (#23560, @B-Step62)

[Evaluation / Tracking] Add OSS-native label schema entity, validation, and SQL store (#23597, @kriscon-db)

[Tracing] Support mapping gen_ai.conversation.id to MLflow trace session (#23584, @SahilKumar75)

[Tracing / UI] Added polling logic to live check and auto-refresh traces tab empty state with trace first ingestion (#23184, @vivian-xie-db)

[Tracing] Add MlflowWalSpanExporter to hand traces off to the WAL daemon (#23641, @aaronteo-db)

[Tracing] Support native UC trace ingestion from TypeScript SDK (#23562, @B-Step62)

[Evaluation] Add Google ADK LLM judge scorers (Hallucination, Safety, ResponseEvaluation) (#22496, @debu-sinha)

... (truncated)

Changelog

Sourced from mlflow's changelog.

3.14.0 (2026-06-17)

MLflow 3.14.0 includes several major features and improvements

Major New Features

🚀 One-command agent onboarding with mlflow agent setup: Install MLflow, set up tracing, and hand your favorite coding agent (Claude Code, OpenAI Codex, or OpenCode) the MLflow skills to instrument your app, all from a single command.

⚡ Durable, low-latency tracing for Claude Code: Roll out Claude Code tracing across a team with confidence: a write-ahead-log keeps it from slowing the agent, overwhelming the tracking server, or losing traces on a network blip or crash.

📝 Review Queues for traces: Assign traces to reviewers (or agents) and collect structured feedback and ground-truth annotations in the UI, written straight back onto the trace so they are immediately usable for evaluation.

🗂️ Revamped evaluation dataset UI: Browse, inspect, edit, and bulk-manage evaluation dataset records directly in the UI, with click-through to the source trace.

🧪 Pytest integration for regression testing: Write GenAI regression tests as plain pytest functions with the @mlflow.test marker, gate them in CI, and review test history and per-assertion judge results in the UI.

🎛️ LLM Playground: Iterate on prompts in the browser against your AI Gateway endpoints and Prompt Registry versions, with settings, tools, structured output, and template variables.

Breaking Changes

[Models] Change mlflow.sklearn serialization_format default from cloudpickle to skops (#23987, @copilot-swe-agent)

[Models] Change serialization_format default to "pt2" for mlflow.pytorch.log_model and mlflow.pytorch.save_model (#23988, @copilot-swe-agent)

[Models] Change serialization_format default to "skops" in mlflow.lightgbm log_model/save_model (#23986, @copilot-swe-agent)

Other Assorted Features & Improvements:

[Evaluation / UI] [3/3] Show regression-test results in the existing eval-run UI (#23985, @B-Step62)

[Prompts / UI] Add "Save prompt to registry" action to the Prompt Playground (#24021, @B-Step62)

[Prompts] Prompt Playground (#23273, @TomeHirata)

[Evaluation] [2/3] Add EvaluationResult.passed/.reason for @mlflow.test assertions (#23869, @B-Step62)

[UI] Review queues: list the affected queues in the delete-question confirmation (#24002, @kriscon-db)

[UI] Add shareable review queue URLs with a startReview deep link (#23941, @harupy)

[UI] Allow editing a completed review in place in focus mode (#23967, @kriscon-db)

[Tracing] Add x-mlflow-run-id support to OTLP trace ingestion (#23664, @sanatb187)

[Evaluation / Tracing] [1/3] Add @mlflow.test pytest marker and assertion framework (#23864, @B-Step62)

[UI] Improve review queue empty states with onboarding content (#23903, @B-Step62)

[UI] Add mlflow skills view/list CLI (#23907, @joshuawong-db)

[UI] Improve review queue list: flat layout, sortable columns, status filter (#23902, @B-Step62)

[Tracing] Add MLFLOW_WORKSPACE support to OSS auth provider (#23927, @Nehanth)

[Gateway] Add cached token pricing to Databricks model catalog (#23901, @TomeHirata)

[Evaluation] Add MLFLOW_GENAI_JUDGE_DEFAULT_MODEL environment variable (#23860, @B-Step62)

[Evaluation] Wire "Run judge(s)" submission in "Run Eval" in Evaluations Run page to POST /mlflow/genai/evaluate/invoke (#23781, @aaronteo-db)

[Evaluation] Add rule-based built-in scorers: RegexMatch, PIIDetection, ResponseLength (#22571, @debu-sinha)

[Tracing] Support Databricks backend in mlflow agent setup (#23783, @harupy)

[Evaluation] Add POST /mlflow/genai/evaluate/invoke handler & job for UI-triggered eval runs (#23779, @aaronteo-db)

[Tracing] [Claude Code] Support UC trace location via MLFLOW_TRACE_LOCATION (#23770, @B-Step62)

[Tracing] [Codex] Support UC trace location via MLFLOW_TRACE_LOCATION (#23771, @B-Step62)

[Evaluation / Tracking] [3/N] Label schemas: handlers + SDK + REST client (#23603, @kriscon-db)

[Tracing / Tracking] Add run_id support for trace APIs (#23629, @sanatb187)

[Evaluation / UI] Dataset v2 port (#23560, @B-Step62)

[Evaluation / Tracking] Add OSS-native label schema entity, validation, and SQL store (#23597, @kriscon-db)

[Tracing] Support mapping gen_ai.conversation.id to MLflow trace session (#23584, @SahilKumar75)

[Tracing / UI] Added polling logic to live check and auto-refresh traces tab empty state with trace first ingestion (#23184, @vivian-xie-db)

[Tracing] Add MlflowWalSpanExporter to hand traces off to the WAL daemon (#23641, @aaronteo-db)

[Tracing] Support native UC trace ingestion from TypeScript SDK (#23562, @B-Step62)

... (truncated)

Commits

86cd7f5 Bump version to 3.14.0 (#24052)
2db0fed Add docs page for @mlflow.test pytest regression testing (#24011)
6786bef [3/3] Show regression-test results in the existing eval-run UI (#23985)
fb1a4ed Skip tracking backend prompt in mlflow agent setup when `MLFLOW_TRACKING_UR...
4d7a1b3 Fix ChrfScore RAGAS scorer instantiation due to class name mismatch (#24047)
a64ca84 [Fix] Restore scrolling in the Playground conversation area (#24042)
03dd3d2 Fix make_judge doc: self-referential deprecation note and link typo (#24046)
1b64388 [Fix] Map OpenAI Agents SDK guardrail spans to SpanType.GUARDRAIL (#24044)
4b60b87 Add "Save prompt to registry" action to the Prompt Playground (#24021)
437d9f6 Surface review-question modal failures as toasts (#24035)
Additional commits viewable in compare view

mtauraso

Not sure why we need to force updates away from mlflow 3.7

Updates the requirements on [mlflow](https://github.com/mlflow/mlflow) to permit the latest version. - [Release notes](https://github.com/mlflow/mlflow/releases) - [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md) - [Commits](mlflow/mlflow@v3.7.0...v3.14.0) --- updated-dependencies: - dependency-name: mlflow dependency-version: 3.14.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>

drewoldag · 2026-07-15T22:18:04Z

Agreed, unsure why we would need to bump the dependency version. A previous dependabot PR was closed for this same reason: #916

Going to close this one the same way.

dependabot · 2026-07-15T22:18:06Z

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.

dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Jul 1, 2026

dependabot Bot force-pushed the dependabot/pip/mlflow-gte-3.14.0 branch from 08c0814 to f395533 Compare July 7, 2026 21:21

mtauraso reviewed Jul 7, 2026

View reviewed changes

mtauraso self-assigned this Jul 7, 2026

dependabot Bot force-pushed the dependabot/pip/mlflow-gte-3.14.0 branch 2 times, most recently from 353b9d5 to 7482fa2 Compare July 13, 2026 22:29

dependabot Bot force-pushed the dependabot/pip/mlflow-gte-3.14.0 branch from 7482fa2 to dac1bef Compare July 15, 2026 22:16

drewoldag closed this Jul 15, 2026

dependabot Bot deleted the dependabot/pip/mlflow-gte-3.14.0 branch July 15, 2026 22:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update mlflow requirement from >=3.7 to >=3.14.0#969

Update mlflow requirement from >=3.7 to >=3.14.0#969
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/mlflow-gte-3.14.0

dependabot Bot commented on behalf of github Jul 1, 2026 •

edited

Loading

Uh oh!

mtauraso left a comment

Uh oh!

drewoldag commented Jul 15, 2026

Uh oh!

dependabot Bot commented on behalf of github Jul 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

dependabot Bot commented on behalf of github Jul 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

v3.14.0

Major New Features

Breaking Changes

Other Assorted Features & Improvements:

3.14.0 (2026-06-17)

Major New Features

Breaking Changes

Other Assorted Features & Improvements:

Uh oh!

mtauraso left a comment

Choose a reason for hiding this comment

Uh oh!

drewoldag commented Jul 15, 2026

Uh oh!

dependabot Bot commented on behalf of github Jul 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

dependabot Bot commented on behalf of github Jul 1, 2026 •

edited

Loading