Mlflow

Features:

- [Models / Scoring] Add support for passing extra params during inference for PyFunc models (9068, serena-ruan)
- [Gateway] Add support for MLflow serving to MLflow AI Gateway (9199, BenWilson2)
- [Tracking] Support `save_kwargs` for `mlflow.log_figure` to specify extra options when saving a figure (9179, stroblme)
- [Artifacts] Display progress bars when uploading/download artifacts (9195, serena-ruan)
- [Models] Add support for logging LangChain's retriever models (8808, liangz1)
- [Tracking] Add support to log customized tags to runs created by autologging (9114, thinkall)

Bug fixes:

- [Models] Fix `text_pair` functionality for transformers `TextClassification` pipelines (9215, BenWilson2)
- [Models] Fix LangChain compatibility with SQLDatabase (9192, dbczumar)
- [Tracking] Remove patching `sklearn.metrics.get_scorer_names` in `mlflow.sklearn.autolog` to avoid duplicate logging (9095, WeichenXu123)

Documentation updates:

- [Docs / Examples] Add examples and documentation for MLflow AI Gateway support for MLflow model serving (9281, BenWilson2)
- [Docs / Examples] Add `sentence-transformers` doc & example (9047, es94129)

Deprecation:

- [Models] The `mlflow.mleap` module has been marked as deprecated and will be removed in a future release (9311, BenWilson2)

Small bug fixes and documentation updates:

9309, 9252, 9198, 9189, 9186, 9184, BenWilson2; 9307, AmirAflak; 9285, 9126, dependabot[bot]; 9302, 9209, 9194, 9187, 9175, 9177, 9163, 9161, 9129, 9123, 9053, serena-ruan; 9305, 9303, 9271, KekmaTime; 9300, 9299, itsajay1029; 9294, 9293, 9274, 9268, 9264, 9246, 9255, 9253, 9254, 9245, 9202, 9243, 9238, 9234, 9233, 9227, 9226, 9223, 9224, 9222, 9225, 9220, 9208, 9212, 9207, 9203, 9201, 9200, 9154, 9146, 9147, 9153, 9148, 9145, 9136, 9132, 9131, 9128, 9121, 9124, 9125, 9108, 9103, 9100, 9098, 9101, harupy; 9292, Aman123lug; 9290, 9164, 9157, 9086, Bncer; 9291, kunal642; 9284, NavneetSinghArora; 9286, 9262, 9142, smurching; 9267, tungbq; 9258, 9250, Kunj125; 9167, 9139, 9120, 9118, 9097, viktoriussuwandi; 9244, 9240, 9239, Sai-Suraj-27; 9221, 9168, 9130, gabrielfu; 9218, tjni; 9216, Rukiyav; 9158, 9051, EdAbati; 9211, scarlettrobe; 9049, annzhang-db; 9140, kriscon-db; 9141, xAIdrian; 9135, liangz1; 9067, jmmonteiro; 9112, WeichenXu123; 9106, shaikmoeed; 9105, Ankit8848; 9104, arnabrahman

- [MLflow AI Gateway] We are excited to announce the release of MLflow AI Gateway, a powerful tool designed to streamline the usage and management of various large language model (LLM) providers, such as OpenAI and Anthropic, within an organization. It offers a standardized interface that simplifies the interaction with these services and delivers centralized, secure management of credentials. To get started with MLflow AI Gateway, check out the docs at https://mlflow.org/docs/latest/gateway/index.html. (#8694, harupy, BenWilson2, dbczumar)
- [Auth]: We are excited to announce the release of authentication and authorization support for MLflow Tracking and the MLflow Model Registry, providing integrated access control capabilities to both services. To get started, check out the docs at https://mlflow.org/docs/latest/auth/index.html. (#9000, 8975, 8626, 8837, 8841, gabrielfu, harupy)

Features:

- [Models] Add Support to the LangChain flavor for chains that contain unserializable components (8736, liangz1)
- [Scoring] Infer spark udf return type from model output schema (8934, WeichenXu123)
- [Models] Add support for automated signature inference (8860, 8782 8795, 8725, jerrylian-db)

Bug fixes:

- [Security] Improve robustness to LFI attacks on Windows by enhancing path validation (8999, serena-ruan)
- If you are using `mlflow server` or `mlflow ui` on Windows, we recommend upgrading to MLflow 2.5.0 as soon as possible.
- [Scoring] Support nullable array type values as spark_udf return values (9014, WeichenXu123)
- [Models] Revert cache deletion of system modules when adding custom model code to the system path (8722, trungn1)
- [Models] add micro version to mlflow version pinning (8687, C-K-Loan)
- [Artifacts] Prevent manually deleted artifacts from causing artifact garbage collection to fail (8498, PenHsuanWang)

Documentation updates:

- [Docs] Update .push_model_to_sagemaker docs (8851, pdifranc)
- [Docs] Fix invalid link for Azure ML documentation (8800, dunnkers)
- [Artifacts / Docs / Models / Projects] Adds information on the OCI MLflow plugins for seamless integration with Oralce Cloud Infrastructure services. (8707, mrDzurb)

Deprecation:

- [Models] Deprecate the `gluon` model flavor. The `mlflow.gluon` module will be removed in a future release. (8968, harupy)

Small bug fixes and documentation updates:

9069, 9056, 9055, 9054, 9048, 9043, 9035, 9034, 9037, 9038, 8993, 8966, 8985, BenWilson2; 9039, 9036, 8902, 8924, 8866, 8861, 8810, 8761, 8544, jerrylian-db; 8903, smurching; 9080, 9079, 9078, 9076, 9075, 9074, 9071, 9063, 9062, 9032, 9031, 9027, 9023, 9022, 9020, 9005, 8994, 8979, 8983, 8984, 8982, 8970, 8962, 8969, 8968, 8959, 8960, 8958, 8956, 8955, 8954, 8949, 8950, 8952, 8948, 8946, 8947, 8943, 8944, 8916, 8917, 8933, 8929, 8932, 8927, 8930, 8925, 8921, 8873, 8915, 8909, 8908, 8911, 8910, 8907, 8906, 8898, 8893, 8889, 8892, 8891, 8887, 8875, 8876, 8882, 8874, 8868, 8872, 8869, 8828, 8852, 8857, 8853, 8854, 8848, 8850, 8840, 8835, 8832, 8831, 8830, 8829, 8839, 8833, 8838, 8819, 8814, 8825, 8818, 8787, 8775, 8749, 8766, 8756, 8753, 8751, 8748, 8744, 8731, 8717, 8730, 8691, 8720, 8723, 8719, 8688, 8721, 8715, 8716, 8718, 8696, 8698, 8692, 8693, 8690, harupy; 9030, AlimurtuzaCodes; 9029, 9025, 9021, 9013, viktoriussuwandi; 9010, Bncer; 9011, Pecunia201; 9007, 9003, EdAbati; 9002, prithvikannan; 8991, 8867, AveshCSingh; 8951, 8896, 8888, 8849, gabrielfu; 8913, 8885, 8871, 8870, 8788, 8772, 8771, serena-ruan; 8879, maciejskorski; 7752, arunkumarkota; 9083, 9081, 8765, 8742, 8685, 8682, 8683, dbczumar; 8791, mhattingpete; 8739, yunpark93

Bug fixes:

- [Models] Add compatibility for legacy transformers serialization (8964, BenWilson2)
- [Models] Fix downloading MLmodel files from alias-based models:/ URIs (8764, smurching)
- [Models] Fix reading model flavor config from URI for models in UC (8728, smurching)
- [Models] Support `feature_deps` in ModelVersion creation for UC (8867, 8815, AveshCSingh)
- [Models] Add support for listing artifacts in UC model registry artifact repo (8803, smurching)
- [Core] Include resources for recipes in mlflow-skinny (8895, harupy)
- [UI] Enable datasets tracking UI (8886, harupy)
- [Artifacts] Use `MLFLOW_ENABLE_MULTIPART_DOWNLOAD` in `DatabricksArtifactRepository` (8884, harupy)

Documentation updates:

- [Examples / Docs] Add question-answering and summarization examples and docs with LLMs (8695, dbczumar)
- [Examples / Docs] Add johnsnowlabs flavor example and doc (8689, C-K-Loan)

Small bug fixes and documentation updates:

8966, BenWilson2; 8881, harupy; 8846, 8760, smurching

Features:

- [Tracking] Extend SearchRuns to support datasets (8622, prithvikannan)
- [Models] Add an `mlflow.johnsnowlabs` flavor for the `johnsnowlabs` package (8556, C-K-Loan)
- [Models] Add a warning for duplicate pip requirements specified in `save_model` and `log_model` for the `transformers` flavor (8678, BenWilson2)

Bug fixes:

- [Security] Improve robustness to LFI attacks (8648, serena-ruan)
- If you are using `mlflow server` or `mlflow ui`, we recommend upgrading to MLflow 2.4.1 as soon as possible.
- [Models] Fix an issue with `transformers` serialization for ModelCards that contain invalid characters (8652, BenWilson2)
- [Models] Fix connection pooling deadlocks that occurred during large file downloads (8682, dbczumar; 8660, harupy)

Small bug fixes and documentation updates:

8677, 8674, 8646, 8647, dbczumar; 8654, 8653, 8660, 8650, 8642, 8636, 8599, 8637, 8608, 8633, 8623, 8628, 8619, harupy; 8655, 8609, BenWilson2; 8648, serena-ruan; 8521, ka1mar; 8638, smurching; 8634, PenHsuanWang

Features:

- [Tracking] Introduce dataset tracking APIs: `mlflow.data` and `mlflow.log_input()` (8186, prithvikannan)
- [Tracking] Add `mlflow.log_table()` and `mlflow.load_table()` APIs for logging evaluation tables (8523, 8467, sunishsheth2009)
- [Tracking] Introduce `mlflow.get_parent_run()` fluent API (8493, annzhang-db)
- [Tracking / Model Registry] Re-introduce faster artifact downloads on Databricks (8352, dbczumar; 8561, harupy)
- [UI] Add dataset tracking information to MLflow Tracking UI (8602, prithvikannan, hubertzub-db)
- [UI] Introduce Artifact View for comparing inputs, outputs, and metadata across models (8602, hubertzub-db)
- [Models] Extend `mlflow.evaluate()` to support LLM tasks (8484, harupy)
- [Models] Support logging subclasses of `Chain` and `LLMChain` in `mlflow.langchain` flavor (8453, liangz1)
- [Models] Add support for LangChain Agents to the `mlflow.langchain` flavor (8297, sunishsheth2009)
- [Models] Add a `mlflow.sentence_transformers` flavor for SentenceTransformers (8479, BenWilson2; 8547, Loquats)
- [Models] Add support for multi-GPU inference and efficient weight loading for `mlflow.transformers` flavor (8448, ankit-db)
- [Models] Support the `max_shard_size` parameter in the `mlflow.transformers` flavor (8567, wenfeiy-db)
- [Models] Add support for audio transcription pipelines in the `mlflow.transformers` flavor (8464, BenWilson2)
- [Models] Add support for audio classification to `mlflow.transformers` flavor (8492, BenWilson2)
- [Models] Add support for URI inputs in audio models logged with the `mlflow.transformers` flavor (8495, BenWilson2)
- [Models] Add support for returning classifier scores in `mlflow.transformers` pyfunc outputs (8512, BenWilson2)
- [Models] Support optional inputs in model signatures (8438, apurva-koti)
- [Models] Introduce an `mlflow.models.set_signature()` API to set the signature of a logged model (8476, jerrylian-db)
- [Models] Persist ONNX Runtime InferenceSession options when logging a model with `mlflow.onnx.log_model()` (8433, leqiao-1)

Bug fixes:

- [Tracking] Terminate Spark callback server when Spark Autologging is disabled or Spark Session is shut down (8508, WeichenXu123)
- [Tracking] Fix compatibility of `mlflow server` with `Flask<2.0` (8463, kevingreer)
- [Models] Convert `mlflow.transformers` pyfunc scalar string output to list of strings during batch inference (8546, BenWilson2)
- [Models] Fix a bug causing outdated pyenv versions to be installed by `mlflow models build-docker` (8488, Hellzed)
- [Model Registry] Remove aliases from storage when a Model Version is deleted (8459, arpitjasa-db)

Documentation updates:

- [Docs] Publish a new MLOps Quickstart for model selection and deployment (8462, lobrien)
- [Docs] Add MLflavors library to Community Model Flavors documentation (8420, benjaminbluhm)
- [Docs] Add documentation for Registered Model Aliases (8445, arpitjasa-db)
- [Docs] Fix errors in documented `mlflow models` CLI command examples (8480, vijethmoudgalya)

Small bug fixes and documentation updates:

8611, 8587, dbczumar; 8617, 8620, 8615, 8603, 8604, 8601, 8596, 8598, 8597, 8589, 8580, 8581, 8575, 8582, 8577, 8576, 8578, 8561, 8568, 8551, 8528, 8550, 8489, 8530, 8534, 8533, 8532, 8524, 8520, 8517, 8516, 8515, 8514, 8506, 8503, 8500, 8504, 8496, 8486, 8485, 8468, 8471, 8473, 8470, 8458, 8447, 8446, 8434, harupy; 8607, 8538, 8513, 8452, 8466, 8465, serena-ruan; 8586, 8595, prithvikannan; 8593, 8541, kriscon-db; 8592, 8566, annzhang-db; 8588, 8565, 8559, 8537, BenWilson2; 8545, apurva-koti; 8564, DavidSpek; 8436, 8490, jerrylian-db; 8505, eliaskoromilas; 8483, WeichenXu123; 8472, leqiao-1; 8429, jinzhang21; 8581, 8548, 8499, gabrielfu;

Features:

- [Models] Add GPU support for `transformers` models `pyfunc` inference and serving (8375, ankit-db)
- [Models] Disable autologging functionality for non-relevant models when training a `transformers` model (8405, BenWilson2)
- [Models] Add support for preserving and overriding `torch_dtype` values in `transformers` pipelines (8421, BenWilson2)
- [Models] Add support for `Feature Extraction` pipelines in the `transformers` flavor (8423, BenWilson2)
- [Tracking] Add basic HTTP auth support for users, registered models, and experiments permissions (8286, gabrielfu)

Bug Fixes:

- [Models] Fix inferred schema issue with `Text2TextGeneration` pipelines in the `transformers` flavor (8391, BenWilson2)
- [Models] Change MLflow dependency pinning in logged models from a range value to an exact major and minor version (8422, harupy)

Documentation updates:

- [Examples] Add `signature` logging to all examples and documentation (8410, 8401, 8400, 8387 jerrylian-db)
- [Examples] Add `sentence-transformers` examples to the `transformers` examples suite (8425, BenWilson2)
- [Docs] Add a new MLflow Quickstart documentation page (8171, lobrien)
- [Docs] Add a new introduction to MLflow page (8365, lobrien)
- [Docs] Add a community model plugin example and documentation for `trubrics` (8371, jeffkayne)
- [Docs] Add `gluon` pyfunc example to Model flavor documentation (8403, ericvincent18)
- [Docs] Add `statsmodels` pyfunc example to `Models` flavor documentation (8394, ericvincent18)

Small bug fixes and documentation updates:

8415, 8412, 8411, 8355, 8354, 8353, 8348, harupy; 8374, 8367, 8350, dbczumar; 8358 mrkaye97; 8392, 8362, smurching; 8427, 8408, 8399, 8381, BenWilson2; 8395, 8390, jerrylian-db; 8402, 8398, WeichenXu123; 8377, 8363, arpitjasa-db; 8385, prithvikannan; 8418, Jeukoh;