Stack Overflow
Stack Overflow

Questions tagged [mlflow]

Use this tag for questions about the machine-learning platform MLflow

722 questions
24
votes
7 answers

How Do You "Permanently" Delete An Experiment In Mlflow?

Permanent deletion of an experiment isn't documented anywhere. I'm using Mlflow w/ backend postgres db Here's what I've run: client = MlflowClient(tracking_uri=server) client.delete_experiment(1) This deletes the the experiment, but when I run a…
Riley Hun
  • 2,541
  • 5
  • 31
  • 77
24
votes
3 answers

How to store artifacts on a server running MLflow

I define the following docker image: FROM python:3.6 RUN pip install --upgrade pip RUN pip install --upgrade mlflow ENTRYPOINT mlflow server --host 0.0.0.0 --file-store /mnt/mlruns/ and build an image called mlflow-server. Next, I start this…
Dror
  • 12,174
  • 21
  • 90
  • 160
14
votes
4 answers

How to run authentication on a mlFlow server?

As I am logging my entire models and params into mlflow I thought it will be a good idea to have it protected under a user name and password. I use the following code to run the mlflow server mlflow server --host 0.0.0.0 --port 11111 works…
helpper
  • 2,058
  • 4
  • 13
  • 32
14
votes
3 answers

Is it possible to set/change mlflow run name after run initial creation?

I could not find a way yet of setting the runs name after the first start_run for that run (we can pass a name there). I Know we can use tags but that is not the same thing. I would like to add a run relevant name, but very often we know the name…
rquintino
  • 163
  • 1
  • 1
  • 6
13
votes
3 answers

Perform GridSearchCV with MLFlow

I just started using MLFlow and I am happy with what it can do. However, I cannot find a way to log different runs in a GridSearchCV from scikit learn. For example, I can do this manually params = ['l1', 'l2'] for param in params: with…
Tasos
  • 7,325
  • 18
  • 83
  • 176
12
votes
2 answers

Saving an Matlabplot as an MLFlow artifact

I am using DataBricks and Spark 7.4ML, The following code successfully logs the params and metrics, and I can see the ROCcurve.png in the MLFLOW gui (just the item in the tree below the model). But the actually plot is blank. Why? with…
Dr.YSG
  • 7,171
  • 22
  • 81
  • 139
12
votes
2 answers

How to update a previous run into MLFlow?

I would like to update previous runs done with MLFlow, ie. changing/updating a parameter value to accommodate a change in the implementation. Typical uses cases: Log runs using a parameter A, and much later, log parameters A and B. It would be…
mountrix
  • 1,126
  • 15
  • 32
12
votes
1 answer

How to use a PySpark UDF in a Scala Spark project?

Several people (1, 2, 3) have discussed using a Scala UDF in a PySpark application, usually for performance reasons. I am interested in the opposite - using a python UDF in a Scala Spark project. I am particularly interested in building a model…
turtlemonvh
  • 9,149
  • 6
  • 47
  • 53
11
votes
4 answers

Setting-up MLflow on Google Colab

I frequently use Google Colab to train TF/PyTorch models as Colab provides me with GPU/TPU runtime. Besides, I like working with MLflow to store and compare trained models, tracking progress, sharing, etc. What are the available solutions to use…
SvitlanaGA...supportsUkraine
  • 1,289
  • 1
  • 11
  • 23
10
votes
1 answer

MLflow: INVALID_PARAMETER_VALUE: Unsupported URI './mlruns' for model registry store

I got this error when I was trying to have a model registered in the model registry. Could someone help me? RestException: INVALID_PARAMETER_VALUE: Unsupported URI './mlruns' for model registry store. Supported schemes are: ['postgresql', 'mysql',…
Aprilcui11
  • 125
  • 1
  • 1
  • 5
10
votes
1 answer

MLflow Artifacts Storing But Not Listing In UI

I've run into an issue using MLflow server. When I first ran the command to start an mlflow server on an ec2 instance, everything worked fine. Now, although logs and artifacts are being stored to postgres and s3, the UI is not listing the artifacts.…
JMV12
  • 965
  • 1
  • 20
  • 52
10
votes
5 answers

How to safely shutdown mlflow ui?

After running mlflow ui on a remote server, I'm unable to reopen the mlflow ui again. A workaround is to kill all my processes in the server using pkill -u MyUserName. Otherwise I get the following error: [INFO] Starting gunicorn 20.0.4 [ERROR]…
skibee
  • 1,279
  • 1
  • 17
  • 37
10
votes
3 answers

mlflow How to save a sklearn pipeline with custom transformer?

I am trying to save with mlflow a sklearn machine-learning model, which is a pipeline containing a custom transformer I have defined, and load it in another project. My custom transformer inherits from BaseEstimator and TransformerMixin. Let's say I…
aliene28
  • 101
  • 1
  • 3
10
votes
2 answers

not able to dockerize mlflow

while dockerizing mlflow , only .trash is getting created beacuse of that in mlflow ui , getting error as "no experiments exists" dockerfile FROM python:3.7.0 RUN pip install mlflow==1.0.0 WORKDIR /data EXPOSE 5000 CMD mlflow server \ …
Akash Kumar
  • 137
  • 2
  • 8
9
votes
1 answer

Data and model drift monitoring with MLflow

The MLFlow Tracking is great for monitoring experiments, but I wonder if there is a solution on MLFlow or another open-source platform that can be integrated to monitor data and model drift. There is a post from Databricks showing how to achieve…
Julio Oliveira
  • 310
  • 3
  • 10
1
2 3
…
48 49