Questions tagged [mlrun]

open source helper/framework based on Python for speedup delivery of ML/AI to the production (support MLOps with featurestore concept), main focus on kubernetes solution. Use this tag for questions about platform MLRun (e.g. MLRun CE, MLRun paid version) or libraries from this solution (e.g. v3io, v3io stream, storey).

MLRun is an open source helper/framework based on Python for speedup delivery from ML/AI experiment phase to production with focus on minimalizing development effort (agnostic approach without focus on a specific AI/ML topic).

It supports MLOps with featurestore concept, including continuous training and continuous monitoring also. It is based on K8s with ability to support scalability of AI/ML in on-prem and cloud (support of main three major cloud providers).

Sample of python code:

import mlrun 
import mlrun.feature_store as fstore
    
# create project 'test' 
project = mlrun.get_or_create_project("test", context="./")

# add feature set (part of feature store)
transaction_set = fstore.FeatureSet("transaction", entities[fstore.Entity("trid")])

# ingest data
fstore.ingest(transaction_set, bank_trn, infer_options=fstore.InferOptions.default())

More information

  • License 'Apache-2.0 license'
  • Official web see
  • Git web see
  • Documentation web see
59 questions
3
votes
2 answers

ConnectionRefusedError: [Errno 111] Connection refused- Mlrun

Im trying to invoke a function in a mlrun but getting above error. can anyone please help me with that.im attaching code here... from cloudpickle import load import numpy as np from typing import List import mlrun class…
2
votes
1 answer

MLRun - Can't access html pages locally. Error: MLRunAccessDeniedError('Unauthorized path')

I followed tutorial to learn mlrun and ran mlrun containers locally by mlrun compose.yaml. https://docs.mlrun.org/en/latest/tutorial/01-mlrun-basics.html The only difference that I did from tutorial is that set environment at beginning. import…
2
votes
1 answer

MLRun Users and Roles configuration

I'm struggling to find how to configure users and roles in my MLRun instance. The documentation say that is possible to do this kind of control. Is this some feature of the premium version or I'm just being blind? I can't even find something similar…
2
votes
1 answer

How do I set Dask autoscaling using Iguazio?

I need to create a new Dask cluster in Iguazio. I want to take advantage of Dask's autoscaling features that are described here: https://docs.dask.org/en/stable/how-to/adaptive.html Does Iguazio support Dask cluster autoscaling and, if so, how do I…
Brennan
  • 39
  • 1
  • 5
2
votes
1 answer

What is the difference between mlrun.code_to_function and mlrun.new_project?

What is the difference between mlrun.code_to_function and mlrun.new_project? For example, we can deploy a function with code_to_function: a_fn = mlrun.code_to_function(name='my_function', handler='handler', …
xsqian
  • 199
  • 5
  • 13
2
votes
1 answer

how to use get_offline_features() in the mlrun.feature_store?

I am trying to get a feature from an existing feature store. In the documentation https://docs.mlrun.org/en/latest/api/mlrun.feature_store.html, it says you can either pass a feature vector uri or FeatureVector object to the…
xsqian
  • 199
  • 5
  • 13
1
vote
2 answers

k8s, without information about CPU and Memory

I got empty values for CPU and Memory, when I used igztop for check running pods in iguazio/mlrun solution. See the first line in output for this pod *m6vd9: [ jist @ iguazio-system 07:41:43 ]->(0) ~ $ igztop -s…
JIST
  • 1,139
  • 2
  • 8
  • 30
1
vote
3 answers

Valid parquet file, but error with parquet schema

I had correct parquet file (I am 100% sure) and only one file in this directory v3io://projects/risk/FeatureStore/ptp/parquet/sets/ptp/1681296898546_70/. I got this generic error AnalysisException: Unable to infer schema ... during read operation,…
JIST
  • 1,139
  • 2
  • 8
  • 30
1
vote
1 answer

PySpark, parquet "AnalysisException: Unable to infer schema for Parquet"

I got this issue, when I read data from parquet via PySpark in MLRun (it seems as invalid parquet). See exception: ------------------------------------------------- AnalysisException Traceback (most recent call…
JIST
  • 1,139
  • 2
  • 8
  • 30
1
vote
1 answer

mlrun cann't show the traning graph by AttributeError(\"'K8sHelper' object has no attribute 'v1api'\")

I have run mlrun by docker-compose. But when I finished the sample training, I couldn't see the results graph on the management pages. I get 500 error and the details likes: { "data": { "detail": "AttributeError(\"'K8sHelper' object has no…
sequoia00
  • 111
  • 4
1
vote
1 answer

Facing Error while deploy the serving function in mlrun

I had instal mlrun with kubernates, i had tried the to execute the 02-model training tutorial code in jupyter-lab, so everything works fine till model serving, then i tried to deploy the serving function then it shows as error listed bellow : Failed…
sukku
  • 19
  • 1
1
vote
1 answer

Issue with dynamic allocation in PySpark session (under MLRun and in K8s)

I would like to maximize power of Spark cluster in MLRun solution for my calculation and I used this session setting for Spark cluster in MLRun solution (it is under Kubernetes cluster): spark = SparkSession.builder.appName('Test-Spark') \ …
JIST
  • 1,139
  • 2
  • 8
  • 30
1
vote
1 answer

function serving deployment failed

Here, I'm attaching actual error showed. im using mlrun with docker. specifically mlrun 1.2.0. -------------------------------------------------------------------------- RunError Traceback (most recent call…
1
vote
1 answer

Possible data Ingest count issue in FeatureStore

I see mistake, that count of values in FeatureStore Statistic do not fit with amount of ingested values, see sample ... project_name = 'test-load' project = mlrun.get_or_create_project(project_name, context='./', user_project=True) .. fset =…
user20531732
1
vote
2 answers

MLRun Docker failed, port is already allocated

I installed MLRun to the docker and I got Error invoking remote method 'docker-start-container': Error: (HTTP code 500) server error - driver failed programming external connectivity on endpoint desktopdockertools-mlrun-api-1…
user20531732
1
2 3 4