Questions tagged [azure-ml-pipelines]
42 questions
4
votes
0 answers
How to store the output dataframe/data of an azure ml job as a data asset
I've been following this "tutorial" by azure on how to create an end to end pipeline in azure: https://github.com/Azure/azureml-examples/blob/main/tutorials/e2e-ds-experience/e2e-ml-workflow.ipynb
I am doing something similar, whereas instead of…
Mase
- 85
- 2
- 11
2
votes
1 answer
I can't select By name in Columns to be cleaned in azureml designer as picture I attached. How should I deal with this?
The data output from select columns in the dataset is not coming and because of this, I am not able to get suggestions in downstream clean missing data components. I am unable to debug why data output from select columns in dataset is not…
Shoaibakhtar Shaikh
- 37
- 2
2
votes
1 answer
AzureML - CLIv2 - Mount Datastore
I've created a simple script in order to understand the interaction between AzureML and AzureStorage in AzureML CLIv2.
I would like to download MNIST Dataset and store in on a datastore.
First, i declared my datastore in AzureML :
I've created a…
FrsECM
- 245
- 2
- 16
1
vote
1 answer
How to make AzureML jobs wait for GPUs to be available on attached Kubernetes compute cluster instead of failing
I am running an AzureML job on an attached Kubernetes compute cluster on a custom instance type with a resource limit of 2 GPUs.
When I trigger the job, only 1 GPU is available because other jobs use the other GPUs. I want the job to be queued and…
ouphi
- 232
- 2
- 9
1
vote
1 answer
Resubmitting AzureML training pipeline with new training data
I am following the tutorial at https://learn.microsoft.com/en-us/azure/machine-learning/tutorial-pipeline-python-sdk to create a training pipeline. Instead of using a file from a web path, I am using a CSV saved at the same location as notebook.…
amit.s
- 31
- 2
1
vote
1 answer
Pass a partitioned TabularDataset into ParallelRunStep with azureml sdkv1
Trying to pass a partitioned TabularDataset into a ParallelRunStep as input, but getting the error and can't figure out why azureml ParallelRunStep can't recognize the partitioned dataset:
UserInputNotPartitionedByGivenKeys: The input dataset…
geominded
- 201
- 2
- 10
1
vote
2 answers
Encountered an internal AutoML error- ClientException: Message: No objects to concatenate
I am trying to implement Hierarchical time series forecasting on azureautoml pipelines.
I followed this notebook for…
Arun P
- 110
- 1
- 8
1
vote
1 answer
How to train Custom Tensorflow Models in Azure ML Studio Designer
I am currently trying out different architectures with Azure ML Ecosystem. Currently, I am testing out Azure ML Studio Designer.
When I created a custom Tensorflow model using the "Create Python Model" Component. When I run the designer pipeline I…
Imperial_J
- 306
- 1
- 7
- 23
1
vote
1 answer
Azure AutoML pipeline -Batch scoring fails with "DriverException: Job failed with There is no succeeded mini batch item returned from run()
While running automl parallel run with tabulardataset ,
azureml_common.parallel_run.exception.NoResultToAppendError: There is no succeeded mini batch item returned from run()
Arun P
- 110
- 1
- 8
1
vote
1 answer
AzureML: msrest.serialization:Ran into a deserialization error following AutoMLStep run
I am running an automated ML training notebook which is basically replicating a MS tutorial notebook…
billfcb
- 11
- 1
1
vote
0 answers
Azure ML Studio: How to get data directory path from class DatasetConsumptionConfig?
I am trying to read my data files from an Azure ML dataset. My code is as follows:
from azureml.core import Dataset
dataset = Dataset.get_by_name(aml_workspace, "mydatasetname")
dataset_mount =…
jarmniku
- 151
- 1
- 2
- 10
0
votes
1 answer
Bind Pipeline id to Experiment in Azureml Python SDK V1
I am submitting Experiment as
python```
experiment.submit(self.pipeline, name=job_name, tags=tags, **kwargs)
where: `self.pipeline` is `azureml.pipeline.core.Pipeline object.`. But after submition, in azure portal it has no published pipeline id.…
0
votes
0 answers
Azure ML Pipeline with dynamic input/output for Batch Endpoint
My goal is to make a pipeline in Azure ML Studio that handles:
an input_folder with audio files
an output_folder with the desired output
some parameters.
The input/output folders are Azureml connections to existing Azure storage containers.
I have…
Ben Haanstra
- 61
- 7
0
votes
1 answer
How to trigger an event-based based pipeline in AzureML?
I have a published pipeline in AzureML that preprocess the data and train a new model. I am trying an event-based schedule so that whenever a new dataset is registered in the workspace, it triggers the whole training pipeline. I am using the python…
ammar
- 3
- 2
0
votes
1 answer
How to convert TabularDataset or a pandas dataframe to a FileDataset using azure ml python sdk v2?
I've written a webscraping script to extract a web table in a dataframe format which I have converted into a TabularDataset using Dataset.Tabular.register_pandas_dataframe() to store in the default datastore.
I want to pass this webscraped table as…
