Stack Overflow
Stack Overflow

Questions tagged [clearml]

48 questions
6
votes
1 answer

Can ClearML (formerly Trains) work a local server?

I am trying to start my way with ClearML (formerly known as Trains). I see on the documentation that I need to have server running, either on the ClearML platform itself, or on a remote machine using AWS etc. I would really like to bypass this…
DalyaG
  • 2,979
  • 2
  • 16
  • 19
3
votes
1 answer

How to manage datasets in ClearML Web UI?

Using a self-deployed ClearML server with the clearml-data CLI, I would like to manage (or view) my datasets in the WebUI as shown on the ClearML webpage (https://clear.ml/mlops/clearml-feature-store/): However, this feature does not show up in my…
kleka
  • 364
  • 3
  • 14
3
votes
1 answer

ClearML get max value from logged values

I use ClearML to track my tensorboard logs (from PyTorch Lightning) during training. At a point later I start another script which connects to existing task and do some testing. But unfortenautly I do not have all information in the second script,…
Daniel Andres
  • 99
  • 5
3
votes
1 answer

ClearML server IP address not used with localhost and SSH port forwarding

Trying to use clearml-server on own Ubuntu 18.04.5. I use env variables to set the IP Address of my clearml-server. export CLEARML_HOST_IP=127.0.0.1 export TRAINS_HOST_IP=127.0.0.1 But it still is available thorugh the external server IP. How can I…
Daniel Andres
  • 99
  • 5
2
votes
1 answer

[Catboost][ClearML] Error: if loss-function is Logloss, then class weights should be given for 0 and 1 classes

Having recently started using ClearML to manage the MLOps, I am facing the following problem: When running a script that trains a CatBoost in a binary classification problem using different class weights from my computer, it works perfectly, logs…
Plinio Zanini
  • 23
  • 2
2
votes
1 answer

What would stop credentials from validation on a ClearML server?

I've set up a ClearML server in GCP using the sub-domain approach. I can access all three domains (https://app.clearml.mydomain.com, https://api.clearml.mydomain.com and https://files.clearml.mydomain.com) in a browser and see what I think is the…
mmiller-max
  • 56
  • 1
  • 5
2
votes
1 answer

ClearML how to change clearml.conf file in AWS Sagemaker

I am working in AWS Sagemaker Jupyter notebook. I have installed clearml package in AWS Sagemaker in Jupyter. ClearML server was installed on AWS EC2. I need to store artifacts and models in AWS S3 bucket, so I want to specify credentials to S3 in…
Slava
  • 55
  • 4
2
votes
1 answer

How to fix trainserver empty server?

Im trying to install an allegroai trains-server on a k8s cluster. I tried the following 3 methods bare linux installtion k8s manifest installation helm installation I followed the linux installation to the letter, and in the k8s installations used…
Dean Light
  • 21
  • 1
2
votes
1 answer

How should Trains be used with hyper-param optimization tools like RayTune?

What could be a reasonable setup for this? Can I call Task.init() multiple times in the same execution?
Michael Litvin
  • 3,976
  • 1
  • 34
  • 40
2
votes
1 answer

Trains: Can I reset the status of a task? (from 'Aborted' back to 'Running')

I had to stop training in the middle, which set the Trains status to Aborted. Later I continued it from the last checkpoint, but the status remained Aborted. Furthermore, automatic training metrics stopped appearing in the dashboard (though custom…
Michael Litvin
  • 3,976
  • 1
  • 34
  • 40
2
votes
2 answers

Tracking separate train/test processes with Trains

In my setup, I run a script that trains a model and starts generating checkpoints. Another script watches for new checkpoints and evaluates them. The scripts run in parallel, so evaluation is just a step behind training. What's the right Tracks…
Michael Litvin
  • 3,976
  • 1
  • 34
  • 40
2
votes
1 answer

Parallel Coordinates Plot in TRAINS

Is there a way to create a parallel coordinates plot in TRAINS (https://github.com/allegroai/trains) package to compare several hyper-parameters in respect to a specific metric?
Majd
  • 21
  • 4
1
vote
1 answer

Experiment tracking for multiple ML independent models using WandB in a single main evaluation

Can you recommend from your experience about choosing a convenient tracking experiment tool and versioning only "Multi independent models, but one input->multi-models->one output" in order to get single main evaluation and conveniently compare…
AlexeyPrikhodko
  • 43
  • 6
1
vote
2 answers

ClearML: How to merge 2 datasets which the 2 datasets inherited from a main dataset?

First I create a root (A) dataset. Then I created 2 dataset branches derived from root dataset. How do I "merge" these 2 branches to form another dataset ? Basically, the graph looks like an inverted diamond shape.
koayst
  • 2,095
  • 3
  • 17
  • 16
1
vote
1 answer

Does ClearML have accounting of information security events

ClearML is one of the most famous MLOps tools existing. It has logging of machine learning processes, however I couldn't find any information regarding its system of accounting of information security events. My question is: does ClearML have such…
alexlakiza
  • 11
  • 1
1
2 3 4