Stack Overflow
Stack Overflow

Questions tagged [loocv]

10 questions
2
votes
0 answers

How to use LOOCV for trainControl with Stacking Algorithms using R caret

I like to know how to build an Ensembl Stacking R model using the caret package. In this model cross-validation function should be loocv In trainControl index param required to add manually. currently, I tried this but I got errors like…
Milinda Arambawela
  • 86
  • 5
1
vote
0 answers

LOOCV Cross-validation: lmer model

Kindly request assistance with the R code for the Leave-one-out CV (LOOCV) for the lmer model with k fold being random factors in the model. I believe the 'Caret' package does only for the lm/glm but not the Linear Mixed model. I might be…
Joyce
  • 11
  • 1
0
votes
0 answers

hyper parameter of loocv - performance reduce

I Try to hyper parameter tuning over my model , I have small dataset thus the basic model is evaluatred by LOOCV. for better performance I want to hyper parameter tune the model thus I did the next step: I Run LOOCV 1.1 for each fold of the LOOCV I…
Gal
  • 1
  • 1
0
votes
0 answers

R ensemble stacking using caret: the right way to establish index for LOOCV

Im trying to stack ensemble of predictions using caretStack and applying LOOCV. Here is my script: library(readr) library(caretEnsemble) # Using wine quality dataset as an example: raw <-…
tabumis
  • 106
  • 7
0
votes
0 answers

getting Rank deficiency error in cross validation

Hi I am trying to cross validate my multiple logistic predictive model. I have used the following code before on the same data before and it never gave me an issue but now its giving the rank deficiency error. Any help would be…
Kierrajames
  • 21
  • 3
0
votes
1 answer

Calculating LOOCV with adjusted R-square scoring parameter

I have dataset where I transformed categorical dataset into numerical by dummies and I ran simple linear regression model to predict dependent variable. I got adjusted R-square as 0.66. Now I want to cross validate my model with leave one out method…
Atique Barudgar
  • 1
  • 4
0
votes
0 answers

How to use learning curves and cross-validation?

My aim is to prove whether there is overfitting or underfitting. However, when I calculate the learning curves (graphically depict how a process is improved), the standard deviation of the cross-validation score is enormous. My observation here is…
vdu16
  • 123
  • 10
0
votes
0 answers

i get one set of feature importance after loocv, is it a result of all loocv model sets or of one mean model? (random forest)

I'm a person who doesnt get used to loocv yet. I've been curious of the title problem. I did leave one out cross validation for my random forest model. My codes are like this. for train_index, test_index in loo.split(x): x_train, x_test =…
shibashiba
  • 49
  • 3
0
votes
0 answers

Leave one out cross validation RStudio randomForest package error

Creating an LOOCV loop using the randomForest package. I have adapted the following code from this link (https://stats.stackexchange.com/questions/459293/loocv-in-caret-package-randomforest-example-not-unique-results) however I am unable to…
cmche
  • 1
  • 1
0
votes
1 answer

Apply LOOCV in java splitting with a specific condition

I have a csv file containing 24231 rows. I would like to apply LOOCV based on the project name instead of the observations of the whole dataset. So if my dataset contains information for 15 projects, I would like to have the training set based on 14…
ValeSwire
  • 33
  • 5