Question

In: Statistics and Probability

How does the computational time changes when we decrease the k in k-fold cross validation? Why?...

How does the computational time changes when we decrease the k in k-fold cross validation? Why? Explain.

b. In which procedures, we can apply k-fold cross validation. Consider all the procedures that we learned.

Solutions

Expert Solution

a) the compulational time changes when we decrease the k in k-fold cross validation.

explanation: In k-fold cross-validation, the original sample is randomly partitioned into k equal sized subsamples. Of the k subsamples, a single subsample is retained as the validation data for testing the model, and the remaining k − 1 subsamples are used as training data. The cross-validation process is then repeated k times, with each of the k subsamples used exactly once as the validation data. The k results can then be averaged to produce a single estimation. The advantage of this method over repeated random sub-sampling (see below) is that all observations are used for both training and validation, and each observation is used for validation exactly once. 10-fold cross-validation is commonly used,but in general k remains an unfixed parameter.

b) Cross-validation is a resampling procedure used to evaluate machine learning models on a limited data sample. That k-fold cross validation is a procedure used to estimate the skill of the model on new data.

The following are the general procedures for the k-fold cross validation.

1) Shuffle the dataset randomly.

2) Split the dataset into k groups.

3) For each unique group:

a) Take the group as a hold out or test data set.

b) Take the remaining groups as a training data set.

c) Fit a model on the training set and evaluate it on the test set.

d) Retain the evaluation score and discard the model.

4) Summarize the skill of the model using the sample of model evaluation scores.

i hope this answer will help yoy. please give me thumsup.


Related Solutions

Cross validation: If we perform k-fold cross validation, training a Naive Bayes model, how many models...
Cross validation: If we perform k-fold cross validation, training a Naive Bayes model, how many models will we end up creating?
how do you compute the test error in 5-fold cross-validation?
how do you compute the test error in 5-fold cross-validation?
[USING R & dataset “Boston”] Using the leave-one-out cross-validation and 5-fold cross-validation techniques to compare the...
[USING R & dataset “Boston”] Using the leave-one-out cross-validation and 5-fold cross-validation techniques to compare the performance of models in (a) and (b) with: (a) SalesPredict <- lm(Sales ~ Price + Urban + US, data = Carseats) (b) SalesRevise <- lm(Sales ~ Price + US, data = Carseats) Hint: Functions update (with option subset) and predict.
What is the purpose of cross-validation? Specifically, why wouldn’t we test a hypothesis trained on all...
What is the purpose of cross-validation? Specifically, why wouldn’t we test a hypothesis trained on all of the available examples?
why does the neutron cross section decrease with increase energy whereas the proton cross section increases...
why does the neutron cross section decrease with increase energy whereas the proton cross section increases ?
How can we use concordant pairs (the c-index) to perform cross-validation for a logistic regression model?
How can we use concordant pairs (the c-index) to perform cross-validation for a logistic regression model?
What does it mean when we are asked are observations cross-classified
What does it mean when we are asked are observations cross-classified
How to know when will we incraese or decrease in account paybable and account receivable in...
How to know when will we incraese or decrease in account paybable and account receivable in cash flows ?
Why does marginal revenue decrease when total revenue increases? I understand how to calculate marginal revenue...
Why does marginal revenue decrease when total revenue increases? I understand how to calculate marginal revenue and total revenue and I've looked at images of the two curves but I don't understand the reason behind what's happening.  
Explain: Analysis of algorithms with the example. Explain with example: How computational time of an algorithm...
Explain: Analysis of algorithms with the example. Explain with example: How computational time of an algorithm depends on input size? Write an algorithm (using whatever method you prefer) that takes an input of 10 integers, sorts the integers in ascending order and out puts the sorted list. In relation to computational time of your algorithm for part 4, what arrangement of the input numbers will cause the best case computational time? What arrangement will cause the worst case time?
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT