Azure Data Scientists Associate Practice Exam

What parameter in an automated machine learning classification function should be set to optimize for the model with the best AUC_weighted metric?

1. task='AUC_weighted'

2. target_column_name='AUC_weighted'

3. primary_metric='AUC_weighted'

4. metric='AUC_weighted'

The correct answer is: primary_metric='AUC_weighted'

In automated machine learning classification functions in Azure, setting the primary_metric parameter to 'AUC_weighted' is essential for optimizing the model to achieve the best possible AUC weighted score. The primary_metric indicates the evaluation metric that the automated machine learning algorithm should use to assess and compare different models during the training process. When the primary_metric is set to 'AUC_weighted', the algorithm focuses on maximizing the area under the curve for the weighted ROC curve, which is particularly important in scenarios with class imbalance. This metric incorporates both the true positive rate and the false positive rate, providing a balanced evaluation of the model's performance across different classes. Other parameters listed do not directly influence the optimization process in the same way. For example, merely assigning 'AUC_weighted' to a task or metric might not set the framework to prioritize this specific evaluation criterion for performance improvement throughout the training iterations. Thus, using primary_metric ensures that the algorithm's objective aligns specifically with the desired performance measurement.