I predict you'll find this logistic regression example with R to be helpful for gleaning useful information from common binary classification problems.

Regression can be used on categorical responses to estimate probabilities and to classify.

David Muchlinski, David Siroky, Jingrui He, Matthew Kocher, Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data, Political Analysis, Vol. 24, No. 1 ...

The regression diagnostics introduced by Pregibon for the dichotomous logistic model are extended to multiple groups viewed as a multivariate generalized linear model. We develop diagnostics which ...