Skip to main content
Loading Events

« All Events

  • This event has passed.

Graduate Student Seminar: Iain Carmichael

30 Nov @ 3:30 pm - 4:30 pm

Iain Carmichael

UNC-Chapel Hill


Geometric Insights into Support Vector Machine Behavior

using the KKT Conditions

The support vector machine (SVM) is a powerful and widely used classification algorithm. We use the Karush-Kuhn-Tucker conditions to provide rigorous mathematical proof for new insights into the behavior of SVM. These insights provide perhaps unexpected relationships between SVM and two other linear classifiers: the mean difference and the maximal data piling direction. For example, we show that in many cases SVM can be viewed as a cropped version of these classifiers. By carefully exploring these connections we show how SVM tuning behavior is affected by characteristics including: balanced vs. unbalanced classes, low vs. high dimension, separable vs. non-separable data. These results provide further insights into tuning SVM via cross-validation by explaining observed pathological behavior and motivating improved cross-validation methodology. Finally, we also provide new results on the geometry of complete data piling directions in high dimensional space.

Details

Date:
30 Nov
Time:
3:30 pm - 4:30 pm
Event Category:

Venue

120 Hanes Hall
Hanes Hall
Chapel Hill, NC 27599 United States