Le eccezioni non gestite.... le puoi gestire in ApplicationEvents.vb:

Private Sub MyApplication_UnhandledException(ByVal sender As Object, ByVal e As _
Microsoft.VisualBasic.ApplicationServices.Unhandle dExceptionEventArgs) Handles Me.UnhandledException

'...... codice...........

End Sub