Constrained Variational-Hemivariational Inequalities on Nonconvex Star-Shaped Sets

In this paper, we study a class of constrained variational-hemivariational inequality problems with nonconvex sets which are star-shaped with respect to a certain ball in a reflexive Banach space. The inequality is a fully nonconvex counterpart of the variational-hemivariational inequality of elliptic type since it contains both, a convex potential and a locally Lipschitz one. Two new results on the existence of a solution are proved by a penalty method applied to a variational-hemivariational inequality penalized by the generalized directional derivative of the distance function of the constraint set. In the first existence theorem, the strong monotonicity of the governing operator and a relaxed monotonicity condition of the Clarke subgradient are assumed. In the second existence result, these two hypotheses are relaxed and a suitable hypothesis on the upper semicontinuity of the operator is adopted. In both results, the penalized problems are solved by using the Knaster, Kuratowski, and Mazurkiewicz (KKM) lemma. For a suffciently small penalty parameter, the solution to the penalized problem solves also the original one. Finally, we work out an example on the interior and boundary semipermeability problem that ilustrate the applicability of our results.