In this article, an approach for metamodel-based design optimization (MBDO) of topology optimization (TO) concepts is proposed by using support vector machines (SVMs) as geometric models of the concepts instead of traditional parametric computer aided design (CAD) models. In such a manner, an efficient approach for the MBDO-driven design of TO-based concepts is obtained. An implicit hypersurface representing the TO-based concept is generated by classifying the TO-solutions of zeros and ones by using the 1-norm SVM of Mangasarian. The implicit SVM-based hypersurfaces are then utilized to set up designs of experiments of nonlinear finite element analyses by morphing the TO-based concepts by using Boolean and blending operations. Finally, MBDO is performed by using an ensemble of metamodels consisting of quadratic regression, Kriging, radial basis function networks, polynomial chaos expansion and support vector regression models. The proposed MBDO framework is demonstrated by minimizing the mass of a three-dimensional design domain with a constraint on the plastic limit load. The performance of the approach is most promising.