Preheat your oven to 400°F (200°C).
In a large mixing bowl, combine the halved baby potatoes, olive oil, dried oregano, salt, and black pepper. Toss until the potatoes are evenly coated.
Spread the potatoes out in a single layer on a large baking sheet. Add the peeled garlic cloves to the baking sheet.
Place the crumbled feta cheese in the center of the baking sheet, surrounded by the potatoes and garlic.
Roast in the preheated oven for 30-35 minutes, or until the potatoes are golden brown and tender, stirring halfway through for even cooking.
Once done, remove from the oven and let it cool for a few minutes. Garnish with fresh parsley before serving.