Gently wash potatoes, leaving the skin on. If they are small, you may leave them whole. If they are larger, cut them in halves or quarters so all pieces are similarly sized. Place the potatoes in a large saucepan. Add water to cover along with a generous amount of salt, similar to how you would salt water to cook pasta. Place the pan on the stove over medium to medium-high heat and bring to a boil. Cook, covered, until tender, 10-15 minutes; drain in a colander.
Using the same pan, heat the oil over medium-high heat. Add the garlic and sauté briefly until it softens. Add the potatoes and cook until browned, 4-6 minutes.
Remove the potatoes from the heat. Stir in Parmesan cheese and lemon juice and season with black pepper and additional salt to taste. Serve warm.
