Does this make enemies harder?

Not really. If you're just going into the Swamp it won't do much. But if you're already in the Swamp and go back into the BlackForest with Swamp gear, the enemies will still be engaging.