I live in zone 4 so, no gulf fritillary here. That's one of the few pluses of our long cold winters. Our main problems are leaf miners and cabbage worms. I had thrips on my lilies once but not enough to really do much damage.
No need to feel guilty...as Clematis' prosper and do well, when they are happy. The work that you did was to make them happy--so they are well pleased with their situation. Chapeau. My soil here is a bit acidicy, so much so that I must add calcium pellets to help make the roots happy. That lovely pink one that was mislabeld I also have, My label is too faded to read but when I have some time I may do a bit of searching to find the name. It did quite well this year. It is a lovely thing, that is for sure.