I think it's a Canker Worm. Inspect every leaf especially the flowering part. They mix in with the color but has a different texture. Poke the sucker off with a sharp tool and kill it along with all of the eggs and web silk. You can mark the ones you checked with a string or anything convienient to help prevent double checking/wasting extra time. If the flower starts to die off or turn brown there's most likely a worm tucked way in the budding flower. They will destroy everything goes unattended. A teaspoon of plant based dish soap in a bollte of whater is a good organic option. spray on the top and bottom of leaves and flowers. Make sure to remove all of the worms,webs and eggs. Personally I manually remove it rather then adding chemicals, but it each is own. Kill,Kill,Kill!!! Happiest worms on earth.