When Ivy is not pulled from around a tree it can girth and pull it down. Ivy on a fence also can cause problems with the weight and the pulling......can you cut the root and put round- up on the root mass. Pulling it out by hand is the only way to get rid of it. If it is on your brick it can cause problem with your pointing. I would definately cut where the roots are on the side of the house and let that just die off...It won't look beautiful but it will eventually fall apart without destroying the wall.