If you aren’t growing with them anymore and being with them has become a hefty task, you should cut them off. The sign that it isn’t leading to something positive from your friendship, makes it clear that being friends with them would bring no good. Therefore, you should cut this friendship off and start fresh for your sake.