I would go for a Large Pro ICU or larger, since both your lenses are quite substantial and the SW150 filter holder with a couple of 150mm filters can be extremely cumbersome to place inside such a bag.
At the moment I use the XF (with prism as well) with the 35, 80 and 150/2.8 blue ring lenses in a XL Pro ICU and it does fit well together with the SW150 system, although I store the actual glass filters in the top compartment instead of inside the ICU.
Also something to think about, if i.e. you don't want to take the lens off the camera when storing, it might be better to into a slightly larger ICU so you have plenty of room to do the layout to accommodate for the 'complete' camera inside, if that makes sense.
Another thing I've learned is that the SW150 system is quite large by itself and often used outside of the camera bag, so perhaps also look into getting one of those external pouches (called Refern or something like that) and place the filter holder and adapter rings in there for easy access and save some space in the ICU for other stuff.