@dpiponiDan Piponi I finally realized what you said there. I am always thinking in terms of the distributions themselves, while these manifolds are on the parameters. So, my example is bad.

There are still plenty of examples of a sequence of parameterized distributions which have a limit not in the parameterized family, though.