This tutorial demonstrates how to use the Mask Generator and Chromakey Alpha effects to create a custom transition from a video clip.
Update 03/08/2018: the tutorial now includes how to save the transition and use it in another project
Brilliant! I have just found this post and it has allowed me to create a transition that I always thought was a serious omission from most video editors as a