The benchmark I use is "Is it probable that this app might become shared between projects?"

Using a Django 'app' for this makes sense. If it's generic enough that I might consider moving it into it's own repo then it's probably not going to be heavily intertwined with the rest of the project.