Python only warm build branch

I was discussing with @ezyang of difficulties to contributing to pytorch. One of them is that build takes so long. For python only changes, would it be possible to have a origin/viable/strict-warm ? We shouldn't need to build from scratch if we are rebasing to a warm commit.