I like the idea, but I’m hearing this as mainly a disparate collection of loops. I’d recommend you do some experimenting with the samples and beats, either with timing or in an editor, in order to get them to line up more and transition from one to the other more smoothly.