First thing I notice: When you drop in the kick you need to keep the bass walking all the time instead of just playing the short riff every other bar. The bass is what ultimately holds a track together. It's quite noticeable if it's not really part of the groove.
Otherwise sounds are good, just needs better arrangement to give it more impact. Good start -- keep on working.
The way I went about making this one was to create a very basic kick loop - that you're talking about - built more basic repetitive loops of the other sounds on top, but then started rearranging those other sounds first to build a groove.
I guess what you're saying is that I should have started that rearranging process with the kick first, which makes sense. It is on my "to do" list, but I was going to do that part last.
The kick, hat, clap, and "pong" sound are still all just the same thing repeating throughout the whole track, but my intention is to work these channels over one by one so that they aren't so straightforward, and so that they work with the groove I'm building.
Hopefully I'm addressing what you were talking about here, and making sense!!