You keep your boss points no matter what level you are, but I recommend you to kill your those bosses at least once so you get the achievements for each boss of that lvl.
After reaching the highest rank in the hunting society, you will keep getting boss points, and you can change them for chances to kill profitable bosses :)