Sri Lanka batsman Kaushal Silva regrets not making the most of his opportunities at the highest level but says the fact that he was in and out of the Test side did not help.