"Going on about downvotes" means complaining about them or otherwise making them a topic of discussion here, which is always tedious and always off-topic.
Comments that break the site guidelines in this way cross into offtopicness regardless of how relevantly they began.