Ballpark Brawl promoter threatens to quit