Platinum-selling rapper Ja Rule was set to leave an upstate prison on Thursday after serving most of his two-year sentence for illegal gun possession but head straight into federal custody in a tax case.