Brown, who has been in jail since the end of last week, was denied bail on Monday and ordered to remain behind bars until at least an April 23, his next scheduled court hearing.
Brown's ejection from rehab is a potential violation of the court-ordered treatment for his conviction in 2009 for beating singer Rihanna, his girlfriend at the time.
He was arrested at the Malibu facility on Friday.
L.A. County Superior Court Judge James Brandlin ordered Brown arrested after he was ejected from the program for allegedly violating internal rules by making a threatening comment, failing to submit to a drug test and touching a female also undergoing treatment at the facility.
"It is clear from reading the incident report from the program, the program was concerned about the defendant's noncompliance and inability to follow the program's rules," Brandlin said in court.
This is not the first time Brown has been kicked out of rehab. During family counseling in November, Brown walked out and threw a rock through his mother's car window.
That led the judge to order a lengthy stay at another facility, complete two dozen hours of community labor and submit to periodic drug tests.
The singer's attorney, Mark Geragos, on Monday asked that Brown be released on bail because of a pending trial April 17 in