Quantile Regression as an Optimization Problem

The model for linear quantile regression is

     

where is the vector of responses, is the regressor matrix, is the vector of unknown parameters, and is the vector of unknown errors.

regression, also known as median regression, is a natural extension of the sample median when the response is conditioned on the covariates. In regression, the least absolute residuals estimate , referred to as the -norm estimate, is obtained as the solution of the minimization problem

     

More generally, for quantile regression Koenker and Bassett (1978) defined the th regression quantile, , as any solution to the minimization problem

     

The solution is denoted as , and the -norm estimate corresponds to . The th regression quantile is an extension of the th sample quantile , which can be formulated as the solution of

     

If you specify weights , with the WEIGHT statement, weighted quantile regression is carried out by solving

     

Weighted regression quantiles can be used for L-estimation; refer to Koenker and Zhao (1994).