6
$\begingroup$

With Least Absolute Deviations (LAD) regression coefficients are estimated through minimization of the sum of the absolute values of the residuals.

Quantile regression aims at estimating either the conditional median or other quantiles of the response variable.

Is nonlinear quantile regression which aims to estimate the conditional median equivalent to nonlinear LAD regression?

$\endgroup$
0

1 Answer 1

4
$\begingroup$

Assume we have the following regression model:

$\mathbf{y} = f(\mathbf{x},\mathbf{\beta}) + \mathbf{\epsilon}$

The $\beta$ estimate of LAD regression is given by:

$ \hat{\beta}_{LAD} = \text{argmin}_{ b} \sum_{i=1}^n |y_i - f(\mathbf{b},x_i)|$

The $\beta$ estimate of Quantile regression is given by:

$ \hat{\beta}_{Quantile} = \text{argmin}_{ b} \sum_{i:y_{i} \geq f(\mathbf{b},x_i) }^n q|y_i -f(\mathbf{b},x_i)| + \sum_{i:y_{i} < f(\mathbf{b},x_i) }^n (1-q)|y_i -f(\mathbf{b},x_i)| $

If $q = 0.5$ (which is the case if we want to estimate the conditional median), this simplifies to:

$ \hat{\beta}_{Quantile, q =0.5} = \text{argmin}_{ b} \sum_{i=1}^n 0.5|y_i - f(\mathbf{b},x_i)|$, which is equivalent to $\hat{\beta}_{LAD}$

$\endgroup$
1
  • $\begingroup$ I still don't quite understand why LAD regression is the same as median regression. When f(x, b) is just b, lad regression does not have a uniq solution. But median regression returns just the median. So they are not the same at least for this special case. $\endgroup$ Commented Aug 8, 2021 at 4:25

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.