Chapter 8

1. Chapter 8 Dummy Variables and Truncated Variables

2. What is in this Chapter? • This chapter relaxes the assumption made in Chapter 4 that the variables in the regression are observed as continuous variables. • Differences in intercepts and/or slope coefficients • The linear probability model and the logit and probit models. • Truncated variables, Tobit models

3. 8.2 Dummy Variables for Changes in the Intercept Term • Note that the slopes of the regression lines for both groups are roughly the same but the intercepts are different. • Hence the regression equations we fit will be

4. 8.2 Dummy Variables for Changes in the Intercept Term • These equations can be combined into a single equation where • The variable D is the dummy variable. • The coefficient of the dummy variable measures the difference in the two intercept terms

5. 8.2 Dummy Variables for Changes in the Intercept Term

6. 8.2 Dummy Variables for Changes in the Intercept Term • If there are more groups, we have to introduce more dummies. • For three groups we have • These can be written as where

7. 8.2 Dummy Variables for Changes in the Intercept Term • As yet another example, suppose that we have data on consumption C and income Y for a number of households. • In addition, we have data on • S: the sex of the head of the household. • A: the age of the head of the household, which is given in three categories, <25 years, 25 to 50 year, and >50 years. • E: the education of the head of the household, also in three categories, <high school, ≧high school but < college degree, ≧ college degree.

8. 8.2 Dummy Variables for Changes in the Intercept Term • We include these qualitative variable in the form of dummy variables

9. 8.2 Dummy Variables for Changes in the Intercept Term • For each category the number of dummy variables is one less than the number of classifications. • Then we run the regression equation • The assumption made in the dummy variable method is that it is the intercept that changes for each group but not the slope coefficients (i.e. coefficients of Y).

10. 8.2 Dummy Variables for Changes in the Intercept Term • The dummy variable method is also used if one has to take care of seasonal factors. • For example, if we have quarterly data on C and Y, we fit the regression equation

11. 8.2 Dummy Variables for Changes in the Intercept Term • If we have monthly data, we use 11seasonal dummies • If we feel that, say, December (because of Christmas shopping) is the only moth with strong seasonal effect, we use only one dummy variable

14. 8.2 Dummy Variables for Changes in the Intercept Term • Two More Illustrative Examples • We will discuss two more examples using dummy variables. • They are meant to illustrate two points worth noting, which are as follows: • 1. In some studies with a large number of dummy variables it becomes somewhat difficult to interpret the signs of the coefficients because they seem to have the wrong signs. (The first example) • 2. Sometimes the introduction of dummy variables produces a drastic change in the slope coefficient. (The second example)

15. 8.2 Dummy Variables for Changes in the Intercept Term • The first example is a study of the determinants of automobile prices. • Griliches regressed the logarithm of new passenger car prices on various specifications. The results are shown in Table 8.1 • Since the dependent variable is the logarithm of price, the regression coefficients can be interpreted as the estimated percentage change in the price for a unit change in a particular quality, holding other qualities constant • For example, the coefficient of H indicates that an increase in 10 units of horsepower, results in a 1.2 increase in price

17. 8.2 Dummy Variables for Changes in the Intercept Term • As another example consider the estimates of liquid-asset demand by manufacturing corporations • Vogel and Maddala computed regressions of the form log C =α +ß log S, where C is the cash and S the sales, on the basis of data from the Internal Revenue Service, "Statistics of Income," for the year 1960-1961. • The data consisted of 16 industry subgroups and 14 size classes, size being measured by total assets.

18. 8.2 Dummy Variables for Changes in the Intercept Term • The equations were estimated separately for each industry, the estimates of β ranged from 0.929 to 1.077. • The R2’s were uniformly high, ranging from 0.985 to 0.998. • Thus one might conclude that the sales elasticity of demand for cash is close to 1. • Also, when the data were pooled and a single equation estimated for the entire set of 224 observations, the estimate of β was 0.992 and R2=0.897.

19. 8.2 Dummy Variables for Changes in the Intercept Term • When industry dummies were added, the estimate of β was 0.995 and R2=0.992. • From the high R2’s and relatively constant estimate of β one might be reassured that the sales elasticity is very close to 1. • However, when asset-size dummies were introduced, the estimate of β fell to 0.334 with R2 of 0.996. • Also, all asset-size dummies were highly significant.

20. 8.2 Dummy Variables for Changes in the Intercept Term • The situation is described in Figure 8.2. • That the sales elasticity is significantly less than 1 is also confirmed by other evidence. • This example illustrates how one can be very easily misled by high R2’s and apparent constancy of the coefficients.

21. 8.2 Dummy Variables for Changes in the Intercept Term

22. 8.3 Dummy Variables for Changes in Slope Coefficients and • We can write these equations together as or

23. 8.3 Dummy Variables for Changes in Slope Coefficients where for all observations in the first group for all observations in the second group for all observations in the first group i.e., the respective value of x for the second group • The coefficient of D1 measures the difference in the intercept terms and coefficient of D2 measures the difference in the slope.

24. 8.3 Dummy Variables for Changes in Slope Coefficients • Suitable dummy variables can be defined when there are change in slopes and intercepts at different times. • Suppose that we have data for three periods and in the second period only the intercept changed ( there was a parallel shift). • In the third period the intercept and the slope changed.

25. 8.3 Dummy Variables for Changes in Slope Coefficients • Then we write • Then we can combine these equations and write the model as

26. 8.3 Dummy Variables for Changes in Slope Coefficients

27. 8.3 Dummy Variables for Changes in Slope Coefficients • An alternative way of writing the equations (8.5), which is very general, is to stack the y variables and the error terms in columns. • Then write all the parameters α1, α2 , α3 , β1 , β2 down with their multiplicative factors stacked in columns as follows:

28. 8.3 Dummy Variables for Changes in Slope Coefficients • What this says is where ( ) is used for multiplication, e.g., α3(0)=α3×0.

29. 8.3 Dummy Variables for Changes in Slope Coefficients where the definitions of D1, D2, D3, D4, D5 are clear from equation(8.7). • For instance,

30. 8.3 Dummy Variables for Changes in Slope Coefficients • Note that equation (8.8) has to be estimated without a constant term. • In this method we define as many dummy variables as there are parameters to estimate and we estimate the regression equation with no constant term. • Note that equations (8.6) and (8.8) are equivalent.

31. 8.7 Dummy Dependent Variables • Until now we have been considering models where the explanatory variables are dummy variables. • We now discuss models where the explained variable is a dummy variable. • This dummy variable can take on two or more values but we consider here the case where it takes on only two values, zero or 1. • The linear probability model, logit and probit models

32. 8.8 The Linear Probability Model and the Linear Discriminant Function The Linear Probability Model • Similarly, in an analysis of bankruptcy of firms, we define • We write the model in the usual regression framework as with E(ui)=0.

33. 8.8 The Linear Probability Model and the Linear Discriminant Function • The condition expectation is equal to . • This has to be interpreted in this case as the probability that the even will occur given the xi. • The calculated value if y from the regression equation (i.e., ) will then give the

34. 8.8 The Linear Probability Model and the Linear Discriminant Function • Since yi takes the value 1 or zero, the errors in equation (8.11) can take only two values, (1-βxi) and (-βxi). • Also, with the interpretation we have given equation (8.11), and the requirement that E(ui)=0, the respective probabilities of these events are βxi and (1-βxi). • Thus we have

35. 8.8 The Linear Probability Model and the Linear Discriminant Function • Hence

36. 8.8 The Linear Probability Model and the Linear Discriminant Function • Because of this heteroskedasticity problem the OLS estimates of β from equation (8.11) will not be efficient. • We use the following two-step procedure: • First estimate (8.11) by least squares. • Net compute and use weighted least squares, that is, defining • We regress

37. 8.8 The Linear Probability Model and the Linear Discriminant Function The problems with this procedure are • in practice may be negative, although in large samples this will be so with a very small probability since is a consistent estimator for .

38. 8.8 The Linear Probability Model and the Linear Discriminant Function 2. The most important criticism is with the formulation itself: that the conditional expectation be interpreted as the probability that the even will occur. In many case cases lie outside the limits (0, 1).

39. 8.8 The Linear Probability Model and the Linear Discriminant Function

40. 8.8 The Linear Probability Model and the Linear Discriminant Function The Linear Discriminant Function • Suppose that we have n individuals for whom we have observations on k explanatory variables and we observe that n1 of them belong to a second group where n1+n2=n. • We want to construct a linear function of the k variables that we can use to predict that a new observation belongs to one of the twp groups. • This linear function is called the linear discriminant function.

41. 8.8 The Linear Probability Model and the Linear Discriminant Function • As an example suppose that we have data on a number of loan applicants and we observe that n1 of them were granted loans and n2 of them were denied loans. • We also have the socioeconomic characteristics on the applicants

42. 8.8 The Linear Probability Model and the Linear Discriminant Function • Let us define a linear function • Then it is intuitively clear that to get the best discrimination between the two groups, we would want to choose the that the ratio

43. 8.8 The Linear Probability Model and the Linear Discriminant Function • Fisher suggested an analogy between this problem and multiple regression analysis. • He suggested that we define a dummy variable

44. 8.8 The Linear Probability Model and the Linear Discriminant Function • Now estimate the multiple regression equation • Get the residual sum of squares RSS. • Then • Thus, once we have the regression coefficients and residual sum of squares from the dummy dependent variable regression, we can very easily obtain the discriminant function coefficients.

45. Discriminant Analysis • Discriminant analysis attempts to classify customers into two groups: • those that will default • those that will not • It does this by assigning a score to each customer • The score is the weighted sum of the customer data:

46. Discriminant Analysis • Here, wi is the weight on data type i, and Xi,c, is one piece of customer data. • The values for the weights are chosen to maximize the difference between the average score of the customers that later defaulted and the average score of the customers who did not default

47. Discriminant Analysis • The actual optimization process to find the weights is quite complex • The most famous discriminant scorecard is Altman's Z Score. • For publicly owned manufacturing firms, the Z Score was found to be as follows:

48. Discriminant Analysis

49. Discriminant Analysis • A company scoring less than 1.81 was "very likely" to go bankrupt later • A company scoring more than 2.99 was "unlikely" to go bankrupt. • The scores in between were considered inconclusive

50. 8.9 The Probit and Logit Models • An alternative approach is to assume that we have a regression model where is not observed. • It is commonly called a “latent” variable. • What we observe is a dummy variable yi defined by