In this survey, we present a modified inverse moment estimation of parameters and its applications. We use a specific model to demonstrate its principle and how to apply this method in practice. The estimation of unknown parameters is considered. A necessary and sufficient condition for the existence and uniqueness of maximum-likelihood estimates of the parameters is obtained for the classical maximum likelihood estimation. Inverse moment and modified inverse moment estimators are proposed and their properties are studied. Monte Carlo simulations are conducted to compare the performances of these estimators. As far as the biases and mean squared errors are concerned, modified inverse moment estimator works the best in all cases considered for estimating the unknown parameters. Its performance is followed by inverse moment estimator and maximum likelihood estimator, especially for small sample sizes.
The inverse estimation method was originally proposed by Wang (1992) and was applied to study parameter estimation for Weibull distribution. Different from the regular method of moments, the idea of the inverse moment estimation (IME) is as follows.
For a sample
Wang (2004) obtained the inverse moment estimators and the interval estimation based on type II progressively censored data under the Weibull distribution. The simulation results showed that the mean square errors of the inverse moment estimators are less than the maximum likelihood estimates (MLE)’s. Gu and Yue (2013) considered the problem of estimating parameters of the generalized exponential distribution based on a complete sample. They proposed the inverse moment estimators of the parameters of the generalized exponential distribution. The precisions of MLEs and IMEs are compared through numerical simulations. Gui (2015) studied the problem of estimating unknown shape and scale parameters of exponentiated half logistic distribution. Inverse moment and modified inverse moment estimators were derived. Monte Carlo simulations were conducted to compare the performances.
Wang
In this paper, we focus on the problem of parameter estimation for the inverted exponential Pareto distribution and demonstrate the inverse estimation and its modified version. We begin with the classical MLE and obtain a necessary and sufficient condition for the existence and uniqueness of MLE of the parameters. We propose inverse moment and modified inverse moment estimators and study their properties. Monte Carlo simulations are used to compare the performances. We also propose the methods for constructing joint confidence regions for the two parameters and study their performances.
Gupta
where
A random variable
and
respectively, where
Shawky and Abu-Zinadah (2009) considered the maximum likelihood estimation of the different parameters of an exponential Pareto distribution. Afify (2010) obtained Bayes and classical estimators for two parameters exponentiated Pareto distribution when a sample is available from complete, type I and type II censoring scheme. Ali
The rest of this paper is organized as follows. In Section 2, we discuss the classical maximum likelihood estimation of the parameters of the inverted exponential Pareto distribution. In Section 3, we propose the inverse and modified inverse estimation methods to estimate the parameters and study their properties. Joint confidence regions for the two parameters are also proposed in Section 4. Section 5 conducts simulations to compare the estimators and the confidence regions. In Section 6, a numerical example is presented to illustrate the superiorities of the proposed methods. Finally, Section 7 concludes.
In this section, we discuss the MLEs of the parameters of inverted exponential Pareto distribution (IEPD) based on a complete sample. Let
The score equations are as:
Consider the case when
and
where
Note that
since (
since (1/
In the following, we discuss the existence and uniqueness of MLEs in the case of at least two non-identical observed values of the sample.
From (
The MLE of
Firstly, we prove that the equation
It follows that the equation
Secondly, we show that the root is unique. We rewrite
where
since (
Since − log(1 −
In Statistics, there are many methods available for estimating the parameter(s) of interest. One of the oldest methods is the method of moments. It is based on the assumption that sample moments should provide adequate estimates of the corresponding population moments. Suppose we want to estimate
Find
Determine the corresponding
Let
The method of moments is simple and easy to compute. However, the estimator may not be unique or not exist. In this section, we propose an inverse moment estimation. The superiority of the new estimator is its existence and uniqueness.
Let
that is,
Thus, the IME of
which is identical with the MLE of
The proof can be found in Arnold
2
The proof can be found in Wang (1992).
Now we consider the IME of
are
Let
Let
where
Noting that the mean of
Solve the equation and we obtain the inverse estimate
Solve the equation and we obtain the modified inverse estimate
In the following, we prove the existence and uniqueness of the root in the
By Lemma 3, we obtain
Thus,
Thus,
Noting that, for
where
and
By Cauchy’s mean-value theorem, for
Note that
Let
and
It is obvious that
and
We obtain that
Let
By using the pivotal variables
The function of
and does not depend on
However, by Lemma 2, we have
In this section, we conduct simulations to compare the performances of the MLEs, IMEs and MIMEs mainly with respect to their biases and mean squared errors (MSE’s), for various sample sizes and for various true parametric values.
Suppose
We consider sample sizes
For different cases, Table 1 reports the average values of
For different cases, Table 2 reports the average values of
From Tables 1 and 2, we observe that
The average relative biases and the average relative MSEs for the three methods decrease as sample size
For the three methods, the average biases and relative MSEs of
Considering only MSE’s, the estimation of
MLE and IME overestimate both of the two parameters
As far as the biases and MSEs are concerned, it is clear MIME works the best in all the cases considered to estimate the two parameters. Its performance is followed by IME and MLE, especially for small sample sizes. The three methods are close for larger sample sizes. Considering all the points, MIME is recommended for estimating both the parameters of the IEPD(
In Section 4, two methods to construct the confidence regions of the two parameters
First, we assess the precisions of the two methods of interval estimators for the parameter
The mean widths as well as the coverage rates over 1,000 replications are computed. Here the coverage rate is defined as the rate of the confidence intervals that contain the true value
The mean widths of the intervals decrease as sample sizes
The mean widths of the intervals decrease as the parameter
The coverage rates of the two methods are close to the nominal level 0.95.
Considering the mean widths, the interval estimate of
We consider the two joint confidence regions and the empirical coverage rates and expected areas. The results of the methods for constructing joint confidence regions for (
It is observed that:
The mean areas of the joint regions decrease as sample sizes
The mean areas of the joint regions increase as the parameter
The coverage rates of the two methods are close to the nominal level 0.95.
Considering the mean areas, the joint region of (
In this section, we consider a real dataset. This data set represents the total seasonal annual rainfall (in inches) recorded at Los Angeles Civic Center during the last 25 years, from 1985 to 2009 (season 1 July–30 June). The observations are
12.82, 17.86, 7.66, 12.48, 8.08, 7.35, 11.99, 21.00, 27.36, 8.11, 24.35, 12.44, 12.40, 31.01, 9.09, 11.57, 17.94, 4.42, 16.42, 9.25, 37.96, 13.19, 3.21, 13.53, 9.08.
The dataset has been previously analyzed by Raqab (2006, 2013) and Ahmadi and Balakrishnan (2009). Here we fit the data with IEPD.
The MLEs of the parameters are
Using the methods proposed in Section 3, we obtain the following estimates:
Based on method 1, the 95% joint confidence region for the parameters (
Based on method 2, the 95% joint confidence region for the parameters (
Figure 3(a) and (b) show the 95% joint confidence regions of (
In this article, we present the modified inverse moment estimation of parameters and its applications. We use the inverted exponential Pareto distribution as a specific model to demonstrate its principle and how to apply this method in practice. The estimation of unknown parameters is investigated. For the classical maximum likelihood estimation, a necessary and sufficient condition for the existence and uniqueness of MLEs of the parameters is obtained. Inverse moment and modified inverse moment estimators are proposed and their properties are studied.
Monte Carlo simulations are conducted to compare the performances of the three estimators. The simulation results show that the modified inverse moment estimator works the best in all the cases considered for estimating the unknown parameters in terms of biases and mean squared errors. Its performance is followed by inverse moment estimator and maximum likelihood estimator, especially for small sample sizes. We also discuss joint confidence regions for unknown parameters. Real rainfall dataset is analyzed and used to illustrate the proposed method.
The method discussed in this paper can be easily extended to other common distributions (such as generalized exponential, and inverse Weibull distribution), which are frequently used in practice. Future research topics should include a comparison of the proposed modified inverse moment estimator with Bayesian estimator, what is the relation between the proposed estimator and sufficient statistics.
The author’s work was partially supported by the program for the Fundamental Research Funds for the Central Universities (2014RC042; 2015JBM109).
Average relative estimates and MSEs of
Methods | ||||||
---|---|---|---|---|---|---|
30 | MLE | 1.1229 (0.1600) | 1.1518 (0.1753) | 1.1790 (0.2353) | 1.1735 (0.2472) | 1.1736 (0.2482) |
IME | 1.0899 (0.1376) | 1.1149 (0.1508) | 1.1376 (0.2019) | 1.1287 (0.2061) | 1.1286 (0.2127) | |
MIME | 1.0457 (0.1166) | 1.0656 (0.1254) | 1.0835 (0.1662) | 1.0721 (0.1688) | 1.0696 (0.1734) | |
40 | MLE | 1.0760 (0.0793) | 1.0948 (0.0914) | 1.1212 (0.1262) | 1.1195 (0.1320) | 1.1356 (0.1617) |
IME | 1.0531 (0.0717) | 1.0690 (0.0820) | 1.0922 (0.1116) | 1.0897 (0.1179) | 1.1014 (0.1416) | |
MIME | 1.0220 (0.0638) | 1.0345 (0.0717) | 1.0543 (0.0964) | 1.0499 (0.1017) | 1.0590 (0.1212) | |
50 | MLE | 1.0720 (0.0661) | 1.0663 (0.0658) | 1.0941 (0.0831) | 1.0866 (0.0877) | 1.1038 (0.1028) |
IME | 1.0537 (0.0609) | 1.0464 (0.0607) | 1.0711 (0.0745) | 1.0635 (0.0799) | 1.0798 (0.0943) | |
MIME | 1.0290 (0.0551) | 1.0199 (0.0549) | 1.0418 (0.0660) | 1.0329 (0.0711) | 1.0472 (0.0831) | |
80 | MLE | 1.0385 (0.0343) | 1.0555 (0.0442) | 1.0515 (0.0455) | 1.0530 (0.0452) | 1.0485 (0.0470) |
IME | 1.0276 (0.0325) | 1.0438 (0.0419) | 1.0387 (0.0431) | 1.0390 (0.0422) | 1.0331 (0.0437) | |
MIME | 1.0129 (0.0306) | 1.0275 (0.0390) | 1.0214 (0.0401) | 1.0207 (0.0392) | 1.0141 (0.0407) | |
100 | MLE | 1.0345 (0.0311) | 1.0431 (0.0318) | 1.0382 (0.0322) | 1.0393 (0.0353) | 1.0419 (0.0374) |
IME | 1.0260 (0.0301) | 1.0339 (0.0304) | 1.0281 (0.0307) | 1.0288 (0.0338) | 1.0298 (0.0353) | |
MIME | 1.0143 (0.0287) | 1.0210 (0.0287) | 1.0144 (0.0290) | 1.0144 (0.0319) | 1.0147 (0.0332) |
MLE = maximum likelihood estimate; IME = inverse moment estimation; MIME = modified inverse moment estimation; MSE = mean square error.
Average relative estimates and MSEs of
Methods | ||||||
---|---|---|---|---|---|---|
30 | MLE | 1.0742 (0.0576) | 1.0590 (0.0491) | 1.0678 (0.0472) | 1.0524 (0.0414) | 1.0557 (0.0459) |
IME | 1.0451 (0.0516) | 1.0316 (0.0445) | 1.0406 (0.0423) | 1.0257 (0.0376) | 1.0294 (0.0419) | |
MIME | 1.0054 (0.0466) | 0.9940 (0.0410) | 1.0038 (0.0385) | 0.9901 (0.0350) | 0.9944 (0.0389) | |
40 | MLE | 1.0628 (0.0396) | 1.0569 (0.0395) | 1.0530 (0.0364) | 1.0480 (0.0310) | 1.0385 (0.0299) |
IME | 1.0416 (0.0363) | 1.0363 (0.0363) | 1.0336 (0.0339) | 1.0286 (0.0285) | 1.0200 (0.0280) | |
MIME | 1.0122 (0.0331) | 1.0081 (0.0336) | 1.0064 (0.0315) | 1.0022 (0.0265) | 0.9942 (0.0265) | |
50 | MLE | 1.0407 (0.0298) | 1.0370 (0.0251) | 1.0360 (0.0261) | 1.0346 (0.0237) | 1.0366 (0.0245) |
IME | 1.0243 (0.0280) | 1.0207 (0.0235) | 1.0203 (0.0246) | 1.0198 (0.0225) | 1.0209 (0.0231) | |
MIME | 1.0013 (0.0264) | 0.9986 (0.0223) | 0.9988 (0.0234) | 0.9989 (0.0214) | 1.0004 (0.0220) | |
80 | MLE | 1.0234 (0.0179) | 1.0200 (0.0147) | 1.0162 (0.0145) | 1.0255 (0.0136) | 1.0161 (0.0139) |
IME | 1.0130 (0.0172) | 1.0101 (0.0142) | 1.0064 (0.0140) | 1.0156 (0.0130) | 1.0067 (0.0135) | |
MIME | 0.9988 (0.0167) | 0.9964 (0.0138) | 0.9933 (0.0137) | 1.0026 (0.0125) | 0.9941 (0.0132) | |
100 | MLE | 1.0193 (0.0123) | 1.0178 (0.0130) | 1.0185 (0.0115) | 1.0189 (0.0105) | 1.0177 (0.0104) |
IME | 1.0113 (0.0119) | 1.0101 (0.0127) | 1.0109 (0.0112) | 1.0116 (0.0102) | 1.0101 (0.0102) | |
MIME | 0.9999 (0.0116) | 0.9992 (0.0123) | 1.0004 (0.0109) | 1.0013 (0.0099) | 1.0000 (0.0099) |
MLE = maximum likelihood estimate; IME = inverse moment estimation; MIME = modified inverse moment estimation; MSE = mean square error.
Results of the methods for constructing intervals for
Methods | |||||||
---|---|---|---|---|---|---|---|
30 | (I) | Mean width | 5.6043 | 5.5489 | 5.5052 | 5.4440 | 5.2401 |
Coverage rate | 0.955 | 0.953 | 0.953 | 0.942 | 0.954 | ||
(II) | Mean width | 3.3248 | 3.1778 | 3.0546 | 3.0291 | 2.9178 | |
Coverage rate | 0.961 | 0.950 | 0.957 | 0.947 | 0.958 | ||
40 | (I) | Mean width | 5.2826 | 5.1410 | 5.0569 | 4.9930 | 4.8931 |
Coverage rate | 0.944 | 0.950 | 0.943 | 0.959 | 0.949 | ||
(II) | Mean width | 2.8476 | 2.7187 | 2.6228 | 2.5556 | 2.5152 | |
Coverage rate | 0.951 | 0.940 | 0.957 | 0.958 | 0.951 | ||
50 | (I) | Mean width | 4.9759 | 4.8686 | 4.7284 | 4.6879 | 4.6513 |
Coverage rate | 0.938 | 0.959 | 0.968 | 0.966 | 0.950 | ||
(II) | Mean width | 2.5179 | 2.4105 | 2.3387 | 2.2844 | 2.2472 | |
Coverage rate | 0.948 | 0.943 | 0.951 | 0.952 | 0.960 | ||
80 | (I) | Mean width | 4.4567 | 4.3395 | 4.2683 | 4.1983 | 4.2200 |
Coverage rate | 0.954 | 0.950 | 0.952 | 0.949 | 0.941 | ||
(II) | Mean width | 1.9824 | 1.9010 | 1.8308 | 1.7857 | 1.7608 | |
Coverage rate | 0.938 | 0.952 | 0.956 | 0.949 | 0.961 | ||
100 | (I) | Mean width | 4.2955 | 4.1699 | 4.1204 | 4.0131 | 3.9981 |
Coverage rate | 0.952 | 0.959 | 0.953 | 0.945 | 0.957 | ||
(II) | Mean width | 1.7564 | 1.6938 | 1.6432 | 1.5951 | 1.5721 | |
Coverage rate | 0.957 | 0.939 | 0.951 | 0.931 | 0.950 |
Results of the methods for constructing joint confidence regions for (
Methods | |||||||
---|---|---|---|---|---|---|---|
30 | (I) | Mean area | 18.1447 | 24.1040 | 29.3229 | 37.4723 | 45.1162 |
Coverage rate | 0.943 | 0.953 | 0.948 | 0.949 | 0.942 | ||
(II) | Mean area | 7.2611 | 9.0473 | 10.4347 | 12.2616 | 14.0958 | |
Coverage rate | 0.940 | 0.951 | 0.957 | 0.954 | 0.949 | ||
40 | (I) | Mean area | 13.9298 | 17.2864 | 22.6337 | 28.3434 | 32.9806 |
Coverage rate | 0.950 | 0.953 | 0.945 | 0.938 | 0.956 | ||
(II) | Mean area | 5.2359 | 6.1751 | 7.3436 | 8.6958 | 9.7041 | |
Coverage rate | 0.952 | 0.942 | 0.944 | 0.946 | 0.948 | ||
50 | (I) | Mean area | 11.1586 | 14.1365 | 17.7005 | 21.1058 | 25.5788 |
Coverage rate | 0.951 | 0.954 | 0.937 | 0.951 | 0.948 | ||
(II) | Mean area | 4.0731 | 4.8594 | 5.6845 | 6.4921 | 7.3824 | |
Coverage rate | 0.955 | 0.953 | 0.942 | 0.953 | 0.949 | ||
80 | (I) | Mean area | 7.2142 | 9.5987 | 11.8881 | 13.8864 | 17.4234 |
Coverage rate | 0.946 | 0.944 | 0.942 | 0.943 | 0.935 | ||
(II) | Mean area | 4.0370 | 4.9886 | 6.1020 | 7.1601 | 8.2498 | |
Coverage rate | 0.941 | 0.951 | 0.938 | 0.940 | 0.936 | ||
100 | (I) | Mean area | 5.8819 | 7.7936 | 9.3763 | 11.3534 | 13.5202 |
Coverage rate | 0.954 | 0.949 | 0.951 | 0.950 | 0.950 | ||
(II) | Mean area | 1.8788 | 2.2596 | 2.6727 | 3.0193 | 3.3800 | |
Coverage rate | 0.950 | 0.952 | 0.950 | 0.942 | 0.953 |