the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
On computing the maximum likelihood estimates for the q-Pareto distribution and application to earthquakes
Fatah Benatia
Mohammed Ridha Kouider
We define a generalized exponential distribution (G-ED) that overlaps with a generalized Pareto distribution (GPD). Then, we introduce the q-Pareto distribution (q-PD) with two-parameter family distribution (strict positive shape and scale parameters) via transforming the G-ED. We demonstrate that the q-PD can be used to model the exceedances over a threshold, and we focus to estimate the q-PD parameters. Often, the estimation is taken the maximum likelihood estimation (MLE) because have a consistent estimator with an asymptotic normal distribution and is asymptotically effective in many cases. We present an algorithm to compute the MLE for q-PD parameters with confidence intervals for each estimator. Numerical examples are given to illustrate the results obtained. Efficient numerically methods are developed for the MLE of the q-PD parameters to maximize the log-likelihood of the q-PD.
- Article
(598 KB) - Full-text XML
- BibTeX
- EndNote
In probability theory and statistics, the exponential distribution family and the Pareto distribution family, each of them is a parametric set of probability distributions of a certain form, in terms of normal parameters, and to determine useful sample statistics. Hence, the exponential distribution is not the same as the class of families of exponential distributions, but rather it is one of the distributions of this family, which includes several distributions, including: normal, gamma, chi-squared, Poisson etc. Also, the Pareto distribution has many related distributions known as Pareto Type I, II, III, IV etc., and Pareto Type IV contains Pareto Type I–III as special cases. So, it can be said that we have two families of important distributions. Each of them has many applications in many fields. The cumulative distribution function (cdf) of the Pareto distribution parameters (Type I) is given by
It follows under differentiation that the probability density function (pdf) of a Pareto random variable with parameters b and t is:
with where denotes the upper endpoint of Gt,b and b is a positive parameter called the Pareto index or the shape parameter. Likewise, the cdf of the exponential distribution parameter is given by
It that the pdf of the exponential distribution random variable with parameter b>0 is:
There are distributions related to the Pareto distribution used to model the energy released by large earthquakes, such as: log-Pareto, Extended Slash Pareto, Tapered Pareto, Generalized Pareto Distribution (GPD), among others. There are some transformations that allow the Pareto distribution to be linked to other distributions like: the Burr distribution, the Power functions, the Chi-square distributions etc. Also, the Pareto distribution has many uses for modeling many types of heavy-tailed distribution. de la Barra and Vega-Jorquera (2021) proposed a new probability distribution related to the Pareto distribution, which is the q-Pareto distribution (q-PD) by transforming the q-exponential distribution. The q-PD is highly effective for modelling the magnitudes of larger, extreme earthquakes in global catalogues, where a small change in parameters results in exponential changes in seismic moments. Also, is used in insurance and actuarial statistics to analyse extreme events, such as calculating reinsurance premiums for catastrophic losses.
Notice that, Tsallis (1994) introduced the q-logarithmic function for x>0. He has proven that the logarithmic function can be generalized to a function of fractional power by
With q is a fixed real number. Among the properties of the q-logarithmic function which is defined in Eq. (3), we mention:
-
lnq(1)=0
-
-
The q-logarithmic function is a concave function.
-
expq(lnq(x))=x for all x>0 with expq is the inverse function of lnq which given as
and the basic properties of expq are expq(0)=1 and . Also, expq, called the q-exponential function is a convex function when q>0. Also, for b>0 and under we have that
where is the tail-exponential distribution random which is defined in Eq. (2). Then, for b>0 and we have if and if q>1. And we agree that expq(−bx) is the general exponential (G-exponential) function or the q-exponential function which given by
Since b>0 with and has the same properties as the function exp(−bx) such as continuity and derivation for x>0 and as . Through, the relation of the tail-exponential distribution which is defined in Eq. (2) and the q-exponential function in Eq. (5) we define the cdf of the q-exponential distribution (G-exponential distribution (G-ED)) which is presented in Eq. (2) if q≠1 as
Also, by deriving the cdf Hq,b, we can define the pdf in the form
where and b is a positive scale parameter for with if . And if q>1 where denote the upper endpoint of Hq,b.
In addition, we have Hq,b in Eq. (6) recover the exponential distribution in Eq. (2) as q→∞ that's why we note that the G-ED in Eq. (6) is a generalization of the exponential distribution in Eq. (2). We point out that, there are those who presented a generalization of the exponential distribution that differs from what we saw in this work. For an instant, you can see the article presented by Gupta and Kundu (2007). The q-exponential function arises as a distribution that maximizing the Tsallis entropy under constraints, acting as a non-standard “exponential” for complex systems. Previous studies extensively explore q-exponential and Tsallis entropy distributions which is generalizes Boltzmann-Gibbs entropy as powerful tools for complex systems, moving beyond standard Boltzmann-Gibbs stats, finding applications in many fields such as: physics (particle/nuclear, geomagnetic, super-statistics), the finance (risk modeling), seismology (earthquake patterns), and information theory. This reveals latent power-law behaviors and self-organization, and providing unified frameworks for non-equilibrium phenomena through their q-parameter, which generalizes standard exponential functions.
We consider be a sequence of iid rv's from the G-ED which is given in Eq. (6) (Note, ) and consider the random variable (rv) X as
And we simply can know the explicit expression to distribute if rv X by
So, we present the approach of the cdf of the q-PD by
which in differentiation yields,
with b>0 and if and if q>1. Therefore then X ∼ q-PD where X=teY with X>t. Then, the G-ED and q-PD are related by an exponential expression. And, the q-PD in Eq. (9) and the G-ED in Eq. (6) are related by for x>t.
Recall de la Barra and Vega-Jorquera (2021) studied the q-PD and defined it by taking the sample to be a sequence of iid rv's following the cdf of the q-exponential distribution which has the df given in the following formula.
where is the shape parameter and b>0 is the scale parameter. And the pdf of the q-exponential distribution is
with and where expq(−bx) is the G-exponential function given in Eq. (5). For ; with and if for denote the upper endpoint of Fq,b. Although we can find a relationship between the G-ED which is presented in Eq. (6) and the q-exponential distribution given in Eq. (11) as follows:
where and β>0 for and b>0.
Fitting GED to the general Pareto distribution (GPD)
Moreover, considering the G-ED which is given in Eq. (6) and if we take with and with b>0. We find that the cdf Hq,b overlaps with the GPD parameters which his df define as
with being the shape parameter and σ>0 the scale parameter. For q=1 we get γ=0 and . Then the GPD's can be rewritten in terms of the G-exponential function which is presented in Eq. (5) as.
with and for q>0 and b>0. The interesting point is that GPD is used to model heavy-tailed distributions and has applications in many fields including: network traffic, hydrology, climatology, geophysics, materials science, etc. We note convergence in distribution. These uses of GPD are related to the peak-over-threshold (POT) method, and the underlying rationale is, of course, the fact that Balkema and de Haan (1974) and Pickands (1975) assert for to be a sequence of independent and identically distributed (iid) random variables (rv's) from some unknown df F and if F satisfies the following condition:
as n→∞ for x>0 with the sequences of constants An>0 , Bn>0 and for and the df ϕ(x) is continuous. Then, there exists a normalizing function σ(t)>0 such that for all x>0,
with γ∈ℝ and denote the upper endpoint of F and Ft be the conditional df of X−t which is given as
with X>t and for t<τF and x>0. Then under Eq. (14) it is well known Ft that up to scale and location transformations as the GPD which given in Eq. (12), .
Theorem 1. Let be positive iid rv's with unknown common df F and denote the order statistics correspondence. If the condition (14) is met then the tail joint df of for X−t with X>t be the G-ED which is given in Eq. (6).
Proof of Theorem 1. For q>0 and b>0, if we take
Replace them in the GPD which defined in Eq. (12). Then, we find the limit in Eq. (14) becomes
with and b>0 where Hq,b is the G-ED which is presented in Eq. (6). End of proof.
Consequently, the limit (17) means that the df of excesses over a threshold Ft follows approximately a G-ED for large values of the threshold t>0 ().
There are many works that address the estimation of GPD parameters using a numerical algorithm based on the MLE method. Under Theorem 1 the G-ED is widely used in statistics to model extreme values and exceedances over a threshold. In this article, we will focus on the methodology employed by Kouider (2019b), and Kouider and Benatia (2023), and Kouider et al. (2023a, b) for estimating GPD parameters via the MLE. In order to propose a robust numerical algorithm for estimating the parameters of the q-PD.
Recall that in this paper we consider the estimation (q,b) based on the MLE method using a numerical method in the form of an algorithm, which we will present in this section. To specify it, let be iid random variables with the common df F which is the cdf q-PD given in Eq. (9). Then for q>0 and b>0 with t>0 the likelihood function can be written as
with for Xi>t and . By accumulating the logarithm of Eq. (18),
with q>0 and b>0. For q≠1 we take if and if q>1. Hence, for q<0 there is no MLE exists because is perfectly positive, and this is consistent with the definition of the q-PD which is presented in Eq. (9). Based on the regularity conditions related to using the MLE method for estimating the GPD parameters defined in Eq. (12), which have been addressed in numerous previous works. Therefore, with the relationship (16) we deduce that the regularity conditions for the MLE of the q-PD are only fully satisfied when the shape parameter q>0, ensuring consistency and asymptotic normality. For q<0, the density becomes unbounded, and the range of data depends on unknown parameters, causing standard regularity conditions (The standard Cramer regularity conditions) to fail.
In addition, under Eq. (19) for q=1 the resulting likelihood equation should be as
Then, the estimator of is b given as
with , if q→1 or if q→0 thus done that
Hence, we find if it's equivalent that thus and with q=0 we get for . Then, letting the associated order statistic, we have . Since if q>1 and for we found . Therefore, we find where and for .
Thus, for q→1 or q→0 we get . Consequently, we can take this following result:
with tCi=Xi for Xi>t we get,
Therefore, with is defined in Eq. (24). And for we take where is defined in Eq. (21). Despite all this, under the limit (25) we can set,
with tCi=Xi and in Eq. (24). Then is given by the local maximum if and is given by the boundary maximum if where M is given in Eq. (25). Although to obtain a finite maximum of the log-likelihood of the q-PD (Eq. 19), the constraint q>0 must be imposed. Therefore, the calculation of is optimal in space:
The likelihood equations from Eq. (19) with q≠1 are then given in terms of the partial derivatives
The resulting likelihood equations are as follows.
which for q>0 can be simplified Eq. (28) to
Obviously with q=1 the tow equations are given . Return to case q≠1, put where and b>0 then the system equations (29) becomes:
where then with θq≠0. Therefore, we go to present a numerical solution to find a solution of these equations which maximizes the approximation likelihood.
First, we have
It is usually more convenient to use nonlinear optimization algorithms, such as the modified bisection algorithm (MBA) for multi-roots, which is proposed by Kouider (2019a) to search for a root of function defined in the interval . The MBA for multi-roots is far more efficient and faster than the combined Bisection method and Newton's method. Moreover, the derivative of the function is not calculated at the reference point, which is not always easy. And it does not depend on the initial solution a crucial factor for Newton's method. In fact, some initial solutions may lead to deviations from Newton's method.
Symbolizes the estimator of the scale parameter θq which is cheeked by determining the roots of ψ(θq). Such as, θq∈B where with for . Hence, for applied the MBA for multi-roots we go to search a close interval for the scale parameter. Next, we have the following theorem. It is done a simple technique for applied MBA for multi-roots to fit for search the root of ψ(θq) which is defined on Eq. (30).
Theorem 2. Let defines function ψ(θq) on Eq. (30). Then,
-
-
ψ(θq)<0 for all
where and for the associated order statistic and the threshold t>0.
Proof of Theorem 2. Results (1) and (2) are simple. In the proof of result (3), we represent the function (30) as
Follows Jensen's inequality we get
and since and with θq<0. Therefore, we find
with θq∈B and since, for all then
For ψ(θq)<0 with θq<0 and using Eqs. (34) and (35), the function (33) follows the following.
Then, for θq<0 we find that Eq. (36) is implied.
while . Hence and suppose that . Then we get
where and . End of proof.
Hence, by the intermediate value theorem a MBA for multi-roots is not work in because the upper bound . Then, to make the MBA for multi-roots works and rely on the results of Theorem 2 we will take and for ϵ>0 (Around the zero) as the upper bound and the lower bound respectively where is given in Eq. (32). We pose with and n∈ℕ. Next, for θq≠0 the B will be defined by . Then, for all bounds are known, the MBA for multi-roots can be made that limit step size so that iterative solutions remain within the known boundaries.
Algorithm for MLE of the q-PD parameters
Maximum likelihood estimators have a consistent estimator of the variance and used it to replace the asymptotic variance of the unknown parameters. The Fisher information matrix gives the asymptotic variance-covariance of the maximum likelihood estimator, which can be calculated by
So, for n>30 we conclude 100(1−κ)% confidence intervals construction using: and .
Then, we preferred an algorithm for estimating the parameters of the q-PD which is defined in Eq. (9) by the MLE method for q≠1 which calculates as the following steps:
-
Let's choose a ϵ>0 for example where . with for
-
Calculate the lower bound using (resp. the upper bound) by and for the associated order statistic with and .
-
To find the root of ψ which is defined in Eq. (30) on both intervals and used MBA for multi-roots with each intervals. Let us note where s the number of roots.
-
For each value of obtained from the previous step, calculate qs which given as for t>0 And calculate the value of
-
Let qs and bs denote the results of the previous step that belongs to the space A and if a local maximum exists, then the maximum likelihood estimator of the parameters of the q-PD is who have a maximum which is defined in Eq. (19).
-
For calculate all estimators of second-order partial derivatives: and ; and the Jacobian determinant of second order derivatives:
-
Calculate 100(1−κ)% confidence intervals of according the following cases:
Case 1. If the length of the sample is n>30 we take and respectively where denotes the quantile of the standard normal distribution is symmetric with respect to 0.
Case 2. If the length of the sample is n≤30 we take and respectively with is the Student's t-distribution quantile by n−1 degrees of freedom
- 8.
The algorithm is finished.
Depending on the algorithm presented in Sect. 2.1 to estimate the q-PD parameters. We have now been able to develop a mechanism to estimate q-PD parameters using MLE method, which we explain in the following steps
-
Find the root of ψ(θq)=0 with for where:
-
Compute by
-
Compute by
The G-ED which is presented in Eq. (6) was shown by Theorem 1 to be a stable distribution for excesses over thresholds. Since the q-PD and the G-ED which are defined in Eqs. (9) and (6) respectively are related by for x>t. Then, using those values that exceed a high threshold in the annual earthquake record, the q-PD can be used to estimate severe earthquakes. Secondly, measuring earthquake intensity is time-consuming because earthquakes are infrequent, requiring extensive data collection. It is included with short samples, but data can be collected on less intense earthquakes such as those caused by unnatural factors. In addition an earthquake intensity scale measures the actual shaking and damage that occurs at a specific location, not the energy emitted from the source. While it is officially assessed on the 12-level Modified Mercalli Inventory (MMI), some older historical or regional frameworks (such as the 10-point Rossi-Forel scale) measure it on a scale of 1 to 10. The intensity 1 is imperceptible. It is felt only by a very small number of people under particularly favorable conditions. Therefore in this study we will take it as optional with for where n represent the length of the sample. This may pave the way for future work on this subject.
3.1 Simulation
In this part, we will perform a simulation of the distribution that we presented earlier, which is the q-Pareto distribution where the related df is shown in the formula (9). In this example, we will generate a sample with a length of 15 that follows the q-Pareto distribution given in Eq. (9). We will also estimate the parameters associated with the df based on the MLE method. Then, to generate a sample that follows the cdf of the q-PD given in Eq. (9) via the R software, we took the following two steps:
-
Generate pi follow the uniform distribution by pi=runif(n) where n=15
-
Generating the quantiles Xi for through inversion the df (9) as
-
Verify that all Xi for belong to the range A which is shown in Eq. (26)
Subsequently, the 15 value that follows the cdf given in Eq. (9) with parameter b=1 and q=0.5 with t=1 are listed in increasing order in the Table 1.
Table 1The 15 Data generated which follows the q-PD for q=0.5 and b=1 with t=1.
Source: Laboratory of Applied Mathematics, Mohamed Khider University, Biskra, Algeria.
First, we note that Ci=Xi with t=1 for and we get the range for q=0.5 with b=1. And from the Table 1 we find and this shows that for all sample values Xi in the Table 1 are belong to the set A.
Next, compute the bounds given by and with for search the roots of ψ(θq)=0 which is given in Eq. (30) via the MBA for multi-roots on the intervals and . Then we find tow zero's or . Next, Using formulas (33), (34) and (19), (25) to determine the values for each value which are , and , M respectively. The following Table 2 shows these results.
Table 2An account the values corresponding to each value of .
Source: Laboratory of Higher School of Social Security, Mohamed saleh Mentouri, Ben Aknoûn, Algiers, Algeria.
Obviously, from Table 2 that for every we find that and are the local maximum log-likelihood of the q-PD on A with . Wherever, the boundary maximum with or and is given as for in Eq. (25). And referring to the table we will find that maximum is with and . Then the q-PD maximum likelihood estimates for the data given in Table 1 are and . It is clear that is very close to the values that we proposed to conduct the simulation. Then, their corresponding 95 % confidence intervals are and .
3.2 Application
Earthquake magnitude scales measure the total energy released from the earthquake's epicenter. These scales use a logarithmic scale, where each incremental increase represents an exponential jump in both amplitude and energy. The Richter scale, developed in 1935, is an older scale that measures the maximum amplitude of seismic waves on a seismograph. This scale is accurate for small to moderate local earthquakes but becomes less accurate for large earthquakes. However, because magnitude scales are logarithmic, the energy jump between increments is enormous. With each incremental increase, the amplitude of the vibration increases approximately 10-fold, and the actual energy released increases approximately 32-fold.
Carefully, this represents a list that contains information about the tectonic earthquake activity (magnitudes) in and around the British Isles in the last 60 d from 22 March to 20 May 2024. We find that the 38 value (C1, C2, …, C38) of the exceedance of the threshold (The known value of the earthquake intensity threshold is not mentioned for reasons related to intellectual property rights) in the tectonic earthquake activity is shown in the following Table 3.
Table 3Earthquakes occurred around the British Isles from 22 March to 20 May 2024.
Note: The data are from the following link https://earthquakes.bgs.ac.uk/earthquakes/recent_uk_events.html (last access: May 2024).
We know that the earthquake activity data are always positive values and that they follow a q-PD parameter (9). We take the value 38 in the Table 3 as , therefore, we agree that the threshold for because the data are absolutely positive values. After applying the algorithm (Sect. 2.1) to the sample in the Table 3 we find that the q-PD maximum likelihood estimates are and with corresponding 95 % confidence intervals are and .
In this work, we focus on estimating the parameters of q-PD (Eq. 9) by presenting an algorithm (Sect. 2.1) based on the MLE method and we have obtained results that we will mention. In addition, we give a new formulation of the distribution of the G-ED which is given in Eq. (6). Since we linked the GPD parameters (Eq. 12) and the G-ED (Eq. 6) using the relationship (16), we managed to approximate the distribution function of exceedances over a threshold that is given in Eq. (15) to the G-ED under the Theorem 1. In addition, we can estimate the index of the extreme value by estimating the shape parameter of the G-ED with the MLE method using the relation (16). Therefore, we find that this work will provide a foundation for other work related to the results we achieved in this article.
The second-order derivatives of the log-likelihood of the q-PD which defined in Eq. (19) are calculating by
where and with for Xi>t and t>0.
The research data and materials associated with this article are available in the references.
F. Benatia conceived of the idea presented in conceptualization, methodology, and investigation. Writing-review, editing, and calculus were done by M. R. Kouider and F. Benatia edited the second section with its practical aspect. M. R. Kouider wrote edited the second part of the third section. M. R. Kouider, reviewed, and edited the Proof the theorems and the appendix parts part. All authors have read and agreed to the published version of the manuscript.
The contact author has declared that neither of the authors has any competing interests.
Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. The authors bear the ultimate responsibility for providing appropriate place names. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher.
This article is part of the special issue “Artificial intelligence and machine learning in climate and weather science research”. It is not associated with a conference.
We thank the reviewers for their careful reading and valuable comments which have improved the results and the presentation of the paper.
This research work is supported by the Applied Mathematics Laboratory, University of Mohamed Khider, Biskra, Alger and Laboratory of Higher School of Social Security, Mohamed saleh Mentouri, Ben Aknoûn, Algiers, Algeria.
This paper was edited by Mark Risser and reviewed by Nesrine Idiou and three anonymous referees.
Balkema, A. A. and De Haan, L.: Residual life time at great age, Ann. Probab., 2, 792–804, 1974.
de la Barra, E. and Vega-Jorquera, P.: On q-pareto distribution: some properties and application to earthquakes, Eur. Phys. J. B, 94, 32, https://doi.org/10.1140/epjb/s10051-021-00045-7, 2021.
Kouider, M. R.: On Maximum Likelihood Estimates for the Shape Parameter of the Generalized Pareto Distribution, Science Journal of Applied Mathematics and Statistics, 7, 89–94, 2019a.
Kouider, M. R.: Modified Bisection Algorithm for Multiple Roots of Nonlinear Equation With the R Software, SSRN Electronic Journal, https://doi.org/10.2139/ssrn.3451155, 2019b.
Kouider, M. R. and Benatia, F.: Modified bisection algorithm in estimating the extreme value index, International Conference of Young Mathematicians – The Institute of Mathematics of the National Academy of Sciences of Ukraine, https://www.imath.kiev.ua/~young/youngconf2023/Abstracts_2023/PS/Kouider_Benatia.pdf (last access: 10 June 2023), 2023.
Kouider, M. R., Idiou, N., and Benatia, F.: Modified Bisection Algorithm in Estimating the Extreme Value Index under Random Censoring, TWMS J. App. and Eng. Math., 13, 1408–1422, 2023a.
Kouider, M. R., Idiou, N., and Benatia, F.: Adaptive estimators of the general Pareto distribution parameters under random censoring and application, Journal of Science and Arts, 23, 395–412, 2023b.
Pickands III, J.: Statistical inference using extreme order statistics, Ann. Stat., 3, 119–131, 1975.
Gupta, R. D. and Kundu, D.: Generalized exponential distribution: Existing results and some recent developments, J. Stat. Plan. Infer., 137, 3537–3547, 2007.
Tsallis, C.: What are the numbers that experiments provide?, Quím. Nova, 17, 468–471, 1994.
- Abstract
- Introduction
- The MLE for the q-PD
- Illustrative example and application
- Conclusions
- Appendix A: The second-order derivatives of the log-likelihood for the q-PD
- Data availability
- Author contributions
- Competing interests
- Disclaimer
- Special issue statement
- Acknowledgements
- Financial support
- Review statement
- References
- Abstract
- Introduction
- The MLE for the q-PD
- Illustrative example and application
- Conclusions
- Appendix A: The second-order derivatives of the log-likelihood for the q-PD
- Data availability
- Author contributions
- Competing interests
- Disclaimer
- Special issue statement
- Acknowledgements
- Financial support
- Review statement
- References