RISK ASSESSMENT IN TENDERS: Correct balance between cost and risk

INDUSTRY OUTLOOK: PRICE AND COSTS TRENDS

Since 2011, copper price has shown a downward trend that has alerted the main producers around the world. In the period between 2011 and 2015, the price showed a 43% reduction, going from 4.15 US$/lb to 2.72 US$/lb (real terms, base year 2016). This tendency has continued during this year with an observed drop of 20%, when comparing the average price of the first trimester of 2016 (2.11 US$/lb) with the average price of the same period in the previous year. At the same time, expectations for copper price in the future are not so encouraging. Researches done by COCHILCO forecast an average copper price close to 2.15 US$/lb for the year 2016, and 2.20 US$/lb for the next year.

Recent declines in copper price are attributable mainly to a slowdown in the growth of the main copper consumer’s economies, being the Chinese economy one of them (consuming 50% of world copper production). The latter has shown a clear deceleration, directly affecting the demanded volumes of copper. On the other hand, an increase in production has been observed, driven mostly by the entrance of huge projects in Peru, worsening the situation.

One of the major problems associated to the observed drops in price during the last period, comes – paradoxically – from the long period of high prices that preceded it, because by betting on higher production, and therefore taking full advantage of the high-price part of the cycle, production costs were neglected. Copper price increases were accompanied by sharp increases in C1 costs, as exemplified by the changes in the Chilean industry cash cost which went from 0.51 US$/lb in 2005 to 1.63 US$/lb in 2014 according to COCHILCO. Somehow, the long period of prosperity experienced by copper mining companies led to an organizational culture of high expenses and low productivity, which was compounded by rises in basic input costs.

To address the current scenario, mining companies have had to make their best efforts to reduce costs and thus keep operating. Some of the main actions that have been observed are related to decreases in OPEX, replanning, changes in production capacities and investments revaluations. As for the OPEX, the most popular actions observed are related to simplifying the administrative structure, along with staff reductions, plans to optimize maintenance of crushing and grinding lines, and the renegotiation of contracts. In replanning, they have raised the cut-off grade, lowered the stripping ratio, and discarded marginal areas (all with the idea of improving cash flow in the short term). In terms of capacity, it has been both increased and decreased, along with optimizations in the comminution line. Finally, regarding investments, projects have been slowed (or even halted), exploration expenditures have been closed, and just investments on sustaining CAPEX have been kept.

All these measures have started to yield results. During the past year, the average industry cash cost has begun to decline. However, there are still operations that are producing with costs above the current and projected prices, or in an extreme situation, where margins are at risk. That is why it is necessary to find new ways for cost reduction and optimization of available resources, such as finding the right bidder in a tender.

Captura de pantalla 2016-07-10 a la(s) 17.57.34

TENDERS EVALUATION

Nowadays, there are many mining companies that are developing new projects, expansions or renegotiating contracts. Nevertheless, only a few of them conduct deep studies in these areas, incorporating different types of assessments and approaches to help the decision making process when it comes to selecting the best bidder. That is why a correct evaluation of tenders must incorporate  traditional evaluations (technical and economic) and also strategic and risk evaluations, in order to be more efficient and sustainable in the use of resources and lower the risk of the project.

RISK ANALYSIS IN TENDERS

METHODOLOGY

As it was mentioned earlier, there are different methodologies to evaluate tenders. Among them, the risk evaluation developed by GEM is capable of differentiating itself from others because of its capacity to incorporate uncertainty when evaluating the real convenience of one offer over the rest. Two fundamental characteristics are considered of high value when doing a risk evaluation of tenders: the robustness of the proposals and the flexibility that companies have to react to risks.Captura de pantalla 2016-07-10 a la(s) 17.57.44

The robustness concept is related to the determination of whether the planned deadlines and costs of each tender can be affected by the materialization of technical and economic uncertainties. When comparing offerors, their robustness relates to whether the most convenient contract (in terms of costs, deadlines and technical characteristics) is still the best when taking into account the materialization of relevant risks. It is important to note that robustness of each offeror can be measured in regard to a referent (i.e., estimates done by the company that is tendering the construction work), or in regard to its own planning.

On the other hand, flexibility seeks to measure each offeror’s capability to react when the main uncertainties are materialized. Flexibility is mainly related to the management capability that companies have when the scheduled plan shows delays or failures in meeting deadlines, which in turn, goes hand in hand with the ability the companies have to access extra resources to offset delays or other imbalance in the plan. This way, flexibility can measure how offerors will be able to implement management actions that lower the effects of uncertainties materializing.

The risk evaluation methodology has three steps, all of which are described below.

1. Uncertainty Identification Captura de pantalla 2016-07-10 a la(s) 17.57.57

It consists on the identification of those uncertainties that could be relevant for the decision-making process. In practice, there are multiple sources of uncertainty, so the study of them should be limited to only those with the greatest impact. The main uncertainties considered in tender evaluations can be divided in two groups: technical and economical.

Some of the relevant technical uncertainties are those linked to the project productivities. In the case of underground mining, it is important to consider the uncertainty of air availability (ventilation), which is conditioned to the development of the ventilation tunnels that allow progress on several fronts. In the same way, critical equipment availability may be a relevant uncertainty if their maintenance and usage times are not properly controlled. Finally, the ramp-up has shown to be a relevant source of uncertainty. The vast majority of the works considers a ramp-up period where the project’s development rate is variable, mainly because it takes some time to reach max productivity or capacity. For this very reason, this stage may be longer than expected, or even present delays in its starting date.

Regarding economic uncertainties, only those that have a high impact on a project’s costs should be considered. Some of the most common economic uncertainties are: the consumer price index (CPI), the remuneration index (RI), the observed dollar (DO) and the value of critical inputs. These economic uncertainties are generally part of the polynomial adjustment of the costs defined by each contractor and presented within the tender process.

In addition, there are probably many other uncertainties that affect the development of a tendered work, depending on the features of each project. However, the ones mentioned above are the most common for mining projects.

Captura de pantalla 2016-07-10 a la(s) 17.58.062. Quantification of Uncertainties 

It allows for the inclusion of variability in the analysis. An uncertainty becomes a risk when it is quantifiable, thus becoming possible to measure its impact. The process of quantifying uncertainties generally requires, in addition to data search and the use of statistical tools, an expert component as well as the vision of the key participants in the tender.

There are three ways to quantify uncertainties: objectively, subjectively and mixed (objectively and subjectively). The objective quantification involves the use of historical data to measure the variability of the relevant uncertainties identified. Thus, it is considered that the past is a good estimate of the future. Such quantification can be performed through probability distributions or stochastic processes. Subjective quantification is used mainly in two scenarios: when historical data available for the variable to study does not represent its future behavior, or when there is no historical data of the variable. In these cases, expert judgment is used to estimate probability distributions or stochastic processes. The mixed quantification is a combination of objective and subjective probabilities. This type of quantification is used mainly when the historical data available partially represent the future behavior of the variable that is going to be studied.

3. Risks Evaluation 

At this stage, the impact of the quantified risks on a variable of interest for the client company (typically deadlines and total cost) is assessed. This is done through the development of a model, which then is simulated through Monte Carlo simulations. The model must contain and link the most important uncertainties (which are called independent variables) to the variables to be studied (or dependent variables). Regarding the simulation, it allows for the generation of a series of statistics that measure the robustness and flexibility of each offeror.

For example, the value at risk or VaR is the most commonly used risk indicator in this methodology. In this context, it is defined as the difference between the expected value of the cost, deadline, or some other relevant variable (which should also be defined as a compromise), and an α percentile (or insured value α) considering a confidence level (1-α). Typically the value used for α is 5%.Captura de pantalla 2016-07-10 a la(s) 17.58.27

The VaR allows the client company to understand the magnitude of the potential loss of value that each contractor could cause (this indicator is shown in FIGURE 1).

For example, offers of two companies may have the same expected value of project completion date, but have very different reactions to risk (i.e., a different VaR).

In FIGURE 2, this concept is exemCaptura de pantalla 2016-07-10 a la(s) 17.58.33plified by showing the distribution of the project’s execution time for three companies and how they can be compared to theoretical expected value of the deadline and their VaR. Curve 1 and 2 show that even though they have the same expected deadline, the VaR can be very different, where the curve with the lower VaR represents a more robust scenario. The expected deadline and VaR for different distributions may also be compared to identify which company has a better relationship between deadline and project risk.

In addition to evaluating different risk indicators, it is also possible to perform a sensitivity analysis of the risks in order to further assess its effect. One way to do this is through the tornado chart, explained in the next section.

APPLIED CASE STUDY

In order to show the effects that risk assessment may have in decision-making in tenders, an applied case study was conducted. The characteristics of the proposal of each of the tender participants were established so that both were competitive and met the technical and economic conditions to carry out the tendered project, and thus giving realistic results.

PROJECT DEFINITION

A company tendered a project that is characterized by the execution of 125,000 advance units (au) within 27 months. The project includes two stages, Milestone 1 and Milestone 2. For technical specifications, it is required that at least 80% of Milestone 1 must be executed to start the Milestone 2 (allowing parallel progress from this point). The technical characteristics of the works restrict the maximum monthly development to 8,500 au. The latter is mainly related to technical restrictions that prevent progress over certain limit (e.g., accesses in open pit mines or ventilation availability in underground operations).

Regarding the penalty system, the client company states that a delay in the execution of the 80% of Milestone 1, respect to the contractor’s plan, triggers a compensation that depends on the monthly general expenses of the contractor and the amount of backlog. Along with this, the project status is evaluated semiannually, generating penalties if there are delays in the original plan. These penalties are also proportional to the accumulated delay at the evaluation date.

According to the client company plan, it would take nine months to run 80% of Milestone 1 (corresponding to 32,000 au), 11 to complete the Milestone 1 (40,000 au), and 27 months to complete the entire project (125,000 au). All this with a total cost of 203 million dollars (MUS $), which comprises 30% by fixed costs, and the remaining by variable costs. The fixed cost (or overhead) is prorated for the months of activity (i.e., MUS$ 2.25/month). The variable cost estimated by the client company is 1,136 US$/au.

TENDER PARTICIPANTS

TABLE 1 shows the client company’s estimates regarding deadlines and costs, in addition to the amounts proposed by bidders A and B.

Captura de pantalla 2016-07-10 a la(s) 17.58.40

From the table above it can be drawn that Company B’s proposal is slightly better because it meets the deadlines required by the client company (both 80% of Milestone 1, as well as the entire project) and the costs are below the ones estimated. In FIGURE 3 (below), each company’s proposed production profile is shown, as well as the estimated cost for each. Along with the profile of each company, the reference profile (i.e., the one of the client company) is shown. The latter will be used to compare both companies, not only in terms of their performance with regard to their original plans, but also in terms of their performance with regard to the reference plan.

Captura de pantalla 2016-07-10 a la(s) 17.58.47

In the case of technical risks, and for the purposes of this applied case study, three productivity-related risks were taken into account: productivity of each work crew (measured in effective hours per work crew), the number of work crews (measured in work crews per turn), and the effective progress rate (measured in advancement units per effective hour). These three variables, multiplied by the deterministic value of the number of shifts per month (90), define the effective progress of each month. Within the technical risks, the possibility that the works may not start on time was considered and therefore a risk of delays in ramp-up was established, where a probability of occurrence and a probability distribution for delay extension in months were considered. Regarding to the technical risk profile of each company, the profile of Company A is less risky than Company B’s, indicating that although Company A requires a longer time for project completion with slightly higher cost, its lower risk may result in a higher probability of meeting its plan in comparison to Company B.

Regarding the economic risks, changes in the exchange rate of Chilean pesos per dollar and CPI (consumer price index) were considered. Economic risks will affect companies depending on how their cost polynomial is established. IPC weights 55% of Company A’s variable cost polynomial, while it only represents 35% of Company B’s polynomial (the remaining percentage ponders the exchange rate). The relevance of this is that, as changes in economic risks are the same for both companies, the only difference in the effect they have on costs is given by the weight that each company assigns to each economic variables, as well as payments realization dates.

TABLE 2 summarizes the monthly quantifications of each risk, showing the distribution used in each case as well as the main parameters of each distribution. It is important to note that quantifications of technical risks are made based on the planned value, (i.e., if in an iteration of the simulation the risk associated to the number of work crews was 1, then that month the materialized risk would be equivalent to the plan, while a value of 0.9 means that the number of work crews for that particular month would be 90% compared to the plan).

Captura de pantalla 2016-07-10 a la(s) 17.58.55

Moreover, although both risk profiles have a negative bias, they also consider values greater than one, which will eventually allow them to catch up with the plan.

STUDY SCENARIOS

The risk evaluation was conducted considering two scenarios. The first, called recovery scenario, is the one in which contractors do not have the ability to manage extra resources in response to delays. In this scenario, contractors must recover – hence its name – the accumulated delay at the end of the planned period, with a productivity equal to their average productivity of the last three months.

In the second scenario, contractors can take management actions to catch up with the accumulated delays during the execution of the project by managing extra resources, and therefore is called management scenario. In this case, the minimum cumulative delay that triggers the management of extra capacity is 3,000 au. Once this happens, the contractor makes a request by the amount delayed up to date, which becomes effective three months later. However, if in three months after the request, the contractor is wholly or partially updated with the delay, then the extra capacity would help to advance production.

Since in both scenarios, the one with recovery as well as the one with management, contractors require additional effort than planned to meet all the advance units stipulated in the tender, the costs of these productions are higher. In the recovery scenario, contractors A and B have an increase in variable cost per advance units recovered of 5% and 10%, respectively. On the management scenario, these numbers go up to 10% and 20%, respectively.

Finally, note that when evaluating the results, both a comparison of the proposals with themselves (the original plan versus the plan at risk) and a comparison with the values of reference (what the client company estimates should be the deadline and cost) are made.   

RESULTS

Once the model that links the technical and economic risks with the deadline and cost has been developed, using the above configurations, a Monte Carlo simulation with 10,000 iterations was performed. Through this simulation, it was possible to find the expected values, the 5th and 95th percentiles of the time that companies would take to implement the project and the cost considering the penalties generated during the project. Furthermore, it was possible to evaluate the development plan of each contractor in the recovery scenario (without management) and management scenario. First, the variability of the deadline of each company was evaluated. FIGURE 4 shows the probability distribution of the deadline of Company A for each scenario.

Captura de pantalla 2016-07-10 a la(s) 17.59.08

In the illustration above it can be seen that, in both cases, the expected value is above the committed value of 26 months (i.e., the odds of compliance are low in both cases: 2.4% with recovery and 6.1% with management). However, when comparing these deadlines with the value of 27 months established by the client company, the chances of compliance notoriously grow to 13% in the recovery scenario and 56% in the management scenario. Regarding the deadlines for the worst possible scenarios, it can be said that the work will take 31 months at the most to be completed in the recovery scenario, and 29 months in the management scenario. Overall, the ability of Company A to manage resources does not generate significant benefit regarding its commitment (results with and without management are similar), but when comparing it to the client company reference, the ability to manage becomes more important.

As in the previous case, FIGURE 5 shows the results regarding the deadline for Company B.

Captura de pantalla 2016-07-10 a la(s) 17.59.17

Here, the expected values for deadlines in both scenarios are higher than the commitment, with virtually no chance of meeting the plan (0% in the case with recovery and 0.3% in the case with management). Nonetheless, when comparing these values to the deadlines stablished by the client company, there is a high probability of meeting it in the management scenario (99.3% probability). Therefore, the possibility of managing resources for Company B has a significant impact, allowing it to go from an expected value of 39 to 26 months. Along with this, the expected value for the deadline in the case with management for Company B is the only one who manages to meet the deadline of 27 months proposed by the client company.

It is important to mention that the reason why the expected deadline of Company B with management is lower than the one of Company A is because Company B’s plan considers a greater margin between its planned deadline (23 months) and the deadline requested by the client company (27 months). Thus, although Company B tends to lag further behind, because of their higher risk profile, this is offset by the ability to manage (identical to Company A’s) and the highest margin mentioned above.

Having analyzed the deadlines of the companies in each scenario, variations in materialized costs were evaluated in relation to the ones planned by each company and the ones estimated by the client company. It is important to note that the costs assessed correspond to the real cost of doing the project for each company (i.e., the cost at risk plus the triggered penalties).

In FIGURE 6, the costs distribution of Company A for the recovery and the management scenarios are shown, as well as a comparison of the values regarding the planned cost and the cost of reference proposed by the client company.

Captura de pantalla 2016-07-10 a la(s) 17.59.23

There is no big difference between the observed cost for the recovery scenario and the management one (in both cases there is a low probability to meet the planned cost and the cost stablished by the client company). The cost at risk, which corresponds to the difference between the reliable cost and committed cost (MUS$ 201), is equal to 9% and 6% of the latter for the recovery and management scenarios respectively. These variations are mainly attributable to penalties that are paid as results of delays, since, as noted in the analysis of deadlines, the likelihood of accomplishing them is low, and therefore the probability of incurring in penalty fees is high.

In FIGURE 7, cost distributions associated with Company B’s scenarios (with recovery and with management), along with their statistics, are displayed.

Captura de pantalla 2016-07-10 a la(s) 17.59.32

Here, even if the differences in the expected costs with respect to the planned ones are higher than for Company A, these are still not relevant. In the case of the value at risk, values are around 4% and 3% of the committed costs, for cases with recovery and management respectively.

Although observed differences between expected costs in the case with recovery and with management are not relevant, it is worth noting that, although the variable cost of each managed unit is higher than the variable cost of recovered advance units, the scenarios with management achieve lower total costs. This is attributable to two reasons. First, the ability to manage the delays (advance units do not accumulate) translates into a lower probability of paying semi-annual penalties. In the case without management, delays are accumulated until the end of the work, and only then the total accumulated delay can be recovered. Therefore, the semi-annual penalties increase and so does the total cost. On the other hand, the costs associated with managed advance units are sticking as they are requested, and therefore the polynomial cost fits the value of economic variables in these periods. In the case of recovered advance units, they are paid at the end of the scheduled time, and therefore they are subject to higher values of economic variables (taking into account that the CPI is a variable that tends to rise).

In FIGURE 8, the expected development profiles of both companies in both scenarios are analyzed. In Company A, there is not a big difference between scenarios, while in Company B, the ability to manage resources becomes critical to get closer to the deadlines proposed by the client company.

Captura de pantalla 2016-07-10 a la(s) 17.59.59

A sensitivity analysis for the technical and economic risks’ impact in the most important performance variables was done. To perform this analysis tornado charts were used, where the idea was to evaluate the sensitivity of deadlines and costs to the assessed risks. For this, the values of each risk were fixed one by one at their extreme values (P5% and P95%), while other risks remained active. Then, the model was simulated (these simulations were performed with 1,000 iterations). Thus, through tornado charts it is possible to see the impact of each risk separately, in addition to showing the intervals in which deadlines and costs may vary. In Figure 9 the tornado charts obtained for management scenarios are shown. It is important to clarify that in the case of cost, the cost that the client company would have to pay considering penalties was was taken into account (i.e., the cost of each contractor minus penalties charged).

From FIGURE 9, it can be concluded that for Company A, the risk that has a greater negative impact in deadlines is the Effective Advance (i.e., the realization of low values of this risk leads to a further deadline increase within the project). Regarding to the costs for the client company, and if it chooses Company A, the risk related to the Effective Advance is the one that reduces its cost the most. In other words, the Effective Advance is responsible for bulkier penalties, reducing the amount payed by the client company.

Captura de pantalla 2016-07-10 a la(s) 18.00.09

In the case of Company B, it can be said that the risk related with the productivity of the crews is the one that has the most negative impact on deadlines. The risk associated with a low level of productivity has a greater impact on increases in deadlines compared to other technical risks. Regarding the contractor’s costs, this risk (crew’s productivity) is also leading to increased generation of fines, reducing the total amount paid by the client company. It is important to note that although the risks have the potential to reduce the amounts paid by the client company due to penalties, the main objective is that the contractor complete the project within the deadline established. In other words, the system of penalties needs to have as a main objective to encourage the contractor to finish the work as planned, and not to generate profits.

Through this risk evaluation of bids, it can be inferred, first, that in the recovery scenarios both companies would not achieve – in expected value – the planned objectives in terms of deadline or cost. However, in this scenario, Company A is closer to the client company’s reference deadline than Company B, who is quite far from it because of its riskier profile.

However, when companies have management capacity, Company B is capable of finishing the project within the client company’s reference deadline, mainly because it can gradually react to the generated delays. Company B has in its favor that the extra capacity runs with no risk and that its planned deadline had a differential in favor with respect to the client company’s reference deadline. Finally, it was found that in the case of Company A, the technical risk with the most impact on the development of the plan was the Effective Advance, while for Company B it was the productivity of the crews. This would allow the client company to ask for the chosen company to add mitigation measures to offset the impact of its critical risks.

CONCLUSIONS

The illustrated case exemplified the importance of performing a risk evaluation when analyzing the options in a tender. A priori, certain offers may be attractive in terms of deadlines and costs. However, this figure may change drastically if the risk profile of each bidder is considered. In this case, it was concluded that, in cases where companies do not have management measures to alleviate the delays (case with recovery), both offerors were incapable – in expected value – to perform the work neither within their planned deadline nor in the way the client company required. However, in the case with management, at least Company B is able to develop the project in the time required by the client company.

Risk evaluation in tenders also provides the benefit of detecting the risks of greater impact for each offeror. This can be very useful as it increases the information that can be used to negotiate once a contractor has been chosen. For example, the client company could ask the contractor to include some prevention and/or mitigation measures to offset the potential impact of a certain risk. In addition, different penalties strategies  could be studied using this tool with the final objective of finding the best penalties strategies. To define these strategies, it should always be taken into account that penalties should encourage the contractor to complete the project as programmed without affecting the financial health of the company, and not to reduce the cost for the client company as a result of charging exorbitant penalties.

Finally, the traditional view of tender evaluation only considers the technical and economic analysis. Nevertheless, and given the current situation, the idea of adding a risk evaluation to the traditional evaluation process gets more relevant each day. This allows for each offer to be studied in detail, considering the risks affecting the performance of contractors, and thus providing a share of realism to the conclusions of the technical and economic evaluations. Risk evaluation allows the client company to choose the right contractor, considering its risk profile, and providing valuable information to assist the client company during the negotiation of the contract terms.

REFERENCES

• COCHILCO, 2016. Informe de Tendencias del Mercado del Cobre: Enero 2016, Santiago.

• COCHILCO, 2015. Caracterización de los Costos de la Gran Minería del Cobre, Santiago.

• Huidobro, J., Heredia, B., Salmona, M., Alvarado, L., 2009. Inclusión en la gestión de riesgos en el estudio de ofertas para licitaciones de proyectos. Revista de la Construcción, 8(2), pp. 27-37.

Captura de pantalla 2016-07-10 a la(s) 18.00.23

advertising-cursoecomin

Comentarios