Monitoring for procurement planning

Are goods ordered in time, and service level agreements in place, so that important public services can be delivered without interruption?

Questions to help guide your investigation

Which entities are responsible for this service?

Identify the sphere of government responsible for the relevant function of government

Schedule 4 and 5 of the constitution of South Africa lays out which parts of government have the authority and responsibility to manage specific functional areas, from liquor licenses to health services. See also the references to other sections of the constitution in these schedules.

Identify departments that fall under the relevant function of government

The consolidated budget by function on vulekamali summarises the allocation to different functions of government in the current national and provincial budget. By selecting the function to see more detail, you can see the range of national and provincial departments budgeting for work under that function.

Identify departments with relevant mandates

The department budget documents (Estimates of National Expenditure, Estimates of Provincial Revenue and Expenditure) outline the mandate of the department in the introduction of its budget vote chapter. Along with the mandate is references to legislation under which the mandate is ussed. These budget documents can be found by visiting the department pages on Vulekamali. Relevant department pages can also be found by searching for keywords related to a given service on vulekamali. You can then read more by accessing the department budget PDF from the department's page.

Identify any agencies and entities of departments, or any NGOs delivering this service

See the department budget documents (ENE, EPRE) for mention of agencies and NGOs receiving money from the department to assist in providing services.

Which activities are carried out by these entities?

Identify any programmes and sub programmes covering this service

The department budget documents (Estimates of National Expenditure, Estimates of Provincial Revenue and Expenditure) include descriptions of the programmes and sub programmes of the department. These are the planned activities for the department for the coming financial years. They also include a review of the activities of the previous financial year.

Identify relevant quarterly performance reporting (QPR) indicators and targets for national or provincial departments

National and provincial departments publish quarterly reporting targets annually. These can offer additional indications of the activities the department should be carrying out during the financial year. Results are published quarterly for quarterly indicators, and audited results are published annually for quarterly and annual indicators.

Identify any relevant activities in municipal Service Delivery and Budget Implementation Plans (SDBIP)

Municipalities' SD IPs list the objectives and strategies to meet them, as well as budget allocations to these activities.

What goods and services are needed to provide this public service?

Look for relevant historical procurement

Review historical procurement data (under awarded tenders) to see what goods and services a department procured in the past.  Make sure to align your findings with their currently-planned activities.

Identify planned and past spending in the Economic Classification of national and provincial departments budgets and spending

The budget and spending data for national and provincial departments is summarised by programme, function, and economic classification. The economic classification can shed light on the kinds of goods and services involved in the implementation of a given programme or sub-programme.

Who needed to be sufficiently qualified to determine whether the goods or services procured were fit for purpose? At which point in the procurement process was this capability required? How was it satisfied? Are you sufficiently qualified to determine this?

Identify the technical requirements

The technical requirements should be specified in the tender specification documents. A template is normally provided for bidders to complete to indicate how they meet the requirements.

Determine whether the bid committee was able to properly determine technical qualification of bids?

Were the technical requirements specified clearly? Access the Bid Evaluation Committee meeting minutes to see who was part of the committee, and how specific decisions were made.

Assess whether you are qualified to assess decisions of qualification for the relevant bids

Are any technical skills or qualifications needed to make sense of tender requirements and bid evaluation? For some technical requirements, you may need to get the assistance of technical experts to make sure you are interpreting requirements and submissions correctly.

These are not necessarily all the questions that would go into an investigation like this. Try to think about what other questions are useful. If you have suggestions for important questions, let us know!

Download investigation worksheet: Printable PDF or Excel.

Monitoring for procurement delivery

Are suppliers delivering the goods or services they were contracted to, as agreed?

Questions to help guide your investigation

Which specific projects or activities would you like to focus on?

Identify specific infrastructure projects, e.g. roadworks, housing, water infrastructure

When trying to gather relevant procurement information, it will be useful to be able to specify as specifically as possible which projects, assets, or physical locations you are referring to. For example, project numbers, names, and sometimes geographic coordinates, are available for infrastructure projects. Note these down to use later. If you can not find project information publicly, try to still be as specific as possible in future communication about the project you are researching - e.g. which schools, roads, or areas are affected?

More info:

See the worksheet "Are goods ordered in time, and service agreements in place, so that important public services can be delivered without interruption?" for more on how to identify activities of government that relate to specific public services.

Which orders or instances of government procurement are relevant?

Determine which procurement method was followed

Smaller contracts can be initiated by sourcing at least three quotes and selecting the lowest valid quote. Larger contracts must be initiated by advertising open tenders. In special circumstances, a single supplier can be contracted directly. If you don't find the information you need using the below approaches, reach out to the relevant entity and ask how the goods or services were procured.

If quotes were used, get the request to quote (RFQ) and all the information supplied to the quoting companies

When sourcing quotes for supplying goods or services, the buyer makes a Request for Quote (RFQ) available to specific companies considered to be able to meet the requirements, and sometimes also publicly. This, as well as the submitted quotes, would have to be requested directly from the procuring entity. They are not always made available publicly proactively. The buyer may have sourced more quotes so make sure to request all quotes and not only those considered.

If tender procurement was carried out, find tender number(s), accompanying documents

Try to find the available public information about the relevant procurement. Look for tender advertisements and awards. Download any accompanying documents and make sure you organise them in a way that will let you find the right document later. e.g. put the tender number and what kind of document it is in the filename (e.g. RFQ 0073 Guidance for Local content.pdf).

These documents typically provide detailed information about the project requirements, scope of work, evaluation criteria, and other relevant details.

What exactly are the requirements on the service provider in the contract? What exactly should be delivered? By when?

Access the signed service level agreement(s) and check what what is to be delivered, and when

Service level agreements (SLA) detail what goods or services are to be delivered, the schedule for deliver, as well as the period of the agreement - when the contractual relationship starts and ends. While the tender documents are a strong indication of what would eventually be agreed, some details about how the contract will be delivered on may be amended or clarified in the SLA and this is what ultimately determines the contractual obligations of both parties - the buyer and the service provider.

SLAs are not generally made public proactively and will have to be requested from the procuring entity directly. The OCPO transparency portal is starting to capture this information but it is not very comprehensive yet so make sure to submit a PAIA request as soon as you know what you need.

What has been delivered? What evidence is there?

Visit site if it is an infrastructure project

If the procurement project involves infrastructure development, consider visiting the project site to gather firsthand information. Contact the responsible government department or agency to inquire about site visits or obtain permission to access the project area. During the site visit, observe the progress of the project, assess the implementation quality, and interact with the project stakeholders to gather additional information.

Request proof of delivery from the procuring entity (e.g. department, municipality)

Proof of delivery must be recorded whether it is goods or services being procured. For goods, this may be a delivery receipt signed by the recipient, photographs of the delivered item, or a witness statement from someone who saw the item being delivered. For services, it may take the form of invoice reports detailing the services delivered as supporting evidence when the supplier sought payment.

If service providers have failed to deliver per the agreement, have they been banned from getting public procurement contracts in future?

Check restricted suppliers list for addition of contractor

The restricted suppliers list is used for monitoring purposes to ensure that the public sector does not do business with suppliers who have engaged in fraudulent or unethical practices.

If they have not, query this with those responsible

If the supplier has not been listed on the restricted supplier list, raise this with the procuring institution. If they do not have a satisfactory explanation for not barring the non-delivering supplier, raise the matter with the OCPO.

These are not necessarily all the questions that would go into an investigation like this. Try to think about what other questions are useful. If you have suggestions for important questions, let us know!

Download investigation worksheet: Printable PDF or Excel.

Monitoring for procurement value

Is government paying competitive prices for goods and services and getting good value for money?

Questions to help guide your investigation

Do you have a representative sample of data showing the unit cost of orders of comparable goods or services?

Prepare a dataset of orders or agreements itemising commodity or service and unit cost. Ideally also including quantity of units to be supplied.

Identify relevant orders or agreements. Refer to the "Are goods ordered in time, and service agreements in place, so that important pubic services can be delivered without interruption" guide for more on identifying relevant orders. You can also contact the relevant procurement department or entity.Once you have located the data sources, you can extract the relevant data from the orders or agreements. This data should include the commodity or service being procured, the unit cost, and the quantity of units to be supplied. If the information does not contain unit cost, but does have total cost and number of units, you can calculate an estimated unit cost, but try to request confirmation or more detail in case other charges were included in the total.

Before conducting analysis on the extracted data you will need to clean the data, this process involves removing errors and inconsistencies in the data sets. But watch out - inconsistencies may simply be unusual prices and valid data. Once this data has been cleaned it is ready to be prepared in a spreadsheet or database in order for it to be analysed.

More info:

Very little data specifying the price paid for specific commodities is publicly available. The best of this data has been the special releases for COVID-19 PPE procurement, and the KwaZulu-Natal floods emergency procurement. You will most likely need to request the data specifically. See the Guide to sourcing data from government for more tips on making practical effective PAIA requests for procurement monitoring.

What is the distribution of prices?

Calculate the median, standard deviation; Plot the price and unit cost in price buckets of appropriate size.

Once the data has been cleaned and stored it is ready for analysis. To analyse the data it is helpful to:

  • Calculate the median. The median is the middle value in a sorted dataset. To calculate the median, you can first sort the orders in ascending order of unit price. Then, the median is the value in the middle of the dataset.
  • Plot the price and unit cost in price buckets of appropriate size. This can be done by creating a histogram. A histogram is a graph that shows the distribution of data. To create a histogram, you first need to divide the data into price buckets. The size of the price buckets will depend on the amount of data you have. Once you have divided the data into price buckets, you can then plot the number of values in each price bucket. The goal is to select bucket sizes that are large enough so that you have enough orders to start seeing a pattern in the unit prices. At the same time, you want buckets that are small enough so that your histogram takes shape and you can see whether prices concentrate more towards one range. Aim for at least 5 buckets.
  • Calculate the standard deviation. The standard distribution is a measure of how spread out the data is. Using the Standard deviation, you can get a sense of whether most of the prices are quite similar, or whether they vary significantly between orders. The more similar prices normally are, the easier it is to identify prices that are different and perhaps need closer scrutiny.

Are there regional variations in pricing? Are there volume variations in pricing?

Calculate and plot for provinces, rural vs urban, high vs low volume.

When you are trying to understand why specific orders have that price, perhaps particularly high or low, it can be useful to understand whether there are systematic variations in prices. Perhaps something is much cheaper at the coast due to transport costs inland. Or perhaps volume discounts can reduce a price significantly.

Once the price for a particular good or service has been plotted in price buckets of appropriates sizes the following processes should be followed:

  • Divide the data into provinces. To do this, add a new column to your spreadsheet or database that indicates the province of each order or agreement.-
  • Divide the data into rural vs urban. To do this, add a new column to your spreadsheet or database that indicates whether each order or agreement was for a rural or urban area.-
  • Divide the data into high vs low volume. To do this, add a new column to your spreadsheet or database that indicates whether the quantity of units to be supplied was high or low.
  • Calculate the median and standard distribution for each province, rural vs urban, and high vs low volume category. To do this, use the same steps as you did when you calculated the median and standard distribution for the entire dataset.
  • Plot the price and unit cost in price buckets of appropriate size for each province, rural vs urban, and high vs low volume category. To do this, create a histogram for each category.

Which orders stand out? Why do they deviate significantly from the norm?

Identify the outliers

This can be done by looking at the histogram or by using a statistical test such as the interquartile range (IQR). The IQR is a measure of the spread of the data, and it can be used to identify values that are outside the interquartile range.

Try to confirm your findings before suspecting foul play
  • Double-check any calculations you made.
  • Try to follow the data for those orders back to the source and see if any errors crept in, perhaps during transcription from documents.
  • Try to corroborate the values with a second source. e.g. Try to match order values between tender award and service agreement. Try to match order quantities between tender advertisement, service agreement, and delivery notes or invoice reports.

Why is the price paid so far from the norm? Are they not receiving normal bids, or are they selecting pricier bids than they should?

Get hold of all bids including bid amounts, reasons for any disqualifications, as well as the selection meeting minutes

In order to ensure that the procurement process was fair and transparent, or to identify if there are any potential problems with the procurement process you need to access more detail about the bids as well as the selection process.

Access the tender award details including the bid amounts from non-winning bidders. Tender awards details often only include the amount for the winning bidder and only names of non-winning bidders. You may need to request the other bid amounts from the buyer. You will also need the bid evaluation committee minutes. These are not normally publicly available and will need to be requested from the procuring entity.

See whether the non-winning bids follow the pricing norm

Looking at the other bid amounts could shed light on special circumstances in this procurement instance

Were the evaluation criteria applied correctly? See if any bids were disqualified unfairly

There may have been other valid bids which could have supplied the goods or service at better value for money but were improperly disqualified without valid reason, favouring the winner.

Determine whether the selected bid was in line with selection rules in procurement regulations

Was a more costly bid selected when a qualifying bid was available with a lower cost? Was a particularly low bid accepted despite the goods or services not really meeting the requirements of the tender?

Who needed to be sufficiently qualified to determine whether the goods or services procured were fit for purpose? At which point in the procurement process was this capability required? How was it satisfied? Am I sufficiently qualified to determine this?

Identify the technical requirements

The technical requirements should be specified in the tender specification documents. A template is normally provided for bidders to complete to indicate how they meet the requirements.

Determine whether the bid evaluation committee was able to properly determine technical qualification of bids?

Were the technical requirements specified clearly? Was the committee qualified to determine whether bids meet these criteria?

Access the Bid Evaluation Committee meeting minutes to see who was part of the committee, and how specific decisions were made.

Assess whether you are qualified to assess decisions of qualification for the relevant bids

Are any technical skills or qualifications needed to make sense of tender requirements and bid evaluation? For some technical requirements, you may need to get the assistance of technical experts to make sure you are interpreting requirements and submissions correctly.

These are not necessarily all the questions that would go into an investigation like this. Try to think about what other questions are useful. If you have suggestions for important questions, let us know!

Download investigation worksheet: Printable PDF or Excel.

Monitoring for transformation

Are preferential procurement regulations followed supporting transformation in industry?

Questions to help guide your investigation

What are the preferential procurement regulations that are put in place to support transformation in industries?

Review preferential procurement regulations as they are set out in the Preferential Procurement Policy Framework Act, 2000 (PPPFA)

The PPPFA sets out a number of different ways in which organs of state must give preference to designated groups in their procurement activities.

Review preferential procurement regulations as they are set out in The National Treasury's Guidelines on Preferential Procurement

The National Treasury's Guidelines on Preferential Procurement provide additional guidance on how to monitor preferential procurement activities.

What proportion of procurement is going to the specific aspect of transformation you would like to focus on, e.g. women-owned businesses; black-owned businesses; small enterprises; or rural enterprises?

Look up proportions of procurement by these classifications on the preferential category summary

Summarise the number and total value of procurement payments by the values within the preferential procurement attribute you would like to focus on. E.g. if focusing on ownership gender, what proportion of procurement went to Women-owned; Partially Women-owned, and Not women-owned businesses?

Is that the case across the board or are some buyers more effective at that than others?

Filter preferential category summary to one or more specific buyers

Filter the preferential category summary data to focus on one or more specific buyers or procuring entities. This will allow you to assess the preferential procurement practices of specific institutions or government departments.

Is it getting better or worse over time?

View a specific category breakdown over time, perhaps filtered to one or more institution

Summarise the preferential category breakdown over years and quarters to identify any trends or fluctuations in the allocation of procurement to different categories. Evaluate whether there is a consistent and balanced distribution of procurement among the preferential categories, an increasing/declining trend, or perhaps any significant variations.

Are there any particularly large instances of procurement skewing the data at any point or does the data really reflect systematic deficiencies in implementation of preferential procurement?

Find the procurement instances for a specific range in time of interest, e.g. where it was particularly bad

Identify specific instances or periods of procurement that are of interest or concern, such as those where adherence to preferential procurement requirements may have been lacking. Determine the range of time for which you want to review procurement instances. Retrieve the tender advertisements and associated criteria for the identified procurement instances. The bid evaluation criteria should be published in the documents accompanying the tender advertisement. Assess whether the tender documents explicitly include preferential procurement criteria and requirements.

Why is preferential procurement not happening at identified institutions? Are they not receiving applicable bids, or are they not selecting in line with regulations?

Check whether relevant bids met the technical requirements

See if the bids that would have represented transformation met the technical criteria. If they do not meet the technical criteria, they would not proceed to the next phase of evaluation considering price and preferential procurement policies.

Check whether the preferential procurement scoring was applied correctly

Sometimes the tender award details indicate the score of the winning bidder. The Bid Evaluation Committee meeting minutes should include the score attained by all the qualifying bidders. Use these and any further motivation from the Bid Evaluation Committee to see if scoring was carried out consistently and gain insights into the decision-making process. Review the minutes to assess whether the evaluation and selection process adhered to the preferential procurement requirements. (Note: only information relating to the requesting supplier will be provided, unless the request comes through PAJA)

These are not necessarily all the questions that would go into an investigation like this. Try to think about what other questions are useful. If you have suggestions for important questions, let us know!

Download investigation worksheet: Printable PDF or Excel.

System Weaknesses

It is essential that the decision-making in respect of procurements and public contracting is done by administrative/technical staff inside departments/organs of state. Political duty-bearers, for example MECs, should have no involvement whatsoever, at any stage of the procurement process. This includes preventing their presence on BSCs BECs and BACs, preventing their influence on the decisions made in these committees, as well as any “passage whispers” which may occur to influence decision-making.

What to do if you discover problems or flaws in the procurement process

  • Civil society organisations can undertake social audits and present findings to the relevant procuring entity concerned. 
  • Report any failures or concerns or abuses to the relevant accounting officer of the procuring entity concerned. Accounting officers/authorities are described here. 
  • Contact the political head of the procuring entity e.g. the MEC
  • Communicate with the Standing Committee on Public Accounts (SCOPA) in Parliament
  • Complain to the Presidential Hotline (17737 or president@po.gov.za)
  • Contact Corruption Watch
  • If the procuring entity is a Municipality, complain to the Municipality’s complaints hotline (if it has one)
  • Complain to the Public Protector’s Office, including provincial offices of the Public Protector’s Office.
  • Some Cities and Provinces have Ombudsmen to receive complaints. 
  • Ensure that suppliers that have failed to perform have been listed on the Database of Restricted Suppliers. 
  • In terms of the Promotion of Administrative Justice Act 3 of 2000, an interested party is entitled to ask for reasons for an administrative decision. The award of a tender is an administrative decision for which reasons must be provided.

Useful Example

What if a school is not built?
  • An interested party can approach a Court to obtain an order enforcing the terms of the contract;
  • The Accounting Officer can recommend to National Treasury to restrict/blacklist the said supplier from doing business with the state for violation of a contract or poor performance for a period not longer than 10 years.

Consequences of an invalid tender award

  • If a tender has been invalidly awarded, the procuring entity will have no authority to conclude the contract for the provision of a good or service.
  • A court of law can be approached to overturn a tender award.

What questions to ask to interrogate a flawed or inappropriate contract

The International Budget Partnership (IBP) manual chapters 19 to 22 lists some of the questions you may want to ask yourself while examining information for each stage of the procurement process.

Questions taken directly from the IBP manual:

  • Are the items to be procured consistent with the needs identified in the needs assessment?
  • Does the procurement plan clearly identify the goods or services to be procured?
  • Have any unnecessary items been included in the procurement plan?
  • Is the timing of the planned procurement reasonable to ensure that the goods or services will be delivered when and as often as they are needed?
  • Is the procurement method appropriate? For example, is sole source bidding being proposed when competitive bidding is really required? To find out more about the different methods that government departments can use to procure goods or services, see Chapter 2.
  • In the case of an infrastructure project, is the planned project unnecessary or too big?If government intends to build a new hospital in a certain area, for example, is there a need for a new hospital, or such a big hospital?
  • Would repairs or upgrades to infrastructure have been more appropriate than new infrastructure? For example, if a school building is structurally sound, would building additional classrooms, or maintenance to existing classrooms, have been more appropriate than building a new school?

These questions are adapted from the Procurement Monitoring Guide of Transparency International USA (2012)