Proponent: esnXpmeRBVMqbaFoY5bbFi9Lapuh85jnDkN8QQtoh3k4jBXxV
Date: 5th July 2023
Amount Requested: 1,803.8063 PDEX
Short description: Ongoing costs for the running of high performance, scalable, and reliable public infrastructure for Polkadex. Full Proposal: <a href="https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing">https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing</a>
<hr>
<h1 id="originalmotivation">Original Motivation</h1>
Setting up blockchain infrastructure is difficult, time consuming, and expensive:
<ul>
<li>
It requires a level of server development expertise that many do not have
</li>
<li>
It's costly to run a full node nearly continuously, especially when your dApp's traffic is low and inconsistent.&nbsp;
</li>
<li>
Running production level infrastructure is especially tricky. You need to autoscale quickly to handle bursty traffic, and you want to provide services in different regions around the world to provide low latency services - all of this is incredibly costly, but comes with significant economies of scale for a provider.
</li>
<li>
DevOps requires constant attention - time that would be better spent elsewhere building.
</li>
</ul>
A shared node API service helps mitigate these barriers of entry to trying accessing a new protocol by reducing all these costs to near zero. We manage all the nodes for our users and distribute them across the world (with intelligent routing) to achieve global scalability from day 1, we monitor each node and ensure that they meet certain service levels, and we have the expertise and scale to handle production workloads and high peak traffic.
In summary, we try to reduce the pain of getting started on Polkadex and minimise the costs of accessing secure nodes while traffic from your dApp is low. When you grow, you can continue to use our shared API service, or we also <a href="https://onfinality.io/dedicated_nodes">provide access to one click deploy dedicated polkadex nodes</a>&nbsp; to any cloud of your choosing.&nbsp;
<h1 id="backgroundonourrpcservice">Background on our RPC Service</h1>
Since inception in November 2020 we have made a large number of improvements to our Ultimate API service focussing on three key areas; performance/reliability, providing more value from our Ultimate API service, and cost optimisation.
<h3 id="performancereliability">Performance/Reliability</h3>
OnFinality is operationally striving for a minimum of 99.99% reliability, which means less than an hour of downtime each year.&nbsp; We proudly display and share our <a href="https://status.onfinality.io/">90 day uptime statistics</a> for each network publicly <a href="https://status.onfinality.io/uptime/r40wwpclbwzm">here</a>.
We have invested hugely into a team dedicated to optimising our application gateway and caching layer to ensure that we provide the fastest possible service for our customers. We run clusters in 5 different regions (North Virginia, Frankfurt, Tokyo, Singapore, and Australia) and across 3 different cloud providers (AWS, GCP, Alicloud) to ensure that we are fault tolerant to any single region or cloud provider ceasing service.
<h3 id="providingmorevaluefromourultimateapiservice">Providing more value from our Ultimate API service</h3>
For customers that do sign up for paid API keys, we've been adding more and more features to provide a better experience. <a href="https://blog.onfinality.io/onfinality-adds-geolocation-insights-for-dapps-and-api-apps/">Geolocation insights</a> provide statistics about where in the world communities are to help influence decisions around where to expand infrastructure and to view the effectiveness of regional BD initiatives.&nbsp; We can also now <a href="https://blog.onfinality.io/onfinality-developer-update-auto-expand-storage-for-dedicated-nodes/">automatically upsize the storage on nodes</a> to prevent the risk of any downtime.
Finally, in Q2 of 2023 OnFinality <a href="https://blog.onfinality.io/onfinality-launches-trace-api-for-unprecedented-visibility-into-your-dapps/">launched Trace API</a> support which was a huge enhancement allowing unprecedented visibility for dApp builders. Trace API captures and records vital information otherwise not available through regular RPC methods and extrinsics (such as complete XCM transfer records and complete list of balance changes). These APIs are essential in order for <a href="https://blog.onfinality.io/onfinalitys-new-trace-api-helping-colorful-notion-get-trace-data-from-over-40-substrate-chains/">developers like Polkaholic</a> to parse and understand XCM transactions.
<h3 id="costoptimisation">Cost Optimisation</h3>
OnFinality is very conscious about providing a strong level of support for Polkadex&nbsp; at an extremely competitive price. Cost saving measurement has been a significant focus on behalf of our customers, with advanced rate limiting controls implemented. We can, for example, rate limit each client on a burst and sustained basis and based on the request methods that they are calling (e.g. each statetraceBlock request is rate limited 45x more than chaingetBlock), <a href="https://documentation.onfinality.io/support/public-rate-limits">read more about these advanced rate limiting tools that we've developed here</a>.
Meaning that we can continue to provide generous public API endpoints for over 40 different networks for common-good applications, but restrict access to high volume users that abuse this free service. We've been able to manage our costs significantly on behalf of our customers as a result.&nbsp;
We've <a href="https://polkadot.polkassembly.io/post/1270">developed and shared our approach towards service sustainability</a>, with the introduction of a 'Paid API Revenue Share Discount' scheme. In this scheme OnFinality pools the revenue from customers that pay for higher API pricing plans and distributes this revenue pool to partners that currently pay for and own each API endpoint proportionally based on the number of paid API requests that go to that API endpoint. The scheme was introduced in Q1 of 2023 and resulted in a discount to <a href="../treasury/16">Polkadex's Q1 treasury proposal</a> of $86.10.
Our cost optimisation efforts were validated in Q1 as we had the lowest cost per million responses across all of the major RPC providers that lodged a proposal to the Polkadot treasury. You can see how our costs compared to other RPC providers in the ecosystem during Q1 <a href="https://docs.google.com/spreadsheets/d/1Utw2HfS7I5Gpyhrl9ejuj0CrQ4AcChGFteXdw0a8tro/edit#gid=0">here</a>.
<h1 id="servicedetails">Service Details</h1>
During Q2 of 2023, we've made a number of new improvements to our Ultimate API service that address performance/reliability, features, and costs.
Additionally, we are proud to have delivered some key service enhancements that benefit the Polkadot ecosystem in the last quarter. This includes:
<ul>
<li>
<a href="https://blog.onfinality.io/onfinality-launches-trace-api-for-unprecedented-visibility-into-your-dapps/">Launched Trace API</a> allowing unprecedented visibility for dApp builders. Trace API captures and records vital information otherwise not available through regular RPC methods and extrinsics (such as complete XCM transfer records and complete list of balance changes). These APIs are essential in order for <a href="https://blog.onfinality.io/onfinalitys-new-trace-api-helping-colorful-notion-get-trace-data-from-over-40-substrate-chains/">developers like Polkaholic</a> to parse and understand XCM transactions.
</li>
<li>
<a href="https://blog.onfinality.io/onfinality-adds-geolocation-insights-for-dapps-and-api-apps/">Geographical Insights</a> - API key owners can view statistics about where in the world your community are to help influence decisions around where to expand infrastructure and to view the effectiveness of regional BD initiatives
</li>
<li>
<a href="https://blog.onfinality.io/how-does-onfinality-deal-with-personal-information/">Clarify our IP address handling</a> - OnFinality does not, and will never, correlate or link specific wallet addresses to the IP address or request origin making the RPC request
</li>
<li>
Added support for a number of new networks, including Anmol, HydraDX, Equilibrium, as well as Osmosis, Evmos, Harmony, Arbitrum, Optimism, Fuse, DFK Chain, Celo, and Klaytn from outside the ecosystem. OnFinality is a new one stop shop for all of your RPC needs from multiple ecosystems.
</li>
<li>
A variety of improvements to our health metric collection tools and automated recovery scripts to ensure our 99.9% SLA is exceeded.
</li>
<li>
Scale improvements to our team, processes, and systems to allow us to provide this same service to any &nbsp;substrate team
</li>
</ul>
Our customers are building cross-chain wallets, running some of the largest block explorers, and are indexing multiple networks - they've all benefited from these API access restrictions, improved monitoring, and the larger number of supported Polkadot chains. You can always see live data on our API service on our public <a href="https://status.onfinality.io/">status page</a>.
<h2 id="costings">Costings</h2>
This proposal includes combined running costs for our infrastructure for Polkadex in Q2 (April, May, June) 2023. The total combined running cost is USD $2,146.27.
Read for the full proposal for further breakdown of costings: <a href="https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing">https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing</a>

**Proponent:** esnXpmeRBVMqbaFoY5bbFi9Lapuh85jnDkN8QQtoh3k4jBXxV

**Date:** 5th July 2023

**Amount Requested:** 1,803.8063 PDEX

**Short description:** Ongoing costs for the running of high performance, scalable, and reliable public infrastructure for Polkadex.  
  
**Full Proposal:** [https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing](https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing)

* * *

Original Motivation
===================

Setting up blockchain infrastructure is difficult, time consuming, and expensive:

*   It requires a level of server development expertise that many do not have
    
*   It's costly to run a full node nearly continuously, especially when your dApp's traffic is low and inconsistent. 
    
*   Running production level infrastructure is especially tricky. You need to autoscale quickly to handle bursty traffic, and you want to provide services in different regions around the world to provide low latency services - all of this is incredibly costly, but comes with significant economies of scale for a provider.
    
*   DevOps requires constant attention - time that would be better spent elsewhere building.
    

A shared node API service helps mitigate these barriers of entry to trying accessing a new protocol by reducing all these costs to near zero. We manage all the nodes for our users and distribute them across the world (with intelligent routing) to achieve global scalability from day 1, we monitor each node and ensure that they meet certain service levels, and we have the expertise and scale to handle production workloads and high peak traffic.

In summary, we try to reduce the pain of getting started on Polkadex and minimise the costs of accessing secure nodes while traffic from your dApp is low. When you grow, you can continue to use our shared API service, or we also [provide access to one click deploy dedicated polkadex nodes](https://onfinality.io/dedicated_nodes)  to any cloud of your choosing. 

Background on our RPC Service
=============================

Since inception in November 2020 we have made a large number of improvements to our Ultimate API service focussing on three key areas; performance/reliability, providing more value from our Ultimate API service, and cost optimisation.

### Performance/Reliability

OnFinality is operationally striving for a minimum of 99.99% reliability, which means less than an hour of downtime each year.  We proudly display and share our [90 day uptime statistics](https://status.onfinality.io/) for each network publicly [here](https://status.onfinality.io/uptime/r40wwpclbwzm).

We have invested hugely into a team dedicated to optimising our application gateway and caching layer to ensure that we provide the fastest possible service for our customers. We run clusters in 5 different regions (North Virginia, Frankfurt, Tokyo, Singapore, and Australia) and across 3 different cloud providers (AWS, GCP, Alicloud) to ensure that we are fault tolerant to any single region or cloud provider ceasing service.

### Providing more value from our Ultimate API service

For customers that do sign up for paid API keys, we've been adding more and more features to provide a better experience. [Geolocation insights](https://blog.onfinality.io/onfinality-adds-geolocation-insights-for-dapps-and-api-apps/) provide statistics about where in the world communities are to help influence decisions around where to expand infrastructure and to view the effectiveness of regional BD initiatives.  We can also now [automatically upsize the storage on nodes](https://blog.onfinality.io/onfinality-developer-update-auto-expand-storage-for-dedicated-nodes/) to prevent the risk of any downtime.

Finally, in Q2 of 2023 OnFinality [launched Trace API](https://blog.onfinality.io/onfinality-launches-trace-api-for-unprecedented-visibility-into-your-dapps/) support which was a huge enhancement allowing unprecedented visibility for dApp builders. Trace API captures and records vital information otherwise not available through regular RPC methods and extrinsics (such as complete XCM transfer records and complete list of balance changes). These APIs are essential in order for [developers like Polkaholic](https://blog.onfinality.io/onfinalitys-new-trace-api-helping-colorful-notion-get-trace-data-from-over-40-substrate-chains/) to parse and understand XCM transactions.

### Cost Optimisation

OnFinality is very conscious about providing a strong level of support for Polkadex  at an extremely competitive price. Cost saving measurement has been a significant focus on behalf of our customers, with advanced rate limiting controls implemented. We can, for example, rate limit each client on a burst and sustained basis and based on the request methods that they are calling (e.g. each state_traceBlock request is rate limited 45x more than chain_getBlock), [read more about these advanced rate limiting tools that we've developed here](https://documentation.onfinality.io/support/public-rate-limits).

Meaning that we can continue to provide generous public API endpoints for over 40 different networks for common-good applications, but restrict access to high volume users that abuse this free service. We've been able to manage our costs significantly on behalf of our customers as a result. 

We've [developed and shared our approach towards service sustainability](https://polkadot.polkassembly.io/post/1270), with the introduction of a 'Paid API Revenue Share Discount' scheme. In this scheme OnFinality pools the revenue from customers that pay for higher API pricing plans and distributes this revenue pool to partners that currently pay for and own each API endpoint proportionally based on the number of paid API requests that go to that API endpoint. The scheme was introduced in Q1 of 2023 and resulted in a discount to [Polkadex's Q1 treasury proposal](../treasury/16) of $86.10.

Our cost optimisation efforts were validated in Q1 as we had the lowest cost per million responses across all of the major RPC providers that lodged a proposal to the Polkadot treasury. You can see how our costs compared to other RPC providers in the ecosystem during Q1 [here](https://docs.google.com/spreadsheets/d/1Utw2HfS7I5Gpyhrl9ejuj0CrQ4AcChGFteXdw0a8tro/edit#gid=0).

Service Details
===============

During Q2 of 2023, we've made a number of new improvements to our Ultimate API service that address performance/reliability, features, and costs.

Additionally, we are proud to have delivered some key service enhancements that benefit the Polkadot ecosystem in the last quarter. This includes:

*   [Launched Trace API](https://blog.onfinality.io/onfinality-launches-trace-api-for-unprecedented-visibility-into-your-dapps/) allowing unprecedented visibility for dApp builders. Trace API captures and records vital information otherwise not available through regular RPC methods and extrinsics (such as complete XCM transfer records and complete list of balance changes). These APIs are essential in order for [developers like Polkaholic](https://blog.onfinality.io/onfinalitys-new-trace-api-helping-colorful-notion-get-trace-data-from-over-40-substrate-chains/) to parse and understand XCM transactions.
    
*   [Geographical Insights](https://blog.onfinality.io/onfinality-adds-geolocation-insights-for-dapps-and-api-apps/) - API key owners can view statistics about where in the world your community are to help influence decisions around where to expand infrastructure and to view the effectiveness of regional BD initiatives
    
*   [Clarify our IP address handling](https://blog.onfinality.io/how-does-onfinality-deal-with-personal-information/) - OnFinality does not, and will never, correlate or link specific wallet addresses to the IP address or request origin making the RPC request
    
*   Added support for a number of new networks, including Anmol, HydraDX, Equilibrium, as well as Osmosis, Evmos, Harmony, Arbitrum, Optimism, Fuse, DFK Chain, Celo, and Klaytn from outside the ecosystem. OnFinality is a new one stop shop for all of your RPC needs from multiple ecosystems.
    
*   A variety of improvements to our health metric collection tools and automated recovery scripts to ensure our 99.9% SLA is exceeded.
    
*   Scale improvements to our team, processes, and systems to allow us to provide this same service to any  substrate team
    

Our customers are building cross-chain wallets, running some of the largest block explorers, and are indexing multiple networks - they've all benefited from these API access restrictions, improved monitoring, and the larger number of supported Polkadot chains. You can always see live data on our API service on our public [status page](https://status.onfinality.io/).

Costings
--------

This proposal includes combined running costs for our infrastructure for Polkadex in Q2 (April, May, June) 2023. The total combined running cost is USD $2,146.27.

**Read for the full proposal for further breakdown of costings:** [https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing](https://docs.google.com/document/d/1BUElC2ilT-EZqhK-YBBePg99FzftVhMoDhgyqwQnvyA/edit?usp=sharing)

: esnXpmeRBVMqbaFoY5bbFi9Lapuh85jnDkN8QQtoh3k4jBXxV is requesting 1,803.8063 PDEX from the Polkassembly Council on 5th July 2023 for the running of high performance, scalable, and reliable public infrastructure for Polkadex. OnFinality has invested significantly into developing their RPC service to improve performance and reliability, providing more value from the Ultimate API service and cost optimization. They have added support for a number of new networks, provided Geographical Insights and clarified their IP address handling. The total combined running cost for their infrastructure on Polkadex in Q2 of 2023 is USD$2,146.27.

#23 OnFinality High Performance Public Infrastructure (Q2, 2023)

No Active Proposals