Combined summary - Warnet + Increase Tx Relay Rate

Combined summary - Warnet + Increase Tx Relay Rate

Recent discussions among programmers have focused on the optimization of blockchain network performance, specifically addressing transaction relay rates and fee calculations.

Modifications to the estimatesmartfee 5 command introduce a variability margin of ±10% to avoid random fees while allowing for fluctuations.

Efficient transaction propagation is essential, balanced with measures to prevent network abuse, such as setting a minimum fee rate measured in satoshis to deter "free relay" attacks. The transaction relay rate is crucial for maintaining node synchronization, particularly for high-fee transactions in the top 1MB of the mempool. Transactions are prioritized by fee rate, and determining the optimal relay rate involves monitoring compact block logging to assess mempool synchronization.

The current transaction relay rate may be too low, as suggested by increased mempool activity during peak times. Natural fee rate increases should be considered, rather than random distributions, to enhance mempool synchronization. Replace-by-Fee (RBF) strategies should only be employed for specific issues related to UTXOs.

Instabilities in network performance have been reported, which do not appear to be CPU-related but could be due to numerous connections. Efforts to improve scalability and stability include simulation enhancements on Warnet to handle higher transaction rates. The impact of RBF, CPFP (Child Pays For Parent), and unconfirmed transaction chains on simulation outcomes remains uncertain, as does the relationship between relay rate and transaction requests.

During simulations involving 100 nodes on a virtual machine, focusing on Bitcoin transaction relays and confirmations, no significant evidence was found to support the effectiveness of updates under moderate transaction rates. It is speculated that implementing RBF, CPFP, and unconfirmed transaction chains may require a shift to Kubernetes for improved stability. Adjusting block production rates could potentially skew results, and 'mocktime' is proposed as a solution to address these discrepancies.

For testing purposes, faster block production provides quicker feedback, but real-world conditions must be maintained for relevance. A deterministic methodology for UTXO generation has been agreed upon, which will involve incrementally increasing transaction creation rates to evaluate system performance thresholds.

To simulate larger network conditions accurately, a protocol has been outlined that includes mining blocks every ten minutes and generating transactions in Taproot or P2WSH formats with dynamically calculated fees. Performance will focus on compact block relay efficiency, with anticipated discrepancies in mempools and an increase in 'txn requested' messages when exceeding certain transaction rates.

Realistic replication of mainnet conditions involves understanding transaction dynamics and network configuration. Different nodes should be used for transaction and block generation to grasp network impacts, including RBF transactions reflecting current mainnet practices. Testing suggests that running 250 nodes using Docker is feasible, and Kubernetes may allow more extensive node management. Discussions continue on optimizing node arrangements to emulate mainnet conditions effectively. Monitoring metrics post-implementation, the correlation between increased bandwidth and CPU usage with relay rate changes, and the effects on mempool turnover during congestion and high fee periods are areas requiring further research. Community input is sought to refine simulation strategies to ensure they accurately represent and inform on mainnet behavior.

Discussion History

amiti Original Post
December 14, 2023 21:14 UTC
December 18, 2023 02:43 UTC
December 20, 2023 21:54 UTC
December 21, 2023 11:23 UTC
December 21, 2023 18:03 UTC
December 22, 2023 03:04 UTC
January 19, 2024 23:48 UTC
January 19, 2024 23:56 UTC
January 20, 2024 03:46 UTC
January 29, 2024 13:01 UTC
January 29, 2024 22:41 UTC
January 31, 2024 12:43 UTC