66 commits

Author	SHA1	Message	Date
Boog900	bd711aff7d	Merge branch 'main' into expose-support-flags	2024-12-04 18:59:33 +00:00
Boog900	7b8756fa80	cuprated: P2P protocol request handler (#303) ... * add cuprated skeleton * fmt and add deny exception * add main chain batch handler * add blockchain init * very rough block manager * misc changes * move more config values * add new tables & types * add function to fully add an alt block * resolve current todo!s * add new requests * WIP: starting re-orgs * add last service request * commit Cargo.lock * add test * more docs + cleanup + alt blocks request * clippy + fmt * document types * move tx_fee to helper * more doc updates * fmt * fix imports * remove config files * fix merge errors * fix generated coins * handle more p2p requests + alt blocks * clean up handler code * add function for incoming blocks * add docs to handler functions * broadcast new blocks + add commands * add fluffy block handler * fix new block handling * small cleanup * increase outbound peer count * fix merge * clean up the blockchain manger * add more docs + cleanup imports * fix typo * fix doc * remove unrelated changes * add `get_objects` handler * add `get_chain` handler * add `fluffy_missing_txs` handler * add `new_fluffy_block` handler * improve interface globals * manger -> manager * enums instead of bools * move chain service to separate file * more review fixes * sort imports + docs * init dandelion integration * add dandelion start function * finish incoming tx handler * Add tx blob hash table * Add missing txpool requests * handle duplicate stem txs * check txpool on incoming block * add request to remove tx in new blocks from the pool * tell the txpool about incoming blocks * fix merge * typos * remove blockchain height from txpool * fix merge * fix merge * handle incoming txs in p2p request handler * Allow `IncomingTxHandler` to be given later * add p2p clearnet init * fix build * misc changes * doc updates * more doc updates * sort imports * review changes * Result -> DbResult * use `NonZero` * review fixes * remove `rust-2024-compatibility` lint	2024-12-03 20:21:05 +00:00
Boog900	ecd077b402	cuprated: config & args (#304) ... * init config * split sections * finish initial config. * fix clap * misc changes * fix doc * fix test & clippy * fix test 2 * try fix windows * testing * testing 2 * fix windows test * fix windows: the remix. * review comments * fix imports * rename & fix default config file * fix cargo hack * enable serde on `cuprate-helper` * changes from matrix chats * fix ci * fix doc * fix doc test * move Cuprated.toml * remove default.rs * `size` -> `bytes` * `addressbook_path` -> `address_book_path` * fix config output * fix ci * Update binaries/cuprated/src/config/args.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-12-03 15:17:21 +00:00
hinto-janai	38541dbfda	workspace: add/fix 1.83 lints (#353) ... * 1.83 `cargo clippy --fix` * fix type complexity, add `DbResult` * clippy fix * redb fix * Update consensus/context/src/difficulty.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-11-28 19:53:59 +00:00
Boog900	c54bb0c8b2	P2P: Change ClientPool to PeerSet (#337) ... * add WeakClient * todo * client pool -> peer set * more peer set changes * fix cuprated builds * add docs * more docs + better disconnect handling * more docs * fix imports * review fixes	2024-11-20 01:37:52 +00:00
Boog900	b3f2684fe1	Merge branch 'fix-network-addr-endianness' into expose-support-flags	2024-11-16 18:23:45 +00:00
SyntheticBird	b6c4adc83a	p2p: Implement P2P Bucket data structure (#329) ... Implements P2P Bucket data structure This commit implements a "Bucket" data structure that is a collection of data that discriminates its items into "buckets" (vector of size N) following a defined function. - Implements Bucket data structure and Bucketable trait - Implements Bucketable for Ipv4Addr - Added the crate to the workspace dependencies - Added arrayvec as a dependency	2024-11-02 00:45:56 +00:00
hinto-janai	372cab24d7	cuprated: internal signatures required for RPC pt. 2 (#320) ... * apply diffs * clippy * fix tests * rpc: fix tests * remove `BlockchainManagerRequest::Overview` * cuprated/p2p: fix `ConnectionInfo` * move `CalculatePow` * remove `AddAuxPow` * move `Spans` and `NextNeededPruningSeed` * factor types into `cuprate-types` * scope cargo features * fix/doc type serde * Update binaries/cuprated/src/rpc/request/address_book.rs Co-authored-by: Boog900 <boog900@tutanota.com> * Update binaries/cuprated/src/rpc/request/blockchain_context.rs Co-authored-by: Boog900 <boog900@tutanota.com> * Update binaries/cuprated/src/rpc/request/blockchain_manager.rs Co-authored-by: Boog900 <boog900@tutanota.com> * fmt * txpool: collapse `TxEntry` * `ConnectionId` * fix import * fix bin --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-11-01 22:25:55 +00:00
Boog900	44981f2b24	CI: add cargo hack (#170) ... * add workflow * fix errors * fix workflow * install dependencies * fix more errors * Update CONTRIBUTING.md * Update CONTRIBUTING.md Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fix hack + enable it for cuprate-database * move hack to main CI * fix docs * fix ci formatting * fix txpool tests * fix CONTRIBUTING.md formatting * service -> tower::Service * review fixes * review fixes * fix CI --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-11-01 20:22:14 +00:00
Boog900	b57ee2f4cf	cuprated: txpool (#312) ... * init dandelion integration * add dandelion start function * finish incoming tx handler * Add tx blob hash table * Add missing txpool requests * handle duplicate stem txs * check txpool on incoming block * add request to remove tx in new blocks from the pool * tell the txpool about incoming blocks * fix merge * typos * remove blockchain height from txpool * add function to start the pool * add cross network address * pre-review changes * fix CI * review fixes * review fixes * abort on DB error * fix clippy	2024-10-29 15:30:51 +00:00
SyntheticBird	63216aecae	workspace: Defines cuprate members as workspace dependencies (#326) ... Defines cuprate members as workspace dependencies - Defines cuprate members as workspace dependencies - Changed all `path` import into `workspace = true` Co-authored-by: Boog900 <boog900@tutanota.com>	2024-10-24 23:12:30 +01:00
Boog900	0cfc43ed58	derive clone	2024-10-17 21:20:51 +01:00
Boog900	bf586aafc0	expose basic node data	2024-10-17 20:54:59 +01:00
Boog900	06b70d9a0a	expose connected peer's support flags	2024-10-16 02:09:59 +01:00
hinto-janai	9923d8d69d	cuprated: internal signatures required for RPC (#297) ... * add request methods * add p2p messages * add txpool msgs * add blockchain_context msgs * add blockchain msgs * fmt * blockchain_manager msgs * blockchain manager msg types * add DB fn signatures * add statics module * p2p msg changes, docs * txpool docs/types * blockchain docs/types * `AlternateChains`, docs * fixes * remove blockchain write handle, fix docs * remove `BlockchainReadRequest::Difficulty` * remove `BlockchainReadRequest::MinerData` * fix p2p ban types * `CurrentRxVm` -> `CurrentRxVms` * storage: remove `Clone` off write handle * Update p2p/p2p-core/src/ban.rs Co-authored-by: Boog900 <boog900@tutanota.com> * fix merge --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-10-08 22:57:09 +01:00
Boog900	8be369846e	cuprated: Blockchain Manager (#274) ... * add cuprated skeleton * fmt and add deny exception * add main chain batch handler * add blockchain init * very rough block manager * misc changes * move more config values * add new tables & types * add function to fully add an alt block * resolve current todo!s * add new requests * WIP: starting re-orgs * add last service request * commit Cargo.lock * add test * more docs + cleanup + alt blocks request * clippy + fmt * document types * move tx_fee to helper * more doc updates * fmt * fix imports * remove config files * fix merge errors * fix generated coins * handle more p2p requests + alt blocks * clean up handler code * add function for incoming blocks * add docs to handler functions * broadcast new blocks + add commands * add fluffy block handler * fix new block handling * small cleanup * increase outbound peer count * fix merge * clean up the blockchain manger * add more docs + cleanup imports * fix typo * fix doc * remove unrelated changes * improve interface globals * manger -> manager * enums instead of bools * move chain service to separate file * more review fixes * add link to issue * fix syncer + update comment * fmt	2024-10-08 18:26:07 +01:00
Boog900	ca882512fc	P2P: move seed nodes to config (#306) ... * move seed nodes to config * fix tests	2024-10-07 23:36:46 +01:00
hinto-janai	a003e0588d	Add constants/ crate (#280) ... * add `constants/` * ci: add `A-constants` labeler * add modules, move `cuprate_helper::constants` * add `genesis.rs` * `rpc.rs` docs * remove todos * `CRYPTONOTE_MAX_BLOCK_HEIGHT` * add genesis data for all networks * features * fix feature cfgs * test fixes * add to architecture book * fix comment * remove `genesis` add other constants * fixes * revert * fix	2024-10-02 18:51:58 +01:00
Boog900	521bf877db	P2P: give the protocol handler access to the peer info (#302) ... * give the protocol handler access to the peer info * add trait alias * clippy + fmt * update doc * simplify trait aliases * use tower `Shared` * clean import * fmt * Update Cargo.toml Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fix merge --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-09-30 23:19:53 +01:00
Boog900	6da9d2d734	P2P: remove peer sync service (#299) ... * remove peer sync service * change `p2p` to not use the peer sync service * fmt & clippy * doc updates * review fixes * add a little more detail to comment	2024-09-30 22:15:48 +01:00
Boog900	a072d44a0d	P2P: fix connection disconnect on Client drop (#298) ... fix connection disconnect on `Client` drop	2024-09-25 20:56:57 +01:00
hinto-janai	848a6a71c4	p2p/p2p-core: enable workspace lints (#288) ... * p2p-core: enable workspace lints * fmt * fix tests * fixes * fixes * fixes * expect reason	2024-09-21 01:37:06 +01:00
hinto-janai	f4c88b6f05	p2p: enable workspace lints (#289) ... * p2p: enable workspace lints * fmt * fixes * fixes * fixes * review fixes	2024-09-21 01:36:39 +01:00
hinto-janai	19150df355	p2p/dandelion-tower: enable workspace lints (#287) ... * dandelion-tower: add/fix workspace lints * fmt * fixes * todos * fixes * fixes * expect reason	2024-09-20 14:36:34 +01:00
hinto-janai	a1267619ef	p2p/address-book: enable workspace lints (#286) ... * address-book: enable workspace lints * fix * fixes	2024-09-18 23:18:31 +01:00
Asurar	2291a96795	P2P: Add latest clearnet mainnet seed nodes. (#281) ... Add Monerod latest clearnet mainnet seed nodes	2024-09-14 14:01:43 +01:00
Asurar	967537fae1	P2P: Implement incoming ping request handling over maximum inbound limit (#277) ... Implement incoming ping request handling over maximum inbound limit - If the maximum inbound connection semaphore reach its limit, `inbound_server` fn will open a tokio task to check if the node wanted to ping us. If it is the case we respond, otherwise drop the connection. - Added some documentation to the `inbound_server` fn.	2024-09-09 23:12:06 +01:00
Boog900	8655a3f5e5	dandelion-tower: improve API (#257) ... * init * reduce the jobs handled by the dandelion pool * fix docs * resolve todo * review changes * Update p2p/dandelion-tower/src/pool/incoming_tx.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update p2p/dandelion-tower/src/pool/incoming_tx.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * `PId` -> `PeerId` --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-08-22 01:18:44 +01:00
Boog900	8227c28604	update monero-serai (#201) ... * update monero-serai * update monero-serai + change height to `usize` * fix merge * fix merge * fix doc * fix clippy take 2 * misc changes * move RPC imports to dev deps * handle miner txs when calculating fee * Update consensus/rules/src/blocks.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update consensus/rules/src/transactions.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update storage/blockchain/src/ops/tx.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update test-utils/src/data/free.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fixes * fix clippy --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-08-07 00:48:53 +01:00
hinto-janai	7416164b19	workspace: fix lint error (#234) ... * cargo.toml: split `keyword_idents` lint * dandelion-tower: fix doc * fix doc/clippy	2024-07-25 22:47:39 +01:00
hinto-janai	6820da9848	types: add BlockCompleteEntry (#230) ... * types: add `block_complete_entry.rs` * net: fix imports * p2p: fix imports * turn off default-features * p2p: fix imports * Update net/wire/Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> * wire: re-export types --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-07-16 22:47:50 +01:00
Boog900	d5c8eba1d8	P2P: API Improvements (#168) ... * start handshaker builder * finish builder * remove borsh requirement * fix poll_ready :/ * add more docs to builder * more docs * fix clippy * merge fixes * fix doc test * fix imports * cargo fmt * split `PeerRequest` and `PeerResponse` enums up. This splits them both into a protocol and admin enum * add request handler file * integrate request handler into connection * fix docs * doc updates * add more docs * fix docs * misc changes * review fixes * fix merge * add dummy file * fix docs * Update p2p/dandelion-tower/src/router.rs * fix docs	2024-07-04 21:05:22 +01:00
Boog900	7c8466f4ba	Storage: add blockchain history requests (#206) ... * Add database requests for chain history * misc fixes * review comments * fix clippy * add link and fix typo * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * add comment --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-07-02 23:08:19 +01:00
Boog900	fb1f071faf	P2P: fix block downloader test (#205) ... make sure timeout is non-zero	2024-07-01 20:23:59 +01:00
Boog900	f91be58a7f	P2P: Fix freeze in D++ (#204) ... * Fix d++ router freeze * update docs * fix imports * fix clippy * Update p2p/dandelion-tower/src/lib.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-07-01 20:23:40 +01:00
hinto-janai	4b93dbec4c	workspace: enforce crate/directory naming scheme (#164) ... * rename all directories and crates * fix all `use` * fix doc link * `dandelion/` -> `dandelion-tower/` * fix epee-encoding test * fix `json-rpc` * fix pruning * crate import fixes * fix leftover merge conflicts * fix `epee-encoding`	2024-06-24 02:30:47 +01:00
Boog900	10aac8cbb2	P2P: Block downloader (#132) ... * impl async buffer * clippy * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * add peer sync state svc * add broadcast svc * add more docs * add some tests * add a test * fix merge * add another test * unify PeerDisconnectFut and add more docs * start network init * add an inbound connection server * remove crate doc for now * fix address book docs * fix leak in client pool * correct comment * fix merge + add some docs * review comments * init block downloader * fix doc * initial chain search * add chain_tracker * move block downloader to struct * spawn task whe getting blocks * check for free peers and handle batch response * add test bin * working block downloader * dynamic batch sizes * dandelion_tower -> dandelion-tower * fix async-buffer builds * check if incoming peers are banned * add interface methods * update docs * use a JoinSet for background network tasks * dynamic batch size changes * Keep a longer of queue of blocks to get * more checks on incoming data * fix merge * fix imports * add more docs * add some limits on messages * keep peers that dont have the current need data * fix clippy * fix .lock * fix stopping the block downloader * clean up API and add more docs * tracing + bug fixes * fix panic * doc changes * remove test_init * remove spammy log * fix previous merge * add a test * fix test * remove test unwrap * order imports correctly * clean up test * add a timeout * fix tests * review fixes * make `BlockDownloader` pub * make `initial_chain_search` pub * make `block_downloader` private * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * split some sections into separate modules * split chain requests * sort imports * check previous ID is correct * fix typos * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-22 01:29:40 +01:00
Boog900	b510739701	P2P: Network init (#130) ... * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * add peer sync state svc * add broadcast svc * add more docs * add some tests * add a test * fix merge * add another test * unify PeerDisconnectFut and add more docs * start network init * add an inbound connection server * remove crate doc for now * fix address book docs * fix leak in client pool * correct comment * fix merge + add some docs * fix doc * dandelion_tower -> dandelion-tower * fix async-buffer builds * check if incoming peers are banned * add interface methods * update docs * use a JoinSet for background network tasks * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update p2p/monero-p2p/src/services.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-04 18:19:25 +01:00
Boog900	e8b20e6115	P2P: async buffer (#109) ... * impl async buffer * clippy * review comments	2024-05-24 02:15:49 +01:00
Boog900	0158c6671a	P2P: Peer sync state svc (#128) ... * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * add peer sync state svc * add a test * fix merge * add another test * unify PeerDisconnectFut and add more docs * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * dif -> diff * move comment * Update pruning/src/lib.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-05-22 01:56:39 +01:00
Boog900	02cd963e57	P2P: Broadcast svc (#129) ... * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * add broadcast svc * add more docs * add some tests * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * review comments --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-05-21 23:19:52 +01:00
Boog900	c5fbbcc6e8	P2P Client Pool (#121) ... * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * review changes * Update p2p/cuprate-p2p/src/connection_maintainer.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-05-17 14:52:51 +01:00
Boog900	75306babf8	dandelion++ lib (#111) ... * init D++ * init D++ router * working D++ router * add test * D++ tx pool * add more txpool docs * add a txpool builder * add tracing * add more docs * fix doc * reduce test epoch (windows CI fail) * generate first state in config Windows seems to not allows taking a big value from an instant * extend tests * clippy * review comments + more docs * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * update Cargo.lock * rename txpool.rs -> pool.rs * review comments * Update p2p/dandelion/src/tests/router.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update p2p/dandelion/src/router.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-05-05 20:22:41 +01:00
Boog900	00c3692eac	P2p changes (#118) ... * p2p changes * clippy * a few more docs * review comments * fix peer list bug	2024-05-02 22:58:22 +00:00
Boog900	93372fa4b5	P2P Address book & Handshake changes (#89) ... * use tokio's delay queue for bans * document handles * remove peers from address book when retrieving * ping inbound peers during handshakes * support receiving pings during handshakes * add peer to anchor before reducing whit list * clippy * comment handshakes * typos * sort `use` * use `rand::prelude::*` * review comments * update macro	2024-03-20 20:58:12 +00:00
Boog900	729b0fb0cf	Keep pruning seeds decompressed (#90) ... * keep pruning seeds decompressed. * add a function to check seeds for P2P network * review comments * add next_pruned_block tests * fix docs	2024-03-15 22:11:27 +00:00
Boog900	159c8a3b48	levin: fragmented messages (#84) ... * levin: fix fragmented messages & use bitflags * levin: add a method to fragment a message * levin: add tests for fragmented messages and fix issues * fix docs * tests: don't include bytes length * levin: add support for sending fragmented / dummy messages * fmt * add fragmented handshake tests. * fix handshake detection when fragmented and alt (non-monero) protocol info * add tracing logs * remove `already_built`, this was an old way I was thinking of sending raw buckets * clippy * clippy 2 * Update net/levin/src/message.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * review comments * add timeout to tests * Update net/levin/src/header.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-03-05 01:29:57 +00:00
Boog900	e560ecc2ee	Add a test for an inbound handshake from monerod (#75) ... * monerod: set a random DB and remove dir when done * add a test for an inbound monerod handshake * don't fail if can't remove dir on windows * Update test-utils/src/monerod.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * use `temp_dir` * use `tempfile` --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-02-25 21:21:25 +00:00
Boog900	cf0fcfb6c5	p2p: remove old code (#74)	2024-02-25 13:42:27 +00:00
Boog900	475c8c5ac0	imporove Monerod spawn stability (#66) ... * output monerod logs when a thread panics * always spawn a monerod don't attempt to re-use * set zmq port and `non-interactive` * check monerod has started before test * remove test panic * review changes	2024-02-16 22:47:50 +00:00