86 commits

Author	SHA1	Message	Date
Boog900	3c751a6406	Merge branch 'main' into init	2024-12-04 00:03:09 +00:00
Boog900	7b8756fa80	cuprated: P2P protocol request handler (#303) ... * add cuprated skeleton * fmt and add deny exception * add main chain batch handler * add blockchain init * very rough block manager * misc changes * move more config values * add new tables & types * add function to fully add an alt block * resolve current todo!s * add new requests * WIP: starting re-orgs * add last service request * commit Cargo.lock * add test * more docs + cleanup + alt blocks request * clippy + fmt * document types * move tx_fee to helper * more doc updates * fmt * fix imports * remove config files * fix merge errors * fix generated coins * handle more p2p requests + alt blocks * clean up handler code * add function for incoming blocks * add docs to handler functions * broadcast new blocks + add commands * add fluffy block handler * fix new block handling * small cleanup * increase outbound peer count * fix merge * clean up the blockchain manger * add more docs + cleanup imports * fix typo * fix doc * remove unrelated changes * add `get_objects` handler * add `get_chain` handler * add `fluffy_missing_txs` handler * add `new_fluffy_block` handler * improve interface globals * manger -> manager * enums instead of bools * move chain service to separate file * more review fixes * sort imports + docs * init dandelion integration * add dandelion start function * finish incoming tx handler * Add tx blob hash table * Add missing txpool requests * handle duplicate stem txs * check txpool on incoming block * add request to remove tx in new blocks from the pool * tell the txpool about incoming blocks * fix merge * typos * remove blockchain height from txpool * fix merge * fix merge * handle incoming txs in p2p request handler * Allow `IncomingTxHandler` to be given later * add p2p clearnet init * fix build * misc changes * doc updates * more doc updates * sort imports * review changes * Result -> DbResult * use `NonZero` * review fixes * remove `rust-2024-compatibility` lint	2024-12-03 20:21:05 +00:00
Boog900	ecd077b402	cuprated: config & args (#304) ... * init config * split sections * finish initial config. * fix clap * misc changes * fix doc * fix test & clippy * fix test 2 * try fix windows * testing * testing 2 * fix windows test * fix windows: the remix. * review comments * fix imports * rename & fix default config file * fix cargo hack * enable serde on `cuprate-helper` * changes from matrix chats * fix ci * fix doc * fix doc test * move Cuprated.toml * remove default.rs * `size` -> `bytes` * `addressbook_path` -> `address_book_path` * fix config output * fix ci * Update binaries/cuprated/src/config/args.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-12-03 15:17:21 +00:00
hinto-janai	38541dbfda	workspace: add/fix 1.83 lints (#353) ... * 1.83 `cargo clippy --fix` * fix type complexity, add `DbResult` * clippy fix * redb fix * Update consensus/context/src/difficulty.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-11-28 19:53:59 +00:00
hinto-janai	caa08d5eaa	benches: initial implementation (#196) ... * add readme * readme, basic examples * name changes, bin impl * example, docs * book * add `cuprate-criterion-example` * docs, tracing * fix clippy * docs * lib readme * json-rpc benchmarks * add to crates.md * add `fixme` * fix `cargo b` failing this `cfg()` existing makes a regular workspace `cargo b` fail * fix cargo.toml	2024-11-25 20:10:42 +00:00
Dmitry Holodov	4b925b8c78	ZMQ PUB/SUB JSON Types (#330)	2024-11-21 01:08:24 +00:00
Boog900	fd4a1746b1	add file logging	2024-11-20 16:06:31 +00:00
Boog900	cde5294bf9	add startup code	2024-11-19 02:11:02 +00:00
Boog900	bbf83b27a8	Merge branch 'cuprated-config' into init	2024-11-18 16:46:37 +00:00
hinto-janai	0f1ad6db1b	Cargo.toml: move commas (#340) ... cargo.toml: move comma	2024-11-13 11:01:15 +00:00
Boog900	5a5f4d1c7c	Merge branch 'main' into cuprated-config	2024-11-05 01:29:38 +00:00
Boog900	525e20e841	Fix ci and loosen version requirements (#335) ... * add deny exception + loosen version requirements * add a comment * remove `expect`	2024-11-04 15:22:43 +00:00
SyntheticBird	b6c4adc83a	p2p: Implement P2P Bucket data structure (#329) ... Implements P2P Bucket data structure This commit implements a "Bucket" data structure that is a collection of data that discriminates its items into "buckets" (vector of size N) following a defined function. - Implements Bucket data structure and Bucketable trait - Implements Bucketable for Ipv4Addr - Added the crate to the workspace dependencies - Added arrayvec as a dependency	2024-11-02 00:45:56 +00:00
Boog900	b57ee2f4cf	cuprated: txpool (#312) ... * init dandelion integration * add dandelion start function * finish incoming tx handler * Add tx blob hash table * Add missing txpool requests * handle duplicate stem txs * check txpool on incoming block * add request to remove tx in new blocks from the pool * tell the txpool about incoming blocks * fix merge * typos * remove blockchain height from txpool * add function to start the pool * add cross network address * pre-review changes * fix CI * review fixes * review fixes * abort on DB error * fix clippy	2024-10-29 15:30:51 +00:00
Boog900	d1f3eb40bf	misc changes	2024-10-26 21:21:27 +01:00
SyntheticBird	63216aecae	workspace: Defines cuprate members as workspace dependencies (#326) ... Defines cuprate members as workspace dependencies - Defines cuprate members as workspace dependencies - Changed all `path` import into `workspace = true` Co-authored-by: Boog900 <boog900@tutanota.com>	2024-10-24 23:12:30 +01:00
SyntheticBird	978d72b6c1	Move consensus context service into a subcrate. (#318) ... Co-authored-by: Boog900 <boog900@tutanota.com>	2024-10-17 00:17:58 +01:00
hinto-janai	f9b847b227	types: HardFork improvements (#309) ... * apply diffs * review fixes	2024-10-11 23:57:43 +01:00
hinto-janai	a003e0588d	Add constants/ crate (#280) ... * add `constants/` * ci: add `A-constants` labeler * add modules, move `cuprate_helper::constants` * add `genesis.rs` * `rpc.rs` docs * remove todos * `CRYPTONOTE_MAX_BLOCK_HEIGHT` * add genesis data for all networks * features * fix feature cfgs * test fixes * add to architecture book * fix comment * remove `genesis` add other constants * fixes * revert * fix	2024-10-02 18:51:58 +01:00
Boog900	521bf877db	P2P: give the protocol handler access to the peer info (#302) ... * give the protocol handler access to the peer info * add trait alias * clippy + fmt * update doc * simplify trait aliases * use tower `Shared` * clean import * fmt * Update Cargo.toml Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fix merge --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-09-30 23:19:53 +01:00
hinto-janai	12bbadd749	cuprated: add constants & statics modules (#301) ... * add modules * docs * test * rename * tabs -> spaces	2024-09-28 01:41:34 +01:00
hinto-janai	5eb712f4de	cargo upgrade (#296) ... cargo upgrade Co-authored-by: Boog900 <boog900@tutanota.com>	2024-09-22 19:34:20 +01:00
hinto-janai	5588671501	levin: enable workspace lints (#292) ... * levin: enable workspace lints * use `drop()` * dep fixes	2024-09-20 15:11:27 +01:00
hinto-janai	6502729d8c	lints: replace allow with expect (#285) ... * cargo.toml: add `allow_attributes` lint * fix lints * fixes * fmt * fix docs * fix docs * fix expect msg	2024-09-18 21:31:08 +01:00
hinto-janai	92800810d9	cuprated: initial RPC module skeleton (#262) ... * readme * cuprated: add all workspace deps * cuprated: add lints * !! * add state, fn signatures * fixes * error signatures * interface: handle json-rpc concepts * split rpc calls into 3 `Service`s * interface: extract out to `RpcService` * fix merge * remove crate lints * use `BoxFuture` * rpc/interface: impl `thiserror::Error` * split state from main handler struct * cleanup * fix imports * replace `RpcError` with `anyhow::Error` * interface: update error * cuprated: update error type	2024-09-08 15:52:17 +01:00
hinto-janai	eead49beb0	lints: opt in manual lint crates (#263) ... * cargo.toml: transfer existing lints * rpc/interface: lints * rpc/json-rpc: lints * rpc/types: lints * storage/blockchain: lints * rpc/types: fix lints * cargo.toml: fix lint group priority * storage/blockchain: fix lints * fix misc lints * storage/database: fixes * storage/txpool: opt in lints + fixes * types: opt in + fixes * helper: opt in + fixes * types: remove borsh * rpc/interface: fix test * test fixes * database: fix lints * fix lint * tabs -> spaces * blockchain: `config/` -> `config.rs`	2024-09-02 18:12:54 +01:00
hinto-janai	b837d350a4	workspace: add naming convention lints (#261) ... * add lint to {Cargo,clippy}.toml * `RandomXVM` -> `RandomXVm` * epee: `TT` -> `T2`	2024-09-02 18:10:45 +01:00
Boog900	7207fbd17b	Binaries: add cuprated skeleton (#258) ... * add cuprated skeleton * fmt and add deny exception	2024-08-20 23:56:18 +01:00
hinto-janai	bca062d2f5	workspace: add 1.78..=1.80 lints (#253) ... cargo.toml: add lints	2024-08-10 00:08:56 +01:00
Boog900	8227c28604	update monero-serai (#201) ... * update monero-serai * update monero-serai + change height to `usize` * fix merge * fix merge * fix doc * fix clippy take 2 * misc changes * move RPC imports to dev deps * handle miner txs when calculating fee * Update consensus/rules/src/blocks.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update consensus/rules/src/transactions.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update storage/blockchain/src/ops/tx.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update test-utils/src/data/free.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fixes * fix clippy --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-08-07 00:48:53 +01:00
Boog900	1a178381dd	Storage: split the DB service abstraction (#237) ... * split the DB service abstraction * fix ci * misc changes * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * review fixes * Update storage/service/Cargo.toml Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update storage/service/Cargo.toml Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fix clippy * fix doc * `bc` -> `blockchain` * doc fixes * Update storage/service/README.md Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * cargo fmt --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-08-05 21:47:30 +01:00
hinto-janai	7416164b19	workspace: fix lint error (#234) ... * cargo.toml: split `keyword_idents` lint * dandelion-tower: fix doc * fix doc/clippy	2024-07-25 22:47:39 +01:00
hinto-janai	5c3258a6e3	workspace: add lints (#133) ... add lints to workspace	2024-07-10 01:32:23 +01:00
dependabot[bot]	7e9891de5b	build(deps): bump curve25519-dalek from 4.1.2 to 4.1.3 (#197) ... Bumps [curve25519-dalek](https://github.com/dalek-cryptography/curve25519-dalek) from 4.1.2 to 4.1.3. - [Release notes](https://github.com/dalek-cryptography/curve25519-dalek/releases) - [Commits](https://github.com/dalek-cryptography/curve25519-dalek/compare/curve25519-4.1.2...curve25519-4.1.3) --- updated-dependencies: - dependency-name: curve25519-dalek dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-06-26 22:59:11 +01:00
hinto-janai	e405786a73	rpc: start cuprate-rpc-types (#147) ... * rpc: add `monero-rpc-types` * lib.rs: add lints * add base files, deps * fix macro generation, doc test * add `strum`, add `misc` module * document struct generation macro * add `GetHeight` * lib.rs: create re-export macro * macro changes, add few more types * docs * `monero-rpc-types` -> `cuprate-rpc-types` * fix modules * specify commit in macro, add () type aliases * macro docs, fixes * add `Status::Other(String)` * add TODO for `strum` * Update rpc/types/Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> * add `BinaryString` * add `ResponseBase` * add `CORE_RPC_*` constants * fix status; use `CORE_RPC_*` constants * cargo.toml: add `epee_encoding` * rpc: add epee_encoding impl for `Status` * macro: add epee_encoding for every type * remove `strum` * add response bases * add `CORE_RPC_STATUS_UNKNOWN` * add response/request bases for epee * create `base` module * use different type for macro example * move base / root types around * docs, status serde test * status: use `Status::Unknown` for `epee_default_value` * json: add missing fields to `GetBlockTemplateRequest` not sure I missed these cc73fe7116/src/rpc/core_rpc_server_commands_defs.h (L947-L950) --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-06-26 22:24:05 +01:00
hinto-janai	4b93dbec4c	workspace: enforce crate/directory naming scheme (#164) ... * rename all directories and crates * fix all `use` * fix doc link * `dandelion/` -> `dandelion-tower/` * fix epee-encoding test * fix `json-rpc` * fix pruning * crate import fixes * fix leftover merge conflicts * fix `epee-encoding`	2024-06-24 02:30:47 +01:00
Boog900	10aac8cbb2	P2P: Block downloader (#132) ... * impl async buffer * clippy * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * add peer sync state svc * add broadcast svc * add more docs * add some tests * add a test * fix merge * add another test * unify PeerDisconnectFut and add more docs * start network init * add an inbound connection server * remove crate doc for now * fix address book docs * fix leak in client pool * correct comment * fix merge + add some docs * review comments * init block downloader * fix doc * initial chain search * add chain_tracker * move block downloader to struct * spawn task whe getting blocks * check for free peers and handle batch response * add test bin * working block downloader * dynamic batch sizes * dandelion_tower -> dandelion-tower * fix async-buffer builds * check if incoming peers are banned * add interface methods * update docs * use a JoinSet for background network tasks * dynamic batch size changes * Keep a longer of queue of blocks to get * more checks on incoming data * fix merge * fix imports * add more docs * add some limits on messages * keep peers that dont have the current need data * fix clippy * fix .lock * fix stopping the block downloader * clean up API and add more docs * tracing + bug fixes * fix panic * doc changes * remove test_init * remove spammy log * fix previous merge * add a test * fix test * remove test unwrap * order imports correctly * clean up test * add a timeout * fix tests * review fixes * make `BlockDownloader` pub * make `initial_chain_search` pub * make `block_downloader` private * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * split some sections into separate modules * split chain requests * sort imports * check previous ID is correct * fix typos * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-22 01:29:40 +01:00
jomuel	663c852b13	Fast sync (WIP) (#155) ... * Fast sync (work in progress) * Cargo.lock * Add missing hashes file * clippy warnings * Stub of database tool to create the fast sync hashes * Command line arg for target height, error handling * Cargo.lock * fmt and unused imports * fmt * Add license information to consensus/fast-sync/Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> * Order imports in consensus/fast-sync/src/create.rs Co-authored-by: Boog900 <boog900@tutanota.com> * beautify hex generation function & fmt * Reorder imports consensus/fast-sync/src/fast_sync.rs	2024-06-09 14:24:44 +01:00
hinto-janai	6df67bb9d3	rpc: add initial crates (#146) ... * add `rpc/` crates * rpc: fix `monero-rpc-server` -> `monero-rpc-types` * rpc: add skeleton `rpc/json-rpc` * remove `cuprate-rpc-server`, add `json-rpc`	2024-06-05 15:35:08 +01:00
Boog900	b510739701	P2P: Network init (#130) ... * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * add peer sync state svc * add broadcast svc * add more docs * add some tests * add a test * fix merge * add another test * unify PeerDisconnectFut and add more docs * start network init * add an inbound connection server * remove crate doc for now * fix address book docs * fix leak in client pool * correct comment * fix merge + add some docs * fix doc * dandelion_tower -> dandelion-tower * fix async-buffer builds * check if incoming peers are banned * add interface methods * update docs * use a JoinSet for background network tasks * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update p2p/monero-p2p/src/services.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-04 18:19:25 +01:00
Boog900	889e15738b	Cleanup & Document consensus (#65) ... * change monero-consensus to cuprate-consensus-rules * document the context service * remove the mutex on blockchain context * comment the context caches * add back tokio * document block checks * typo * keep tha amount of outputs with a certain amount in the output cache * typo * nuke cross-block batch verification * remove RPC scanner * change how contextual data is got. * fmt & clippy fixes * typo * cargo update * restore Cargo.lock * add a verify tx test. + fixes an issue with verifying signatures after BPs * clippy * remove bad test * add mores tests and fix a couple bugs * typos * move tests and add some more * typo * remove scan_chain docs * fix check for duplicate txs when duplicates are not sequential * add a proptest for dup txs * cache tx verification state * doc updates + move `Vec` to `Arc<[]>` * clippy * misc changes * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> Co-authored-by: SyntheticBird <118022351+SyntheticBird45@users.noreply.github.com> * fix fmt * review changes --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com> Co-authored-by: SyntheticBird <118022351+SyntheticBird45@users.noreply.github.com>	2024-05-31 01:52:12 +01:00
hinto-janai	4876e159e7	repo: add skeleton directories, fix labels (#139) ... * `database/` -> `storage/`, create skeleton `storage/` crates * add skeleton root directories * books: add skeleton * ci: fix labeler.yml * fix CONTRIBUTING.md * fix workspace Cargo.toml * fix `storage/` * rename helper fs fn, `cuprate_database` -> `cuprate_blockchain` * fix Cargo.toml * cuprate-blockchain: revert find-and-replace Since it has to be ported to the book anyway, there's not much reason to update this and create review diffs. * labeler.yml: remove `A-docs` from `books/` changes Although books are documentation, the `A-books` label already exists for this	2024-05-29 02:18:30 +01:00
Boog900	c5fbbcc6e8	P2P Client Pool (#121) ... * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * review changes * Update p2p/cuprate-p2p/src/connection_maintainer.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-05-17 14:52:51 +01:00
Boog900	75306babf8	dandelion++ lib (#111) ... * init D++ * init D++ router * working D++ router * add test * D++ tx pool * add more txpool docs * add a txpool builder * add tracing * add more docs * fix doc * reduce test epoch (windows CI fail) * generate first state in config Windows seems to not allows taking a big value from an instant * extend tests * clippy * review comments + more docs * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * update Cargo.lock * rename txpool.rs -> pool.rs * review comments * Update p2p/dandelion/src/tests/router.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * Update p2p/dandelion/src/router.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-05-05 20:22:41 +01:00
Boog900	88f7d1f212	download monerod in CI (#123) ... * download monerod in CI * move action file * add macOS arm support * remove reqwest from workspace * undo whitespace changes * fix indentation * update comments * add monerod to .gitignore * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * add back spacing --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-05-01 01:21:08 +01:00
hinto-janai	32a44a2503	test-utils: compare data against RPC (#115) ... * cargo: add `pretty_assertions` * test-utils: add tests to compare data against RPC data, and fix * small fixes * database: fix `cumulative_generated_coins` from test data block had wrong data which offset all of the asserts	2024-04-25 19:58:45 +01:00
hinto-janai	d503548716	Implement types/ (#94) ... * workspace: add `bytemuck` to workspace * add `types/` * workspace: add `cuprate-types` to members * copy `consensus/` types to `types/` * remove `hard_fork/` * extended_block_header: impl `Pod`, fix layout * update `Request/Response` * impl types * fix `Response/Request` * impl `borsh` * workspace: add `strum` * service: add `strum` traits * remove `paste`, `serde_json`, `thiserror` * remove `strum` * VerifiedBlockInformation: remove `hf_vote` * Update Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-03-27 00:46:32 +00:00
hinto-janai	004bb153b4	database: use rayon for service's reader thread-pool (#93) ... * add `rayon 1.9.0` * service: re-impl reader threadpool with `rayon` * service: impl `tower::Service` for writer * backend: create db dir in `Env::open` * service: read + write request/response tests * docs, name changes * service: always return `Poll::Ready` in writer * service: use `spawn()` instead of `install()` * service: replace `DatabaseReader` with free functions * cargo: add `tokio-utils` * service: acquire permit before `call()` for read requests * service: acquire permit in tests * docs * service: use loop for write request tests * service: use `ready!()`	2024-03-21 20:16:12 +00:00
Boog900	93372fa4b5	P2P Address book & Handshake changes (#89) ... * use tokio's delay queue for bans * document handles * remove peers from address book when retrieving * ping inbound peers during handshakes * support receiving pings during handshakes * add peer to anchor before reducing whit list * clippy * comment handshakes * typos * sort `use` * use `rand::prelude::*` * review comments * update macro	2024-03-20 20:58:12 +00:00
Boog900	159c8a3b48	levin: fragmented messages (#84) ... * levin: fix fragmented messages & use bitflags * levin: add a method to fragment a message * levin: add tests for fragmented messages and fix issues * fix docs * tests: don't include bytes length * levin: add support for sending fragmented / dummy messages * fmt * add fragmented handshake tests. * fix handshake detection when fragmented and alt (non-monero) protocol info * add tracing logs * remove `already_built`, this was an old way I was thinking of sending raw buckets * clippy * clippy 2 * Update net/levin/src/message.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * review comments * add timeout to tests * Update net/levin/src/header.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-03-05 01:29:57 +00:00